27 Comments

Summary:

Satyamev Jayate, one of India’s highest-rated television shows, is using data as a means to effect meaningful change. The show’s producers are aggregating and analyzing the millions of messages they receive on controversial issues to do everything from planning future episodes to pushing for political change.

satyamev

Every Sunday morning, millions of people in India tune in to watch Bollywood star Aamir Khan host one of the country’s highest-rated television shows, Satyamev Jayate. Only unlike so many popular programs, Satyamev Jayate doesn’t involve a singing competition or a collection of volatile strangers living under the same roof. It’s a documentary program tackling some of the country’s most-sensitive topics, and it has the whole country — indeed, the whole world — talking. In order to funnel millions of messages a week into something valuable, the shows producers have turned to big data.

Aside from Khan’s star power, the show is so popular because of the types of issues it tackles — female feticide, caste discrimination, dowry deaths, child abuse and medical practice among them. According to one of the show’s producers, the amount of engagement and the number of responses from viewers is “completely unprecedented.” Here’s a sample of what we’re talking about, just 13 episodes into the show’s existence:

  • 400 million viewers on Indian television and across the world on YouTube.
  • More than 1.2 billion people have connected with Satyamev Jayate across its website, Facebook, Twitter, YouTube and mobile devices.
  • More than 8 million people have contributed a total of more than 14 million responses to the show’s content via Facebook, web comments, text-message votes and a telephone hotline. More than 100,000 new people respond each week.

The responses take all sorts of forms, from votes on a weekly poll question to long, heartfelt letters explaining a viewer’s experience with an issue or how the show has changed their thinking on an issue. And although 95 percent of responses come from India, the show has received them from 5,000 locations in 165 countries, including as far away as northern Canada and Alaska. The show’s topics regularly rank among the top trends on Twitter shortly after each episode airs.

Surprisingly, the producer said, the India-created Satyamev Jayate has not received a single piece of hate mail from bitter geopolitical rival Pakistan. In fact, there have been numerous requests for an episode on India-Pakistan unity. (If you have 90 minutes, here’s an episode on human dignity.)

Parsing through millions of messages

In order keep up with all the messages, Satyamev Jayate turned to Persistent Systems, an Indian IT consultancy with offices around the world, which created a system for automating their analysis. Here’s how the process works.

About a day-and-a-half before each show, Satyamev Jayate’s production company tells Persistent what the issue will be and the two groups come up with a taxonomy that will help the system sort through messages based on what topics will be brought up during Sunday’s show. But it’s not by any means the definitive list. As activity ramps up on Twitter while the show airs (tweet rates are highest during commercials and immediately after it ends, by the way), the team gets a sense of what topics are resonating with viewers and what themes they can expect in the nearly million responses that will follow.

When the responses actually do start pouring in after lunch, they hit a system designed by Persistent to automatically tag them and score them based on interest level and sentiment. So, as Mukund Deshpande, head of business intelligence and analytics at Persistent, told me, a long message with an interesting story will be marked as higher quality, while a short, congratulatory note will be scored lower. Because so many viewers write in “Hinglish,” a combination of Hindi and English, an off-the-shelf system wouldn’t have been as accurate for processing these messages.

In the future, he’d like to train the system to recognize various gradients of emotion, too, beyond just simple sentiment. That means not just “positive” or “negative,” but also “happy,” “sad,” “angry” and any other way a viewer might be feeling.

The best messages are then sent to a team of trained analysts — often college students and graduates, along with some Persistent employees — who decide which ones are worth following up on for a Friday radio show Khan does, and for placement on Satyamev Jayate’s web site. These analysts try to ensure that the stories shared are truthful and that the messages don’t contain personal information that could get viewers in trouble or affect their privacy. Data visualizations about how many people have responded and where they come from is available on the Impact section of the show’s site, as well as on separate Impact pages for each episode.

Making a difference with data

Aamir Khan

All this feedback has an impact, both on the show itself and on India. Satyamev Jayate’s voting process, in particular, has yielded some impressive results. After the first episode about female feticide, or the selective abortion of female fetuses, 99.8 percent of viewers said they agreed with the idea of a fast-track court to prosecute doctors who perform such operations. When Khan presented the results to the Indian government, officials agreed almost immediately to amend the court system accordingly, the producer told me.

Sometimes, though, the results simply present an interesting — if not troubling — view into the Indian subconscious. Almost 32 percent of respondents, for example, voted in favor of the right of families to use force preventing the marriage of two willing adults (subsequent analysis uncovered some reasons why, including continuing opposition to inter-caste marriage), while almost 14 percent of respondents one week said that beating a woman is a sign of masculinity. And although women comprise only about 32 percent of the show’s audience, they have accounted for the majority of responses on shows addressing issues important to them.

The producer said his team also uses the data to inspire ideas for future shows and to populate a weekly radio show that Khan does with a local journalist. The Satyamev Jayate team analyzes the week’s messages in order to pick the most powerful and determine trends in viewers’ feelings, and Khan shares them during the interview. The second season, he said, will be shaped in part by how viewers responded to the format during the first season and the issues they want covered next.

Beyond just the next season, though — and the occasional political victory — the hope is that all the data Satyamev Jayate generates will have continuing utility. Deshpande said he’d like to see it used for ethnographic and social science research, because the dataset is larger than most academic studies could generate (something that’s already happening with crowdsourced medical research) and it’s very high quality because of the demographic and geographic information attached to it.

However, the producer with whom I spoke seems perfectly content right now with the way Satyamev Jayate is resonating with the public. For example, he said, viewers are reporting crimes they previously might not have considered too big a deal and are reaching out to disabled citizens. This is the first time many people are speaking openly about these issues, he said, and they’re able to track the effects because they’re able to ensure no message is left behind.

  1. Super coverage. Proves the point that real time responses are so important for TV channels and shows like these in India

    Share
  2. Great going. Marvel at the analytics.
    If only we have better educated people’s representatives who harness the power of technology for policy formulation and implementation, the country can go places

    Share
  3. This is very interesting analysis. I would love to see this data being available in open domain so that researchers around the world can do more analysis. This data can bring LOT of change in India and it will be sad to see it behind the closed doors!

    Share
  4. its an interesting analysis of what the show is doing through out the world, atleast it is making to stop for a while and think about the issues we are facing society, which we were ignoring all these years.

    Share
  5. Crunching all this amount of data is awesome. Kudos to SMJ and Persistent Systems. Three cheers!

    Share
  6. perhaps one of the most comprehensive analytic research for any TV show plus something that fueled the actions too!

    Share
  7. popularity and its effect claimed seems to be exaggerated. we need to appreciate the indians’ voeyer mentality and our tch..tch..mentality..our disbelief in positive change by directed actions..if there is a mass Y mentality population in the world..it is in india..its not criticism..its my analysis..maybe Aamir can do a show on our chalta hai…kuch nahin badlega attitude..

    Share
    1. “chalta hai” seems to be your attitude, ajay.. not that of everyone.. “popularity and its effect claimed seems to be exaggerated”: looks like you are from the congress

      Share
      1. Ravi, you still seems to be living in euphoria of SMJ. Lets see in coming times, how much change it brings in the society, the procedures (government), and the thinking. So lets stop trying to prove each other right/wrong.

        I’ve nothing wrong in my mind about SMJ or efforts that Amir has put in; however, remember that this is not first of its kind of agitation except the fact that it is being done at such a wide scale. Use of technology is at its best.

        Share
      2. Ravi:
        Why do you take umbrage at criticism? It seems valid enough. Reach of 400 mn TV is an exaggeration unless you are counting anybody who has watch any one minute of any of the episodes. 1.2 billion on the net, twitter etc is a misleading figure. It cannot be a count of number of unique people. Think and work out why
        Sankara Pillai

        Share
  8. Such data should be deemed authentic and be made to good use for various social initiatives. Fast tracking court cases is a welcome move. Need similar efforts on other Sensitive issues.

    Share
  9. Awesome! Being a former Persistentian, I feel proud of the company. Way to go!!

    -Neelesh

    Share
  10. Brilliant Coverage!

    Share

Comments have been disabled for this post