10 Comments

Summary:

NBC’s new TAMi multiplatform ratings system doesn’t measure engagement, so Robert Seidman finds it mostly worthless. But he picks through it to find that iTunes numbers are pitifully low.

A version of this post originally appeared on TVbytheNumbers on Oct. 15.

I praised NBC earlier in the year for the experiment with TAMi — the total audience measurement index that seeks to measure the total viewing of shows on various platforms and not just television. While I do appreciate the attempt, I am no longer finding it praise-worthy and find it mostly useless because the comparisons and numbers used are apples-to-pears or apples-to-grapes style comparisons at best, and apples-to-orange comparisons at worst.

We think it’s fantastic that NBC is measuring and reporting numbers involving newer technologies, and we applaud them for that. But we wish they’d have reported based on total engagement so the numbers and relative comparisons would’ve actually been useful.

The standard Nielsen audience average numbers reported by us and others are engagement based. It’s measuring total minutes of viewing and dividing it by the duration of a show. If there are 600 million minutes of viewing for a one hour show, that show will show an average of 10 million viewers. Engagement-based measurement compared to engagement-based measurement is the only really worthwhile way to go.

Unfortunately TAMi doesn’t use this, not even for television, where it uses the “total audience” Nielsen measurement. These are people who watched at least 6 minutes of a show, but not the whole show and there is no way to garner total engagement from such numbers.

Similarly, the Internet streaming counts are bogus. For one, if a single episode is broken up into six streams, it counts as six streams, even if it was only one episode. Further, streams are counted whether they are completely viewed or not. There’s no way to derive the total engagement from that (total minutes of viewing divided by episode length) and so there’s no basis to compare them to anything useful.

Because it’s not truly an engagement based measurement, it’s of little real value. Except for this: Finally we have numbers from iTunes. And guess what? The numbers are tiny — even when they were giving away shows. Oh sure, there were more than 10 times as many downloads for the free episodes NBC gave away on iTunes (which leads us to believe downloads on Amazon Unbox are likely in the hundreds, if not the tens, since they are included as well).

The most downloaded episode surprisingly (at least to me) was the first (and free) episode of Knight Rider. Heroes is really the most downloaded show and after the freebie (which got 58,886 downloads) the second and third episode dropped to less than 20,000 downloads. So please excuse us if the next time we hear someone chime in about a show being No. X on iTunes and acting like it makes some significant difference and we tell them to STFU.

Again, because the data isn’t engagement-based focusing on total minutes, either for television or the streaming data, it’s mostly useless, but for including the download numbers we thank NBC profusely! The bottom line is, TV is still king, though streaming is growing. But, unless and until they provide minutes of streaming, it will be difficult to get a true idea of what portion of viewing of shows happens via sanctioned streaming channels.

You can download the full slide show (PDF) with data for all shows, but note some data for certain shows is missing. For example there is no download or mobile data for Chuck, even though it is available on iTunes.

Robert Seidman co-edits the blog TVbytheNumbers.com which focuses on television metrics.

You’re subscribed! If you like, you can update your settings

  1. Ignoring for a minute the accuracy of the data supplied… The headline say ‘insignificant,’ but I’m wondering if small numbers can still be profitable. That might be significant to an iTunes, Hulu, or even NBC.

  2. I think that the viewing experience is changing overall and that’s why it’s so hard to measure it. For example, I tend to watch only snippets of a show, let’s say The Daily Show – I’d watch the intros and then skip to the end if Stewart has an interesting guest. Just my 2c. Cheers, Sameer

  3. Wouldn’t it be more appropriate to compare downloads/itunes numbers to DVD sales? Then they might be more significant, cause ofc many ppl who watch it on television don’t buy the DVD, and that’s what itunes/amazon unbox compares to. Also, why not just pick a show without free episodes on itunes if you want accurate numbers.

  4. ITunes Adds FOX HD, Sells 200M TV Eps. « NewTeeVee Thursday, October 16, 2008

    [...] hold on there, buster. Didn’t we just run a story this morning calling out Apple for it’s inability to push more product? Two hundred million downloads ain’t too [...]

  5. HmmConvenient Friday, October 17, 2008

    The download numbers also include NBC Direct I would assume (this article omitted that fact). This is another flaw in the numbers above, because NBC Direct allows content to be “delivered” to a computer on a schedule (so it counts as a download even if it wasn’t viewed).

    I prefer ABC.com’s method of MINUTES viewed.

  6. Can You Compare New Media to Old? « NewTeeVee Tuesday, October 21, 2008

    [...] issue of comparing new and old media has come up quite a bit lately. Our pal Robert Seidman had plenty to say on the subject of NBC comparing views of its shows across platforms (he likes the fruit [...]

  7. Ninja Tops iTunes Podcast List (Again) « NewTeeVee Tuesday, December 2, 2008

    [...] show) also cracked the top 10, beating out shows like House and Desperate Housewives. Of course, if NBC’s iTunes numbers are any indication, none of these shows are being downloaded in huge [...]

  8. Is Hulu Driving People Back to Piracy? « NewTeeVee Saturday, February 21, 2009

    [...] to pull its content off of iTunes. Only it didn’t really make a difference back then, because hardly anyone watched TV shows via iTunes. (In fact, some argue that iTunes still doesn’t really count.) Licensing-based blackouts like [...]

  9. Is Hulu Driving People Back to Piracy? | Viral Video Maker Saturday, February 21, 2009

    [...] to pull its content off of iTunes. Only it didn’t really make a difference back then, because hardly anyone watched TV shows via iTunes. (In fact, some argue that iTunes still doesn’t really count.) Licensing-based blackouts like [...]

  10. NBC lost a high profile place when they bailed on itunes. That’s marketing 101. Now they have all their shows tucked away where? Does anyone know where these other sites are? iTunes is like media central for most people and NBC left that. Doesn’t matter how much they were making on iTunes. What mattered was that they were getting what’s known as “top of mind” presence there. That all matters. It all snowballs. When you remove those kinds of things, you lower your product’s profile and you lose. You’d have to be braindead to pull your content from iTunes the way NBC did.

Comments have been disabled for this post