Nielsen ratings, TiVo, and ‘Arrested Development’
How might changes in the Nielsen ratings system help shows like “Arrested Development”? And how do the Nielsens work, anyway? Here’s how.
Some background. The Nielsen Media Research company has about 9,000 “Nielsen families” whose TV habits are monitored from week to week. Nielsen tries to get an accurate cross-section of different types of households so that from those 9,000 they can extrapolate what the entire nation is watching. For example, since African-Americans make up 12 percent of the population, they make up 12 percent of the Nielsen families.
So when they say “Lost” was viewed by 10 million households last week, they don’t actually know that. What they know is that “Lost” was viewed by 900 Nielsen households, and Nielsen extrapolated that to guess roughly how many American households watched it.
Basically, the formula works like this: There are approximately 109,000,000 households with TV in America. Since there are 9,000 Nielsen families, that means each of those families is representing 12,111 other American households — 109,000,000 divided by 9,000. So if 900 Nielsen families watch something, they take that to mean 10,899,900 households in America watched it — 900 x 12,111. Got it?
Of course, they often report not the number of households, but the number of VIEWERS. That requires even more approximating. Nielsen knows how many people live in each of its 9,000 households — but it DOESN’T know exactly how many people live in each of America’s 109,000,000 households. All it has are averages. So while reports of households might be fairly accurate (assuming Nielsen’s sample group is a representative sample), reports of total viewers are always going to be somewhat guess-y.
Nielsen claims that its sampling is a pretty darned accurate reflection of what America is watching. Every February, May, July and November — “sweeps” months — it augments its regular 9,000 families by sending out additional surveys to thousands of other households, in all 210 of the nation’s TV markets. This is to get a more detailed, more accurate sample — and Nielsen says it usually resembles its regular 9,000-family sampling very, very closely. How closely, they won’t say.
In theory, of course, a show could be watched by all 9,000 Nielsen households, and NO other households in all of America. Nielsen would report it as a phenomenal hit, even though it was actually only watched by 9,000 families (which makes it actually a huge flop). Statistically, it’s possible, but of course it’s astronomically unlikely. (Maybe if a network aired a sitcom ABOUT Nielsen families, one where ONLY Nielsen families would get the jokes….)
But what about the reverse? What if there were a show that was watched by a lot of average Americans, but for some reason NOT by Nielsen families?
UPN had some trouble with that in early 2005 when all of a sudden its shows’ ratings dropped. Why had viewers suddenly abandoned them? Turns out they hadn’t. Nielsen had merely changed its reporting methods in some major cities, and the new methods were under-representing African-Americans — UPN’s key demographic. To its credit, Nielsen took measures to improve the situation. I do think Nielsen WANTS to be accurate.
Yet until recently, a significant and fast-growing portion of American society — almost 7 percent of all TV households — was not represented by the 9,000 Nielsen families. Not represented AT ALL — as in, if you belonged to this group, Nielsen wouldn’t let you be one of its families.
The group? People with TiVo or other Digital Video Recorders (DVRs).
Nielsen’s information-gathering device, the PeopleMeter, was not equipped to handle DVRs, it said. People with DVRs were still included in the “sweeps” surveys — the forms Nielsen mailed out had a column to indicate that you had watched the show on DVR rather than “live” — but if you had a DVR, you could not be one of those 9,000 families who comprise the bulk of Nielsen’s research. Nielsen wouldn’t let you.
This is kind of a big deal. Nielsen strives to get an accurate sampling of American households, yet leaves out 7.4 million. (That’s how many have DVRs as of August 2005 — and the number is rising fast.) Added to Nielsen’s notorious lack of representation for TV viewing in non-home settings — at bars, in dorm rooms, etc. — we start to see a lot of cracks in Nielsen’s system.
Because here’s the thing: Nielsen and the networks should be paying particular attention to DVR viewers, not ignoring them. Not only are DVRs the way of the future — that 7 percent of American households is expected to rise to 35 percent within the next four years — but DVR users are also the people who CARE about TV. They’re the ones who are passionate about it, who choose their shows intentionally, who don’t watch something just because it happens to be on when they’re flipping channels.
They’re loyal, too. A non-DVR fan of “Desperate Housewives” might miss the occasional episode due to forgetfulness or being out of the house, but a DVR user never will, because the DVR records it each week automatically. Isn’t that the audience you’d want to cater to?
Nielsen has finally alleviated the problem and has done whatever was necessary to make the PeopleMeters DVR-compatible. As of this week (Dec. 26), 60 of its 9,000 families are DVR households. Nielsen will increase the number 100 per month until the percentage of Nielsen families matches the percentage of DVR households nationwide. That means it will be another six months before Nielsen is accurately reflecting DVR usage. (Seven percent of 9,000 is 630.)
It will be interesting to see how this affects the ratings. Are there shows that are watched more by DVR viewers than regular viewers? I suspect we will see these changes:
- Ratings for “The War at Home” will decline. The Fox sitcom, a wretched exercise in forced “outrageousness,” currently has a cushy slot between “The Simpsons” and “Family Guy.” I suspect many of the people who watch it do so simply because they like the shows before and after it, and there’s no particular reason to change the channel (or turn the TV off) for that half-hour in between. DVR users, however, don’t watch shows accidentally. They record what they want to see, period — which in this case probably means “The Simpsons” and “Family Guy,” but NOT “The War at Home.”
- The lead-in effect in general will be minimized. Many, many shows remain “popular” (that is to say, they are watched by a lot of people) simply because they come on immediately after shows that are genuinely popular. Fox used this to its advantage with “House,” which struggled on its own, then became a hit when it followed “American Idol.” After gaining an audience in that time slot, the show was sent out on its own — and did just fine, thanks to all those people discovering it and becoming fans when they saw it after “American Idol.” Had Fox not taken advantage of people’s apathy — they don’t change the channel or turn off the TV when their show ends; they just sit there and look at whatever comes on next — “House” would have continued to struggle.
This phenomenon will fall off once DVR usage is accurately reported, and especially as it becomes more prominent over the next few years. Like I said, DVR people generally don’t watch shows accidentally. They record them and watch them later. At the very least, they start watching a show half-way through, so they can skip the commercials.
- Ratings for Letterman and Leno will even out. At present, Letterman’s ratings tend to go up when CBS has a strong prime-time lineup leading into it, apparently because people watch the 10 p.m. show, then keep it on CBS for their local news, then keep it on for Letterman. Leno receives a similar boost when NBC is strong. Again, this is not generally how DVR people watch TV. I don’t expect Letterman to start matching Leno — Leno has a lot of people who watch him regardless of what they were watching earlier in the evening — but I do expect the gap to lessen somewhat, being no longer influenced as heavily by lead-ins.
- Ratings for some middle-of-the-road shows will go down. I’m thinking of CBS’ Monday night sitcom lineup here, particularly the 9 p.m. hour: “Two and a Half Men” and “Out of Practice.” Both are highly rated, regularly winning their time slot and charting among the top 20 shows of the week. But does anyone LOVE those shows? Do people look forward to them? Does anyone have their DVR set to record them each week? I suspect not. These aren’t “appointment” shows. They air on a night when people are very likely to be home, at a time when there’s not much else on. Plus, they’re on right before “CSI: Miami,” which is a much more “legitimately” popular show (as in, people actually anticipate it). Some viewers, with nothing else to do, will turn to a station early just to make sure they don’t forget to watch their show. Honestly, I suspect DVR households don’t watch middling shows like that nearly as much as other people.
A show I DO think DVR people watch in greater percentages than non-DVR people is “Arrested Development.” The show is densely packed with jokes, subtle references, and even fleeting visual gags. You almost HAVE to have a DVR (or at least have recorded the show with your VCR) to fully appreciate it.
It’s also, frankly, a show that is more likely to be watched regularly by people who are willing to commit to a TV show. It requires a viewer’s careful attention, and it requires faithful viewing, each and every week. (It also rewards it immeasurably with brilliantly funny writing and performances, but that’s another article.) What kind of viewer is most likely to give a show that kind of attention? The kind of viewer who is also passionate enough about TV to have a DVR.
I don’t mean to say that ALL DVR users are passionate, selective viewers, nor that ALL people without DVRs will indiscriminately watch anything that happens to land in front of their eyes. But there is certainly a trend, particularly in the attention DVR users will pay to a show.
It might be too late for “Arrested Development,” since Fox has all but canceled it. But other shows with devoted cult followings might find their ratings improving once the Nielsen ratings start accurately reflecting DVR usage. And maybe some of those crappy shows — the ones no one cares about, but that they sometimes watch anyway — maybe those will go away. Here’s hopin’.
May 25th, 2007 at 11:41 pm
I think Nielsen is a total fraud and the efforts to save the CBS show Jericho by it’s fans are proving daily that Nielsen is a fraud…..
Bring Back Jericho
Nuts!!!!!!
May 25th, 2007 at 11:48 pm
Hey people thanks for letting us do this… We want our precious Jericho back and are willing to fight til we get it. Jericho is the only decent show on Network tv. Nuts to CBS
May 25th, 2007 at 11:55 pm
Outdated modes of decided numbers helped cancel Jericho. Save Jericho!
May 26th, 2007 at 12:02 am
Great article, I think it really brings up some key points. I for example am a busy person, not a lot of time to just “turn on the tube and see what is on”. I choose shows to watch that are worth my time and don’t pay much attention to the rest. The best example of a quality show I have seen lately has been “Jericho”. I was hooked on the show from the beginning and although I did watch many of the episodes live, I had my DVR programmed to catch the rest. Some nights I didn’t get home until later and my wife would wait for me so we could watch it with the DVR together. I believe this show had more viewers than CBS knew, and this is one reason. There is a huge movement afoot at this time to convince CBS to bring the show back. If you are upset about the cancellation of this show, please join us. Go to http://www.jericholives.com.
May 26th, 2007 at 12:13 am
We have 8 DVRs in our house and at least 6 of them record Jericho every week….sort of a back-up for a back-up thing in the event that one of the DVRs gets hung/chokes…But also, everyone in my family loves the show and while we watch it together, we also watch it independently….sometimes when the family is watching you miss nuances,etc that you catch when you watch by yourslef in a more quiet setting. Honestly, we can hardly wait through the commercials for the action to come back. The show is that good….just waiting until fall would be hard enough, but never again? We even connected the computer to the big screen so we could all watch the “Countdown” serials. NUTS CBS! Bring back Jericho, Please Please Please!!!!!!!!!
Our demographic info, 36, 36, 59, 13, 10; household income over $100,000; never missed an episode and use the website extensively (interaction with message boards weekly, watched Countdown, also re-watched some episodes)
May 26th, 2007 at 12:15 am
Thank you for pointing out what the industry has not been able to figure out in a long time. Since “Gore’s” invention of the web ;-), media content has been added in ways that were unprecedented. Add to that the creation of recording devices such as Tivo/DVR’s and you have a new media outlet that surpasses the need for the Nielsen rating system since most content can be counted digitally. Unfortunately, this was the cause of the demise for the CBS show Jericho. Please help us get into the 21st century by becoming involved in the Save Jericho campaign at http://www.jericholives.com
May 26th, 2007 at 12:18 am
One other thing, that I think speaks to the phenomenon that is Jericho, from the moment that I saw the commercials advertising it, it was on the TOP of my list of shows to record when i was setting up my DVR for the fall season to begin. I just had to know wha tit was about, and I even bumped other shows that I used to watch to an alternate DVR, so I could make sure Jericho was watched weekly in Hi-Def. The other important thing to note is that my family was so caught up in Jericho that we practically quit watching American Idol….kids didn’t even miss it!
May 26th, 2007 at 12:34 am
Outdated system. Over 20 million Jericho people not counted inside and outside of the US. SAVE JERICHO. All We Are Saying, Is GIve It A Chance For A Second Season. And then make a choice.
May 26th, 2007 at 12:39 am
Hey, i dont think Neilson ratings are working right, they need to be fixed and reworked, long live Jericho
May 26th, 2007 at 12:40 am
So Nielsen is outdated, and takes many approximations in their process? I would add to your article that 9000 families is not a statistically large sample size. And when that 9000 is broken down into subsets for different demographics, the approximation is even more so. This article addresses DVRs very nicely. Since this article was written, online viewership has grown a great deal. Something else Nielsen is missing.
Please CBS, save Jericho. Bring it back for another full season. Thank you.
May 26th, 2007 at 12:56 am
The Nielsen ratings are a joke. Supposedly, CBS cancelled Jericho due to ‘bad’ ratings. Pretty odd then that Jericho happened to finish #2 in its timeslot on a consistent basis, yet it still got cancelled. Many Jericho fans watched episodes online or with DVR/Tivo…….
Further making things suspicious is that CBS’s own magazine for June 2007 the producers and CBS executives were saying how much of a hit the show was. Bring back Jericho ! If you wish to look into our campaign, please go to http://www.jericholives.com
It is time for the networks to stop using this outdated rating system. And no, not everyone likes retarded Reality Television. Give your viewers what they actually want.. quality thought-provoking programming… not more reality-crap shoved down our throats.
May 26th, 2007 at 1:08 am
I was one of the people who filled out the handwritten surveys this spring for Nielsen. When I had the survey, it was the second week of sweeps. Jericho had already had its finale. I wrote in at the bottom of the packet that was one show I usually watched that wasn’t on TV that week. I still had the surveys when it was it was announced that Jericho was canceled. I added my thoughts about that to the survey too. I also have TiVo and usually record shows like Lost and Jericho, because I like to be able and go back and check something out that I may have missed live. I didn’t realize how many network shows I watch until I kept that survey for a week. However, it was a sweeps week. I am a TV junkie and I sure hope this protest about Jericho succeeds. It will be nice for viewers like me to show the networks we want shows with some depth and characters who show us how to be better people.