Mark Ramsey: More Reasons Why It’s Time To Dump Nielsen’s PPM
August 17, 2016 at 11:41 AM (PT)
Last week (NET NEWS 8/8), MARK RAMSEY MEDIA President MARK RAMSEY took it to NIELSEN in his blog "It's Time To Drop NIELSEN's PPM."
Discussing the fact that NIELSEN will allow up to 16 PPM devices in a single household, RAMSEY wrote "that one current in-tab household has 13 meters, and nine of them belong to people under the age of 17," adding, "NIELSEN likes stability on the panel, and this particular household has been in the sample for quite a while. Imagine replacing them when they leave after as much as a two-year tenure. That will require placement into multiple households to achieve 13 new meter-carriers, and it costs NIELSEN money. But a couple of stations in NIELSEN markets aren’t crazy about the possibility of one household with more than a dozen PPMs. We know that younger children can be influenced by the media behavior of their parents or older siblings, for instance. Subscribers aren't allowed to know the identity of panel members."
This is called 'how to lie with statistics'. So let’s do some math.
NEILSEN commented on RAMSEY's blog, telling ALL ACCESS, "We strongly believe in and stand behind our PORTABLE PEOPLE METER (PPM) technology. Our 70,000+ PPM panel is representative of the marketplace. While the tenure of individual NIELSEN PPM panelists vary by demographics, on average, a person is part of the panel for 11 months. While less than half a percent of our in-tab persons come from households with 10 or more residents, our average household panel size for people 6 years and older is 2.5 persons per home for all PPM markets. This is in line with the household universe estimate of 2.4 persons per home. NIELSEN's PPM technology will continue to deliver currency grade metrics that the radio and advertising industries depend on to transact with confidence."
Now RAMSEY is back, blogging, "This is called 'how to lie with statistics'. So let’s do some math. By NIELSEN’s own fuzzy estimate, about 350 panelists come from households featuring 10 or more meters. That would average to 35 households. Let’s say there are 50 PPM markets, and let’s assume that the 35 households are equally distributed by market (they’re not, but go with me here). That means the average PPM market contains between 1 and 2 10+ PPM households.
"Does that make you feel better? How many 10+ PPM households is 'not too many' in your market? The problem is that NIELSEN is trying to swamp the issue with big numbers. But your station’s ratings don’t vary because of big numbers, they vary because of small ones. They vary not because your ratings depend on 70,000+ PPM panelists, but because they hinge precariously on one or two. To say nothing of 10 in one household. I got a note recently from a client who broadcasts Religious spoken word programming on AM – a format targeting primarily White/Other listeners over the age of 35: 'We found out that we are reaching 90% African American Women and 78% of our audience is 25-34! Of course, we have only 5 or 6 meters for the metro. Crazy, right?' Right. Thank you, PPM! All 70,000 of you! At least these 5 or 6 meters were not all in the same household. Or were they? How will you ever know?
"Is this what NIELSEN means by 'currency grade metrics that the radio and advertising industries depend on to transact with confidence?' When we talk about meters we tend to think of them as disconnected from each other: Independent listening events. But this is hardly true. Households affect listening within that household to a significant degree, at least inasmuch as multiple panelists share the same car. That means there’s a huge group dynamic that affects station ratings caused by multi-panel households, and the bigger the household the stronger this dynamic. 10 meters in a single household is not the same as 10 meters in 10 households. Period. For NIELSEN to pretend otherwise is disingenuous. It’s one thing to represent the market with 70,000 panelists when that market is yours. It’s another thing to represent it when the difference between ratings success and failure is a handful of listening occasions from fewer panelists than you have fingers on one hand.
"Meanwhile, (as I predicted) the average household size of a PPM family IS larger than the average U.S. household size. 2.5 is bigger than 2.4 by 4%. And why be off by 4% when you have 70,000 panelists? That’s 2,800 panelists, Nielsen. You could err in the other direction for more sample stability and measurement accuracy, you know. For radio stations, the sample you are concerned with is the one that determines your ratings and the volatility of those ratings. That sample is abjectly too small. And the danger of that too-small sample is only aggravated when between one and two households in your market are packed with 10 or more meters, thus placing that household on the NIELSEN payroll. Look, there are many wonderful, talented, committed, and hard-working people at NIELSEN trying to do the difficult work of measurement. I respect and admire each and every one. But when you stand behind the logo and spin the numbers, somebody has to point out that this Emperor lacks clothes."
A NIELSEN spokesperson told ALL ACCESS that the company will not comment on RAMSEY's latest column.
You can share your thoughts below.