TAMS News Releases
Issues Which Have and May Affect TAMS Ratings during 2006
As quite a number of improvements were and are still being made to the TAMS
Panel, the SAARF TAMS Council requested SAARF to inform users of the changes.
Also of problems that we experienced which are out of SAARF and AGB Nielsen
Media Research’s control.
In debating the improvements and upgrades to the TAM panel, it became evident
that the communications industry requires an overview of how ratings may have
been affected during 1st quarter of 2006. Furthermore, there are other
improvements planned for later in the year which will also have a ratings
effect.
TAM panels are universally used around the world to estimate TV ratings. The
technology is proven and well documented. Our current contractor AGBNMR measures
TV audiences in 30 countries around the world, including the UK, Australia and
Italy. However, the estimates are sensitive to change, which is understandable.
In this document, we are listing the various past and future events that could
have or will have an effect on the ratings, both decreases and increases.
1. Change of Processing Software to Pollux in Week 01 of 2006
Central to every TAM operation is the processing software. This software
accumulates and processes the viewing data from panel households. This is a
complex procedure and happens every single day. Firstly, households are
validated for example whether the household could be contacted (polled) or not;
was the meter working correctly; was there too much viewing with no one logged
in; etc. These rules are called the “Edit rules” and are used to validate each
household everyday to determine which household can be regarded as ‘good’ to
report on.
Once the good households are validated, their data are weighted up to reflect
the TAMS universe. At this point any skews in the sample are effectively
re-weighted back to proper representation.
The order in which weights are applied, the exact number of rejected or good
households and the application of the edit rules, all contribute to the ratings
calculation. Simply put, 1 piece of processing software cannot possibly
duplicate another.
The SAARF Tender Committee approved the change of processing software, because
Pollux is “state of the art” software for Overnight or Day-After ratings, as it
has numerous quality control checks to ensure data integrity and also panel
management control.
From August 2005 to the changeover to Pollux in January 2006, we went through a
protracted period of testing Pollux output against the previous software. Yes,
there were differences in the ratings calculation, but over time these were
minimised. There is no doubt that the changeover to Pollux at the beginning of
2006 constitutes a small rating change.
2. Power Failures in the Western Cape
After the severe failures during the last 2 weeks of February, we analysed the
viewing data of the Western Cape, and it was very clear that this period,
compared to previous weeks, showed much lower ratings. The effect was
significant.
We need to add that those households on the panel that cannot watch TV because
of an failure, must stay on the panel, so replicating the effects of the failure
on viewing levels in that area. Clearly, we cannot remove these households and
so boost ratings as it would be indefensible as viewing did not take place in
those households, reflecting reality.
Currently, reactor 1 at Koeberg is coming back on line, and Reactor 2 is about
to be shut down because re-fuelling must take place. This is a lengthy process.
Cape Town needs both reactors running in order to produce enough electricity
during the cold weather. Depending on the re-fuelling process we could see
severe failures again - and these will depress ratings again.
The real problem may well be in Gauteng. In previous years during failures when
whole sections of Johannesburg went down, we did not specifically track the
effects. If, as forecast, we have serious failure in Gauteng this winter, there
would be a significant depressing effect on ratings, remembering that Gauteng
has the bulk of our panel, in line with population densities.
3. MTN Problems with GSM Polling
We use GSM enabled polling in many households and not Telkom landlines. This is
biased to upmarket DStv households who will not allow us to use their landline
facilities. In the new rural panel we have no choice but to use GSM because
Telkom availability in rural households is so poor.
From 08 April to the 20 April 2006, MTN’s GSM polling effectively stopped
working. MTN experienced a load problem at its base station in the Ormonde area
(which AGBNMR use), and decided to compress voice mail in order to accommodate
the extra load. Unknowingly, they disabled the data transmission facility
through the compression. It took MTN until the night of 20 April to find and
rectify the problem.
This affected hundreds of panel households. However, we managed to re-route a
substantial number of households through Vodacom, where it was possible. Data
was also accumulated in the affected households, which we could poll once MTN
was up and running again. However, we have no doubt that ratings were affected
over this period. Most probably negatively, because those households with no
polling would have been included on the reporting base for a week – the normal
time period allowed to establish reasons for households being down, and to
rectify the problem.
4. Easter Holidays 2006
April this year had the Easter weekend, and then directly after that another
very long weekend again. Every TAM panel around the world measures TV viewership
in home. In other words when households go on holiday there is no viewership,
because the members are not at home. Households on holiday must be left on the
reporting panel.
Including households with no viewership depresses ratings and gives a measure of
who is on holiday.
5. Rural Panel
As per the new TAMS contract, AGBNMR is currently installing the rural panel,
that has not been measured up to now. This will not have affected ratings as
yet, because the rural households are not in the reporting base. However, once
we have reached “critical mass” in terms of reporters, we will begin to test the
effects of weighting these households up to universe.
This will entail re-weighting the whole TAM panel and again, this will affect
ratings. Obviously, every care will be taken, together with the TAMS Council to
minimise the affects, but there will be a ratings effect, if only minor.
6. Measuring all TV Sets in House and DualView Decoders
There are 2 upgrades that will positively affect ratings, and probably
significantly.
Previously, it was virtually impossible to measure every TV set in house,
because the various master and slave meters were connected via cabling.
Households usually refuse to have more cabling tacked to their walls, and in
some cases in concrete roofed flats / apartments or houses, the additional
cabling was actually impossible to install.
As part of the new contract, all the TV meters now in use, must be connect via
radio links. This means that through time we will eventually measure virtually
all TV sets in panel homes. The effect of this will increase the number of
channels viewed, maybe also the time spent viewing TV in those households, and
this will positively affect ratings.
We have fairly recently found a fool proof method of measuring both output
channels of the DualView decoder. This, together with the full measurement of
every TV set in panel households, again means an increase in the time spent
viewing TV and an increase in ratings.
Both these effects will increasingly be felt as more DualViews come on the
panel, and more additional TV sets are measured. Both these upgrades are
currently underway.
We hope that this communication gives more information on how upgrades to the
panel, as well as methodological changes can affect ratings. The worrying issues
are things which we cannot control, such as the power situation in the country
and polling problems due to network communications failures.
Special Note – Week 18 of 2006 Revision:01
Unavoidable Delay in Release of Viewing Data
In times where long weekends hold up collecting & processing data, AGB Nielsen
Media Research would normally release the current week’s TV ratings some days
late.
After the extraordinary holiday periods in April, with 2 extended long weekends,
the effects have been significant, & we have asked SAARF’s permission for
delaying the release of the data until later today, or at the latest tomorrow
[Wednesday 10th May].
The reasons for this request are twofold, being the holiday periods & also the
Integration of new DSTV households onto the reporting panel:-
a.) The SAARF Tam contract makes allowances for late data delivery where public
holidays have held up data collection & processing. In past years where the
Easter weekend was concerned, we have normally released the data on the Monday
or Tuesday, after the normal Thursday release date. In this case the weekend
directly after Easter was again a very long weekend, so that simply made matters
a lot worse, & further delayed processing.
b.) We have started recruiting & installing DualView households onto the
satellite panel – [SingleView decoders making up the bulk of the panel]. In
order to measure DualView, & Singleview households through the new meter,
special software was written which resides on the decoder, & which outputs the
viewing data to the meter. The new decoder software is available for use now &
we have 11 DualView households & a further 15 Singleview households measured via
the new software, which are “good” & definitely should be integrated into the
viewing data for release, but have been withheld pending integration with the
viewing data of the other panel households.
In order to do this, these households data had to be extremely thoroughly
checked & their data made compatible with all the other households. This has now
been done, & we are on course to merge these 26 DSTV households onto the panel.
This process has been time consuming & has held up data release for
approximately 24 hours.
Oracle Airtime Sales has been informed of the reasons for the hold up in the
data release, & are fully supportive that the 26 DSTV household’s data is
integrated into the market release data for this week [week 18].
31 March 2006
SAARF TAMS Data: Influences on the ratings by switching to the Pollux
Processing Software and the implementation of the 2005 Universe Update
Part of the reason for SAARF running a TV panel is so that viewing data can be
tracked through time, via THE SAME RESPONDENTS. This methodology allows precise
and reliable viewership trends across time to be deduced from the data.
Unfortunately, with the march of time, there are always better ways of
gathering, processing and reporting on the data, and in order to be at the
“cutting edge” we need to move with the times. The upside is better technology
and better data, the downside is that the trend in the data is broken. Actually,
the “currency” has changed.
An example of this is when new TV meters are introduced onto the panel. When the
existing Eurometers were first introduced onto the panel in 1999 they had an
immediate effect on the viewing data. Viewership went up significantly, in part
because the Eurometer disables TV channel changing until at least one household
member logs into the meter: a “hard prompt”. The previous meter did not have
this facility. The effect was that there was a break in the trend data, and the
“currency” changed.
2 significant events have recently happened and they will affect the data, and
might also represent a change in data levels.
Pollux Processing Software The heart of
any TAMS system is the software that downloads the viewing data and processes it
to provide the raw data that gives us TV ratings. This software works to very
strict criteria: for example should a household’s data be rejected if no viewing
took place during a 24 hour period ?; if the TV set/s is on but no viewer is
logged in, what should happen to the data, or suppose 1 viewer logs in to the
main TV set, and without logging out then logs into a secondary set – what
should happen ?.
As part of the new TAMS contract, “state of the art” processing software called
Pollux has produced the TAMS ratings since beginning 2006. Extreme care was
taken in setting up Pollux, so that the processing criteria were as close as
possible to the old software. Also, over a period of months, the ratings
produced by both systems was compared and presented at numerous SAARF TAMS
Council meetings, in order to verify that the ratings estimates were close, or
actually even identical to the rating produced by the old system.
So, whilst infinite care was taken in the switchover, the introduction of Pollux
represents a ratings currency change.
Universe Update to AMPS 2005
The TAMS universe estimates derived from the annual AMPS surveys, which was done
since the inception of the TAMS panel in 1989, has been implemented recently. At
the same time the estimate of satellite and M-Net households is updated based on
audited subscription figures from M-Net and Multichoice.
The universe update happened later than planned, simply because we held up the
process so as to include audited figures for the DualView decoder subscriptions,
but unfortunately these are still unavailable [we are currently introducing
DualView households onto the TAMS panel having solved the problem of measurement
of both channels – this is probably a first in the world !].
The universe estimates have been updated as from week 12 (13 – 19 March 2006).
In a nutshell satellite households have increased by 12.9%, while non-satellite
households increased by 9.0%. There has been a decrease in M-Net subscriber
households.
This universe update also represents a break in the trend data and there is now
a new currency.
|