« The mysteries of measuring marketing response, part 3: Reconciling post-click behavior | Main | Experian consumes Hitwise »

April 17, 2007

Cookies are evil! Burn them!

Click for original on www.webflyer.comThere's a lot of chatter on the wires here (ooh, I make it sound so glamorous and newsroom-y - it would be more accurate to say there are a lot of e-mails going back and forth) about Comscore's press release about cookie deletion. It makes for somewhat alarming reading - according to the report, 31% of Internet users delete their first-party cookies at least once a month, with 7% deleting them more than four times. Comscore estimates that this means that a cookie-based count of unique users would be overstated by a factor of 2.5, or 150%.

Of course, Comscore is hardly likely to come out with a piece of research that provides a glowing endorsement of cookies, since their measurement methodology - panels (or, more accurately, sampling using a piece of client software that users install on their machines) competes directly with regular web analytics solutions, which rely on cookies for user counts and persistence. But is this study as alarming as it seems?

One thing that caught my eye about the study is that the first-party counts excluded log-in cookies. I'm not quite sure what they meant by this (i.e. whether those were just session cookies), but a lot of sites' first-party cookies are login cookies. So the first-party cookies measured were 'non-essential' cookies; perhaps much more likely to be deleted.

Furthermore, if your site is issuing log-in cookies (assuming they're persistent), you can use these cookies to generate UU numbers, even if not all users have them (assuming your web analytics solution is sophisticated enough to do this). The great thing about a log-in cookie is that, even if the user clears their cookie, when they come back and log in again, their log-in cookie looks identical, even if it's not the same actual cookie. So you can have users delete their cookies 10 times a month with no problems, as long as the new cookie you give them looks the same as the old one.

Which leads me onto the point I made in my previous post - sites need to work with their web analytics vendor to implement strategies to limit the impact of cookie deletion on their numbers. It's still very common to encounter a site which is issuing a high-quality cookie associated with a log-in, but is using a 'junk' first- (or even third-)party cookie for sessionizing, UU counts and persistence.

The other point I'd make is that debates about the absolute accuracy of web analytics have been raging for as long as the industry has existed, and the main answer to this kind of thing remains the same today as it always have - don't rely on your web analytics solution for absolute numbers. Instead, focus on trends and comparisons - which have a much higher chance of being accurate if your measurement technique is consistent across your audience and over time. If you want absolute numbers, use a panel.

del.icio.usdel.icio.us diggDigg RedditReddit StumbleUponStumbleUpon


TrackBack URL for this entry:

Listed below are links to weblogs that reference Cookies are evil! Burn them!:



About me



Enter your email address:

Delivered by FeedBurner