I read a nice factoid on this topic this morning in Eric Schaffer’s Institutionalization of Usability book. It’s a quote from Jared Spool:
In April of 2002, Princeton Survey Research Associates surveyed 1,000 adult Internet users about their concerns with privacy on the Internet. In the survey, only 18% said they never read privacy policies most of the time, or every time they shop.
Yet, in our study of more than 1,000 shopping sessions, where we actually observed what users did while shopping, we noticed that only two users ever checked the privacy policy. And for these two users, it had no effect on their shopping behaviour. This is yet one more case of users doing something different from what they say they do.
To reiterate this point –
What users said they do:
82% of users said they read privacy policies (from survey data)
What they actually did:
0.2% looked at privacy policies (in user tests)
This ‘observational data vs self-report’ argument is a road well trodden (read Jakob’s 2001 alertbox on this topic here, or a great signal vs. Noise post here), but I like this factoid because it sums up the argument so well.
[Note – typos have been removed from the original post. Thanks Jared!]
This is are real problem when you are conducting surveys which leads me to wonder how accurate many of them are.
Not that it changes your point, but you’ve got the statistic inverted:
82.0% said they looked a the policies most of the time or every time they shopped.
0.2% actually looked at the policies.
Jared
Oops!
Thanks Jarred, I remember thinking “I really should check this before I click publish.”
That’ll teach me not to blog and write a presentation simultaneously! I’ve corrected the numbers in the post.
cheers
Harry
Oooh nice fact. These things are great for convincing clients.