Survey Software, Web Survey, Online Surveys, and Enterprise Feedback Management solutions from Vovici

Your email:
   

Welcome to the Listening Post!

Your single source for everything Voice of the Customer (VoC) and Customer Experience (CxP). And, don’t forget you can follow us on twitter @vovici, or come check us out on Facebook and join the Vovici Network on LinkedIn.

 

Current Articles | RSS Feed RSS Feed

A Method to the Madness: Weird Survey Techniques that Work

 

This week we're counting down the Top 5 posts published to Voice of Vovici in 2010. At #4 is this post originally published October 26.

The fine folks at Research magazine have compiled a slideshow, “When surveys go weird.” Let’s face it – the day we in the market research industry stop making fun of surveys is the day the neuroscientists have won.

That said, there is a method to the madness for some of these techniques. Take this screenshot:

weird survey 1

I like this approach. In fact, I advise clients doing surveys to access panels to do something similar. You can eliminate much dishonesty from respondents simply by prefacing a survey with a simple question asking them to be honest. (See Encouraging Honesty from Survey Respondents and Community Members for more.)

weird survey 2

Sure, this question insults the intelligence of the respondent. But it is included to make sure that the respondent is actually reading and answering each question, rather than speeding through the survey to collect the spiffy incentive. Yes, survey incentives corrupt, and absolutely great survey incentives corrupt like Absolut.

weird survey 3

This is what happens when the legal department gets involved, unfortunately. This is tedious but fair to the respondent, as it sets expectations appropriately. What you need to do for MROCs is even worse: you may have to subject them to eight points of legalese about how your client owns any ideas they submit. (See Idea Ownership in Research Communities.)

Unfortunately, many of the other examples from Research demonstrate madness to the method: indeed, three screen shots show surveys that don’t look as intended—an important reminder to test, re-test and test your survey again. And some of the other examples are just good for a laugh. Check them all out at When surveys go weird.

Comments

Hi, Jeffrey: 
 
 
 
Nice article. Thank you! But I am just wondering based on the hamster question. What if you find that the respondent was just trying to speed through the survey and the answer was wrong, will you just discard this survey? 
 
 
 
Helen
Posted @ Tuesday, October 26, 2010 7:13 AM by Helen Wu
I would definitely delete their entire response to the survey, as their failure to answer this question correctly makes it difficult to trust any of their other answers.
Posted @ Tuesday, October 26, 2010 7:19 AM by Jeffrey Henning
I'm afraid I'm with Research on the first point, Jeff. I appreciate why it is there, but for me it is tonally wrong. It comes across as hectoring. A message with an "I'm ready to proceed" button or similar would have achieved a similar result without potentially annoying the many panel members that do always answer correctly 
 
Simon 
 
(A digression, but it also reminds me of those unskippable anti-piracy ads at the start of DVDs. Some DVD buyers may indeed illegally download, but why berate people that have actually bought the product?!)
Posted @ Tuesday, October 26, 2010 3:12 PM by Simon
We will have to agree to disagree, Simon! 
 
I would be against it on any survey of a known constituency (e.g., customers, employees, etc.) but I think it is completely appropriate for access panel surveys, where the only relationship between surveyor and surveyed is financial. Asking people to be honest has been proven to increase their honesty. 
 
As for DVDs, most consumers don't understand or value copyright, and therefore the industry continues to "educate" them about the ramifications of piracy. 
 
Thanks for commenting!
Posted @ Tuesday, October 26, 2010 3:16 PM by Jeffrey Henning
There is indeed method behind these examples, but what strikes me about them as much as anything else is the tone in which they address the respondent. Why doesn't the hamster question say, "Just a quick question to check you're a real person"? As for the NDA and the agreement to behave, if survey writers should be careful taking that sort of tone unless they too have "taken their time to think carefully" and put the survey together "with care". It's often not the case.
Posted @ Thursday, October 28, 2010 6:42 AM by Robert Bain
To me this type of questions are insulting to respondents. Not my idea of 'fun'. Please take people seriously with short and relevant research.
Posted @ Wednesday, November 03, 2010 11:44 AM by Jorrit Lang
This is a good example of the downside of technology, as it reduces the barriers of entry. In this case, now anybody can easily (and cheaply) implement an online survey.  
 
But, that doesn’t mean it’s well thought out. The scary part is that those who are implementing poorly constructed and worded surveys probably don’t even realize it.  
 
Posted @ Tuesday, November 09, 2010 1:08 PM by Kris Hodges
Post Comment
Name
 *
Email
 *
Website (optional)
Comment
 *

Allowed tags: <a> link, <b> bold, <i> italics

Latest Posts

Loading
What's New
Don't Be in the 4%
VoC on Twitter
Verint Blog
Verint Blog: Read the Latest from the Verint Systems Blog