Survey Software, Web Survey, Online Surveys, and Enterprise Feedback Management solutions from Vovici

Your email:
   

Welcome to the Listening Post!

Your single source for everything Voice of the Customer (VoC) and Customer Experience (CxP). And, don’t forget you can follow us on twitter @vovici, or come check us out on Facebook and join the Vovici Network on LinkedIn.

 

Current Articles | RSS Feed RSS Feed

Don't Make Me Lie to You

 

Today's post is by Siobhan Miller, one of our senior product managers.

Siobhan MillerAs a patriotic American who probably stimulates the economy a little more than any student in Accounting 101 would tell you she should, I’m often asked for my opinion by retailers, non-profits and market researchers who sense they have a “live one.”  That request is always conveyed in survey form.   Now, I talk to Vovici clients every day who want to get the most accurate information from their own customers as possible. When I take a survey, I feel a moral and personal obligation to answer every question to the best of my ability because I know how important this data can be to the person on the other end. So I feel I must beg all the survey authors out there: don’t make me lie to you.

Case in point: two weeks ago I received a survey from a charity that I support.  I was excited to take it—the topic indicated that the group had identified a problem with a program that was glaringly obvious to supporters, and I was eager to share where I felt it should focus its efforts. It started off well, lots of comments like “great question!” and “yes, that’s important” and “no, don’t worry about it.” And then I was confronted with my dilemma: a four-point scale, requiring an answer, about a step in the program I would not experience for at least another six months. There was no escape—no neutral option, no “N/A”, no “Other, please specify.” I couldn’t go forward without answering.

I considered abandoning the survey—but what if the analysis only included completed responses? My opinion wouldn’t make the cut.  Maybe it was all the adrenaline, the sweaty palms, the desire to not make the charity think I was so cold-hearted as to not respond to its important survey—but at some point, rationalization kicked in.  “Surely, there will be a chance to enter a verbatim response, no matter how small the character limit. You can clarify any issues there.” I took a deep breath, focused on the radio button to the left of “Slightly disagree” and satisficed my way to the next page…which thanked me for my time. GAH!

Now, I recognize it’s only one data point and perhaps I’m slightly overplaying the guilt experienced (but only slightly—and that’s a whole different post on a whole different blog).  However, a simple way to extract myself from that situation—via a verbatim, non-required question, or “N/A”—would have given the charity a more accurate response and a more willing participant for its future surveys.  Because at the end of the day, I want my online survey relationships to be built on a solid foundation of truth. Honest.

See also:

Comments

Siobhan 
Nice article. I am not a professional Marketing researcher but I do DIY for my product management and pricing decision making. I tend to fall on the side of, "make the respondent take a stand and not take the easy way out". 
In a meta analysis conducted on survey responses for questions with even scale vs Odd scale, it was found that Odd scale gives the "middle" option that most select as default. Not having the middle option stops the respondent briefly and makes them take a stand - you either agree wee bit or disagree wee bit. 
 
 
The same reasoning goes for N/A, it makes it easy for them to pick N/A without expending thought on the question. Unless the analysis takes into account responses that have high number of N/A or middle option we will end up with incorrect data. 
 
Regards 
-rags 
@pricingright
Posted @ Sunday, November 14, 2010 10:31 AM by Rags Srinivasan
I totally agree with you. Not having those options ignores the human psyche and behavior. I wrote a post about this a while back: Is it right to include a Neutral point in rating questions? 
 
 
 
http://www.relevantinsights.com/is-it-right-to-include-a-neutral-point-in-rating-questions 
 
 
 
Check it out.
Posted @ Sunday, November 14, 2010 12:27 PM by Michaela Mora
This is a great point. One of my serious concerns with surveys is that when something goes wrong from the researcher point of view, whether it's random responding or straightlining or some other horrible survey error, our first assumption is that the survey responder is deliberately trying to make our lives miserable. Well, I think a huge part of the responsibility lies with the researcher. If we wrote better surveys, we wouldn't put people in the position where they felt that they were lying or needed to lie. Better surveys = happier responders = better data
Posted @ Sunday, November 14, 2010 12:48 PM by Annie Pettit
Here's an idea: 4 options (no middle ground) but every question has an Explain... button that pops up a text window. People have to go out of their way, make it harder on themselves, so in theory the extra trouble to process qualitative responses rather than quantitative, pick one responses will pay off with improved truthiness and engagement from the responder.
Posted @ Sunday, November 14, 2010 3:11 PM by Alastair Dallas
Thanks to everyone for the comments. I'll be the first to admit that I am a recovering satisficer: I have used a neutral response as an easy way out. In my defense, it was almost always because I reached a point in the survey where I perceived it was too long or too repetitive. Now when either of those conditions occur, I stick it out for another 5 minutes and--if it doesn't get better--quit. I understand why researchers don't include a neutral option, but I will say that sometimes it's been the right answer to the question. Some things aren't positive or negative. They're just a blank, unblinking stare straight at the screen. 
 
With the survey I mention in the post, my concern was that I was being asked to evaluate a step in a process I hadn't experienced at that point. Sort of like being asked how hard finals are on the first day of school--the only right way to answer was not to answer it at all. An "N/A" would have been entirely appropriate for that question, as it asked to review an event without evidence I had actually participated.  
 
...and I post this full well knowing that somewhere out there in the universe a respondent is rolling his/her eyes at one of my amazingly phrased questions, clicking out of my survey and checking Facebook...*sigh*  
 
 
 
Posted @ Monday, November 15, 2010 10:40 PM by Siobhan Miller
Post Comment
Name
 *
Email
 *
Website (optional)
Comment
 *

Allowed tags: <a> link, <b> bold, <i> italics

Latest Posts

Loading
What's New
Don't Be in the 4%
VoC on Twitter
Verint Blog
Verint Blog: Read the Latest from the Verint Systems Blog