Survey Software, Web Survey, Online Surveys, and Enterprise Feedback Management solutions from Vovici

Your email:
   

Welcome to the Listening Post!

Your single source for everything Voice of the Customer (VoC) and Customer Experience (CxP). And, don’t forget you can follow us on twitter @vovici, or come check us out on Facebook and join the Vovici Network on LinkedIn.

 

Current Articles | RSS Feed RSS Feed

Standardize Your Customer Satisfaction Questions & Rating Scales

 

One of the reasons your organization may need enterprise feedback management is to standardize on the same question wording and scale across your products, departments and divisions. Whichever measures you decide are best for your organization, use them consistently. You want to be able to compare your Net Promoter Scores®, your ACSI Scores, your CSAT scores, your Apostle Models to one another.  This will enable you to compare and contrast different parts of the business. Internal benchmarking can help your different groups learn from one another.

Sad to say, such standardization is the exception rather than the rule.  In a review of 29 customer-satisfaction questions used by one Vovici partner, we identified eight different scales in use with nine different ways of wording the question:

Occurrences Question Wording
13 How would you rate your company's satisfaction with...
6 Please rate your satisfaction with...
4 How satisfied are you with...
3 How would you describe your level of satisfaction with...
1 Please indicate your level of satisfaction with...
1 Please describe your satisfaction with...
1 In general how would your describe your level of satisfaction with...
Occurrences   Scale
12   1 (Poor) - 6 (Excellent)
5   1 (Not Satisfied) - 5 (Very Satisfied)
4   1 (Not At All Satisfied) - 5 (Extremely Satisfied)
4   Very Dissatisfied, Dissatisfied, Somewhat Dissatisfied, Somewhat Satisfied, Satisfied, Very Satisfied, No Opinion
1   Very Dissatisfied, Dissatisfied, Neither Satisfied Nor Dissatisfied, Satisfied, Very Satisfied
1   1 (Extremely Unsatisfied) - 5 (Extremely Satisfied)
1   Extremely Dissatisfied, Slightly Dissatisfied, Neither Satisfied Nor Dissatisfied, Slightly Satisfied, Extremely Satisfied
1   1 - 4 [no labels specified!]

Ironically, not a single rating scale followed the best practices of not showing numbers, of labeling each point and of using five points for unipolar scales and seven points for bipolar scales.

For individual groups that are reluctant to switch to the standard measure, allow them to run the new metrics alongside the old for a period of time so that they can understand the relationship between the two measures. Some Vovici clients have run the old and new methods side by side for a year, only retiring the old measure once year-over-year comparisons could be provided on the new measure.

Then your staff can say, "Measure by measure, what's mine is yours, and what is yours is mine." Well, at least the English majors can, and they were probably never too fond of the old numbers anyway.

Comments

Is there a best practice scale for a comparison question? 
 
 
 
Survey question: How do we compare? 
 
 
 
Choices: 
 
Much worse 
 
Worse 
 
About the same 
 
Better 
 
Much better
Posted @ Monday, September 07, 2009 12:41 PM by Bob Klaus
The difficulty with using this question is that your ratings might change over time, not due to your efforts, but do to competition getting better or worse. Better to ask them to rate you on the appropriate common rating scale and rate a few of your competitors on the same scale.
Posted @ Tuesday, September 08, 2009 10:51 AM by Jeffrey Henning
After deciding which rating scale to adopt (bipolar or unipolar, 5 point or 7 point etc.), are there any suggestions to converting past reported satisfaction scores that reflect asking the same question but using different scales?
Posted @ Wednesday, March 17, 2010 9:23 AM by Mary Iwanowski
Regarding relative comparison scale vs. common rating scale:  
 
In our usability studies with back-to-back evaluations of two software apps, our observations so far indicate that when participants rate two competitors individually on the same scale, their average ratings (across multiple aspects) skew depending on which one they tried/rated first. It seems that they rate the first app they used fairly objectively, but then they rate the second one relatively higher if they liked it more or lower if they liked it less. (On average, between subjects, comparing the same product's ratings when tried first vs. second.)  
 
My theory is that participants don't remember exactly how they rated the first product, so to make sure they capture their relative preference they exaggerate their ratings on the second one.
Posted @ Thursday, June 24, 2010 2:17 PM by lawnjay
Post Comment
Name
 *
Email
 *
Website (optional)
Comment
 *

Allowed tags: <a> link, <b> bold, <i> italics

Latest Posts

Loading
What's New
Independent Research Report: Why Customer Experience? Why Now?
VoC on Twitter
Verint Blog
Verint Blog: Read the Latest from the Verint Systems Blog