How to Develop Survey Questions That Help You Make Good Decisions

I’ve been involved in a back and forth with a client around creating survey questions that measure the effectiveness of a team. I was most concerned about the nature and the quality of the questions that we would ask.  We all know the old saying “Garbage in. Garbage out.”  And this is certainly true as it relates to constructing good survey questions.

QuestionPro already gives us many options and question types to choose from.  But if you’re not asking the right questions, you’re not going to get actionable results.

The most basic reason we conduct surveys is to help us make decisions.   In fact, surveys aren’t just used for marketing decisions.  They are often most useful for making improvements in our operations.

How to Know If Your Question Will Yield Actionable Results?

The best way to test your questions for good results is to literally run your survey internally as a test and ask people to answer the questions.  Then look at your results.

Gather a small team in the room and set your objective as reviewing the test results for specific action items.

For example:

“We received a score of 6.7 out of 10 as a response to “Overall, how would you rate the training you received?”  Our objective is to raise this score to an 8 out of 10.  What are some specific action items we could do to improve this score?”

Chances are your team may take in this information and come up with more questions such as:

  • Which aspects of the training were rated low?
  • Which aspects were rated high?
  • What specific parts of the training drive the respondents’ experience?  Is it the trainer, the materials, the exercises, the venue?

If your group is tasked with coming up with specific changes to drive improvement, and they are asking these kinds of questions — then the original survey question is too broad.

The good news is that the questions you’re asking yourselves in order to come up with actions that will drive your score up are the key to creating more specific questions that will help you take action.

Focus on What Decision You’re Making And The Objectives

What is the objective of your survey and what decisions will you make with the results?  Are you looking for ways to improve your training process and system so that your trainees retain more information?   In that case, you can focus the question on your respondents’ ability to actually do a specific task.

With that in mind, you can create a more focused question such as:

“After completing the training, I can process an online order easily”

This question is focused on the area of online order processing.  If you get a low rating, your team will know to focus on that specific area for improvement.

Managing Survey Length

The downside of focused questions is that they tend to proliferate and make your survey too long.   This is why it’s critical to be clear about how you will use the survey to help you make decisions.  It’s worth the time and effort to discuss and come to agreement on what decision you are making and what information you will need to make that decision.  That alone, will eliminate those “nice to know” questions that yield interesting results, but really don’t help you make improvements.

Developing a Survey Strategy

If you’re using your survey results to make decisions, and you don’t want to overwhelm your respondents with a long survey.  The best thing to do is develop a survey plan.

  1. Identify the decision that you are making
  2. Identify the data you will need to support your decision
  3. Develop survey objectives around your decision
  4. Create ALL the questions that will give you the information that you need.
  5. Break those questions out into separate surveys that your respondents can take at different stages of the process.

Focusing your surveys on decisions and actionable steps that you can take will not only yield better results, it will make your team more efficient and your respondents more responsive because they can see their feedback in action.

Reblog this post [with Zemanta]

Ivana Taylor is the publisher of DIYMNarketers.com a resource for entrepreneurs who want do LESS marketing and make MORE money. In 2010 she ranked #21 out of 30,000 influential people on the Internet. She is the book editor for Small Business Trends, a contributing author to AMEX Open Forum and has appeared on MSNBC.

Posted in Best Practice, Newsletter
3 comments on “How to Develop Survey Questions That Help You Make Good Decisions
  1. zmfrederick says:

    I just wrote a post detailing some advice on how to write better survey questions. My #1 piece of advice is to avoid complicated sentences. Keep it simple, stupid, is an especially good piece of advice when composing a survey! Check it out if you’re looking for help:

    http://blog.surveytool.com/2011/04/27/survey-questions-help-guide/

  2. Sujit says:

    Hi, John!Understood sometimes going onnlie just isn’t an option. If you find yourself in a position where you’re seeing respondents in-person, but don’t have internet access at the time, we might recommend trying our partner, they offer a way to collect data offline, then sync that data into your SurveyGizmo account at a later time.If there’s no other solution than paper surveys, however, you can always plug all of your paper data into an Excel spreadsheet, and have our team import it into your account. If you’re looking at a lot of data, an efficient way to create an Excel spreadsheet is to use a company like , which will scan, categorize, and arrange your results in a CSV file for you.(As a side note, we’re definitely considering adding this sort of functionality. If it’s very high on your priority list, would you mind submitting it to our forum? We try and develop the features with the highest demand first, so that will help us prioritize it.) Thanks for the feedback! on Tue, Sep 27 11 at 9:59 am

  3. Hello says:

    I go to see every day a few web pages and sites to read articles, however this web site gives quality based writing.

6 Pings/Trackbacks for "How to Develop Survey Questions That Help You Make Good Decisions"
  1. [...] How to Develop Survey Questions That Help You Make Good Decisions (questionpro.com) [...]

  2. [...] How to Develop Survey Questions That Help You Make Good Decisions (questionpro.com) Possibly related posts: (automatically generated)Successful Survey Tips: Setting Your Survey Up For SuccessInternships, or Free Work?Surveys and missing dataiMake Money: Surveys 41.138388 -81.863747 [...]

  3. [...] How to Develop Survey Questions That Help You Make Good Decisions (questionpro.com) Possibly related posts: (automatically generated)Successful Survey Tips: Setting Your Survey Up For Success 41.138388 -81.863747 [...]

  4. [...] How to Develop Survey Questions That Help You Make Good Decisions (questionpro.com) [...]

  5. [...] How to Develop Survey Questions That Help You Make Good Decisions (questionpro.com) [...]

  6. [...] How to Develop Survey Questions That Help You Make Good Decisions – April 2, 2010 [...]