Bad Survey Questions Bad Survey

Bad Survey Questions

SHARE THE ARTICLE ON

Table of Contents

A survey is one of the most effective tools for obtaining insightful data. Whether your goal is to boost employee engagement or improve your marketing strategy, conducting a quick survey always helps. A well-crafted survey with the right questions will yield meaningful results. These questions are what differentiates a good survey from a bad survey. 

Read on to learn about the common survey mistakes to avoid while constructing a survey.

Transform your insight generation process

Create an actionable feedback collection process.

online survey

How to identify a Bad Survey Question

A bad survey question creates a bias in the respondents. The questions are worded in a way that may confuse them. When people encounter such questions, they may decide to drop off from the survey.

A bad survey also affects the organization conducting the survey. If questions are not answered correctly, the data collected may be unreliable, and companies may misjudge decisions as a result. This simply defeats the purpose of conducting a survey.

Bad Survey Questions Bad Survey

Features of Bad Survey Questions

  • Bad survey questions are often unclear and off-topic.
  • The wordings used in these questions are biased which makes it difficult for the respondents to answer them.
  • Bad survey questions ask for multiple information at once.
  • They use adjectives such as “amazing”, “great” etc that will drive the users towards a certain response. This makes it difficult for respondents to provide useful input.
  • Bad survey questions limit the user’s responses to a few options. This prevents them from providing honest answers.

Download Market Research Toolkit

Get market research trends guide, Online Surveys guide, Agile Market Research Guide & 5 Market research Template

Making the most of your B2B market research in 2021 PDF 3 s 1.png

Examples of Bad Survey Questions

Asking questions to which you already have an answer

It may seem absurd, but a poorly constructed survey commonly includes questions to which you already know the answer. 

For example, consider an online store conducting a survey to learn about the customers’ experience. If this survey includes numerous demographic questions as opposed to questions tailored to know about their purchase experience, it will only waste time. Think about it. The online store has sent their customers a survey which indicates that they are familiar with them and their basic background details. So it’s pointless to ask the same questions to which they already know the answer. Instead, these questions could be replaced by more specific ones. 

Some common examples are – 

  • What is your email id?
  • What product did you purchase?
  • Fill in your phone number.

It is important to prioritize the respondents’ time and ask questions about topics that you can’t figure out on your own.

Using leading questions in the survey

Bad Survey Questions Bad Survey

Leading questions are phrased in a way to drive the users’ responses towards a specific option. A survey uses a leading question if the researcher wants the respondents to answer a certain way. The problem is that you’ll never really know the honest opinions of users. 

Examples of leading questions – 

  • How satisfied are you with the product?

Fixed: On a scale of 1-10, how would you rate our product?

  • What problems did you face when using our website?

Fixed: What was your impression of our website?

  • Our restaurant has been given a 5-star rating by our customers. How would you rate your experience?

Fixed: Removing the first sentence is a better way to ask the question.

Asking negative questions 

A negative question is a survey question in which a “yes” signifies a negative response and “no” signifies a positive response. Such kinds of questions have tricky wordings that may confuse the respondents. They may end up choosing the wrong option as their response which will affect the survey result. 

Examples – 

  • I don’t know about Machine Learning.
    • Yes
    • No
  • I didn’t enjoy visiting your restaurant.
    • True
    • False

Reframe the questions as given below: 

  • How well do you know about Machine Learning?
    • Not at all
    • Fairly well
    • Very well
    • Excellently well
  • How will you rate your experience at our restaurant?
    • Excellent
    • Good
    • Average
    • Poor

Questions without a “Not Applicable” option

If respondents are required to answer all questions in a survey, they may abandon the survey. There may be situations when the respondent does not know the answer to a question or wish to skip a particular question. 

For example, 

  • What is your annual income?
    • Less that $15,000
    • $15,000 to $36,999
    • $35,000 to $49,999
    • $50,000 or above

The above question that asks about the income of the respondents does not give them a “Not applicable” option. Not everyone is comfortable sharing details on how much they earn. Therefore, keep such questions optional or include a default entry.

Avoid double-barreled questions

Double-barreled questions are a very common example of a bad survey question. It aims to cover multiple subjects in a single question. The best way to identify such questions is to look for questions that have “and” or “or” in them. For example,

  • How satisfied are you with our product and delivery?

This question forces the respondent to give an opinion on both the product and delivery. 

The question can be fixed by splitting it into two as follows – 

  • How would you rate our product?
  • How satisfied are you with the delivery of your product?

A good survey aims to ask only one question at a time to be able to gather valuable data. 

Using absolutes in a question

An absolute question restricts the response options to a simple “yes” or “no”. Always include a variety of options that the respondents can choose from. This will not only let them give honest answers but will also let businesses gain deeper insights.

For example,

  • Do you always watch TV?
    • Yes
    • No

In the case of the above question, a respondent is most likely to answer with a “no”.

A better way to frame the question is as given below,

  • How often do you watch TV?
    • 2 hours per week
    • 4 hours per week
    • 6 hours per week
    • Above 6 hours

A few more pointers to take care to avoid a bad survey are-

  1. Understand the audience of the survey before listing down the questions. Learn about the demographics, their language preferences, and their needs. 
  2. Ensure the number of questions is neither too high nor too low. Include a variety of questions for reliable results.
  3. Ask short, simple, and precise questions. Avoid using phrases or slang that are complicated.
  4. Make use of both open-ended and closed-ended questions. Focusing more on open-ended questions will consume a significant amount of the respondents’ time.

See Voxco survey software in action with a Free demo.

Wrap-up

Asking the appropriate questions is the key to extracting the most information out of a survey. You will certainly end up with a solid survey that will produce honest feedback if you avoid the survey blunders listed above. A win-win situation for you and your customers!

Explore all the survey question types
possible on Voxco

Read more

Regression-Analysis1

Exponential Regression

Exponential Regression Get started with your research today. Book a quick call with our experts. Schedule a Call SHARE THE ARTICLE ON Table of Contents ...

Shopping Basket
Great Research
Fast Insights
Best-in-class ROI

Voxco’s platform helps you gather omnichannel feedback, measure sentiment, uncover insights and act on them.

Join 500 + global clients across 40+ countries

Great Research
Fast Insights
Best-in-class ROI

Voxco’s platform helps you gather omnichannel feedback, measure sentiment, uncover insights and act on them.

Join 500 + global clients across 40+ countries