Members of the market research industry find themselves fighting tooth and nail for decent response rates and representative sample.
So when your study is about drug use, sexual behaviors, political and religious beliefs, or other sensitive topics, you’ll need to ensure that you’re doing everything possible to keep response rates steady.
Asking sensitive questions via surveys or interviews can be considered intrusive or offensive, regardless of what the respondent’s answer may be. And if the respondent feels that their response could be contrary to popular societal norms, they may be more inclined to provide a dishonest answer that conforms to their perception of normal (this is called ‘social desirability bias’). Compounding the issues of question intrusiveness and social desirability bias, respondents may not trust that their responses will remain anonymous, or that the data will be kept secure.
Sensitive questions can negatively affect three important survey measurements: overall response rates, single question decline rates, and response accuracy – due to a higher percentage of respondents who answer sensitive questions dishonestly. That means that the inclusion of sensitive questions in a survey needs to be handled in an intelligent and delicate way whenever possible. Fortunately, technology can help.
The chosen survey channel can compound the issues around sensitive questions. The selected channel can exponentially increase respondents’ hesitation to answering sensitive questions:
- Self-completion surveys (e.g. Voxco Online): in which respondents complete surveys on their own time and in privacy;
- Telephone interviews (e.g. Voxco CATI): in which survey call center interviewers ask respondents questions over the phone;
- Personal interviews (e.g. Voxco Mobile Offline): in which interviewers use mobile devices to ask respondents questions directly in a face-to-face setting.
In general, respondents are more likely to answer sensitive questions honestly via self-completion surveys. But there’s tremendous value in choosing personal interviews over self-completion surveys, or choosing a complimentary multichannel approach, so interviews should not be ruled out immediately.
Here are six ways to use technology to boost response rates and response accuracy on sensitive questions:
1. Channel selection
As we mentioned above, self-completion surveys that can be taken by respondents in privacy offer a better atmosphere of anonymity which helps respondents feel more comfortable answering sensitive questions. The elimination of an interviewer can also reduce the social desirability bias introduced by the presence of another person.
2. Multichannel studies
Your studies don’t need to stick to only one survey method. Using an integrated survey platform, you can target a single respondent database and follow sample across multiple channels. For example, after a phone interview is completed, invite a segment of the respondents to complete an online survey. The logic of the online survey can trigger follow-up questions based on their CATI responses and probe into more sensitive topics that respondents would be less likely to confide to an interviewer.
3. Live channel switching
Consider redirecting interviewees mid-interview to a self-completion channel to ask sensitive questions. This temporarily gives respondents the anonymity and privacy needed for sensitive topics. Redirect CATI respondents to an IVR system to answer a few sensitive questions using their phone keypad, then return them to the interviewer to finish the survey. Pass the CAPI tablet to respondents directly and let them enter their answers directly into the questionnaire without having to say the words aloud to an interviewer.
4. Live question wording changes
As your survey progresses, be sure to keep an eye on real-time response analytics. If you note significant drop off rates at a specific question, or higher-than-average item nonresponse rates on specific questions, take action! Alter question wording, and instantly push the updates live. Add in some language that emphasizes survey anonymity and data security when surveys start veering into sensitive territory. That’s the benefit of live survey updating.
5. Survey logic/flow changes
If early results show that respondents are being turned off by sensitive questions, you could also adjust the logic and flow of the survey. Move sensitive questions further into the survey to build more trust and rapport with respondents before they get to them. If you have a sensitive question earlier in the survey, trigger ease-in questions and language to show only for those respondents who chose ‘refuse’ on the first sensitive question. Or go the other way: build trust with those respondents who did answer the sensitive question by hiding demographic or identifying questions at the end of the survey that could make respondents feel that their responses will be connected back to them.
6. Data hosting
Sometimes it’s enough for respondents to know that the survey is anonymous. But other respondents could want assurances that their data is being stored with the highest possible security and encryption, or on internal servers versus stored “out there” in the cloud. So give them those assurances.
Use technology to maintain response rates!
In a period of declining response rates, it is likely that respondents will be even more reluctant to take part in surveys that tackle sensitive topics. And in an age of growing concerns over data security, those who do respond to your surveys could be less inclined to reveal potentially embarrassing information about themselves.
Even in self-administered surveys, respondents may still misreport or refuse answers on sensitive questions. But there are a number of ways to use survey technology to your advantage when asking the tough questions. Get in touch with the team at Voxco if you’d like to discuss more unique ways to use a flexible survey platform to collect sensitive respondent data.