Chapter 1: Understanding Non-Response in Surveys

Crafting online health research surveys is already a challenging task, and dealing with low response rates can make it feel nearly impossible to gather reliable data. Several factors influence non-response rates, with the perceived burden of participation and incentives being two of the most significant.

Burden of Participation

The perceived burden of completing a survey plays a crucial role in whether individuals choose to participate. While many assume that the length of a survey directly correlates with this burden, research indicates that this relationship is not straightforward. Studies have suggested that the perceived value of the survey can also affect how burdensome it feels to participants. For instance, individuals who see the survey as beneficial report lower levels of burden, whereas those who perceive it as intrusive tend to feel more burdened.

Role of Incentives

Incentives can significantly influence response rates. Surprisingly, even a modest incentive of $1 to $2 can enhance cooperation and lower non-response rates. Moreover, incentives don't always have to be monetary; participants are often motivated by altruistic reasons, interest in the survey topic, or the promise of receiving information post-survey. This highlights the importance of appealing to the intrinsic motivations of potential respondents.

How to Improve Survey Response Rates Like a Market Research Pro

This video provides valuable insights and practical tips on enhancing survey response rates, drawing from expert market research strategies.

Avoiding Agreement Bias

Certain question formats can inadvertently lead to biases in responses. For example, yes/no questions can increase acquiescence bias, where respondents tend to agree with statements regardless of their true opinions. To enhance data quality, it’s advisable to minimize the use of these types of questions.

Mitigating Demand Bias

When providing options for responses, it's essential to present them neutrally. If one option sounds significantly better or worse than another, it may lead to demand bias, where participants answer based on what they think the researcher wants to hear. Careful wording and balanced options can help reduce this risk.

Addressing Extreme and Neutral Response Bias

Researchers often encounter extreme response bias, particularly in sliding scale questions, where participants may gravitate towards the ends of the scale or choose a neutral position. Factors like the scale's design, its length, and its visual layout can all impact how respondents interpret the scale. Clear language and defined measures can help clarify meanings, ensuring more accurate responses.

Awareness of these biases may not allow for perfect survey design, but it will aid in better interpreting the collected data.

You can create secure, HIPAA-compliant surveys easily with Honeybee Forms, our intuitive survey builder. It's included at no extra cost to help enhance the quality of participants engaging with Honeybee.

Chapter 2: Enhancing Survey Participation

Getting More People to Take Your Surveys: 8 Ways to Optimize Response Rates

This video outlines eight effective strategies to increase survey participation, ensuring that you gather more comprehensive and reliable data.

References

1. Read “Nonresponse in Social Science Surveys: A Research Agenda” at NAP.Edu. doi:10.17226/18293

3. Hinz A, Michalski D, Schwarz R, Herzberg PY. The acquiescence effect in responding to a questionnaire. Psychosoc Med. 2007;4:Doc07.

5. Meisenberg G, Williams A. Are acquiescent and extreme response styles related to low intelligence and education? Personality and Individual Differences. 2008;44(7):1539–1550. doi:10.1016/j.paid.2008.01.010
6. DeCastellarnau A. A classification of response scale characteristics that affect data quality: a literature review. Qual Quant. 2018;52(4):1523–1559. doi:10.1007/s11135–017–0533–4