Web Survey Bibliography
Relevance & Research Question: Self-administered online surveys put respondents into an essentially anonymous and uncontrolled response situation. This raises worries on potentially biased or uninformative answers, such as nondifferentiation – always using the same score on all items offered – which may harm the measurement accuracy of population statistics. Our presentation explores the question which respondents are inclined to give such answers.
Methods & Data: For our study, longitudinal observations from a large commercial online survey panel in The Netherlands were available: the Appreciation Panel (fieldwork by Intomart GfK on behalf of NPO, the Dutch Public Broadcasting Organisation. Nondifferentiation behavior was identified in every single survey of the panel for a time frame of six months in 2009 (totaling to 502,750 completed online questionnaires). In this way a history of panel (nondifferentiation) behavior was created for each of over 7,700 active panel members. Subsequently a cross-sectional online survey was designed to survey possible determinants of response behavior. The survey was conducted post-hoc with a stratified probability sample of 1,200 respondents.
Results: Analyses based on data from a large-scale online panel indicate that not only respondents’ perception of effort caused by a survey explains their behavior. Also more abstract social behavioral norms, individual moral obligations and the norm of ‘honest behavior’ are related to nondifferentiation behavior. However, extrinsic motivation to participate in the panel because of a monetary incentive is found unrelated. These results imply that survey researchers have somewhat limited ways to reduce the effects of factors causing uninformative behaviors. Using monetary incentives to encourage panel participation is not harmful to the quality of answers, but it is recommended to limit respondents’ perception of effort.
Added Value: Very few examples have been published about nondifferentiation in applied online market research. The method presented offers an example of applied research what respondents are inclined to give nondifferentiated responses and how nondifferentiation in combination with other indicators such as response time is used to identify low quality responses in online research.
Conference Homepage (abstract) / (presentation)
Web Survey Bibliography - Online qualitative research (808)
- Prison break: Releasing offline experiments from methodological constraints by transforming them into...; 2013; Förstel, H., Manthei, K., Mohnen, A., Berger, G.
- GESIS Online Panel Pilot: Results from a Probability-Based Online Access Panel; 2013; Kaczmirek, L., Bandilla, W., Schaurer, I., Struminskaya, B., Weyandt, K.
- How the screen-out influence the dropout of a commercial panel; 2013; Bartoli, B.
- Innovation in Data Collection: the Responsive Design Approach; 2013; Bianchi, A., Biffignandi, S.
- Break-off and attrition in the GIP amongst technologically experienced and inexperienced participants...; 2013; Blom, A. G., Bossert, D., Clark, V., Funke, F., Gebhard, F., Holthausen, A., Krieger, U., Wachenfeld...
- Nonresponse and Nonresponse Bias in a Probability-Based Internet Panel; 2013; Blom, A. G., Bossert, D., Funke, F., Gebhard, F., Holthausen, A., Krieger, U.
- Rewards - Money for Nothing?; 2013; Cape, P. J., Martin, P.
- Effects of incentive reduction after a series of higher incentive waves in a probability-based online...; 2013; Struminskaya, B., Kaczmirek, L., Schaurer, I., Bandilla, W.
- Timing of Nonparticipation in an Online Panel: The effect of incentive strategies; 2013; Douhou, S., Scherpenzeel, A.
- Measurement effects in mixed-mode panel surveys; 2013; Lugtig, P. J.
- Life history calendars - a viable method for web-based data collection?; 2013; Glasner, T., van der Vaart, W.
- Experiences from a probability-based Internet panel: Sample, recruitment and participation; 2013; Scherpenzeel, A.
- Participation and engagement in web surveys of the general population: An overview of challenges and...; 2013; Roberts, C.
- Online Research, Game On!; 2013; Puleston, J.
- Use of a Social Networking Web Site for Recruiting Canadian Youth for Medical Research; 2013; Chu, J. L., Snider, C. E.
- 'Ready to complete the survey on Facebook': Web 2.0 as a research tool in business studies; 2013; Gregori, A., Baltar, F.
- Online Instruments, Data Collection, and Electronic Measurements: Organizational Advancements; 2013; Bocarnea, M. C., Reynolds, R. A., Baker, J. D.
- The equivalence of Internet versus paper-based surveys in IT/IS adoption research in collectivistic...; 2013; Fang, J., Wen, C., Prybutok, V.
- How Do Lotteries and Study Results Influence Response Behavior in Online Panels?; 2013; Goeritz, A., Luthe, S. C.
- Sample composition discrepancies in different stages of a probability-based online panel; 2013; Bosnjak, M., Haas, I., Galesic, M., Kaczmirek, L., Bandilla, W., Couper, M. P.
- A Randomized Experiment Investigating the Suitability of Speech-Enabled IVR and Web Modes for Publicly...; 2012; Elliott, M. N., Brown, J. A., Lehrman, W. G., Beckett, M. K., Hambarsoomian, K., Giordano, L. A., Goldstein...
- Emerging Techniques of Respondent Engagement: Leveraging Game and Social Mechanics for Mobile Application...; 2012; Lai, J. W., Vanno, L.
- Interactive and Gaming Techniques to Improve Surveys; 2012; Dean, E., Sage, A., Lai, J. W., Link, M. W., Richards, A., Vanno, L., Henning, J.
- Especially for You: Motivating Respondents in an Internet Panel by Offering Tailored Questions; 2012; Oudejans, M.
- Social media as a data collection tool: the impact of Facebook in behavioural research; 2012; Zoppos, E.
- The war against unengaged online respondents; 2012; Gittelman, S. H., Trimarchi, E.
- Qualitatively Speaking: The five absolute, no-excuse must-dos for online qualitative researchers; 2012; Rossow, A.
- Can Microtargeting Improve Survey Sampling? An Assessment of Accuracy and Bias in Consumer File Marketing...; 2012; Pasek, J.
- Survey Interviewing: Deviations from the Script; 2012; Schaeffer, N. C.
- Specific mixed-mode methodology to reach sensory disabled people in quantitative surveys; 2012; Fontaine, S.
- Multi-Language Multi-Continent B2B Community Panel: How B2B research can effectively span the world; 2012; Morden, M., Accomando, E.
- Can Survey Gaming Techniques Cross Continents? Examining cross cultural reactions to creative questioning...; 2012; Puleston, J.
- Facing The Future Webcams as a survey tool in China; 2012; Gordon, A., Llewellyn, T., Gu, E.
- Dimensions of Online Survey Data Quality What really matters?; 2012; Puleston, J., Eggers, M.
- Measuring Work Activities and Skill Requirements of Occupations: Experiences from a European Pilot Study...; 2012; Tijdens, K., De Ruijter, E., De Ruijter, J.
- An assessment of equivalence between Internet and paper-based surveys: evidence from collectivistic...; 2012; Fang, J., Wen, C., Prybutok, V.
- Using screen video capture software to aide and inform cognitive interviewing; 2012; Chaney, B. H., Barry, A. E., Chaney, J. D., Stellefson, M. L., Webb, M. C.
- E-Mail Surveys; 2012; Mesch, G.
- Does survey experience affect respondents’ reported level of satisfaction?; 2012; Schultz Christensen, A., Ladenburg, J.
- Evaluation of an online (opt-in) panel for public participation geographic information systems surveys...; 2012; Brown, G., Weber, D., Zanon, D., de Bie, K.
- Developing an Online GIS-based Survey Instrument to Elicit Perceived Neighborhood Information for Environmental...; 2012; Carr, J., Johnson, I., Keene, R., Landry, P., Gradeck, R., Lucht, J., Beach, S., Clougherty, J.
- Studying Migrants with the Help of the Internet: Methods from Psychology; 2012; Reips, U. -D., Buffardi, L.
- Panel Conditioning in Online Survey Panels: Problems of Increased Sophistication and Decreased Engagemeent...; 2012; Adams, A. N., Atkeson, L. R., Karp, J. A.
- Efficiency of Different Recruitment Strategies for Web Panels; 2012; Hansen, K. M., Pedersen, R. T.
- Improving Representativeness In Online Surveys Using A Combined Internet/Postal Approach: Evidence From...; 2012; Atorough, P., Donaldson, B., Harris, A.
- Surveying Rare Populations Using a Probabilitybased Online Panel; 2012; Peugh, J., Wright, G.
- Nonresponse and Online Student Evaluations of Teaching: Understanding the Inﬂuence of Salience...; 2012; Adams, M. J. D., Umbach, P. D.
- Innovation der Online-Datenerhebung für wissenschaftliche Forschungen. Das niederländische MESS-Projekt...; 2012; Das, M.
- Do Questions about Watching Internet Pornography Make People Watch Internet Pornography? A Comparison...; 2012; Peter, J., Valkenburg, P. M.
- “I think I know what you did last summer” Improving data quality in panel surveys; 2012; Lugtig, P. J.