Web Survey Bibliography
Interactive web questionnaires promise to improve survey measurement relative to more static modes, whether online or paper. By designing questionnaires that react to respondent actions, it may be possible to promote behavior that leads to more accurate responses. We are investigating one type of interactivity, namely giving feedback to respondents (―speeders‖) when they answer so fast they cannot realistically have read the question let alone thought about the answer (―You seem to have responded very quickly. Please be sure you have given the question sufficient thought to provide an accurate answer.‖). In prior research (reported at AAPOR, 2009) we observed that some speeders answered questions about quantities (e.g., ―Overall, how many overnight trips have you taken in the PAST 2 YEARS?‖) more slowly when they were prompted once or twice; hardcore speeders never slowed down. We were encouraged by the slowdown for at least some respondents but could not be sure it reflected higher quality data. In the current research (n=2565) we explored the relationship between response time and quality by prompting speeders on simple numeracy items for which we could determine response accuracy (e.g., ―If the chance of getting a disease is 10%, how many people out of 100 would be expected to get the disease: 1, 10 or 20?‖). Prompting slowed some speeders AND increased their response accuracy, suggesting that in the earlier studies the slowdown also improved data quality. The benefits of prompting seemed to persist beyond the intervention itself as it reduced straightlining on later grid questions. Psychologically, interactive interventions seem to work differently than simple instructions. We randomly asked half of the respondents to commit to answering conscientiously; this slowed their responses but did not increase accuracy or interact with prompting. Overall, the current work illustrates the promise of interactive interventions for improving online measurement.
Conference Homepage (abstract)
Web survey bibliography (4086)
- Comparing Numeric and Text Open-End Responses in Mail and Web Surveys.; 2011; Olson, K., Smyth, J.
- Effects of Response Formats when Measuring Attitudes in Consumer Web Surveys Across Markets.; 2011; Couper, M. P., Nunge, E.
- Re-Examining the Validity of Different Survey Modes for Measuring Public Opinion in the U.S.: Findings...; 2011; Ansolabehere, S., Fraga, B., Schaffner, B. F.
- How to Survey All 14 000 Swedish Local Political Representatives And Get 10 000 Responses.; 2011; Gilljam, M., Granberg, D., Holm, B., Persson, M.
- Measuring User Satisfaction in the Lab: Questionnaire Mode, Physical Location, and Social Presence Concerns...; 2011; Jans, M., Romano, J. C., Ashenfelter, K. T., Krosnick, J. A.
- Interactive interventions in web surveys can increase response accuracy.; 2011; Conrad, F. G.
- Impact on Data Quality of Making Incentives Salient in Web Survey Invitations.; 2011; Zhang, Che.
- Effects of Mode and Incentives on Response Rates, Costs, and Response Quality in a Mixed Mode Survey...; 2011; Stevenson, J., Dykema, J., Kniss, C., Black, P., Moberg, P.
- Effects of Differential Incentives on Response Rates in Four Countries for a Web-based Follow Up Survey...; 2011; McSpurren, K.
- Completing Web Surveys on Cell-enabled iPads.; 2011; Dayton, J., Driscoll, H.
- The Social Aspect of the Digital Divide; 2011; Johnson, E. P.
- Which Technologies Do Respondents Use in Online Surveys – An International Comparison?; 2011; Kaczmirek, L., Behr, D., Bandilla, W.
- Matrix Questionnaire Design to Reduce Measurement Error; 2011; Peytchev, A., Peytcheva, E.
- Race-of-Virtual-Interviewer Effects; 2011; Conrad, F. G., Schober, M. F., Nielsen, D.
- Which Web Survey Respondents Are Most Likely to Click for Clarification?; 2011; Coiner, T., Schober, M. F., Conrad, F. G.
- Providing Clarifying Instructions in a Web Survey; 2011; Redline, C. D.
- Does social desirability compromise self-reports of physical activity in web-based research?; 2011; Crutzen, R., Goeritz, A.
- Use of new technologies in social research: Self-administered mobile surveys; 2011; Bosnjak, M.
- An Alternative to the Response Rate for Measuring a Survey's Realization of the Target Population; 2011; Skalland, B.
- Should I Stay or Should I go: The Effects of Progress Feedback, Promised Task Duration, and Length of...; 2011; Yan, T., Conrad, F. G., Tourangeau, R., Couper, M. P.
- Internet-Based Follow-Up Questionnaire for Measuring Patient-Reported Outcome after Total Hip Replacement...; 2011; Rolfson, O., Salomonsson, R., Garellick, G., Dahlberg, L. E.
- Nonresponse in Web Surveys ; 2011; Lozar Manfreda, K., Berzelak, N., Vehovar, V.
- Kids' Life and Times: using an Internet survey to measure children's health-related quality...; 2011; Lloyd, K.
- Features of the Z-scoring method in graphical two-dimensional web surveys: the case of ZEF; 2011; Selkaelae, A., Ronkainen, S., Alasaarela, E.
- Can Verbal Instructions Counteract Visual Context Effects in Web Surveys?; 2011; Toepoel, V., Couper, M. P.
- Can Internet surveys help us understanding allergic disorders? – results from a large survey in...; 2011; Kalogeromitros, D., Psaltopoulou, T., Makris, M., Koti, I., Chliva, C., Stefanadi, E., Hatziagelaki,...
- Development and Pilot Testing of an Internet-Based Survey Instrument to Measure the Alcohol Brand Preferences...; 2011; Siegel, M., DiLoreto, J., Johnson, An., Fortunato, E. K., DeJong, W.
- Can web surveys provide an adequate alternative to phone and face to face surveys?; 2011; Bethlehem, J.
- Online qualitative approaches: an appraisal; 2011; Parker, Ke.
- E-survey (surveys based on e-mail & web) Analysis and identification of cold responsive proteins in...; 2011; Sodabeh, J.-G., Ferdous, R.-J., Lello, Z., Ghasem, K., Ghasem, H. S., Gholipoori, A., Siroos, M., Sajjad...
- Development of a web-based survey system for evaluating affective satisfaction ; 2011; Cho, Y., Han, S. H., Kang, S., Park, J.
- Nonresponse Error, Measurement Error, And Mode Of Data Collection: Tradeoffs in a Multi-mode Survey...; 2011; Sakshaug, J. W., Yan, T., Tourangeau, R.
- A Method for Evaluating Mode Effects in Mixed-mode Surveys; 2011; Vannieuwenhuyze, J., Loosveldt, G., Molenberghs, G.
- Handle with Care: The Impact of Using Java Applets in Web-Based Studies on Dropout and Sample Composition...; 2011; Stieger, S., Goeritz, A., Voracek, M.
- An overview of Internet-based surveys in hospitality and tourism journals; 2011; Hung, K., Law, R.
- Factorial trial found mixed evidence of effects of pre-notification and pleading on response to Web-...; 2011; Felix, L. M., Burchett, H. E., Edwards, P. J.
- Testing for measurement equivalence of human values across online and paper-and-pencil surveys; 2011; Davidov, E., Depner, F.
- Measuring Political Knowledge in Telephone and Web Surveys: A Cross-National Comparison; 2011; Strabac, Z., Aalberg, T.
- IVR and web administration in structured interviews utilizing rating scales: exploring the role of motivation...; 2011; Yang, Y., Callegaro, M., Bhola, D. S., Dillman, D. A.
- Social and Behavioral Research and the Internet: Advances in Applied Methods and Research Strategies; 2011; Das, M., Ester, P., Kaczmirek, L.
- Mode and Context Effects in Measuring Household Assets; 2011; van Soest, A., Kapteyn, A.
- Running experiments on Amazon Mechanical Turk; 2010; Paolacci, G., Chandler, J., Ipeirotis, P. G.
- Making Good Use of Survey Paradata; 2010; Lynn, P., Nicolaas, G.
- Questionnaire Length, Fatigue Effects and Response Quality Revisited; 2010; Cape, P. J.
- Preventing Satisficing in Online Surveys: A “Kapcha” to Ensure Higher Quality Data...; 2010; Chandler, D., Kapelner, A.
- Game on; 2010; Ewing, T.
- Respondent Engagement: How Much Does it Matter?; 2010
- The Internet and Social Inequalities; 2010; Mannon, S.E.; Witte, J. C.
- Need to Improve Routine HIV Testing of U.S. Veterans in Care: Results of an Internet Survey; 2010; Valdiserri, R. O., Nazi, K., McInnes, D. K., Ross, D., Kinsinger, L.
- The Prevalence of Chronic Pain in United States Adults: Results of an Internet-Based Survey; 2010; Johannes, C. B., Le, T. K., Zhou, X., Johnston, J. A., Dworkin, R. H.