Web Survey Bibliography
Respondents follow simple heuristics in interpreting the visual features of questions. The authors carried out two experiments in two panels to investigate how the effect of visual heuristics affects the answers to survey questions. In the first experiment, the authors varied the distance between scale points in a 5-point scale to investigate whether respondents use the conceptual or visual midpoint of a scale. In the second experiment, the authors used different end point labels of a 5-point scale, by adding different shadings of color and numbers that differed both in sign and value (2 to -2), to study whether options that are similar of appearance are considered conceptually closer than when they are dissimilar in appearance. The authors predicted that there is a hierarchy of features that respondents attend to, with verbal labels taking precedence over numerical labels, and numerical labels taking precedence over visual cues. The results confirmed the hypothesis: the effect of spacing of response options and different end points was only apparent in polar point scales and not in fully labeled scales. In addition, this study on two panels, with one consisting of extremely trained respondents and the other of relatively fresh respondents, shows that trained respondents are affected by the distance between response options whereas relatively new respondents are not. To reduce the effect of visual cues, taking into account the robustness of results, the authors suggest it is better to use fully labeled 5-point scales in survey questions.
Journal Homepage (abstract) / (full text)
Web Survey Bibliography - Social Science Computer Review (114)
- Comparing Survey Results Obtained via Mobile Devices and Computers: An Experiment With a Mobile Web...; 2013; de Bruijne, M., Wijnant, A.
- Cognitive Probes in Web Surveys: On the Effect of Different Text Box Size and Probing Exposure on Response...; 2013; Behr, D., Bandilla, W., Kaczmirek, L., Braun, M.
- Data Quality in PC and Mobile Web Surveys; 2013; Mavletova, A. M.
- The Design of Grids in Web Surveys; 2013; Couper, M. P., Tourangeau, R., Conrad, F. G., Zhang, C.
- How Do Lotteries and Study Results Influence Response Behavior in Online Panels?; 2013; Goeritz, A., Luthe, S. C.
- Mode Effects in Free-list Elicitation: Comparing Oral, Written, and Web-based Data Collection; 2013; Gravlee, C. C., Bernard, H. R., R., Jacobsohn, A., R.Maxwell, C. R.
- Combining Mail and E-Mail Contacts to Facilitate Participation in Mixed-Mode Surveys; 2012; Israel, G. D.
- Effects of E-Mailed Versus Mailed Invitations and Incentives on Response Rates, Data Quality, and Costs...; 2012; Dykema, J., Stevenson, J., Klein, L., Kim, Y., Day, B.
- The Effectiveness of Survey Recruitment Methods in Second Life; 2012; Dean, E., Cook, S., Murphy, J., Keating, M.
- Asking Probing Questions in Web Surveys: Which factors have an Impact on the Quality of Responses? ; 2012; Behr, D., Kaczmirek, L., Braun, M., Bandilla, W.
- Using the Internet to Administer More Realistic Vignette Experiments; 2012; Caro, F. G., Ho, T., McFadden, D., Gottlieb, A. S., Yee, C., Chan, T.,
- The Impact of Mobilization Media on Off-Line and Online Participation: Are Mobilization Effects Medium...; 2012; Vissers, S., Hooghe, M., Stolle, D., Maheo, V.-A.
- Succinct Survey Measures of Web-Use Skills; 2012; Hargittai, E., Hsieh, Y. P.
- Assessing the Effects of Technical Variance on the Statistical Outcomes of Web Experiments Measuring...; 2012; Brand, A., Bradley, M. T.
- The Effect of Invitation Design on Web Survey Response Rates; 2012; Kaplowitz, M. D., Lupi, F., Couper, M. P., Thorp, L.
- Survey Mode Effects on Data Quality: Comparison of Web and Mail Modes in a U.S. National Panel Survey...; 2012; Shin, E., Johnson, T. P., Rao, K.
- Online Data Collection in Developing Nations: An Investigation into Sample Bias in a Sample of South...; 2012; Payne, J., Barnfather, N.
- Conducting Internet Research With the Transgender Population: Reaching Broad Samples and Collecting...; 2012; Miner, M. H., Bockting, W. O., Swinburne Romine, R., Raman, S.
- How to Increase Response Rates in List-Based Web Survey Samples; 2012; Keusch, F.
- LinkedIn and Facebook in Belgium: The Influences and Biases of Social Network Sites in Recruitment and...; 2011; Caers, R., Castelyns, V.
- Researching Personal Information on the Public Web - Methods and Ethics; 2011; Wilkinson, D., Thelwall, M.
- Words, Numbers, and Visual Heuristics in Web Surveys: Is There a Hierarchy of Importance?; 2011; Toepoel, V., Dillman, D. A.
- Sliders for the Smart: Type of Rating Scale on the Web Interacts With Educational Level; 2011; Funke, F., Reips, U. -D., Thomas, R. K.
- Measuring Political Knowledge in Telephone and Web Surveys: A Cross-National Comparison; 2011; Strabac, Z., Aalberg, T.
- Response Rates and Data Quality in Web and Mail Surveys Administered to PhD Holders; 2011; Barrios, M., Villarroya, A., Borrego, A., Olle, C.
- Computer Literacy and the Accuracy of Substance Use Reporting in an ACASI Survey; 2010; Johnson, T. P., Fendrich, M., Mackesy-Amiti, M. E.
- Mobile Phones in an Environment of Competing Survey Modes: Applying Metric for Evaluation of Costs and...; 2010; Vehovar, V., Berzelak, N., Lozar Manfreda, K.
- Using Questionnaire Design to Fight Nonresponse Bias in Web Surveys; 2010; Vicente, P., Reis, E.
- Experiments in Mobile Web Survey Design - Similarities to Other Modes and Unique Considerations; 2010; Peytchev, A., Hill, C. A.
- Understanding the Willingness to Participate in Mobile Surveys: Exploring the Role of Utilitarian, Affective...; 2010; Bosnjak, M., Metzger, G., Graef, L.
- Social Network Services as Data Sources and Platforms for e-Researching Social Networks; 2009; Ackland, R.
- The Mode Effect in Mixed-Mode Surveys: Mail and Web Surveys; 2009; Börkan, B.
- Asking Factual Knowledge Questions: Reliability in Web-Based, Passive Sampling Surveys ; 2009; Elo, K.
- An Update on Survey Measures of Web-Oriented Digital Literacy; 2009; Hargittai, E.
- Differences in the Visual Design Language of Paper-and-Pencil Surveys Versus Web Surveys A Field Experimental...; 2009; Fuchs, M.
- The Influence of Topic Interest and Interactive Probing on Responses to Open-Ended Questions in Web...; 2009; Holland, J. L., Christian, L. M.
- Matching the Message to the Medium: Results from an Experiment on Internet Survey Email Contacts ; 2008; Klofstad, C. A., Boulianne, J. S., Basson, D.
- Prenotification in Web-Based Access Panel Surveys: The Influence of Mobile Text Messaging Versus E-Mail...; 2008; Bosnjak, M., Neubarth, W., Couper, M. P., Bandilla, W., Kaczmirek, L.
- How Demographic Characteristics Affect Mode Preference in a Postal/Web Mixed-Mode Survey of Australian...; 2007; Diment, K., Garrett-Jones, S.
- Reducing Nonresponse by SMS Reminders in Mail Surveys; 2007; Virtanen, V., Sirkiä, T., Jokiranta, V.
- Compensating for low topic interest and long surveys: A field experiment on nonresponse in Web surveys...; 2007; Marcus, B., Bosnjak, M., Lindner, S., Pilischenko, S., Schuetz, A.
- Drop Downs and Scroll Mice: The Effect of Response Option Format and Input Mechanism Employed on Data...; 2007; Healey, B.
- Lotteries as Incentives in Longitudinal Web Studies; 2007; Goeritz, A., Wolff, H.-G.
- Cash Lotteries as Incentives in Online Panels; 2006; Goeritz, A.
- An Evaluation of Nonresponse and Coverage Errors in a Prerecruited Probability Web Panel Survey; 2006; Lee, Sunghee
- Evaluating the Effectiveness of Visual Analog Scales: A Web Experiment; 2006; Couper, M. P., Tourangeau, R., Conrad, F. G., Singer, E.
- Web-Based Questionnaires and the Mode Effect: An Evaluation Based on Completion Rates and Data Contents...; 2006; Denscombe, M.
- Trust, Identity, and the Effects of Voting Technologies on Voting Behavior; 2005; Oostveen, A. M., Besselaar, P.
- Technology Trends in Survey Data Collection; 2005; Couper, M. P.
- When Methodology Interferes With Substance; 2005; Schoen, H., Faas, T.
