Web Survey Bibliography
There are several alternative response formats available to the Web survey designer. These include radio button, check boxes, drop boxes and text fields. The choice of these HTML form elements is often made with little consideration of measurement error, but rather for reasons of efficiency or space. In this paper we explore three common forms of presenting response options to a single choice question. Specifically, we examine a series of radio buttons, a drop box with none of the items initially displayed until the respondent clicks on the box, and a scrollable drop box with five of the ten options initially visible, requiring the respondent to scroll to see the remainder of the items. In addition we reversed the order of the response options for half of the sample, yielding a 3*2 experimental design. This experiment was embedded in a survey administered to a sample from an online panel administered by Survey Sampling, Inc., yielding over 2,500 respondents, with random assignment to the six conditions. We explore the effect of order and format on the responses obtained to two different questions, one on breakfast cereal nutrients and the other on desirable automobile features. We discuss the implications of our findings both for Web survey design and for the literature on response effects and satisficing. We generally find support for the primacy effects found in the literature on visually-presented items, but also find some surprises in terms of the effect of format and in terms of the time taken to complete the items.
Homepage - conference (abstract)
Journal Homepage (abstract) / (full text)
2003
Conferences, workshops, tutorials, presentations
Web survey bibliography - Social Science Computer Review (82)
- Displaying Videos in Web Surveys: Implications for Complete Viewing and Survey Responses; 2017; Mendelson, J.; Lee Gibson, J.; Romano Bergstrom, J. C.
- Examining Completion Rates in Web Surveys via Over 25,000 Real-World Surveys; 2017; Liu, M.; Wronski, L.
- Article Establishing an Open Probability-Based Mixed-Mode Panel of the General Population in Germany...; 2017; Bosnjak, M.; Dannwolf, T.; Enderle, T.; Schaurer, I.; Struminskaya, B.; Tanner, A.; Weyandt, K.
- Why Do Web Surveys Take Longer on Smartphones?; 2016; Couper, M. P.; J. J.Peterson, G. J.
- Do Initial Respondents Differ From Callback Respondents? Lessons From a Mobile CATI Survey; 2016; Vicente, P.; Marques, C.
- Thinking Inside the Box Visual Design of the Response Box Affects Creative Divergent Thinking in an...; 2016; Mohr, A. H.; Sell, A.; Lindsay, T.
- What is the gain in a probability-based online panel to provide Internet access to sampling units that...; 2016; Revilla, M.; Cornilleau, A.; Cousteaux, A-S.; Legleye, S; de Pedraza, P.
- The Dynamic Identity Fusion Index: A New Continuous Measure of Identity Fusion for Web-Based Questionnaires...; 2016; Jimenez, J.; Gomez, A.; Buhrmester, M.; Whitehouse, H.; Swann, W. B.
- When Should I Call You? An Analysis of Differences in Demographics and Responses According to Respondents...; 2016; Vicente, P.; Lopes, I.
- Solving the Nonresponse Problem With Sample Matching?; 2016
- Does the Inclusion of Non-Internet Households in a Web Panel Reduce Coverage Bias?; 2016; Eckman, S.
- Respondent Conditioning in Online Panel Surveys: Results of Two Field Experiments; 2016; Struminskaya, B.
- Measuring Political Knowledge in Web-Based Surveys: An Experimental Validation of Visual Versus Verbal...; 2015; Munzert, S.; Selb, P.
- A Review of Issues in Gamified Surveys; 2015; Keusch, F.; Zhang, Che.
- Metrics and Design Tool for Building and Evaluating Probability-Based Online Panels; 2015; DiSogra, C.; Callegaro, M.
- Response Effects of Prenotification, Prepaid Cash, Prepaid Vouchers, and Postpaid Vouchers: An Experimental...; 2015; van Veen, F.; Goeritz, A.; Sattler, S.
- The Influence of the Answer Box Size on Item Nonresponse to Open-Ended Questions in a Web Survey ; 2015; Zuell, C.; Menold, N.; Koerber, S.
- What are the Links in a Web Survey Among Response Time, Quality, and Auto-Evaluation of the Efforts...; 2015; Revilla, M.; Ochoa, C.
- Comparing a Cell Phone Survey and a Web Survey of University Students ; 2015; Couper, M. P.; Kim, S.; Woo, Y.
- Improving Survey Response Rates in Online Panels Effects of Low-Cost Incentives and Cost-Free Text Appeal...; 2014; Pedersen, M. J., Nielsen, C. V.
- The Influence of the Answer Box Size on Item Nonresponse to Open-Ended Questions in a Web Survey; 2014; Zuell, C., Menold, N., Koerber, S.
- What are the Links in a Web Survey Among Response Time, Quality, and Auto-Evaluation of the Efforts...; 2014; Revilla, M., Ochoa, C.
- Recruitment of Sex Buyers: A Comparison of the Efficacy of Conventional and Computer Network-Based Approaches...; 2013; Kolar, K., Atchison, C.
- Data Quality in PC and Mobile Web Surveys; 2013; Mavletova, A. M.
- Combining Mail and E-Mail Contacts to Facilitate Participation in Mixed-Mode Surveys; 2013; Israel, G. D.
- Effects of E-Mailed Versus Mailed Invitations and Incentives on Response Rates, Data Quality, and Costs...; 2013; Dykema, J., Stevenson, J., Klein, L., Kim, Y., Day, B.
- How Do Lotteries and Study Results Influence Response Behavior in Online Panels?; 2013; Goeritz, A., Luthe, S. C.
- Mode Effects in Free-list Elicitation: Comparing Oral, Written, and Web-based Data Collection; 2013; Gravlee, C. C., Bernard, H. R., R., Jacobsohn, A.Maxwell, C. R.
- Using the Internet to Administer More Realistic Vignette Experiments; 2012; Caro, F. G., Ho, T., McFadden, D., Gottlieb, A. S., Yee, C., Chan, T.,
- Succinct Survey Measures of Web-Use Skills; 2012; Hargittai, E., Hsieh, Y. P.
- LinkedIn and Facebook in Belgium: The Influences and Biases of Social Network Sites in Recruitment and...; 2011; Caers, R., Castelyns, V.
- Measuring Political Knowledge in Telephone and Web Surveys: A Cross-National Comparison; 2011; Strabac, Z., Aalberg, T.
- Using Questionnaire Design to Fight Nonresponse Bias in Web Surveys; 2010; Vicente, P., Reis, E.
- Asking Factual Knowledge Questions: Reliability in Web-Based, Passive Sampling Surveys ; 2009; Elo, K.
- An Update on Survey Measures of Web-Oriented Digital Literacy; 2009; Hargittai, E.
- The Influence of Topic Interest and Interactive Probing on Responses to Open-Ended Questions in Web...; 2009; Holland, J. L., Christian, L. M.
- How Demographic Characteristics Affect Mode Preference in a Postal/Web Mixed-Mode Survey of Australian...; 2007; Diment, K., Garrett-Jones, S.
- Reducing Nonresponse by SMS Reminders in Mail Surveys; 2007; Virtanen, V., Sirkiä, T., Jokiranta, V. Sirkia, T.
- Compensating for low topic interest and long surveys: A field experiment on nonresponse in Web surveys...; 2007; Marcus, B., Bosnjak, M., Lindner, S., Pilischenko, S., Schuetz, A.
- Drop Downs and Scroll Mice: The Effect of Response Option Format and Input Mechanism Employed on Data...; 2007; Healey, B.
- Cash Lotteries as Incentives in Online Panels; 2006; Goeritz, A.
- When Methodology Interferes With Substance; 2005; Schoen, H., Faas, T.
- From Crayons to Computers: The Evolution of Computer use in Redistricting; 2005; Altman, M., MacDonald, K., McDonald, M.
- Survey Measures of Web-Oriented Digital Literacy; 2005; Hargittai, E.
- The Labelling Game: A Conceptual Exploration of Deviance on the Internet; 2005; Denegri-Knott, J., Taylor, J.
- E-Mail Contacts: A Test of Complex Graphical Designs in Survey Research; 2004; Whitcomb, M. E., Porter, S. R.
- Impacts of the Use of E-Mail and the Internet on Personal Trip-Making Behavior; 2004; Tonn, B. E., Hemrick, A.
- How You Ask Counts: A Test of Internet-Related Components of Response Rates to a Web-Based Survey; 2004; Trouteaud, A. R.
- Using the Online Medium for Discursive Research About People With Disabilities; 2004; Bowker, N., Tuffin, K.
- Classifying and Coding Online Actions.; 2004; Hargittai, E.