Web Survey Bibliography
Scope: This study focuses on measurement error, one component of error of observation in the framework of the total survey error (Groves et al., 2009). More precisely, this research is about is formatting error that occurs if a rating scale does not provide a perfectly matching response option (see Schwarz & Oyserman, 2001). Therefore data collected with two different closed-ended rating scales – conventional 5-point scales and graphical visual analogue scales (VASs) – were checked against each other. About VASs: The general advantages of VASs are (1) great sensitivity because of a great range, (2) data are less affected by error, leading to more statistical power (see Funke, 2010), and (3) there are far more possibilities for data analysis (e.g., recoding into odd and even number of categories, as well as into any empirical quantile). Study Design: Respondents (N = 460) completed a 40 item Big Five personality test (found at http://ipip.ori.org/ipip/). In a between-subjects design participants were randomly assigned to a questionnaire that was either made of 5-point scales or of VASs. The VASs used in the study were plain, horizontal lines with only the ends verbally anchored. They had a range of 250 values and they were generated with the free Web service VAS Generator (see http://vasgenerator.net).
Results: Overall, higher loadings on predicted factor and lower loadings on unpredicted factors lead to more explained variance with VASs in comparison to 5-point scales. The expected factor structure was considerably clearer with VASs than with 5-point scales.
Conclusion: This study adds further evidence that VASs can have a beneficial effect on data quality and that one should think about the general reluctance to use this rating scale. Overall, VASs’ positive scale characteristics should be taken advantage of in computerized data collection.
Conference Homepage (abstract)
Web survey bibliography - Funke, F. (19)
- Higher Item Nonresponse Rates Caused by Slider Scales in Web Surveys; 2015; Toepoel, V.; Funke, F.
- Investigating Response Quality in Mobile and Desktop Surveys: A Comparison of Radio Buttons, Visual...; 2014; Toepoel, V.; Funke, F.
- The Use of Paradata to Predict Future Cooperation in a Panel Study; 2014; Funke, F., Goeritz, A.
- HTML5 and mobile Web surveys: A Web experiment on new input types; 2013; Funke, F.
- Break-off and attrition in the GIP amongst technologically experienced and inexperienced participants...; 2013; Blom, A. G., Bossert, D., Clark, V., Funke, F., Gebhard, F., Holthausen, A., Krieger, U., Wachenfeld...
- Nonresponse and Nonresponse Bias in a Probability-Based Internet Panel; 2013; Blom, A. G., Bossert, D., Funke, F., Gebhard, F., Holthausen, A., Krieger, U.
- Enhancing Web Surveys With New HTML5 Input Types; 2012; Funke, F.
- Mobile Survey Participation Rates in Commercial Market Research: A Meta-Analysis; 2012; Bosnjak, M., Poggio, T., Becker, K. R., Funke, F., Wachenfeld, A., Fischer, B.
- High potential for mobile Web surveys: Findings from a survey representative for German Internet users...; 2012; Funke, F., Wachenfeld, A.
- Why semantic differentials in Web-based research should be made from visual analogue scales and not...; 2012; Funke, F., Reips, U.-D.
- Web-based rating scales: HTML 5 and other innovations; 2011; Funke, F.
- Ignoring the compatibility of online questionnaires may bias the psychological composition of your sample...; 2011; Funke, F.
- Explaining more variance with visual analogue scales: A Web experiment; 2011; Funke, F.
- Internet-Based Measurement With Visual Analogue Scales: An Experimental Investigation; 2010; Funke, F.
- Making small effects observable: Reducing error by using visual analogue scales; 2009; Funke, F., Reips, U.-D.
- Yes, VASs can! Increasing the accuracy of survey measurements with computerized visual analogue scales...; 2009; Funke, F., Reips, U.-D.
- Response Formats in Cross-cultural Comparisons in Web-based Surveys; 2009; Thomas, R. K.l, Terhanian, G., Funke, F.
- Using Audio and Video Clips in Web Surveys — Feasibility and Impact on Data Quality; 2007; Fuchs, M., Funke, F.
- Dynamic Forms: Online Surveys 2.0 ; 2007; Funke, F., Reips, U.-D.