Web Survey Bibliography
Relevance & Research Question: Open-ended questions are often used to gather short numeric information in self-administered web questionnaires. Respondents are encouraged to enter numbers, quantities or frequencies into input fields, most often without any computerized formatting constraints predominantly in order to prevent item nonresponse. However, the absence of any formatting restrictions encourages large variances in answers deviating from the desired format, including value ranges, estimations, alphanumeric supplements, or even different measuring units which affect data quality negatively, and increase the efforts for data cleansing and preparation. Thus, concise and clear formatting instructions are needed to guide respondents providing answers in the desired format. Considering the fact that instructions are likely to be ignored the question arises how different modes of verbal instructions and visual cues can be applied to improve the impact of formatting instructions, and finally to enhance data quality.
Methods & Data: In a between-subjects field experiment conducted among university freshman students in an opt-in panel (N=670), we tested different visual modes of formatting instructions in open-ended numeric questions: (1) conventional instruction in a static manner, (2) dynamic instruction in a tooltip appearing when the mouse cursor hovers over the input field, and (3) symbolic instruction in terms of pre-defined default values in the input field indicating the desired response format. The effectiveness of each instruction mode was determined by the proportion of formally correct answers.
Results: Findings indicated that the implementation of dynamic formatting elements in terms of tooltips or default values had no positive effect on an improvement of response quality compared to conventional static formatting instructions. Even a combination of tooltips and pre-filled symbols could not achieve a significant increase in correctly formatted answers compared to the sole presentation of a fixed instruction.
Added Value: The results indicated that static formatting instructions should not be replaced hastily without examining the effect of dynamic elements sufficiently. However, initial findings suggested the potential of dynamic formatting instructions in enhancing the positive effect of conventional instructions.
GOR Homepage (abstract) / (presentation)
Web Survey Bibliography - Questionnaire design (1458)
- Adaptive survey designs to minimize survey mode effects. A case study on the Dutch Labour Force Survey...; 2013; Calinescu, M., Schouten, B.
- The challenge of a mixed-mode design survey and new IT tools application: the case of the Italian Structure...; 2013; Cardinaleschi, S., De Santis, S., Rocci, F., Spinelli, V.
- The Design of the Online Questionnaire of the Italian Population Census ; 2013; Tininini, L., Virgillito, A.
- Response Burden in Official Business Surveys: Measurement and Reduction Practices of National Statistical...; 2013; Giesen, D., Bavdaz, M., Loefgren, T., Raymond-Blaess, V.
- Web panel surveys – can they be designed and used in a scientifically sound way?; 2013; Svensson , J.
- How Does Online Survey Mode Affect Answers to Customer Feedback Loyalty Surveys?; 2013; Gupta, A., Lee, J.
- Model-Based Mode of Data Collection Switching from Internet to Mail in the American Community Survey; 2013; Chesnut, J.
- Proceedings of The 3rd International Conference: Quantitative And Qualitative Methodologies In The Economic...; 2013; Frangos, C. (ed.)
- How Mobile Stacks Up to Traditional Online: A Comparison of Studies; 2013; Knowles, R.
- Online Survey on Twitter: A Urological Experience; 2013; Dal Moro, F.
- Development of a Questionnaire and Cross-Sectional Survey of Patient eHealth Readiness and eHealth Inequalities...; 2013; Jones, R.
- Why respondents suffer if you're not mobile-ready; 2013; Knapton, K.
- Thoughts on retrieving information from open-ended questions; 2013; Luyens, S.
- Social media data demands a marriage of high-tech and high-touch; 2013; Waldheim, C., Stevens, N.
- How to make your questionnaire mobile-ready; 2013; Cape, P. J.
- Leveraging mobile and online qualitative to get inside shoppers’ heads; 2013; Bryson, J., Ritzo, J.
- A report on the Confirmit Market Research Software Survey 2013; 2013; Macer, T., Wilson, S.
- Interactive applets on the Web for methods and statistics; 2013; Reips, U. -D., McClelland, G.
- Can creative web survey questionnaire design improve the response quality?; 2013; Angelovska, J., Mavrikiou, P. M.
- Utilization of High-Technology to Collect Health Risk Assessment Information from Medicare Members:...; 2013; Freedman, D., VanderHorst, N.
- Respondent Behavior Logging: An Opportunity for Online Survey Design; 2013; Sjoestroem, J., Rahman, M. H., Rafiq, A., Lochan, R., Agerfalk, P. J.
- Methodological Issues in the Design of Online Surveys for Measuring Unethical Work Behavior: Recommendations...; 2013; Wouters, K., Maesschalck, J., Peeters, C. F. W., Roosen, M.
- Where Am I? A Meta-Analysis of Experiments on the Effects of Progress Indicators for Web Surveys; 2013; Villar, A., Callegaro, M., Yang, Y.
- Panel Conditioning in Difficult Attitudinal Questions; 2013; Binswanger, J., Schunk, D., Toepoel, V.
- Optimizing quality of response through adaptive survey designs; 2013; Schouten, B., Calinescu, M., Luiten, A.
- A Comparison of Data Quality Across Modes in a Mixed-Mode Collection of Administrative Records; 2013; Worthy, M., Mayclin, D.
- Internet visual media processing: a survey with graphics and vision applications; 2013; Hu, S.-M., Chen, T., Xu, K., Cheng, M.-M., Martin, R. R.
- Measuring the impact of the Web: Rasch modelling for survey evaluation; 2013; Annoni, P., Weziak-Bialowolska, D., Farhan, H.
- Encouraging Record Use For Financial Asset Questions In A Web Survey; 2013; Couper, M. P., Ofstedal, M. B., Lee, S.
- The Gamification of Marketing Researc; 2013; Donato, P., Link, M. W.
- Gamification Master Class; 2013; Puleston, J.
- Multimode, Global Scale Usage: Understanding respondent scale usage across borders and devices; 2013; Pettit, F. A., Courtright, M.
- Insights into Action Profiling shopping occasions for retailers through mobile and online research; 2013; Churkina, O., Morris, T.
- Evaluating the left‐right dimension: Category Selection Probing conducted in an online access...; 2013; Huefken , V.
- From Face‐to‐face to Web: Consequences for Measurement of Complex and Open‐ended Questions...; 2013; Villar, A., Fitzgerald, R., Martin, P., Harrison, E., Gatrrell, L.
- Explaining Interview Duration in Web Surveys on Political Attitudes and Behavior: A Multilevel Approach...; 2013; Gummer, T., Rossmann, J.
- An Examination of the Relationship Between Pretest Method Results and Data Quality; 2013; Maitland, A.
- Associations Between Interactional Indicators of Problematic Questions and Systems for Coding Question...; 2013; Dykema, J., Schaeffer, N. C., Garbarski, D.
- Impact of mode design on reliability in longitudinal data; 2013; Cernat, A.
- Mobile devices a way to recruit hard-to-reach groups? Results from a pilot study comparing desk top...; 2013; Toepoel, V., Lugtig, P. J.
- Adding Observation to Copy Testing with Kids; 2013; Hurley, B., Salo, M.
- Gamified Surveys: Journey Into Product Development; 2013; Adamou, B.
- The State of Technology in Market Research; 2013; Macer, T.
- Avatare in der Marktforschung: Effekte künst-licher Interviewer im Online-Interview; 2013; Luetters, H.
- Historic Resource Surveys and the Internet; 2013; The Center for Historic Architecture University of Houston Gerald D. Hines College of Architecture
- Effects of Sponsorship on Response: Mixed-Mode Web and Mail Surveying ; 2013; Edwards, M. L., Dillman, D. A., Smyth, J.
- Identifying and Mitigating Satisficing in Web Surveys: Some Experimental Evidence; 2013; Rossmann, J.
- Designing a Pilot to Introduce Web Collection in the UK Labour Force Survey; 2013; Merad, S.
- Data Collection Method Comparisons for the 2011 Fishing, Hunting, and Wildlife-Associated Recreation...; 2013; Herbstritt, M., Hornick, D.
- Comparing Questionnaire Pretesting Methods for the 2015 Population and Housing Census of Korea; 2013; Park, Y.