Web Survey Bibliography
Relevance & Research Question: Open-ended questions are often used to gather short numeric information in self-administered web questionnaires. Respondents are encouraged to enter numbers, quantities or frequencies into input fields, most often without any computerized formatting constraints predominantly in order to prevent item nonresponse. However, the absence of any formatting restrictions encourages large variances in answers deviating from the desired format, including value ranges, estimations, alphanumeric supplements, or even different measuring units which affect data quality negatively, and increase the efforts for data cleansing and preparation. Thus, concise and clear formatting instructions are needed to guide respondents providing answers in the desired format. Considering the fact that instructions are likely to be ignored the question arises how different modes of verbal instructions and visual cues can be applied to improve the impact of formatting instructions, and finally to enhance data quality.
Methods & Data: In a between-subjects field experiment conducted among university freshman students in an opt-in panel (N=670), we tested different visual modes of formatting instructions in open-ended numeric questions: (1) conventional instruction in a static manner, (2) dynamic instruction in a tooltip appearing when the mouse cursor hovers over the input field, and (3) symbolic instruction in terms of pre-defined default values in the input field indicating the desired response format. The effectiveness of each instruction mode was determined by the proportion of formally correct answers.
Results: Findings indicated that the implementation of dynamic formatting elements in terms of tooltips or default values had no positive effect on an improvement of response quality compared to conventional static formatting instructions. Even a combination of tooltips and pre-filled symbols could not achieve a significant increase in correctly formatted answers compared to the sole presentation of a fixed instruction.
Added Value: The results indicated that static formatting instructions should not be replaced hastily without examining the effect of dynamic elements sufficiently. However, initial findings suggested the potential of dynamic formatting instructions in enhancing the positive effect of conventional instructions.
GOR Homepage (abstract) / (presentation)
Web Survey Bibliography (6797)
- Permission email messages significantly increase gambler retention; 2013; Jolley, W., Lee, A., Mizerski, R., Sadeque, S.
- How virtual corporate social responsibility dialogs generate value: A framework and propositions; 2013; Korschun, D., Du, S.
- Customer loyalty to a commercial website: Descriptive meta-analysis of the empirical literature and...; 2013; Toufaily, E., Ricard, L., Perrien, J.
- The moderating role of socio-semantic networks on online buzz diffusion; 2013; Lee, H., Lee, D. I., Kim, T., Kim, T., Lee, J.
- Discovering interest groups for marketing in virtual communities: An integrated approach; 2013; Wang, K. -Y., Wu, H. -J., Ting, I -H.
- “Translating” between survey answer formats; 2013; Dolnicar, S., Grün, B.
- Understanding service quality in a virtual travel community environment; 2013; Elliot, S., Li, G., Choi, C.
- Research note: E-store image, perceived value and perceived risk; 2013; Chang, E. -C., Tseng, Y. -F.
- Retail relationships in a digital age; 2013; Keeling, K., Keeling, D., McGoldrick, P.
- The Gamification of Marketing Researc; 2013; Donato, P., Link, M. W.
- Gamification Master Class; 2013; Puleston, J.
- Research Communities in Asia Pacific: A review of similarities and contrasts; 2013; Poynter, R.
- Measuring Up: Impact of mobile and segmentation on respondent behaviour; 2013; Luck, K.
- Best of Both Worlds? Can we make convenience samples representative?; 2013; Doe, P.
- Multimode, Global Scale Usage: Understanding respondent scale usage across borders and devices; 2013; Pettit, F. A., Courtright, M.
- Why Big Data is a Small Idea…and Why You Shouldn’t Worry So Much; 2013; Needel, S.
- Advanced Research Methods Training in the UK: Current Provision and Future Strategies; 2013; Moley, S., Wiles, R., Sturgis, P.
- Doing real time research: Opportunities and challenges; 2013; Back, L., Lury, C., Zimmer, R.
- ‘Digital Methods as Mainstream Methodology’: Building capacity in the research community...; 2013; Roberts, S., Hine, C., Morey, Y., Snee, H., Watson, H.
- New social media, new social science?; 2013; Woodfield, K., Morrell, G.
- Digital technology and data collection; 2013; Henriksen, B., Jewitt, C., Price, S., Sakr, M.
- The impact of website content dimension and e-trust on e-marketing effectiveness: The case of Iranian...; 2013; Rahimnia, F., Farzaneh Hassanzadeh, J.
- Service with an e-smile: Employee authenticity and customer use of web-based support services; 2013; Turel, O., Connelly, C. E., Fisk, G. M.
- Survey Breakoffs in a Computer-Assisted Telephone Interview; 2013; McGonagle, K.
- Developing a New Mixed-Mode Methodology For a Provincial Park Camper Survey in British Columbia; 2013; Dyck, B. W.
- Mode effect analysis and adjustment in a split-sample mixed-mode Web/CATI survey; 2013; Kolenikov, S., Kennedy, C.
- Exploring factors associated with respondent mode choice for surveys using mobile devices.; 2013; Walton, L.
- Responsive design for mixed-mode panel data; 2013; Bianchi, A., Biffignandi, S.
- Adjusting for bias in a mixed-mode CAWI survey on University students ; 2013; Clerici, R., Giraldo, A.
- Comparative analysis of data from web and face-to-face surveys. A case study on e-commerce in young...; 2013; Cappello, C., Pellegrino, D.
- Insights into Action Profiling shopping occasions for retailers through mobile and online research; 2013; Churkina, O., Morris, T.
- Mobilizing your Branded Panel: Panel data quality during the smartphone transition; 2013; Kugel, C., Brien, D., Blechman, J.
- Evaluating the left‐right dimension: Category Selection Probing conducted in an online access...; 2013; Huefken , V.
- From Face‐to‐face to Web: Consequences for Measurement of Complex and Open‐ended Questions...; 2013; Villar, A., Fitzgerald, R., Martin, P., Harrison, E., Gatrrell, L.
- Computers, Tablet & Smart Phones: The Truth about Web‐based Surveys; 2013; Merle, P., Gearhart, S., Craig, C., Rahimi, M., Brooks, M. E., Vandyke, M.
- Explaining Interview Duration in Web Surveys on Political Attitudes and Behavior: A Multilevel Approach...; 2013; Gummer, T., Rossmann, J.
- An Examination of the Relationship Between Pretest Method Results and Data Quality; 2013; Maitland, A.
- Associations Between Interactional Indicators of Problematic Questions and Systems for Coding Question...; 2013; Dykema, J., Schaeffer, N. C., Garbarski, D.
- The Technology Behind Mobile Research: Browsers vs. Apps ; 2013; Macer, T.
- Methodological, legal and technical perspectives on the feasibility of web survey paradata in German...; 2013; Sattelberger, S.
- Specific mixed-mode methodologies to include sensory disabled people in quantitative surveys; 2013; Sebastien, F., Marc, J., Patrick, I.
- An imputation approach for analyzing mixed-mode surveys; 2013; Kim, J. K., Park, S., Kim, S. Y.
- Investigating the Bias of Alternative Statistical Inference Methods in Sequential Mixed-Mode Surveys; 2013; Suzer-Gurtekin, Z., Heeringa, S. G., Valliant, R. L.
- Random versus Systematic Error in a Mixed Mode Online-Telephone Survey; 2013; Hox, J., Scherpenzeel, A., Boeve, A., Boeve, A., de Leeuw, E. D.
- Impact of mode design on reliability in longitudinal data; 2013; Cernat, A.
- Online Survey Participation via Mobile Devices: implications for nonresponse; 2013; Poggio, T., Bosnjak, M.
- Mobility and Smartphones: a pilot study of travel data collection among experienced and inexperienced...; 2013; Douhou, S., Scherpenzeel, A.
- Mobile devices a way to recruit hard-to-reach groups? Results from a pilot study comparing desk top...; 2013; Toepoel, V., Lugtig, P. J.
- The Relation of Survey Topic and Participation Behavior. Analyzing Unit Nonresponse using web-generated...; 2013; Zillmann, D., Schmitz, A., Blossfeld, H. P.
- The Attention Span of a Goldfish: Impacts of Survey Mobilization on Respondents ; 2013; Luck, K.