Web Survey Bibliography
Title Ein online Experiment: Varianten der online Fragebogengestaltung und ihr Einfluss auf die Bearbeitungseffizienz
Author Sabin, S., Jirasko, M.
Year 2005
Access date 22.04.2005
Abstract Please remember your last online study! How many questions did you pool on a page? Did you use small radios or did you prefer large buttons? And did you use the often criticised matrix format? The decision for either format may be based on methodical considerations (e.g. number of drop outs), but the usability and the ease of questionnaire development may also influence this decision. The mode "one question per page" seems to be quite advantageous, since a comprehensive drop out analysis can be done. To further investigate participant satisfaction and time efficiency of this mode an online experiment was conducted. Furthermore, this experiment was designed to test which kind of input field and layout would be preferable in regards to the above criteria of usability and time efficiency. The experiment consisted of a questionnaire, which was presented in five different modes. The participants were randomly assigned to the different modes. The handling time and assessment of the usability of the modes were recorded. The modes vary in regards to the number of questions presented on one page (one question per page, several questions per page so that scrolling is not necessary, all questions on one page), the input fields (radios, buttons) and the layout. The experiment lasted 4 weeks, and 93 participants answered all questions. Statistically significant differences in handling time were found for the five modes. The shortest handling time was observed for the questionnaire in the mode "one question per page" using buttons as input fields. Statistically significant differences between the five modes were also found for the retrospectively rated efficiency. The highest efficiency was again reported for the mode "one question per page" with buttons as input fields. The worst rating was assigned to the mode "one question per page" with radios as input fields. Altogether the mode "one question per page" can be recommended, if buttons are used as input fields, and if a high performance server and fast internet connection are available.
Abstract - optional Bitte erinnern Sie sich an Ihre letzte Online Untersuchung! Wie viele Fragen haben Sie auf einer Seite zusammengefasst? Haben Sie die kleinen Radios verwendet oder große Buttons? Und verwenden Sie das oft kritisierte Matrixformat? Die Entscheidung für die eine oder andere Variante mag auf Grund von methodischen Aspekten (Drop Out Analyse) getroffen werden, aber auch Überlegungen zur Usability oder einfach die Ökonomie der Fragebogenerstellung mögen die Hauptentscheidungskriterien gewesen sein. Bisher fehlten noch klare Belege dafür, ob die, aus methodischen Aspekten vorteilhafteste Variante - eine Frage pro Seite - ,von den Teilnehmern auch zeiteffizient bearbeitet werden kann und angenommen wird. Außerdem sollte noch zur Klärung der Frage beigetragen werden, welche Art der Eingabefelder und Form des Layouts hinsichtlich Bearbeitungszeit und Beliebtheit bei den Teilnehmern zu bevorzugen ist. Deswegen wurde ein online Experiment durchgeführt in dem 5 verschiedene Darbietungsformen bewertet und die Bearbeitungszeit gemessen wurde. Diese Formen variieren in der Anzahl der Fragen je Seite (eine Frage pro Seite, mehrere Fragen, jedoch ohne Scrollen, alle Fragen auf einer Seite), den verwendeten Antwortfeldern (Radios, Buttons) und bzw. oder dem Layout (Matrixform). Am Experiment nahmen im Zeitraum von 4 Wochen insgesamt 93 Personen vollständig teil. Es zeigten sich signifikante Unterschiede in der (objektiven) Bearbeitungszeit eines Fragebogens zur Bedeutung des Internets, je nachdem in welcher Darbietungsform er präsentiert wurde. Dabei konnte die Bearbeitungszeit des Fragebogens in der Variante "eine Frage pro Seite" mit Buttons deutlich gesenkt werden. Der erlebte Aufwand des Fragebogens und die Bewertung unterschieden sich ebenfalls überzufällig, abhängig von den verschiedenen Darbietungsformen. Am wenigsten aufwendig erschien wieder die Variante "eine Frage pro Seite" mit Buttons, die schlechteste Bewertung erhielt die Variante "eine Frage pro Seite" mit Radios. Insgesamt kann man sowohl aufgrund von methodischen als auch usability Überlegungen die Variante "eine Frage pro Seite" empfehlen, sofern Buttons verwendet werden und ein high speed Server mit guter Verbindung vorhanden ist.
Access/Direct link Homepage - conference (abstract)
Year of publication2005
Bibliographic typeConferences, workshops, tutorials, presentations
Web Survey Bibliography - 2005 (418)
- Data Quality Issues in a Multimode Survey; 2005; Wilson, C., Wright, D., Barton, T., Guerino, P.
- Web Survey Methodologies: A Comparison of Survey Accuracy; 2005; Krosnick, J. A., Nie, N., Rivers, D.
- Non-interviews in Mobile Phone Surveys; 2005; Vehovar, V.
- Quality Assessed: Cellular Phone Surveys versus Traditional Telephone Surveys; 2005; Steeh, C. G.
- Testing the Impact of Caller ID Technology on Response Rates in a Mixed Mode Survey; 2005; Trussell, N., Lavrakas, P. J.
- Re-examining Approaches to Achieving High Response Rates on Web-based Surveys of Post-secondary Students...; 2005; Lodato, B. N., Ghadialy, R.
- Qualitative Comparison of Paper and Online Self-Administered Modes; 2005; Grigorian, K. H., Sederstrom, S.
- Evaluating Nonsampling Errors in a Study Comparing Data Collected by Mail and Using the Web; 2005; Lesser, V. M., Newton, L.
- Effectiveness of E-mail and Paper Mail Notifications for Internet Surveys; 2005; Ruggiere, P., Ver Duin, D'Arlene
- Transforming a Paper Survey into a Web-based Survey: Respondent Experiences; 2005; Luyegu, A.
- A Profile of Self-Selecting Web Respondents; 2005; Guerino, P.
- What's Up Doc? Mixing Web and Mail Methods in a Survey of Physicians; 2005; Beebe, T. J., Locke, G. R., Barnes, S. A.
- Predicting Smapled Respondents' Likelihood to Cooperate in a Mail Survey: Part III; 2005; Burks, A. T., Lavrakas, P. J., Bennett, M.
- Sound Bytes: Capturing Audio in Survey Interviews; 2005; Hansen, S. E., Krysan, M., Couper, M. P.
- (Inter) Net Gain? Experiments to Increase Web-Based Response; 2005; Tourkin, S., Cox, S., Parmer, R., Zukerberg, A.
- Does Type of Pre-Notification Affect Web Survey Response Rates?; 2005; Harmon, M., Westin, E., Levin, K.
- Did You Get The Message? Using E-Mail and SMS for Prenotification in Web Surveys; 2005; Neubarth, W., Bosnjak, M., Bandilla, W., Couper, M. P., Kaczmirek, L.
- Analysis of Break-off Patterns in Web Surveys; 2005; Ahsan, S., Broach, R. J.
- The Effect of Incentives on Two Physician Mail Surveys: A Response Rate Comparison; 2005; Christian, J.
- Value and Timing Strategies in Prize Draws: A Further Examination of the Immediacy Effect in Web Surveys...; 2005; Tuten, T. L., Galesic, M., Bosnjak, M.
- Comparative Analyses of Parallel Paper, Phone, and Web Surveys With and Without Incentives: What Differences...; 2005; Olsen, D., Call, V., Wygant, S.
- Characteristics Related to Cell Phone Status: Why Generation Y Should be Targeted; 2005; Hancock, L.
- The Labelling Game: A Conceptual Exploration of Deviance on the Internet; 2005; Denegri-Knott, J., Taylor, J.
- Mode Effects for Hybrid Telephone/Internet Surveys and Reaching Cellphone-Only Households; 2005; Kulp, D., Herrmann, M., Dutwin, D., Lavine, S.
- In Search of Equivalency across Modes: Experimental Results Comparing Alternative Question Formats for...; 2005; Christian, L. M., Dillman, D. A., Smyth, J. D.
- Survey Mode Effects: Comparison between Telephone and Web; 2005; Speizer, H., Baker, R. P., Schneider, K.
- How Does Social Desirability Affect Responses?: Differences in Telephone and Online Surveys; 2005; Taylor, H., Krane, D., Thomas, R. K.
- Young Cell Phone Users and Voting Behavior in Georgia in 2004; 2005; Bason, J. J.
- Comparing Check-All and Forced-Choice Question Formats in Web Surveys: The Role of Satisficing, Depth...; 2005; Smyth, J. D., Dillman, D. A., Christian, L. M., Stern, M. J.Chou, C.; de Rouvray, C.Christianson DeMay...
- Improving Web Based Intercept Surveys: A Framework For The Active User Sampling; 2005; Kaczmirek, L., Neubarth, W.
- Comparing the Knowledge Networks Web-Enabled Panel and the In-Person 2002 General Social Survey: Experiments...; 2005; Smith, T. W., Li, R. J., Pulliam, P.
- Data Collection Mode Effects Controlling for Sample Origins in a Panel Study: Telephone versus Internet...; 2005; Dennis, J. M., Chatt, C.Li, R. J.; de Rouvray, C.Pulliam, P.; de Rouvray, C.
- Translucent is the mind of the web user; 2005; Britschgi, M.
- Comparing response distributions of offline and online data collection methods; 2005; Schillewaert, N., Meulemeester, P.
- Online focus groups; 2005; Reid, D. J., Reid, F. J. M.
- A Typology of Real-Time Validations in Web-Based Surveys; 2005; Peytchev, A., Crawford, S. D.
- Pediatric Gastroenterology Workforce Survey, 2003-2004; 2005; Crandall, W., Barnard, J., Cohen, M., Colletti, R., Ferry, G., Harnsberger, J., Hart, M., Rosenthal,...
- Interaction in cyberspace: an online focus group; 2005; Kenny, A. J.
- The value of online surveys; 2005; Evans, J. R., Mathur, A.
- Improving Customer Experience via Text Mining; 2005; Lakshminarayan, C., Yu, Q., Benson, A.
- An Empirical Evaluation of Three Web Survey Design Principles; 2005; Healey, B., MacPherson, T., Kuijten, B.
- In my opinion; 2005; Haley, F.
- Studying marriage and family therapists in the 21st century: Methodological and technological issues; 2005; Northey, N. F. Jr.
- Online has all the answers; 2005; Buxton, P.
- Survey Says...Or Does It? Fun with Statistics; 2005; Crawford, W.
- Websurveyor debuts free web polling tool; 2005; Anonymous
- FIRM: FIRM to release a free and easy-to-use questionnaire designer; 2005; Anonymous
- Online Data Collection: Strategies for Research; 2005; Granello, D. H., Wheaton, J. E.
- Eight tips offer best practices for online MR; 2005; Kottler, R. E.
- Get the most from Net-based panel research; 2005; Philpott, G.