Web Survey Bibliography
The utility of an archived survey mainly depends on the quality and elaborateness of its documentation. This holds true for traditional-static and computer-assisted data collection and especially for online surveys. Online surveys allow for documentation standards which exceed the needs in classical paper-based surveys. Hitherto known documentation standards for offline conducted surveys were evaluated with online surveys in mind. In a collaboration of the two GESIS institutes ZU MA and ZA these standards were revised and, if necessary, extended for their use in online surveys. New demands arise especially because (a) partial completions (dropouts) remain in the dataset, and (b) variations in the visual design affect the answers. We mayaiso add (c) particularities for online surveys which are based on or include experimental designs. Negative effects in online surveys (e.g. high non-response) are often caused by inadequate and poor operationalisations of the questionnaire. To allow for an assessment of any research result it is necessary to provide information on the operationalisations for the reader. Similarly, a description of the flow of the questionnaire (filter paths) is needed. All the same, the layout and design of single questions should be documented in online surveys, as they are known to influence answer behavior.
The resulting guidelines for documentation practice in online surveys therefore focus on the following aspects:
1) Coding of missing data. Our proposed scheme for missing data documentation combines two known standards, clears it from unnecessary irregularities and extends it to the area of online surveys.
2) Codebook. We propose an extended version of the classical codebook with simple frequency distributions, information on the page number and the display of the questions.
3) Process documentation. We explain how the questionnaire flow and controls may be described.
4) Variable labels, The well known label approach prefix-stem-suffix is explicated for online surveys.
Examples are used to illustrate and discuss the guidelines.
Der Nutzen einer archivierten Befragung ist im Wesentlichen abhangig von der Gute und Detailliertheit ihrer Dokumentation. Dies gilt fOr traditionell-statische und computergestotzte Erhebungen, insbesondere aber auch fOr Befragungen, die mittels des Internet realisiert werden. Im Vergleich zu Papier-gestotzten Erhebungen ermoglichen Online-Befragungen den Einsatz von Dokumentationsstandards, die weit Uber das Bisherige hinausgehen.
ln einer Zusammenarbeit der beiden GESIS-Institute ZUMA und ZA wurden die gangigen Dokumentationsstandards fOr offline durchgefOhrte Erhebungen im Hinblick auf ihre Tauglichkeit in Online-Befragungen UberprUft und, soweit dies notwendig erschien, erweitert. Neue Anforderungen entstehen vor allem dadurch, dass (a) unvollstandige Interviews in den Datensatz gelangen (Dropouts) und (b) den zahlreichen Variationsmoglichkeiten im visuellen Design, die zu speziellen Antworteffekten fOhren konnen. Hinzu kommen (c) Besonderheiten, sofern den Online-Befragungen experimentelle Designs zugrunde liegen.
Bei Online-Befragungen lassen sich negative Effekte wie z.B. ein hoher Nonresponse haufig auf mangelhafte Operationalisierungen zurUckfOhren. Daher sollte zur Bewertung der Forschungsergebnisse die Operationalisierung fOr den Leser verfUgbar sein. Damit einhergehend ist zu einer genaueren Dokumentation von Abbruchquoten eine Beschreibung des Fragebogenablaufs und der Fragebogensteuerung notwendig. Gleichwohl sollten gerade im Online-Bereich Design und Layout einzelner Fragetypen dokumentiert werden, da diese einen Einfluss auf das Antwortverhalten ausUben konnen.
Die entstandenen Richtlinien zur Dokumentationspraxis legen ihre Schwerpunkte daher auf die folgenden Aspekte:
1) Codierung fehlender Angaben: Hierbei stehen die Bereinigung von Irregularitaten in der Codevergabe, die generelIe GUltigkeit bei verschiedensten Befragungen, sowie die Erweiterung auf den Online-Bereich im Vordergrund.
2) Codebuch: Erweiterung des klassischen Codebuchs um Haufigkeitstabellen, Angaben zur Befragungsseite, sowie der verwendeten Darstellungsform.
3) Prozessdokumentation: Darstellung des Fragebogenverlaufs und der -steuerung.
4) Variablenbezeichnungen: Explizierung der bekannten Dreiteilung PrefixStamm-Suffix auf Online-Befragungen.
Anhand von Beispielen sollen die hier entwickelten Standards vorgestellt und zur Diskussion gestelit werden.
Abbruchquoten eine Beschreibung des Fragebogenablaufs und der Fragebogensteuerung notwendig. Gleichwohl sollten gerade im Online-Bereich Design und Layout einzelner Fragetypen dokumentiert werden, da diese einen Einfluss auf das Antwortverhalten ausUben konnen.
Web Survey Bibliography - Standards, codes (430)
- The Internet as a research site: establishment of a web-based longitudinal study of the nursing and...; 2009; Huntington, A., Gilmour, J., Schluter, P., Tuckett, A., Bogossian, F., Turner, C.
- Mobile Phone Interviewing - Why being engaged is a good thing!; 2009; Johnson, A. J., Martin, P.
- Mobility, Flexibility and Identity - How the use of mobile questionnaires improves the data quality...; 2009; Hellwig, O., Wirth, T.
- Anytime, Anywhere Mobile Interviewing: Comparing Mobile Voice and Web Response Patterns; 2009; Petit, F. C.
- Using mobile phones to measure TV-broadcast quality; 2009; Wieland, J. L., Puggaard, B.
- Life360: Use of Mobile Technology for Electronic Ethnographic Studies; 2009; W., Lai, J. W., Vanno, L., Makowska, H., Benezra, K., Green, M.Link, M. W.
- Ethical suicide research: A survey of researchers ; 2009; Lakeman, R., Fitzgerald, M.
- Mobile phone surveys in mixed mode environment; 2009; Vehovar, V.
- Providing Real-Time Incentives for Anonymous Web Surveys; 2008; Heinrich, T.
- Technology and the Survey Interview and Questionnaire; 2008; Couper, M. P.
- National Surveys Via RDD Telephone Interviewing vs. the Internet: Comparing Sample Representativeness...; 2008; Chang, L. C., Krosnick, J. A.
- Quality Criteria for Quantitative, Qualitative and Mixed Methods Research: A View from Social Policy...; 2008; Bryman, A., Becker, S., Sempik, J.
- Encyclopedia of Survey Research Methods; 2008; Lavrakas, P. J.
- Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method ; 2008; Dillman, D. A., Christian, L. M., Smyth, J. D.
- The Methodological Issues Associated With Internet-Based Research; 2008; Beddows, E.
- Experiments in Mobile Web Survey Design; 2008; Peytchev, A., Hill, C.
- A multimedia-based and time-sensitive interactive web survey for road user opinion on traffic condition...; 2008; Posawang, P., Phosaard, S., Polnigongit, W., Pattara-Atikom, W.
- CAQDAS, Secondary Analysis and the Coding of Survey Data; 2008; Fielding, N.
- Machines that Learn how to Code Open-Ended Survey Data: Underlying Principles, Experimental Data, and...; 2008; Sebastiani, F.
- Computer coding of 1992 ANES Like/Dislike and MIP responses; 2008; Fan, D. F.
- CATA (Computer Aided Text Analysis) Options for the Coding of Open-Ended Survey Data; 2008; Skalski, P.
- Classifying Open Occupation Descriptions in the Current Population Survey; 2008; Conrad, F. G., Couper, M. P.
- Coding Responses Generated by Open-Ended Questions: Meaning Matching or Meaning Inference?; 2008; Potter, J.
- Open-ended questions and text analysis; 2008; Popping, R.
- Coding Verbal Data - What to Optimize?; 2008; Krippendorff, K.
- Practical advice for conducting ethical online experiments and questionnaires for United States psychologists...; 2008; Barchard K. A., Williams, J.
- Research Instruments: Driving e-Science? ; 2008; Schroeder, R.
- The US Institutional Review Board and Online Research Ethics; 2008; Markham, A., Buchanan, E. A., Ess, C.
- What Can We Achieve With 5 Euros? Optimization of Survey Data Quality Using Mixed-Mode Approaches; 2008; Berzelak, N., Vehovar, V., Lozar Manfreda, K.
- Measuring Non-Response Cross Nationally; 2008; Blom, A. G.
- Testing the Effects of Multiple Manipulations on Print and Online Survey Response Rates: Lessons Learned...; 2008; Bachman, M., Vaccaro, D.
- Validating Check-All and Forced-Choice Question in a Paper Survey of Provincial Park Campground Users...; 2008; Dyck, B., Moore, D.
- Rate of Response in Web-Based Data Collection as a Factor of Author of E-mail Invitation; 2008; Mitra, A.
- Graduate vs. Undergraduate Student Respondent Behavior Differences in Web Surveys; 2008; Showen, S., Eisenberg, D., Roe, D. J.
- Mode Effects and Non-Response Bias in an Undergraduate Student Satisfaction Survey: Results from a Randomized...; 2008; Beach, S., Musa, D., Beeson, P., Sparks, C.
- Worth the Weight?: The Benefits and Pitfalls in Applying Survey Weights to Web Surveys of College Undergraduates...; 2008; Bloom, J. D.
- Improving the Efficiency of Web Survey Experiments; 2008; Luks, S., Rivers, D.
- Computing Metrics for Online Panels; 2008; Callegaro, M., DiSogra, C.
- 2006 Canadian Census Internet Mode Effect Study; 2008; Grondin, C., Sun, L.,
- Mode Effects on In-Person and Internet Surveys: A Comparison of the General Social Survey and Knowledge...; 2008; Smith, T. W., Dennis, J. M.
- Using Paradata to Actively Manage Data Collection; 2008; Laflamme, F., Pasture, T., Talon, J., Maydan, M., Miller, A.
- Survey Research Methods (Applied Social Research Methods); 2008; Fowler, F.
- Ethical Issues in Surveys; 2008; Singer, E.
- Overview: Online Surveys; 2008; Vehovar, V., Lozar Manfreda, K.
- Understanding and Managing Legal Issues in Internet Research; 2008; Charlesworth, A.
- The Ethics of Internet Research; 2008; Eynon, R., Fry, J., Schroeder, R.
- Internet surveys; 2008; Vehovar, V., Lozar Manfreda, K., Koren, G.
- Mail and Internet Surveys ; 2008; Dillman, D. A.
- Internet research ethics; 2007; Ess, C.
- Surveys and Technology – Polishing the Crystal Ball; 2007; Neffendorf, H.