Web Survey Bibliography
Experiments also show advantages in the social sciences, e.g. the possibility to test hypotheses with optimal internal validity. So, the analysis of social dilemmas recently has become a prominent example for experiments in the social sciences. Because it is assumed that cultural differences could be of major importance in this case (e.g. Heinrich et al. 2001), comparison of experimental results is of some interest here.
But, the organisation and realisation of the same experiment in several countries requires high amounts of time and money, especially if significant sample sizes are needed. An online implementation of an analysis of vignettes (or: factorial survey) can minimize these problems. The factorial survey combines properties of the experiment and the survey.
Here, the respondents get descriptions of realistic situations of social dilemmas with experimentally varied attributes (e.g. an ultimatum game with gains and one with losses). Measuring respondents reactions then open ways to test appropriate hypotheses. Hence, the classical paper-and-pencil method here leads to major technical problems, especially in an international application. e.g., even with few variables the number of different vignettes becomes very large.
An online implementation of the vignettes experiment can be a solution to this problem. First it simplifies the technical handling (e.g., vignette generation or the random assignment of the vignettes to the respondents).Second, international comparison is easier, because one survey can be put in practice in different countries easy, fast and cost-effective even with large sample sizes. The only thing to do is to translate the texts. So the additional effort for the international survey can be minimized.
However external validity remains a problem when measuring actions with factorial surveys (e.g. Eifler and Bentrup 2004). Therefore the interpretation should focus on differences in marginal effects and not on absolute differences between the countries.
Data from a vignette survey in Poland, Germany and Italy on decisions in trust and ultimatum games is used to illustrate the procedure described above.
Experimente weisen auch für die Sozialwissenschaften einige Vorteile auf. Z. B. lassen sich damit Hypothesen unter optimaler Drittvariablenkontrolle testen. Als prominentes Feld für sozialwissenschaftliche Experimente hat sich in letzter Zeit die Analyse von sozialen Dilemmata erwiesen. Da hier auch kulturelle Einflüsse vermutet werden, ist insbesondere der internationale Vergleich von experimentellen Ergebnissen sinnvoll (vgl. z.B. Henrich et al. 2001).
Die Durchführung desselben Experiments in verschiedenen Ländern ist allerdings mit einem hohen zeitlichen, finanziellen und organisatorischen Aufwand verbunden, insbesondere wenn eine aussagekräftige Fallzahl erreicht werden soll. Abhilfe kann hier ein Online implementiertes Vignettenexperiment (oder: faktorieller Survey) schaffen. Dieses kombiniert Eigenschaften von Experimenten und Befragungen. Konkret werden den Respondenten in der hier verfolgten Anwendung kurze reale Darstellungen von sozialen Dilemmata präsentiert, die experimentell variiert werden (z.B. wird in einem Ultimatumspiel einmal ein Gewinn und einmal ein Verlust aufgeteilt). Die Messung der Reaktionen erlaubt dann die Überprüfung von entsprechenden Hypothesen. Klassische Vignettenexperimente erfordern allerdings einen hohen organisatorischen Aufwand, da z. B. die Zahl der unterschiedlichen Fragebögen, auch bei wenigen Variablen, schnell sehr groß wird.
Die Online-Implementierung eines Vignettenexperiments bietet hier einige Vorteile. Einerseits vereinfacht dies die technische Handhabung der Vignetten an sich (z.B. Generierung und zufällige Zuweisung der Vignetten auf die Respondenten). Andererseits wird spezifisch der internationale Vergleich dadurch erleichtert. Denn die Erhebung von hohen Fallzahlen in mehreren Ländern kann einfach, schnell und kostengünstig erfolgen, da die entsprechenden Texte nur übersetzt werden müssen. Der Zusatzaufwand für die Erhebung an verschiedenen Orten wird damit minimiert.
Allerdings ist die externe Validität von Vignettenexperimenten bei der Messung von Handlungen nicht gesichert (vgl. z. B. Eifler und Bentrup 2004). Bei der Interpretation der Resultate sollten deshalb die Marginaleffekte im Vordergrund stehen und weniger absolute Anteile in verschiedenen Ländern verglichen werden.
Anhand von Vignettendaten aus Polen, Deutschland und Italien bei denenKooperationsentscheidungen im Vertrauens- und Ultimatumspiel analysiert werden, wird das dargestellte Vorgehen illustriert.
German Online Research Conference (GOR) 2007 (abstract)
Web Survey Bibliography - Conference proceedings (240)
- Unintentional mobile respondents; 2012; Peterson, G.
- Sensitive topics in PC Web and mobile web surveys: Is there a difference?; 2012; Mavletova, A. M., Couper, M. P.
- Metering mobile usage. Insights from global Arbitron mobile trends panel; 2012; Verkasalo, H.
- Is „chapterisation“ a viable alternative to traditional progress indicators ?; 2012; Spicer, R., Dowling, Z.
- An experimental investigation of the effects of noncontingent and contingent incentives in recruiting...; 2012; Lavrakas, P. J., Dennis, J. M., Peugh, J., Shand-Lubbers, J., Lee, E., Peugh, J., Charlebois, O., Murakami...
- The smart(phone) way to collect survey data; 2011; Stapleton, C.
- The next CAPI evolution - completing web surveys on cell-enabled iPads; 2011; Dayton, J., Driscoll, H.
- Self-administered mobile surveys; 2011; Bosnjak, M.
- Online survey research: Findings, Best practices, and future research; 2011
- Moving forward, building an ethics community (Panel statement); 2011; Kenneally, E. et al.
- In search of a new approach to measure newspaper audiences in Canada: The journey continues; 2011; Crassweller, A. et al.
- Effects of response format on requalification for recontact studies; 2011; Thomas, R. K.
- A meta-analysis of experiments manipulating progress indicators in Web surveys; 2011; Callegaro, M., Villar, A., Yang, Y.
- Blend, balance, and stabilize respondent sources; 2011; Eggers, M., Drake, E.
- Mode Effect or Question Wording? Measurement Error in Mixed Mode Surveys; 2011; de Leeuw, E. D., Hox, J., Scherpenzeel, A.
- Using a fillable PDF together with SAS ® for questionnaire data; 2010; Donald, E.
- There is an app for that! A review of smartphone apps for marketing research; 2010; Michelson, M.
- The state of online research in the U.S.; 2010; Miller, J.
- Function follows form: Effects of response format on self-reported individuals and household disability...; 2010; Falcone, A. E., Thomas, R. K.
- Address-based sampling. Merits, design & implementation, and review of field statistics; 2010; Fahimi, M.
- A framework for understanding and applying ethical principles in network and security research; 2010; Kenneally, E., Bailey, M., Maughan, D.
- Restructuring and innovations on the survey “capacity of collective tourist accommodation”...; 2010; Santoro, M. T., Staffieri, S.
- An Analyze of the Zero Price Effect on Online Business Performance - An Research Based on the Mobile...; 2010; Liu, Y., Yuan, P.
- Dealing with Nonresponse in Survey Sampling: an Item Response Modeling Approach; 2010; Matei, A.
- Web survey design and usability; 2010; Karakoyun, F., Kurt, A. A.
- Response format effects on measurement of employment; 2009; Thomas, R. K., Dillman, D. A., Smyth, J. D.
- Getting data for (business) statistics: What's new? What's next?; 2009; Snijkers, G.
- Response Mode and Bias Analysis in the IRS’ Individual Taxpayer Burden Survey; 2009; Brick, J. M., Contos, G.,Masken, K.,Nord, R.
- Survey Mode Effects in Two Military Surveys; 2009; Yang, M., Falcone, A. E., Milan, L. M.
- Web based macroseismic survey: fast information exchange and elaboration of seismic intensity effects...; 2009; De Rubeis, V., Sbarra P., Sorrentino, D., Tosi, P.
- The representativeness of the LISS panel ; 2009; Knoef, M., de Vos, K.
- Sample factors that influence data quality; 2008; Gailey, R., Teal, D., Haechrel, E.
- An online panel as a platform for multi-disciplinary research; 2008; Scherpenzeel, A.
- Visual Design Effects on on Respondents Behaviour in Web-Surveys. A Design Experiment; 2008; Greinöcker, A.
- Effects of Privacy Assurances on the Online Measurement of Psychological Constructs; 2008; Witzki, A., Kramer, J.
- Effects of AJAX Technology in Online Questionnaires; 2008; Lütters, H., Westphal, D., Heublein, F.
- How Web 2.0 Technologies Can Become a Valuable Part of Online Research; 2008; Jaron, R.
- Respondent Authenticity - A biometrical approach to authenticate panelists; 2008; Wachter, B., Bender, C.
- Visual Analogue Scales Versus Categorical Scales: Respondent Burden, Cognitive Depth, and Data Quality...; 2008; Funke, F.,Reips, U. -D.
- Not Mixed-Mode but Switch-Mode; 2008; Höglinger, M., Abraham, M., Arpagaus, J.
- The Impact of Cognitive and Computer Skills on Data Quality in Computer Assisted Self Administered Questionnaires...; 2008; Brecko, B. N., Vehovar, V.
- Optimal Contact Strategy in a Mail-and-Web Mixed Mode Survey; 2008; Holmberg, A., Lorenc, B., Werner, P.
- 10 Years of Meinungsplatz.de: Success in the Collection of Data for Targeted Audiences, Such as the...; 2008; Weyergraf, O.
- Self-selection in Online Access Panels: No “Little Difference” in the Recruiting Process...; 2008; Wirth, T.
- Selectivity or Usefulness of Online-Surveys? A Comparison with Data from a Local Population Survey; 2008; Kroll, S., Hüfken, V., Reuband, K.H.
- Mobile Market Research; 2008; Maxl, E.
- Flexible and High-Speed Market Research through Mobile Data Collection & Online Reporting Tool; 2008; Haag, J., Volkmer, H.P.
- Online vs. Offline in Mobile Surveys; 2008; Neubarth, W., Maier, U.
- Gender-of-Interviewer Effects in Video-Enhanced Web Surveys. Results from a Randomized Field-Experiment...; 2008; Fuchs, M.
- The Online Use of Randomized Response Measurements; 2008; Snijders, C., Weesie, J.
