Web Survey Bibliography
Many companies are faced with the question whether administering surveys to their employees via Internet technologies will lead to different results than surveying them with paper and pencil, just because of the technologies or the psychological aspects of using the technologies. In a 2x2x2x2 factorial (quasi-)experimental design it was investigated whether anonymity, voluntariness, age, and administration mode (Internet versus paper-and-pencil) would influence answering behavior in a newly designed short-format employee survey. Employees in one complete section of a large Swiss company (N=655) were randomly assigned to conditions and invited to participate in the survey. Overall, 318 employees responded, with lower return rates for anonymous and for voluntary conditions: anonymous & voluntary 31% return vs. less anonymous & less voluntary 58% return, with other conditions in-between. There was also a tendency for differences in dropout. Voluntariness had a significant effect on response times, a dependent measure that could be applied in the Internet condition only. Age and anonymity were shown to have significant influence on the expression of job satisfaction; voluntariness and administration mode showed tendencies to moderate these influences. Effects of anonymity were shown to be stronger for participants who chose to reveal even less information about themselves by leaving questions with identifying content unanswered. Results will be discussed in terms of the strategic aspect of the Social Identity model of Deindividuation Effects (SIDE). Methods and applications used in developing and administering the employee survey and in analyzing the data will be presented. Recommendations will be made regarding the increase of response rates, the avoidance of social desirability in survey answering behavior, and the organization of Internet-based employee surveys.
Das Internet kann für Mitarbeiterbefragungen eingesetzt werden, aber in vielen Unternehmen stellt sich die Frage, ob sein Einsatz einfach aufgrund dieser neuen Technologie oder der psychologischen Aspekte im Umgang mit der Technologie zu anderen Ergebnissen führen kann. In einem 2x2x2x2 faktoriellen (quasi-)experimentellen Design wurde untersucht, ob Anonymität, Freiwilligkeit, Alter, und Befragungsmodus (Internet-gestützt versus Papier-und-Bleistift) das Antwortverhalten in einer neu entwickelten kurzformatigen Mitarbeiterbefragung beeinflussen würde. Alle Mitarbeiter einer Arbeitseinheit (N=655) eines grossen Schweizer Unternehmens wurden zufällig den Versuchsbedingungen zugeteilt und zur Teilnahme an der Befragung eingeladen. Im Ganzen antworteten 318 Beschäftigte, es zeigten sich geringere Response-Raten in den anonymen und freiwilligen Bedingungen: anonym & freiwillig 31% Response vs. wenig anonym & eingeschränkt freiwillig 58% Response, die anderen Versuchsbedingungen lagen dazwischen. Es zeigte sich auch eine Tendenz zu unterschiedlichem Teilnahmeabbruch. Freiwilligkeit hatte einen signifikanten Effekt auf die Antwortzeiten, einem abhängigen Mass, das nur in der Internet-Bedingung erhoben werden konnte. Die Befragungsergebnisse zeigen Effekte von Anonymität und Alter auf Arbeitszufriedenheitsäusserungen, die tendenziell durch Freiwilligkeit und Befragungsmodus moderiert wurden. Einflüsse der Anonymität erwiesen sich stärker bei Teilnehmern, die noch weniger Informationen über sich preisgaben, idem sie Fragen mit identifizierendem Inhalt unbeantwortet liessen. Diese Ergebnisse werden im Hinblick auf das Social Identity model of Deindividuation Effects (SIDE) diskutiert. Methoden und Anwendungen, die in der Entwicklung und Durchführung der Mitarbeiterbefragung und bei der Datenanalyse benutzt wurden, werden vorgestellt. Es werden Empfehlungen zur Erhöhung der Response-Raten, der Vermeidung von sozial erwünschtem Antwortverhalten und zur Durchführung von Internet-basierten Mitarbeiterbefragungen gemacht.
Homepage - conference (abstract)
Web survey bibliography - Reips, U.-D. (41)
- Using Visual Analogue Scales in eHealth: Non-Response Effects in a Lifestyle Intervention; 2016; Kuhlmann, T.; Reips, U.-D.; Wienert, J.; Lippke, S.
- Build your own social network laboratory with Social Lab: a tool for research in social media; 2014; Garaizar, P., Reips, U.-D.
- WEBDATANET: Innovation and Quality in Web-Based Data Collection ; 2014; Steinmetz, S., Slavec, A., Tijdens, K. G., Reips, U.-D., de Pedraza, P., Popescu, A., Belchior, A., ...,...
- Mining “Big Data” using Big Data Services ; 2014; Reips, U.-D., Matzat, U.
- Interactive applets on the Web for methods and statistics; 2013; McClelland, G., Reips, U.-D.
- Askito: An open source Web questionnaire tool; 2013; Reips, U.-D., Heilmann, T.
- Psychometric properties of an internet administered version of the Marlowe-Crowne Social Desirability...; 2012; Vesteinsdottir, V., Reips, U.-D., Joinson, A. N., Porsdottir, F.
- Why semantic differentials in Web-based research should be made from visual analogue scales and not...; 2012; Funke, F., Reips, U.-D.
- Methodological challenges in the use of the Internet for scientific research: Ten solutions and recommendations...; 2011; Reips, U.-D., Buchanan, T., Krantz, J. H., McGrawn, K.Reips, U.-D.
- What are participants doing while filling in an online questionnaire: A paradata collection tool and...; 2010; Stieger, S., Reips, U.-D.
- Making small effects observable: Reducing error by using visual analogue scales; 2009; Funke, F., Reips, U.-D.
- Yes, VASs can! Increasing the accuracy of survey measurements with computerized visual analogue scales...; 2009; Funke, F., Reips, U.-D.
- True Web experiments; 2009; Reips, U.-D.
- Internet questionnaires in e-health contexts: Non-response to sensitive items; 2009; Reips, U.-D., Buchanan, T., Joinson, A. N., Paine, C.
- Collecting data in surfer's paradise: Internet-mediated research yesterday, now, and tomorrow; 2009; Reips, U.-D.
- A decade of Internet-based data collection: Time is ripe for combining e-learning with i-science; 2009; Reips, U.-D.
- Experimentation within surveys; 2009; Reips, U.-D.
- Investigating causal relationships with power: Online experiments; 2009; Reips, U.-D.
- TitleInternet-basierte Messung sozialer Erwünschtheit: Theoretische Grundlagen und experimentelle Untersuchung...; 2008; Kaufmann, E., Reips, U.-D.
- Response time measurement in the lab and on the Web: A comparison; 2007; Galesic, M., Reips, U.-D., Kaczmirek, L., Czienskowski, U., Liske, N., von Oertzen, T.
- Experiments on non- response in internet- based research; 2007; Reips, U.-D.
- Dynamic Forms: Online Surveys 2.0 ; 2007; Funke, F., Reips, U.-D.
- Forced response in online surveys: bias from reactance and an increase in sex-specific dropout; 2007; Stieger, S., Reips, U. -D., Voracek, M.
- The methodology of Internet-based experiments; 2007; Reips, U.-D.
- Personalized salutation, power of sender and response rates to Web-based surveys; 2007; Joinson, A. N., Reips, U. -D.
- Web-based methods; 2006; Reips, U.-D.
- Privacy, Trust, Disclosure and the Internet; 2006; Paine, C., , Buchanan, T., Reips, U. -D.
- The Web experiment list: A Web service for the recruitment of participants and archiving of Internet...; 2005; Reips, U. -D., Lengler, R.
- Scientific LogAnalyzer: A Web-based tool for analyses of server log files in psychological research; 2004; Reips, U.-D., Stieger, S.
- Employee surveys via Internet or paper? The influence of administration mode, anonymity, voluntariness...; 2004; Reips, U.-D., Franek, L.
- Salutation, Power and behaviour in on-line panels; 2004; Joinson, A. N., Reips, U.-D.
- WEXTOR: A Web-based tool for generating and visualizing experimental designs and procedures; 2002; Reips, U.-D., Neuhaus, C.
- WeXtor 2.5: Develop, manage, and visualize experimental designs and procedures; 2002; Reips, U.-D., Blumer, T., Neuhaus, C.
- Social desirable responding and age on the Internet: older participants in online studies show a higher...; 2002; Reips, U.-D., Stoeber, J., Hahn, A.
- Internet-Based Psychological Experimenting: Five Dos and Five Don'ts; 2002; Reips, U.-D.
- The Kid's Experimental Psychology Lab: A Web Site for Internet Research with Children; 2002; Frick, A., Reips, U.-D.
- Platform-dependent biases in Online Research: Do Mac users really think different?; 2001; Buchanan, T., Reips, U.-D.
- Financial Incentives, Personal Information and Drop-Out in Online Studies; 2001; Frick, A., Bachtiger, M. T., Reips, U.-D.
- A Brief History of Web Experimenting; 2000; Musch, J., Reips, U.-D.
- Current Internet science - trends, techniques, results. ; 1999; Reips, U.-D., Batinic, B., Bandilla, W., Bosnjak, M., Graef, L., Moser, K., Werner, A.
- Drop-out caused by JavaScript: "I could not have expected this to happen " - A Web experiment...; 1999; Reips, U.-D., Schwarz, S.