Web Survey Bibliography
Performing online behavioral research is gaining increased popularity among researchers in psychological and cognitive science. However, the currently available methods for conducting online reaction time experiments are often complicated and typically require advanced technical skills. In this article, we introduce the Qualtrics Reaction Time Engine (QRTEngine), an open-source JavaScript engine that can be embedded in the online survey development environment Qualtrics. The QRTEngine can be used to easily develop browser-based online reaction time experiments with accurate timing within current browser capabilities, and it requires only minimal programming skills. After introducing the QRTEngine, we briefly discuss how to create and distribute a Stroop task. Next, we describe a study in which we investigated the timing accuracy of the engine under different processor loads using external chronometry. Finally, we show that the QRTEngine can be used to reproduce classic behavioral effects in three reaction time paradigms: a Stroop task, an attentional blink task, and a masked-priming task. These findings demonstrate that QRTEngine can be used as a tool for conducting online behavioral research even when this requires accurate stimulus presentation times.
Web survey bibliography - Behavior Research Methods (16)
- Use of Internet panels to conduct surveys; 2015; Kapteyn, A.; Liu, H., D.Hays, R. D.
- QRTEngine: An easy solution for running online reaction time experiments using Qualtrics; 2014; Barnhoorn, J. S., Haasnoot, E., Bocanegra, B. R., van Steenbergen, H.
- Disclosure of sensitive behaviors across self-administered survey modes: a meta-analysis; 2014; Gnambs, T., Kaspar, K.
- Build your own social network laboratory with Social Lab: a tool for research in social media; 2014; Garaizar, P., Reips, U.-D.
- A standard for test reliability in group research; 2013; Ellis, J. L.
- Why do you play? The development of the motives for online gaming questionnaire (MOGQ); 2011; Demetrovics, Z., Urbán, R., Nagygyörgy, K., Farkas, J., Zilahy, D., Mervó, B., Reindl, A., Agoston,...
- Seriousness Checks are Useful to Improve Data Validity in Online Research; 2010; Diedenhofen, D., Aust, F., Ullrich, S., Musch, J.
- Differences in responses to Web and paper surveys among school professionals; 2010; Yetter, G., Capaccioli, K.
- Making small effects observable: Reducing error by using visual analogue scales; 2009; Funke, F., Reips, U.-D.
- Comparison of ability tests administered online and in the laboratory; 2009; Marten Ihme, J., Lemke, F., Lieder, K., Martin, F., C. C., Schmidt, Sa., Mueller, J. C.
- A decade of Internet-based data collection: Time is ripe for combining e-learning with i-science; 2009; Reips, U.-D.
- The effect of varying the number of response alternatives in rating scales: Experimental evidence from...; 2009; Maydeu-Olivares, A., Kramp, U., García-Forero, C., Gallardo-Pujol, D., Coffman, D.
- Timing accuracy of Web experiments: A case study using the WebExp software package; 2009; Keller, F., Gunasekharan, S., Mayo, N., Corley, M.
- Using the World-Wide Web to obtain large-scale word norms: 190,212 ratings on a set of 2,654 German...; 2009; Lahl, O., Goeritz, A., Pietrowsky, R., Rosenberg, J.
- Individual payments as a longer-term incentive in online panels ; 2008; Goeritz, A., Wolff, H.-G., Goldstein, D. G.
- The Web experiment list: A Web service for the recruitment of participants and archiving of Internet...; 2005; Reips, U. -D., Lengler, R.