Web Survey Bibliography
The type of response scale may compromise the psychometric quality of a survey instrument even though its qualitative underpinning is excellent and the wording of the items is appropriate. A series of four experiments (one paper-and-pencil, two online, one eye-tracking experiment) were conducted to examine the functioning of response scales of different direction (agree-disagree versus disagree-agree). The effects of the direction of the response scale are exemplified by two different constructs, based on the Rasch measurement model. As a key result, the agree-disagree format performs better (in terms of fit and the unit of measurement) than the disagree-agree variant. Since a difference in the unit of measurement (a multiplicative bias) may lead to spurious mean differences, extreme caution has to be exercised when data sets based on different modes of collection or different response scales are merged. In search for a more detailed understanding of the differences found, an eye-tracking experiment was conducted. The eye-tracking experiment allowed to observe the answering process and to investigate the reading patterns of the respondents in a more direct way. In line with the results of the psychometric analysis, the two response formats also differed regarding reading patterns. For instance, fixation and observation length and counts of the defined areas of interest (e.g., scale-poles) were significantly higher for the disagree-agree format. These findings suggest the disagree-agree format implying more effort and difficulties for the respondents throughout the answering process.
Conference Homepage (abstract)
Web survey bibliography - Other (439)
- Why do you play? The development of the motives for online gaming questionnaire (MOGQ); 2011; Demetrovics, Z., Urbán, R., Nagygyörgy, K., Farkas, J., Zilahy, D., Mervó, B., Reindl, A., Agoston,...
- The “Frequency Divide” on Web Surveys: Opinions, Behaviours and Demographics Differences...; 2011; Reis, E., Vicente, P.
- LinkedIn and Facebook in Belgium: The Influences and Biases of Social Network Sites in Recruitment and...; 2011; Caers, R., Castelyns, V.
- PhD Students’ Research Group Networks. A Qualitative Approach; 2011; Coromina, L., Capo, A., Coenders, G., Guia, J.
- PhD Students’ Research Group Social Capital in Two Countries: A Clustering Approach with Duocentred...; 2011; Coenders, G., Coromina, L., Ferligoj, A., Guia, J.
- Preface; 2011; Coenders, G., Doreian, P.
- Explaining Unit Nonresponse in Online Panel Surveys: An Application of the Extended Theory of Planned...; 2011; Haunberger, S.
- Utilizing Web Technology in Business Data Collection: Some Norwegian, Dutch and Danish Experiences; 2011; Haraldsen, G., Snijkers, G., Roos, M., Sundvoll, A., Vik, T., Stax, H.-P.
- E-Census 2011 Portugal: implementation and results of the Pilot Survey; 2011; Vicente, P., Rosa, A., Reis, E.
- Standardising the web data collection channel at the Basque Statistics Office (EUSTAT); 2011; Prado, C., Guinea , C.
- An Experimental Investigation of Mode Effects in the Hungarian Census Test 2009; 2011; Vereczkei, Z.
- Effectiveness and consequences of various recruitment methods in psychological research: case study; 2011; Poltorak, M.
- Snap judgement polling; 2011; Anderson, K., Wright, M., Wheeler, M.
- Web based CATI on Amazon Elastic Compute Cloud and VirtualBox using queXS; 2011; Zammit, A.
- Web/Cloud Based CATI Using queXS; 2011; Zammit, A.
- Research on Internet survey errors and control methods; 2011; Mingyue, F., Xicang, Z.
- Does the direction of Likert-type scales influence response behavior in web surveys?; 2011; Keusch, F.
- Different functioning of rating scale formats – results from psychometric and physiological experiments...; 2011; Koller, M., Salzberger, T.
- A Comparison of CAPI and PAPI through a Randomized Field Experiment; 2011; De Weerdt, J.
- Changing research methods in Ukraine: CATI or Mixed-Mode Surveys?; 2011; Paniotto, V., Kharchenko, N.
- The Influence Of The Direction Of Likert-Type Scales In Web Surveys On Response Behavior In Different...; 2011; Keusch, F.
- Which Technologies Do Respondents Use in Online Surveys – An International Comparison?; 2011; Kaczmirek, L., Behr, D., Bandilla, W.
- Can Internet surveys help us understanding allergic disorders? – results from a large survey in...; 2011; Kalogeromitros, D., Psaltopoulou, T., Makris, M., Koti, I., Chliva, C., Stefanadi, E., Hatziagelaki,...
- E-survey (surveys based on e-mail & web) Analysis and identification of cold responsive proteins in...; 2011; Sodabeh, J.-G., Ferdous, R.-J., Lello, Z., Ghasem, K., Ghasem, H. S., Gholipoori, A., Siroos, M., Sajjad...
- Development of a web-based survey system for evaluating affective satisfaction ; 2011; Cho, Y., Han, S. H., Kang, S., Park, J.
- A Method for Evaluating Mode Effects in Mixed-mode Surveys; 2011; Vannieuwenhuyze, J., Loosveldt, G., Molenberghs, G.
- Handle with Care: The Impact of Using Java Applets in Web-Based Studies on Dropout and Sample Composition...; 2011; Stieger, S., Goeritz, A., Voracek, M.
- An overview of Internet-based surveys in hospitality and tourism journals; 2011; Hung, K., Law, R.
- Measuring Political Knowledge in Telephone and Web Surveys: A Cross-National Comparison; 2011; Strabac, Z., Aalberg, T.
- Response Rates in Organizational Science, 1995–2008: A Meta-analytic Review and Guidelines for...; 2010; Anseel, F., Lievens, F., Schollaert, E., Choragwicka, B.
- Developing a web explicit research strategy theory in African universities: a cross-comparison of specific...; 2010; Kirigha, K. A., Neema-A.
- Maximizing online respondent engagement through a game-way research design; 2010; Swahar, G., Swahar, J.
- Online panel survey, Change and stability of political attitudes; 2010
- Social Networking Sites: Evaluating and Investigating their use in Academic Research; 2010; Redmond, F.
- An Analyze of the Zero Price Effect on Online Business Performance - An Research Based on the Mobile...; 2010; Liu, Y., Yuan, P.
- Dealing with Nonresponse in Survey Sampling: an Item Response Modeling Approach; 2010; Matei, A.
- Blogosphere and Democracy in Portugal–Results of a Websurvey; 2010; Carvalho, T., Casanova, J. L.
- Establishing a Qualitative Data Archive in Austria; 2010; Smioski, A.
- Web Based Paper Form Verification Using QueXF; 2010; Zammit, A.
- Does Making The Survey Topic More Salient Lead To An Expert Bias? – The Influence of Announcing...; 2010; Keusch, F., Mayerhofer, W., Weilbuchner, N., Jungreithmaier, S.
- Developing and Evaluating a Student Online Panel.; 2010; Stiglbauer, B., Gamsjäger, M., Gnambs, T., Batinic, B., Altrichter, H.
- Online Access Panels: A detailed look at different Ways of Entering, their Costs and Participation Behavior...; 2010; Führer, R., Keusch, F.
- Theoretical model of context-sensitive mobile methods; 2010; Maxl, E.
- Can a professional questionnaire layout make up for a boring topic? The mediating role of topic interest...; 2010; Keusch, F., Mayerhofer, W., Jungreithmaier, S., Weilbuchner, N., Fuehrer, R., Kling, H.
- Using Propensity Score Weighting to Reduce Bias of a Swiss Market Research Web Panel; 2010; Wiegand, G., Jella, H., Beat, H., Stefan, L.
- Combining Link-Tracing Sampling and Cluster Sampling to Estimate Totals and Means of Hidden Human Populations...; 2010; Félix-Medina, M. H., Monjardin, P. E.
- Quality in Unimode and Mixed-Mode designs: A Multitrait-Multimethod approach; 2010; Revilla, M.
- Some Notes on the Probability Space of Statistical Surveys; 2010; Petrakos, G.
- Web panels: Replacement technology for market research; 2010; Goeritz, A.
- Color red in web-based knowledge testing; 2010; Gnambs, T., Batinic, B., Appel, Ma.