Web Survey Bibliography
Trained respondents may answer questions differently than those with little or no experience in a panel. This can result in different responses with regard to content (e.g. because of increasing knowledge on topics) as well as the procedure (question-answering process). Having two panels—a trained one and a completely fresh one —created a unique opportunity for analysing panel conditioning effects (both panels are recruited via a probability sample of the Dutch population). Due to procedural learning, trained respondents may react differently to web survey design choices than inexperienced respondents. Because of their experience they may be able to process more information on a screen, e.g. make fewer errors when more items are placed on a single screen. In addition, they may be less sensitive to social desirability bias and less reluctant to select a response category that seems unusual in the range of responses. They also may be used to a particular question layout so that changing that layout (e.g. from disagree-agree to agree-disagree) may not be noticed. We investigated whether there are differences in design effects between trained and fresh respondents using a questionnaire consisting of three experiments. In the experiments we varied the number of items on a screen, the choice of response categories, and the layout of a five point rating scale. We found that trained respondents were somewhat more sensitive to satisficing. Besides procedural knowledge, trained respondents can develop knowledge on topics addressed in previous surveys. To find out the relation between question type and panel conditioning, trained and fresh respondents answered questions with different question types. We used nine questions on two different subjects: food infection and old-age pensions. These subjects were presented to the trained panel multiple times, so we thought these would be the most sensitive to bias due to panel conditioning. The results show that panel conditioning only arises in knowledge questions. Questions on attitudes, actual behaviour, or facts were not sensitive to panel conditioning. Panel conditioning in knowledge questions was restricted to less-known subjects (more difficult questions), suggesting a relation between panel conditioning and cognition.
Conference homepage (abstract)
Web Survey Bibliography - Online measurement (790)
- Improving the quality of complex surveys: The case of the EU Labour Force Survey ; 2012; van der Valk, J.
- The re-engineering of the Structural Earnings survey process: Mixed - Mode data collection and new E...; 2012; Cardinaleschi, S., De Santis, S., Rocci, F., Spinelli, V.
- Between demand and reality: Ensuring efficiency and quality in pretesting questionnaires; 2012; Sattelberger, S., Blanke, K.
- How to provide high data quality in online-questionnaires: Setting guidelines in design; 2012; Tries, S., Nebel, S., Blanke, K.
- Boosting Web pick-up Rates by referring to Compliance Principles ; 2012; Falnes-Dalheim, E., Haraldsen, G., Sundvoll, A.
- Ebook readings jumps, print book reading declines; 2012; Rainie, L., Duggan, M.
- Developments and the impact of smart technology; 2012; Macer, T.
- How Should Debriefing Be Undertaken in Web-Based Studies? Findings From a Randomized Controlled Trial...; 2012; McCambridge, J., Kypri, K., Wilson, A.
- Better customer in sight in real time; 2012; Macdonald, E., Wilson, H. N., Konus, H.
- An experimental investigation of the effects of noncontingent and contingent incentives in recruiting...; 2012; Lavrakas, P. J., Dennis, J. M., Peugh, J., Shand-Lubbers, J., Lee, E., Peugh, J., Charlebois, O., Murakami...
- The Feasibility of Conducting a Web Survey Using Respondent Driven Sampling among Transgenders in the...; 2012; Kappelhof, J.
- The role of topic interest and topic salience in online panel web surveys.; 2012; Keusch, F.
- Multi-Language Multi-Continent B2B Community Panel: How B2B research can effectively span the world; 2012; Morden, M., Accomando, E.
- Can Survey Gaming Techniques Cross Continents? Examining cross cultural reactions to creative questioning...; 2012; Puleston, J.
- Rules of engagement: The war against poorly engaged respondents - guidelines for elimination; 2012; Gittelman, S. H., Trimarchi, E.
- WebSM Study: Survey software features overview ; 2012; Vehovar, V.; Cehovin, G.; Kavcic, L.; Lenar, J.
- Web Panels; 2012; Bethlehem, J., Biffignandi, S.
- Use of Response Propensities; 2012; Bethlehem, J., Biffignandi, S.
- Weighting Adjustment Techniques; 2012; Bethlehem, J., Biffignandi, S.
- The Problem of Self-Selection; 2012; Bethlehem, J.,Biffignandi, S.
- Designing a Web Survey Questionnaire; 2012; Bethlehem, J., Biffignandi, S.
- Examining Contexts-of-Use for Web-Based and Paper-Based Questionnaires; 2012; Hardré, P. L., Crowson, H. M., Xie, K.
- Probabilistic survey questions and incorrect answers: Retirement income replacement rates; 2012; van Santen, P., Alessie, R., Kalwij, A.
- Survey Quality; 2012; Lyberg, L. E.
- Effects of E-Mailed Versus Mailed Invitations and Incentives on Response Rates, Data Quality, and Costs...; 2012; Dykema, J., Stevenson, J., Klein, L., Kim, Y., Day, B.
- Unit Non-Response Due to Refusal; 2012; Stoop, I.
- Non-Response and Measurement Error; 2012; Billiet, J., Matsuo, H.
- An Overlooked Approach in Survey Research: Total Survey Error; 2012; Bautista, R.
- Data Quality in HIV/AIDS Web-Based Surveys: Handling Invalid and Suspicious Data; 2012; Bauermeister, J. A., Pingel, E., Zimmerman, M., Couper, M. P., Carballo-Diéguez, A., Strecher, V. J.
- Response rates in three opinion surveys performed through online questionnaires in the health setting...; 2012; Aerny Perreten, N., Domínguez-Berjón, M. F., Astray Mochales, J., Esteban-Vasallo, M. D., Blanco Ancos...
- Impact of Fixed Choice Design on Blockmodeling Outcomes; 2012; Znidarsic, A.
- The Mode of Invitation for Web Surveys; 2012; Bandilla, W., Couper, M. P., Kaczmirek, L.
- Disfluencies and Gaze Aversion in Unreliable Responses to Survey Questions; 2012; Schober, M. F., Conrad, F. G., Dijkstra, W., Ongena, Y. P.
- Evaluating Survey Questions: A Comparison of Methods; 2012; Yan, T., Kreuter, F., Tourangeau, R.
- When More Gets You Less: A Meta-Analysis of the Effect of Concurrent Web Options on Mail Survey Response...; 2012; Medway, R., Fulton, J.
- Reliable Online Social Network Data Collection; 2012; Abdesslem, F. B., Parris, I., Henderson, T.
- Enhancing Web Surveys With New HTML5 Input Types; 2012; Funke, F.
- Panel retention rate and data quality: experimental results drawing on Reciprocity design; 2012; Biffignandi, S., Artaz, R.
- Presidential Elections in Iceland 2012 – Did online panel surveys give false hope to new candidates...; 2012; Jonsdottir, G. A., Dofradottir, A. G., Bjornsdottir, A. E.
- Website exit surveys. What can we measure with them?; 2012; Andreadis, I.
- Challenges and pitfalls of measuring wages via web surveys - some explorations; 2012; Steinmetz, S., Bianchi, A., Tijdens, K., Biffignandi, S.
- Firefly Online Surveys: A fully featured tool for Web surveys and forums; 2012; Deal, K.
- Doing the E-Delphi: Using Online Survey Tools; 2012; Holloway, K.
- Using the Web to Snowball Discussants of Survey Respondents; 2012; Hopmann, D. N.
- Online Questionnaire Data Analysis System (OQDAS); 2012; Ali, A. Q.
- A Structural Analysis Based on Similarity between Fuzzy Clusters and Its Application to Evaluation Data...; 2012; Chiba, R., Furutani, T., Sato-Ilic, M.
- Online Survey Spawning, Administration And Management ; 2012; Jepson, S., Powlette, J. F., Queenan, M.
- Mixed Mode Survey Design: Mode Effect Problem; 2012; Sztabinski, F., Zmijewska-Jedrzejczyk, T.
- Transferring Telephone-Based National Household Travel Survey to the Internet ; 2012; Son, S., Khattak, A., Wang, X., Chen, J.-Y.
- Myths and realities of respondent engagement in online surveys; 2012; Downes-Le Guin, T., Baker, R. P., Mechling, J., Ruyle, E.

