Web Survey Bibliography
Mode effects are difficult to separate from nonresponse effects in mixed-mode surveys. Mode effects include acquiescence and social desirability effects due to the presence of an interviewer, recency effects in audio surveys and primacy effects in visual surveys. However, in everyday mixed-mode surveys we often cannot distinguish mode-effects from effects due to differences in nonresponse and coverage that coincide with the use of multiple survey modes.
This paper provides a framework for separating mode-effects from nonresponse- bias by matching similar respondents from different survey modes using propensity score matching. We use data from a multi-mode survey conducted in the Netherlands in 2007. About 14.000 people in our sampling frame were randomly assigned to a survey mode: either Internet or telephone. The internet-respondents were invited by mail. To assess the technique of propensity score matching, respondents from the Internet-survey are matched to participants in an access-panel who completed an identical survey. After matching, we find that differences in the composition of the Internet sample and access-panel can account for differences in our dependent variables; a set of items that ask respondents about perceived environmental hindrance.
In the second part of the paper, we assess the occurrence of mode effects in our survey experiment and match the respondents from the Telephone to the Internet-survey. After matching, we can account for differences due to nonresponse effects. The differences we found before matching however persist after matching. This indicates the occurrence of mode-effects in our telephone and Internet survey for the environmental hindrance questions. We conclude with a discussion how future mixed-mode survey designs can give more insight in the situations in which mode-effects occur.
Conference Homepage (abstract)
Web survey bibliography - Internet access Panels (431)
- Exploring New Pathways to Survey Recruitment; 2012; Bilgram, V., Stadler, D.Jawecki, G.
- Data quality in MAWI and CAWI; 2012; Mavletova, A. M., Blasius, J.
- Scrutinizing Dynamics – Rolling panel waves in theory and practice; 2012; Faas, T., Blumenberg, J. N.
- FamilyVote – Conducting online surveys with children and families; 2012; Geissler, H., Peeters, H.
- Reducing the Threat of Sensitive Questions in Online Surveys; 2012; Couper, M. P.
- Data Use: Trying to bring the numbers alive ; 2012; Rung, J., Woll, B., Edstrom, C.
- Exploring Animated Faces Scales in Web Surveys: Drawbacks and Prospects; 2012; Emde, M., Fuchs, M.
- Reminders in Web-Based Data Collection: Increasing Response at the Price of Retention?; 2012; Goeritz, A., Crutzen, R.
- Web panels in Slovenia; 2011; Lenar, J.
- Less questions, more data: Revitalizing the european currency in single source affluent audience measurement...; 2011; Hartman, H.
- Using a Probability-based Online Panel to Survey American Jews; 2011; Wright, G., Phillips, B. T., Tobias, J., Peugh, J., Semans, K.
- Seasonal Yield Variation and Related Response Patterns in Address-based Mail Samples; 2011; DiSogra, C., Hendarwan, E.
- Peanuts and Monkeys: Incentivisation and engagement in online access panels; 2011; Marks, B.
- Establishing Cross-National Equivalence of Measures of Xenophobia: Evidence from Probing in Web Surveys...; 2011; Braun, M., Behr, D., Kaczmirek, L.
- Using Internet in Stated Preference Surveys: A Review and Comparison of Survey Modes; 2011; Lindhjem, H., Navrud, S.
- New Esomar survey on use of cookies and tracking technologies; 2011
- Google and Kantar develop measurement panel; 2011
- “You are Invited to Participate”: Challenges of Applying Mixed Survey Methods to Assess...; 2011; Chew, F.
- Classic Inspirations for Social Research Methodology in the time of Online Access Panels ; 2011; Jerabek, H.
- Beyond data stability: Rising above quality concerns; 2011
- Background - QSOAP; 2011
- The optimal number of response options in internet panel surveys; 2011; Thorsdottir, F.
- Online Research @ GESIS; 2011; Kaczmirek, L., Lenzner, T.
- E-dater, Artificial Actors, and German Households; 2011; Hebing, M.
- True Longitudinal and Probability-Based Internet Panels: Evidence from the Netherlands; 2011; Das, M., Scherpenzeel, A.
- Understanding Society Innovation Panel Wave 3: Results from Methodological Experiments; 2011; Burton, J., Budd, S., Gilbert, E., Jaeckle, A., McFall, S., Uhrig, S. C. N.
- The Effect of a Mixed Mode Wave on Subsequent Attrition in a Panel Survey: Evidence from the Understanding...; 2011; Lynn, P.
- The German Access Panel and the Impact of Response Propensities; 2011; Amarov, B., Enderle, T., Muennich, R., Rendtel, U., Zins, S.
- Methodological Issues in Internet-Mediated Research: A Randomized Comparison of Internet Versus Mailed...; 2011; Whitehead, L.
- Explaining Unit Nonresponse in Online Panel Surveys: An Application of the Extended Theory of Planned...; 2011; Haunberger, S.
- Nonparametric Tests of Panel Conditioning and Attrition Bias in Panel Surveys; 2011; Das, M., Toepoel, V., van Soest, A.
- Exploring Health-related Experiences and Access to Care: Differences between Online and Telephone Survey...; 2011; Doty, M. M., Peugh, J., Shand-Lubbers, J.
- Collaborative systems for enhancing the analysis of social surveys: the Grid Enabled Specialist Data...; 2011; Lambert, P., Warner, G., Doherty, T., McCafferty, S., Watt, J., Comerford, M., Gayle, V., Tan, L., Blum...
- Development of a Web-Based Survey for Monitoring Daily Health and its Application in an Epidemiological...; 2011; Sugiura, H., Ohkusa, Y., Akahane, M., Sano, T., Okabe, N., Imamura, T.
- A new approach to the analysis of survey drop-out. Results from Follow-up Surveys in the German Longitudinal...; 2011; Rossmann, J., Blumenstiel, J. E., Steinbrecher, M.
- Tracking the decision-making process – Findings from an Online Rolling Cross-Section Panel Study...; 2011; Faas, T.
- Rich Profiles – Or: What's the problem with self-disclosure data?; 2011; Tress, F.
- Who are leaving our panel: panel attrition and personality traits; 2011; Marchand, M.
- Mobile Research Apps – Adding New Capabilities to Market Research; 2011; Rieber, D.
- The influence of personality traits and motives for joining on participation behavior in online panels...; 2011; Keusch, F.
- Asking sensitive questions in a recruitment interview for an online panel: the income question; 2011; Schaurer, I., Struminskaya, B., Kaczmirek, L., Bandilla, W.
- Respondent Characteristics as Explanations for Uninformative Survey Response: Sources of Nondifferentiation...; 2011; Van Meurs, L., Klausch, L. T., Schoenbach, K.
- Individual differences in motivation to participate in online panels; 2011; Bruggen, E., Wetzels, M., de Ruyter, K., Schillewaert, N.
- DDI and the Lifecycle of Longitudinal Surveys; 2011; Hoyle, L., Wackerow, J.
- Dissemination of survey (meta)data in the LISS data archive; 2011; Streefkerk, M., Elshout, S.
- Does the direction of Likert-type scales influence response behavior in web surveys?; 2011; Keusch, F.
- Using propensity score matching to separate mode- and selection effects; 2011; Lugtig, P. J., Lensvelt-Mulders, G. J.
- Flexibility of Web Surveys: Probing 'do-not-know' over the Phone and on the Web; 2011; Hox, J., de Leeuw, E. D.
- Mode Effect or Question Wording? Measurement Error in Mixed Mode Surveys; 2011; de Leeuw, E. D., Hox, J., Scherpenzeel, A.
- Framing Effects and Expected Social Security Claiming Behavior; 2011; Brown, Je., Kapteyn, A., Mitchell, O. S.