Web Survey Bibliography
As more survey modes have become available, it has ever been an aspiration in survey methodology research to test and assure comparability of measurements obtained in different modes. Such research has often found 'mode effects’, which are measurement differentials between modes beyond sampling variation. Moreover, with the rise of the mixed-mode survey, which combines more than one survey mode in the data collection design , the question of comparability has become even more pressuring.
The reason why estimates based on different survey modes are known to differ is bias introduced by mode-specific survey nonresponse and mode-specific measurement error. The major problem in such research has remained, however, that these errors are confounded in studies experimentally comparing two or more survey modes. Comparative studies therefore should strive to control for mode-specific nonresponse before observing residual measurement differentials.
We review commonly used techniques useful for this goal and then present results from an experiment, in which the same survey project was administered in four different modes (CAPI, CATI, CAWI, and PAPI). About 8000 respondents were randomly sampled from the Dutch population and assigned to one of the modes. In the analysis we use structural modeling to test measurement invariance across survey modes on a set of items taken from round five of the European Social Survey (ESS). We control for mode-specific survey nonresponse using auxiliary information from various registries . The adjustment is expected to be imperfect due to the typically low explanatory power of registry data; however, the adjustment situation is comparable to that encountered in practical fieldwork. Hence if measurement invariance between some modes is rejected , this will have strong implications for measurements realized in mixed-mode surveys and the practical researcher’s means to adjust for bias in mixed-mode surveys.
Conference Homepage (abstract)
Web Survey Bibliography - Mixed mode surveys (879)
- Internet access - Households and individuals, 2012 part 2; 2012
- Internet access - Households and individuals, 2012; 2012
- Sampling for Single and Multi-Mode Surveys using Address-Based Sampling; 2012; O'Muircheartaigh, C.
- Mode and non-response effects and their treatment; 2012; Chrysanthopoulos, S., Georgostathi, A.
- What can be said about quality in the Central Population Register based on a self-completion survey...; 2012; Falnes-Dalheim, E., Pedersen, H. E.
- Improving the quality of complex surveys: The case of the EU Labour Force Survey ; 2012; van der Valk, J.
- The re-engineering of the Structural Earnings survey process: Mixed - Mode data collection and new E...; 2012; Cardinaleschi, S., De Santis, S., Rocci, F., Spinelli, V.
- Choosing a Data Collection Approach: Mixed Mode Design Experiences in Statistics Finland; 2012; Taskinen, P., Kiianmaa, N.
- Does mentioning "Some People" and "Other People" in an opinion question improve...; 2012; Yeager, D. S., Krosnick, J. A.
- Specific mixed-mode methodology to reach sensory disabled people in quantitative surveys; 2012; Fontaine, S.
- A Choice in Mode: A Solution for Increasing Response Rates of Hard-to-Survey Populations?; 2012; Haan, M., Ongena, Y. P.
- WEBDATANET: web-based data-collection methodological challenges, solutions and implementations. Action...; 2012; de Pedraza, P.
- Web Panels; 2012; Bethlehem, J., Biffignandi, S.
- The Problem of Undercoverage; 2012; Bethlehem, J., Biffignandi, S.
- Mixed-Mode Surveys; 2012; Bethlehem, J., Biffignandi, S.
- Combining Mail and E-Mail Contacts to Facilitate Participation in Mixed-Mode Surveys; 2012; Israel, G. D.
- Effects of E-Mailed Versus Mailed Invitations and Incentives on Response Rates, Data Quality, and Costs...; 2012; Dykema, J., Stevenson, J., Klein, L., Kim, Y., Day, B.
- Costs and Errors in Fixed and Mobile Phone Surveys; 2012; Vehovar, V., Slavec, A., Berzelak, N.
- “I think I know what you did last summer” Improving data quality in panel surveys; 2012; Lugtig, P. J.
- Understanding Society Innovation Panel Wave 4: Results from Methodological Experiments; 2012; Burton, J., Budd, S., Gilbert, E., Jaeckle, A., Kaminska, O., Uhrig, S.C. N., Brown, M., Calderwood,...
- The Propensity of Older Respondents to Participate in a General Purpose Survey; 2012; Lynn, P.
- Mode-Switch Protocols: How a Seemingly Small Design Difference can affect Attrition Rates and Attrition...; 2012; Lynn, P.
- Does Giving People Their Preferred Survey Mode Actually Increase Survey Participation Rates?; 2012; Olson, K., Smyth, J. D., Wood, H.
- Going online with a face-to-face household panel: Initial results from an experiment on the UK Household...; 2012; Jaeckle, A., Lynn, P., Burton, J.
- Survey Quality Evaluation for Business Surveys; 2012; Biemer, P. P.
- Mixed Mode Survey Design: Mode Effect Problem; 2012; Sztabinski, F., Zmijewska-Jedrzejczyk, T.
- Solving the Mode Mystery The Cost, Coverage and Quality Tradeoffs of Picking (and Mixing) Online and...; 2012; Cape, P. J., Phillips, K.
- Ordering Your Attention: Response Order Effects in Parallel Phone and Online Surveys; 2012; Barlas, F. M., Thomas, R. K.
- Influencing Mode Choice in a Mixed Mode Survey; 2012; Mooney, G., Lan, F., Lin, X., Hurwitz, A.
- Developing a New Mixed Mode Methodology for a Provincial Park Camper Survey in British Columbia; 2012; Dyck, B. W., Dearden, P., Rollins, R.
- Are Multiple Modes Helpful? Balancing Reduction of Nonresponse and Sampling Error against Mode Effects...; 2012; Phillips, B. T., Harrison, C., Turakhia, C.
- Using SMS Text Messaging To Collect Time Use Data; 2012; Brenner, P., DeLamater, J.
- Update Your Status Lately? – Then Why Not Respond to Our Survey!; 2012; Borie-Holtz, D.
- Effects of Technical Difficulties on Item Nonresponse and Response Favorability in a Mixed-Mode Survey...; 2012; Gibson, J. L.
- Using Technology to Enhance the Quality of In-Depth Interview Data Collected by Telephone: A Study of...; 2012; Mulcahy, T. M., Nguyen, K., Brownstein, H., Johannes, F.-H.
- Using Mixed-Mode Contacts to Facilitate Participation in Public Agency Client Surveys; 2012; Israel, G. D.
- Demonstration of an Integrated Sample Management System for a Mixed Mode (Paper/Web) Survey; 2012; Ullman, E., Peng, H., Helppie McFall, B.
- Making a Match: Exploring the Impact of Mode Preference on Measurement; 2012; Kasabian, A., Olson, K., Smyth, J.
- Question or Mode Effects in Mixed-Mode surveys: A Cross-cultural study in the Netherlands, Germany,...; 2012; de Leeuw, E. D., Nicolaas, G., Campanelli, P., Hox, J.
- Recruitment and Retention in Multi-Mode Survey Panels; 2012; McCutcheon, A. L., Rao, K., Kaminska, O.
- The Confirmit Annual Market Research Software Survey 2011; 2012; Macer, T.,
- The Effect of Mixed Mode Designs on Nonresponse Bias; 2012; Wells, B. M., Olson, K.
- Best Approaches to Mode Order and Non-response Prompting in a Multi-Mode Survey; 2012; Newsome, J., Levin, K., Schafer, B., Vigil, M., Liu, W.
- Intensifying the Request: Results from an Experiment on Improving Internet Response Rates for Address...; 2012; Messer, B. L., Dillman, D. A.
- The Impact of a Reminder Postcard in a Multi-node Survey of Rental Units; 2012; Dion, S., Muir, K., ZuWallack, R. S., Hall, L. M.
- Survey Mode Preference among Enrollees in the World Trade Center Health Registry; 2012; Yu, S., Brackbill, R., Walker, D., Turner, L., Farfel, M., Stellman, S., Miller, S., Li, J.
- The Effects of Survey Design Features on Answers to Sensitive Questions; 2012; Witt, L.
- The Challenge of Going National: An Experimental Evaluation of the Effects of Local vs. Distant Survey...; 2012; Edwards, M. L., Dillman, D. A.
- Mixed-mode design and Mode Effect in Surveying Military Veterans; 2012; Wang, W., Morin, R., Parker, K.
- Assessing Measurement Equivalence and Bias of Questions in Mixed-mode Surveys Under Controlled Sample...; 2012; Klausch, L. T., Hox, J., Schouten, B.