Web Survey Bibliography
Equivalence is a necessary prerequisite of any substantive analysis of cross-cultural survey data. Cognitive interviewing is a suitable method when it comes to identifying non-equivalence in survey data and, particularly, its causes. Usual face-to-face cognitive interviews have their shortcomings or particular challenges, though, such as limited sample sizes, great time and cost investment, or interviewer effects due to different interviewer behavior. In cross-national research, these problems are exacerbated and, thus, it does not come as a surprise that the use of cognitive interviewing in the comparative context brings with it particular challenges. We therefore propose to test web surveys as a supplemental means to conduct cross-cultural probing studies and to assess equivalence of measures in cross-national studies. Web surveys permit to counter the above mentioned aspects: they allow e.g. the cost-effective increase in sample size and therefore quantification of results; they also allow for the standardization of probing procedures, a factor which is not unimportant in cross-national studies. In this paper, we report findings regarding equivalence from an international web survey conducted in Canada, Denmark, eastern and western Germany, Hungary, Spain, and the US in January 2011. A net sample of 480 respondents in each country/region was targeted. Online access panels were commissioned to provide the respondents according to pre-set quotas. The survey on politics and family included eight probing questions for each respondent, among which category selection probing, comprehension probing, and specific probing. Among the close-ended questions, four items regarding beliefs on immigrants taken from the ISSP 2003 questionnaire on “National Identity” were asked in the survey. They refer to whether immigrants increase crime rates, whether they are generally good for the economy, whether they take jobs away from native people, and whether they improve society by bringing in new ideas and cultures. Four splits were implemented and each of the four items figured as the first item in one of these split version. In each split, the first item was followed by a specific probe, which was: “Which type of immigrants were you thinking of when you answered the question?” Being aware that design plays an important role in web surveys due to its impact on answer behavior, we additionally implemented a design experiment for the above mentioned probe. Respondents were thus randomly assigned either to a probe with a small answer box or a probe with a large answer box in order to test the effect of answer box sizes on answer patterns.
Conference Homepage (abstract)
Web Survey Bibliography - Noncoverage & sampling (1271)
- Convenient yet not a convenience sample: Jury pools as experimental subject pools; 2013; Murray, G. R., Rugeley, C. R., Mitchell, D.-G., Mondak, J. J.
- The equivalence of Internet versus paper-based surveys in IT/IS adoption research in collectivistic...; 2013; Fang, J., Wen, C., Prybutok, V.
- Incentives for college student participation in web-based substance use surveys; 2013; Patrick, M. E., Singer, E., Boyd, C. J., Cranford, J. A., McCabe, S. E.
- Sample composition discrepancies in different stages of a probability-based online panel; 2013; Bosnjak, M., Haas, I., Galesic, M., Kaczmirek, L., Bandilla, W., Couper, M. P.
- A comparison of data quality and practicality of online versus postal questionnaires in a sample of...; 2013; King, M. T., Butow, P., Olver, I., Smith, A. B.
- The rise of the "connected viewer"; 2012; Smith, A., Boyles, J. L.
- The effects of item saliency and question design on measurement error in a self-administered survey; 2012; Stern, M. J., Smyth, J. D., Mendez, J.
- Smartphone ownership update: September 2012; 2012; Rainie, L.
- Research company spotlight - Mobile surveys; 2012
- Participation of mobile users in traditional online studies; 2012; Jue, A.
- More dirty little secrets of online panel research.; 2012
- Mobile email opens report 2nd half 2011; 2012
- Guide to social science data preparation. Best practice throughout the data life cycle; 2012
- GMI Pinnacle; 2012
- Social media as a data collection tool: the impact of Facebook in behavioural research; 2012; Zoppos, E.
- Smartphone Apps and User Engagement: Collecting Data in the Digital Era; 2012; Link, M. W.
- Snowball Sampling in Online Social Networks; 2012; Raissi, M., Ackland, R.
- The Use of Facebook as a Locating and Contacting Tool; 2012; McCarthy, T.
- The war against unengaged online respondents; 2012; Gittelman, S. H., Trimarchi, E.
- Qualitatively Speaking: The five absolute, no-excuse must-dos for online qualitative researchers; 2012; Rossow, A.
- By the Numbers: Lessons for using online panels in B2B research; 2012; Elsner, N.
- Experience Sampling and Ecological Momentary Assessment; 2012; Stone, A.
- Can Microtargeting Improve Survey Sampling? An Assessment of Accuracy and Bias in Consumer File Marketing...; 2012; Pasek, J.
- Cognitive Evaluation of Survey Instruments: State of the Science (Art?) and Future Directions; 2012; Willis, G. B.
- Oh, Just One More Thing … Leveraging “Leave-Behinds” in Data Collection; 2012; Link, M. W.
- Can Official Records Correct Errors in Turnout Self-reports?; 2012; Berent, M., Krosnick, J. A., Lupia, A.
- Modes of Data Collection; 2012; Tourangeau, R.
- Probability vs. Non-probability Methods; 2012; Langer, G,
- Sampling for Single and Multi-Mode Surveys using Address-Based Sampling; 2012; O'Muircheartaigh, C.
- Proxy Reporting; 2012; Cobb, C. L.
- Measure the response burden in the Swedish Intrastat system; 2012; Weideskog, F.
- Boosting Web pick-up Rates by referring to Compliance Principles ; 2012; Falnes-Dalheim, E., Haraldsen, G., Sundvoll, A.
- An experimental investigation of the effects of noncontingent and contingent incentives in recruiting...; 2012; Lavrakas, P. J., Dennis, J. M., Peugh, J., Shand-Lubbers, J., Lee, E., Peugh, J., Charlebois, O., Murakami...
- Response Mode Choice and the Hard-to-Interview in the American Community Survey; 2012; Nichols, E. M., Horwitz, R., Guarino Tancreto, J.
- Recruiting in an Internet panel using respondent driven sampling; 2012; Schonlau, M.
- A Choice in Mode: A Solution for Increasing Response Rates of Hard-to-Survey Populations?; 2012; Haan, M., Ongena, Y. P.
- The Feasibility of Conducting a Web Survey Using Respondent Driven Sampling among Transgenders in the...; 2012; Kappelhof, J.
- Use of Response Propensities; 2012; Bethlehem, J., Biffignandi, S.
- Weighting Adjustment Techniques; 2012; Bethlehem, J., Biffignandi, S.
- Probabilistic survey questions and incorrect answers: Retirement income replacement rates; 2012; van Santen, P., Alessie, R., Kalwij, A.
- Combining Mail and E-Mail Contacts to Facilitate Participation in Mixed-Mode Surveys; 2012; Israel, G. D.
- Prenotification, Incentives, and Survey Modality: An Experimental Test of Methods to Increase Survey...; 2012; Tepper, J. R., Jacob, B.
- Reaching and Hearing the Invisible: Organizational Research on Invisible Stigmatized Groups via Web...; 2012; Trau, R. N. C., Haertel, C. E. J., Haertel, G. F.
- An Overlooked Approach in Survey Research: Total Survey Error; 2012; Bautista, R.
- An assessment of equivalence between Internet and paper-based surveys: evidence from collectivistic...; 2012; Fang, J., Wen, C., Prybutok, V.
- Using screen video capture software to aide and inform cognitive interviewing; 2012; Chaney, B. H., Barry, A. E., Chaney, J. D., Stellefson, M. L., Webb, M. C.
- Costs and Errors in Fixed and Mobile Phone Surveys; 2012; Vehovar, V., Slavec, A., Berzelak, N.
- Building Your Own Online Panel Via E-Mail and Other Digital Media; 2012; Toepoel, V.
- Use of Web 2.0 to Recruit Australian Gay Men to an Online HIV/AIDS Survey; 2012; Theriault, N., Bi, P., Hiller, J. E., Nor, M.
- The World's Simplest Survey Microsimulator (WSSM); 2012; Karr, A. F., Cox, L. H.

