Web Survey Bibliography
The visual capabilities offered by the internet provide a platform by which magazine readers may be queried about their viewing, noting and recognizing of ad copy appearing in specific magazine issues. However, it is well known that “samples” used in these studies may be subject to substantial bias arising from the non-probability nature of the sample selection process. Furthermore, when correctly computed, the response rates on many internet panels are quite low. In those situations when certain key variables are statistically linked (i.e. strongly correlated) with sample selection bias and key substantive outcomes, these variables may be used to adjust or calibrate these estimates. This is sometimes known as post stratification in traditional full-probability sampling and model-based estimation for model based (non-probability) sampling. In examining a large number of internet samples used to collect data on ad-noting and ad recognition it is has been found that these outcome measures are associated and correlated, to varying degrees, with gender, time spent reading, place of reading, percent of pages opened, and frequency of reading. Furthermore, we have found the distribution of these variables among internet respondents is substantially different from those in traditional full-probability surveys. We have developed a series of sample weighting procedures to remove a substantial amount of the “selection bias” linked to these reading qualities. This bias reduction step results in meaningful changes in readership ad-noting and ad identification. This paper will show, using actual data, how our approach to bias reduction weighting was developed, and how it impacts the outcomes of ad-noting and identification. In our decision to apply these weights we have adopted a standard minimization of mean squared error approach and perspective. That is, any weighting which increases variable random error must be offset with bias reduction. Bias reduction occurs when changes in the survey estimates are observed. Within a single magazine issue, the overall changes in ad noting scores are not typically large. However, there are ads in which noting scores do show substantial change. These changes are consistent with expectations linked to the adjustment measures. Furthermore, while an outside validation of the model based estimates has not been undertaken, our examination of overall impact across magazines is highly consistent with those expected on the basis of the variables involved. Thus, while we do not claim that our results are externally validated, we are comfortable in saying that the adjustments are in the expected direction and appear to make sense.
Conference Homepage (abstract) / (full text)
Web Survey Bibliography (6374)
- The Perils of Online Surveys; 2011; McCullough, P. R.
- A National Profile of Teacher Education Faculty: The Construction of an Online Survey; 2011; Graber, K. C., Erwin, H., Woods, A. M., Rhoades, J., Zhu, W.
- Using web-based and paper-based questionnaires for collecting data on fertility issues among female...; 2011; Van Den Berg, M. H., Overbeek, A., van der Pal, H. J. H., Versluys, B. A., , Van Leeuwe, F. E. Lambalk...
- Agreement between web-based and paper versions of a socio-demographic questionnaire in the NutriNet-...; 2011; Vergnaud, A. C., Touvier, M., Méjean, C., Kesse-Guyo, E., Pollet, C., Malon, A., Castetbon, K., Hercberg...
- Validation of the web-based LUMINA questionnaire for recruiting large cohorts of migraineurs; 2011; van Oosterhout, W. P. J., Weller, C. M., Stam, A. H., Stijnen, T.,Ferrari, M. D.; Terwindt, G. M.
- Reducing Sensitive Survey Response Bias in Research on Adolescents: A Comparison of Web-Based and Paper...; 2011; Wyrick, D. L., Bond, L.
- Exploring Health-related Experiences and Access to Care: Differences between Online and Telephone Survey...; 2011; Doty, M. M., Peugh, J., Shand-Lubbers, J.
- The Impact of “Forgiving” Introductions on the Reporting of Sensitive Behavior in Surveys...; 2011; Peter, J., Valkenburg, P. M.
- Comparing the Accuracy of RDD Telephone Surveys and Internet Surveys Conducted with Probability and...; 2011; Yeager, D. S., Krosnick, J. A., Chang, L. C., Javitz, H. S., Levendusky, M. S., Simpser, A., Wang, R...
- Surveying the General Public over the Internet Using Address-Based Sampling and Mail Contact Procedures...; 2011; Messer, B. L., Dillman, D. A.
- The power of qualitative research in the era of social media; 2011; Branthwaite, A., Patterson, S.
- Mobile phones as an extension of the participant observer's self: Reflections on the emergent role...; 2011; Hein, W., O'Donohoe, S., Ryan, A.
- Mixed methods designs in marketing research; 2011; Harrison, R. L., Reilly, T. M.
- Development and Validation of a Web-Based Questionnaire for Surveying Skydivers; 2011; Nilsson, J.; Friden, C.; Buren, V.; Ang, B.
- Method of administration affects adolescent post-immunization survey response rate: phone, paper, internet...; 2011; Pielak, K. L.; Buxton, J.; McIntyrea, C.; Tu, A,; Botnick, M. R.
- Introduction to Usability Testing for Survey Research; 2011; Geisen, E., Jarrett, C.
- Utilizing Web Technology in Business Data Collection: Some Norwegian, Dutch and Danish Experiences; 2011; Haraldsen, G., Snijkers, G., Roos, M., Sundvoll, A., Vik, T., Stax, H.-P.
- E-Census 2011 Portugal: implementation and results of the Pilot Survey; 2011; Vicente, P., Rosa, A., Reis, E.
- Facebook sampling methods: some methodological proposals; 2011; Macrì, E., Tessitore, C.
- Reflections on web based data collection in a mixed mode design: the case of the EU Labour Force Survey...; 2011; Kloek, W., van der Valk, J.
- Standardising the web data collection channel at the Basque Statistics Office (EUSTAT); 2011; Prado, C., Guinea , C.
- An Experimental Investigation of Mode Effects in the Hungarian Census Test 2009; 2011; Vereczkei, Z.
- Collaborative systems for enhancing the analysis of social surveys: the Grid Enabled Specialist Data...; 2011; Lambert, P., Warner, G., Doherty, T., McCafferty, S., Watt, J., Comerford, M., Gayle, V., Tan, L.,...
- ILS Online Survey; 2011; Weber, C.
- Testing for measurement equivalence of human values across online and paper-and-pencil surveys; 2011; Davidov, E., Depner, F.
- Development of a Web-Based Survey for Monitoring Daily Health and its Application in an Epidemiological...; 2011; Sugiura, H., Ohkusa, Y., Akahane, M., Sano, T., Okabe, N., Imamura, T.
- Sampling v. Scale: An investigation the tension between convenience sampling, response rates, probability...; 2011; Garland, P.
- Effectiveness and consequences of various recruitment methods in psychological research: case study; 2011; Póltorak, M.
- Using Amazon's Mechanical Turk for the recruitment of participants in Internet-based research; 2011; Reips, U. -D., Buffardi, L., Kuhlmann, T.
- A new approach to the analysis of survey drop-out. Results from Follow-up Surveys in the German Longitudinal...; 2011; Rossmann, J., Blumenstiel, J. E., Steinbrecher, M.
- Tracking the decision-making process – Findings from an Online Rolling Cross-Section Panel Study...; 2011; Faas, T.
- Social desirability and self-reported health risk behaviors in web-based research: three longitudinal...; 2011; Crutzen, R., Goeritz, A.
- Slider Scales Causing Serious Problems With Less Educated Respondents; 2011; Funke, F., Reips, U. -D., Thomas, R. K.
- Should we use the progress bar in online surveys? A meta-analysis of experiments manipulating progress...; 2011; Callegaro, M., Yang, Y., Villar, A.
- From "Web Questions" to "Propensity Score Weighting": An Evaluation of Topics and...; 2011; Welker, M., Taddicken, M.
- Survey Says? A Primer on Web-Based Survey Design and Distribution; 2011; Oppenheimer, A. J., Pannucci, C. J., Kasten, S. J., Haase, S. C.
- Quota Controls: Science or merely Sciencey?; 2011; Cape, P. J.
- Rich Profiles – Or: What's the problem with self-disclosure data?; 2011; Tress, F.
- Who are leaving our panel: panel attrition and personality traits; 2011; Marchand, M.
- Mobile Research Apps – Adding New Capabilities to Market Research; 2011; Rieber, D.
- The influence of personality traits and motives for joining on participation behavior in online panels...; 2011; Keusch, F.
- Asking sensitive questions in a recruitment interview for an online panel: the income question; 2011; Schaurer, I., Struminskaya, B., Kaczmirek, L., Bandilla, W.
- Determinants of access-panel participation: Recent experiences from the recruitment of members for a...; 2011; Engel, U., Bartsch, S., Vehre, H.
- Speeders in Online Value Research: Cross-checking results of fast and slow respondents in two separate...; 2011; Beckers, T., Siegers, P., Kuntz, A.
- Effects of survey question clarity on data quality; 2011; Lenzner, T.
- Respondent Characteristics as Explanations for Uninformative Survey Response: Sources of Nondifferentiation...; 2011; Van Meurs, L., Klausch, L. T., Schoenbach, K.
- Recreation Participation and Conservation Attitudes: Differences Between Mail and Online Respondents...; 2011; Graefe, A., Mowen, A. J., Covelli, E.
- Improving online surveys; 2011; Puleston, J.
- Snap judgement polling; 2011; Anderson, K., Wright, M., Wheeler, M.
- Individual differences in motivation to participate in online panels; 2011; Bruggen, E., Wetzels, M., de Ruyter, K., Schillewaert, N.

