Web Survey Bibliography
The visual capabilities offered by the internet provide a platform by which magazine readers may be queried about their viewing, noting and recognizing of ad copy appearing in specific magazine issues. However, it is well known that “samples” used in these studies may be subject to substantial bias arising from the non-probability nature of the sample selection process. Furthermore, when correctly computed, the response rates on many internet panels are quite low. In those situations when certain key variables are statistically linked (i.e. strongly correlated) with sample selection bias and key substantive outcomes, these variables may be used to adjust or calibrate these estimates. This is sometimes known as post stratification in traditional full-probability sampling and model-based estimation for model based (non-probability) sampling. In examining a large number of internet samples used to collect data on ad-noting and ad recognition it is has been found that these outcome measures are associated and correlated, to varying degrees, with gender, time spent reading, place of reading, percent of pages opened, and frequency of reading. Furthermore, we have found the distribution of these variables among internet respondents is substantially different from those in traditional full-probability surveys. We have developed a series of sample weighting procedures to remove a substantial amount of the “selection bias” linked to these reading qualities. This bias reduction step results in meaningful changes in readership ad-noting and ad identification. This paper will show, using actual data, how our approach to bias reduction weighting was developed, and how it impacts the outcomes of ad-noting and identification. In our decision to apply these weights we have adopted a standard minimization of mean squared error approach and perspective. That is, any weighting which increases variable random error must be offset with bias reduction. Bias reduction occurs when changes in the survey estimates are observed. Within a single magazine issue, the overall changes in ad noting scores are not typically large. However, there are ads in which noting scores do show substantial change. These changes are consistent with expectations linked to the adjustment measures. Furthermore, while an outside validation of the model based estimates has not been undertaken, our examination of overall impact across magazines is highly consistent with those expected on the basis of the variables involved. Thus, while we do not claim that our results are externally validated, we are comfortable in saying that the adjustments are in the expected direction and appear to make sense.
Conference Homepage (abstract) / (full text)
Web Survey Bibliography (267)
- Panel Attrition: Separating Stayers, Sleepers and Other Types of Drop-Out in an Internet Panel; 2013; Lugtig, P. J.
- Speeding and Non-Differentiation in Web Surveys: Evidence of Correlation and Strategies for Reduction...; 2013; Zhang, C.
- Web Versus Outbound: A Mode Face-Off Following the Presidential Debate; 2013; Marlar, J.
- The Effects of Errors in Paradata on Weighting Class Adjustments: A Simulation Study; 2013; West, B. T.
- Improving Surveys with Paradata: Analytic Uses of Process Information; 2013; Kreuter, F.
- Ten questions to ask your online survey provider; 2013; Williams, D.
- Practical tools for designing and weighting survey samples; 2013; Valliant, R. L., Daver, J. A., Kreuter, F.
- Measuring Wages Worldwide: Exploring the Potentials and Constraints of Volunteer Web Surveys; 2013; Steinmetz, S., Raess, D., Tijdens, K., de Pedraza, P.
- Moving an established survey online – or not?; 2013; Barber, T., Chilvers, D., Kaul, S.
- The comparison of road safety survey answers between web-panel and face-to-face; Dutch results of SARTRE...; 2013; Goldenbeld, C., de Craen, S.
- Measuring working conditions in a volunteer web survey; 2013; de Pedraza, P., Villacampa, A.
- Propensity Score Weighting – Can Personality Adjust for Selectivity?; 2013; Glantz, A., Greszki, R.
- The rise of the "connected viewer"; 2012; Smith, A., Boyles, J. L.
- Eurobarometer Special surveys: Special Eurobarometer 381; 2012
- Computation of Survey Weights: Bridging Theory and Practice; 2012; Debell, M.
- Modes of Data Collection; 2012; Tourangeau, R.
- An experimental investigation of the effects of noncontingent and contingent incentives in recruiting...; 2012; Lavrakas, P. J., Dennis, J. M., Peugh, J., Shand-Lubbers, J., Lee, E., Peugh, J., Charlebois, O., Murakami...
- Rules of engagement: The war against poorly engaged respondents - guidelines for elimination; 2012; Gittelman, S. H., Trimarchi, E.
- Web Panels; 2012; Bethlehem, J., Biffignandi, S.
- Use of Response Propensities; 2012; Bethlehem, J., Biffignandi, S.
- Weighting Adjustment Techniques; 2012; Bethlehem, J., Biffignandi, S.
- The Problem of Self-Selection; 2012; Bethlehem, J.,Biffignandi, S.
- The Problem of Undercoverage; 2012; Bethlehem, J., Biffignandi, S.
- Respondent-driven sampling; 2012; Schonlau, M., Liebau, E.
- A Structural Analysis Based on Similarity between Fuzzy Clusters and Its Application to Evaluation Data...; 2012; Chiba, R., Furutani, T., Sato-Ilic, M.
- Why one should incorporate the design weights when adjusting for unit nonresponse using response homogeneity...; 2012; Kott, P. S.
- Cell Sample Demographics under Alternative Dual-Frame Sample Designs; 2012; Montgomery, R., Morrison, H., Zeng, W., Wolter, K., Blumberg, S. J., O'Connor, K.
- Data Quality from Low Cost Data Collection Methodologies; 2012; Traugott, M. W.
- To Weight, or Not to Weight, That is the Question: Survey Weights and Multivariate Analysis; 2012; Young, R., Johnson, D. R.
- Multiple Imputation for Unit Nonresponse and Measurement Error; 2012; Peytchev, A.
- Assessing the Quality of Survey Data ; 2012; Blasius, J.
- Collecting, Managing, and Assessing Data Using Sample Surveys; 2012; Stopher, P.
- Online survey research: Findings, best practices, and future research. Report prepared for the Advertising...; 2011; Vannette, D.
- Online survey research: Findings, Best practices, and future research; 2011
- Just published: Forrester Wave™ of enterprise feedback management satisfaction and loyalty solutions...; 2011; McInnes, A.
- In search of a new approach to measure newspaper audiences in Canada: The journey continues; 2011; Crassweller, A., Rogers, J., Graves, F., Gauthier, E., Charlebois, O.
- Households with Computers, Telephone Subscriptions, and Internet Access, Selected Years, 1997 - 2010; 2011
- Eurobarometer Special surveys: EB75.1 E-Communications Household Survey. Special Eurobarometer 362; 2011
- A meta-analysis of experiments manipulating progress indicators in Web surveys; 2011; Callegaro, M., Villar, A., Yang, Y.
- The Evolution of Edits in the Canadian Census of Population Online Questionnaires; 2011; Laroche, D.
- Current Projects at University of Ljubljana; 2011; Lozar Manfreda, K.
- Maintaining Cross-Sectional Representativeness in a Longitudinal General Population Survey ; 2011; Lynn, P.
- The German Access Panel and the Impact of Response Propensities; 2011; Amarov, B., Enderle, T., Muennich, R., Rendtel, U., Zins, S.
- A Bayesian analysis of small area probabilities under a constraint; 2011; Nandram, B., Sayit, H.
- The Impact of Non-Response Treatments on the Stability of Blockmodels; 2011; Znidarsic, A., Ferligoj, A., Doreian, P.
- test; 2011; Aadland, D.; Øverlien, C.; Abbott, R. D.; Abels, E. G.
- Research on Internet survey errors and control methods; 2011; Mingyue, F., Xicang, Z.
- Separation of selection bias and mode effect in mixed-mode survey – Application to the face-to...; 2011; Bayart, C., Bonnel, P.
- Social Climate Survey of Tobacco Control: A mixed-mode approach; 2011; Klein, J. D., McMillen, R.
- Exploring use of information in paradata through calibration method to detect and adjust non-response...; 2011; Billiet, J. Matsuo, H.
