Web Survey Bibliography
The visual capabilities offered by the internet provide a platform by which magazine readers may be queried about their viewing, noting and recognizing of ad copy appearing in specific magazine issues. However, it is well known that “samples” used in these studies may be subject to substantial bias arising from the non-probability nature of the sample selection process. Furthermore, when correctly computed, the response rates on many internet panels are quite low. In those situations when certain key variables are statistically linked (i.e. strongly correlated) with sample selection bias and key substantive outcomes, these variables may be used to adjust or calibrate these estimates. This is sometimes known as post stratification in traditional full-probability sampling and model-based estimation for model based (non-probability) sampling. In examining a large number of internet samples used to collect data on ad-noting and ad recognition it is has been found that these outcome measures are associated and correlated, to varying degrees, with gender, time spent reading, place of reading, percent of pages opened, and frequency of reading. Furthermore, we have found the distribution of these variables among internet respondents is substantially different from those in traditional full-probability surveys. We have developed a series of sample weighting procedures to remove a substantial amount of the “selection bias” linked to these reading qualities. This bias reduction step results in meaningful changes in readership ad-noting and ad identification. This paper will show, using actual data, how our approach to bias reduction weighting was developed, and how it impacts the outcomes of ad-noting and identification. In our decision to apply these weights we have adopted a standard minimization of mean squared error approach and perspective. That is, any weighting which increases variable random error must be offset with bias reduction. Bias reduction occurs when changes in the survey estimates are observed. Within a single magazine issue, the overall changes in ad noting scores are not typically large. However, there are ads in which noting scores do show substantial change. These changes are consistent with expectations linked to the adjustment measures. Furthermore, while an outside validation of the model based estimates has not been undertaken, our examination of overall impact across magazines is highly consistent with those expected on the basis of the variables involved. Thus, while we do not claim that our results are externally validated, we are comfortable in saying that the adjustments are in the expected direction and appear to make sense.
Conference Homepage (abstract) / (full text)
Web Survey Bibliography - Research on Internet (644)
- Online Fundraising Essentials, Second Edition; 2013; Stevenson, S. C.
- Tips for Evaluating Online Effectiveness; 2013; Stevenson, S. C.
- Worldwide online research spending; 2012
- The rise of the "connected viewer"; 2012; Smith, A., Boyles, J. L.
- The integration of facebook into class management: an exploratory study; 2012; Chou, P. N.
- Selection bias of internet panel surveys: A comparison with a paper-based survey and national governmental...; 2012; Tsuboi, S. et al.
- Research company spotlight - Mobile surveys; 2012
- Redeveloping the research section of Meningitis UK's website — A case study report; 2012; Witt, J. et al.
- Guide to social science data preparation. Best practice throughout the data life cycle; 2012
- Google et Médiamétrie créent une audience bimédia; 2012; Gonzales, P.
- Ebook readings jumps, print book reading declines; 2012; Rainie, L., Duggan, M.
- Better customer in sight in real time; 2012; Macdonald, E., Wilson, H. N., Konus, H.
- Better Answers to Basic Questions: Enhancing the accuracy of online reach and audience metrics; 2012; van Dam, P. H., van Ossenbruggen, R., Voorend, R.
- WebSM Study: Survey software features overview ; 2012; Vehovar, V.; Cehovin, G.; Kavcic, L.; Lenar, J.
- Web Panels; 2012; Bethlehem, J., Biffignandi, S.
- Challenges of assessing the quality of a prerecruited probability-based panel of internet users in...; 2012; Struminskaya, B., Kaczmirek, L.
- Deep Data: Qualitative Approaches to E-Research in the Digital Age; 2012; Salmons, J.
- The use of new technologies on the British Birth Cohort Studies; 2012; Calderwood, L.
- Opportunities and Challenges for the Digital Researcher; 2012; Blank, G., Morey, Y.
- Reliable Online Social Network Data Collection; 2012; Abdesslem, F. B., Parris, I., Henderson, T.
- Little experience with technology as a cause of nonresponse in online surveys; 2012; Struminskaya, B., Schaurer, I., Kaczmirek, L., Bandilla, W.
- The Impact of Mobilization Media on Off-Line and Online Participation: Are Mobilization Effects Medium...; 2012; Vissers, S., Hooghe, M., Stolle, D., Maheo, V.-A.
- Succinct Survey Measures of Web-Use Skills; 2012; Hargittai, E., Hsieh, Y. P.
- Where gamification came from and why it could be here to stay; 2012; Ewing, T.
- Gamification 101 - from theory to practice - part II ; 2012; Puleston, J.
- The impact of two-stage highly interesting questions on completion rates and data quality in online...; 2012; M, Hansen, J. M; Smith, S. M.
- User models as revealed in web-based research services; 2012; Bodoff, D., Raban, D.
- User agent; 2011
- Unpublisihed internal Google report on break off rates by device type; 2011; Callegaro, M.
- The GfK NOP Media Efficiency Panel; 2011; Moy, C. et al.
- Online survey research: Findings, Best practices, and future research; 2011
- GRE® program announces big benefits and big savings for GRE® test takers worldwide; 2011
- Google and Kantar develop measurement panel; 2011
- Going online with assessment; 2011; Burke, E. et al.
- Exploring the digital nation. Computer and Internet use at home; 2011
- Ethical issues in Internet research; 2011; Hoerger, M., Currell, C.
- ESOMAR AND CASRO submission to the W3C tracking protection working group - Market research techniques...; 2011
- A Methodological Inference towards the Quantification of Technological Frames ; 2011; Cachia, E., Camilleri, P.
- The Battle For Business Data: New Technologies Critical To Researchers' Arsenal; 2011; Anderson, J.
- A Comparison of Internet-Based Participant Recruitment Methods: Engaging the Hidden Population of Cannabis...; 2011; Temple, E. C., Brown, R. F.
- The Perils of Online Surveys; 2011; McCullough, P. R.
- Mixed methods designs in marketing research; 2011; Harrison, R. L., Reilly, T. M.
- Development and Validation of a Web-Based Questionnaire for Surveying Skydivers; 2011; Nilsson, J.; Friden, C.; Buren, V.; Ang, B.
- Facebook sampling methods: some methodological proposals; 2011; Macrì, E., Tessitore, C.
- Survey Says? A Primer on Web-Based Survey Design and Distribution; 2011; Oppenheimer, A. J., Pannucci, C. J., Kasten, S. J., Haase, S. C.
- Improving online surveys; 2011; Puleston, J.
- Visiting item non-responses in internet survey data collection; 2011; Albaum, G., Roster, C. A., Smith, S. M., Wiley, J. B.
- Estimating nonresponse bias and mode effects in a mixed-mode survey; 2011; Lugtig, P. J., Lensvelt-Mulders, G. J., Frerichs, R., Greven, A.
- Conceptualizing Trust in Digital Environments: Health-e Skepticism: Trust in the Age of the Internet; 2011; Harris, A., Wyatt, S., Kelly, S.
- The Changing Face of Trust in Health Websites; 2011; Sillence, L., Mo, P., Briggs, P., Harris, P. R.
