Web Survey Bibliography
Relevance & Research Question: Profile data in online panels consists mainly of self-disclosure data by the panelists. Unfortunately there are some general problems with self-disclosure data, e.g. data quality (Are you willing to provide information with high quality?), the identification of special target groups (Are you a LOHAS / Early Adopter?) or specific response behaviour (Are you always one of the first panelist who react to our invitations?) This contribution deals with the question, which simple metrics could be used to profile externally the panelists and what's the impact of these additional profile data on sampling.
Methods & Data: In a first exploratory study, we collected a variety of data for response behavior, data quality and special target groups. Based on this data we developed a short profiling questionnaire to predict the panelists response behavior. In a second study we evaluated the accuracy of our profiling method, comparing the response behavior of profiled and not-profiled panelists.
Results: In general, the additional profile data can be used to identify panelists better according to the specific requirements in studies, especially the recruitment for qualitative online studies, where the willingness to provide information voluntarily is crucial.
Added Value: Profiling in online panels usually only aims at the information itself and not at the performance when giving the information. With our contribution we'd like to show, that profile data can also be used for sampling, when studies have special requirements on response behavior. By that, it's possible to improve data quality. None of the less, we don't want to discuss only the possibilities of this method, but also its limits in our experience.
Conference Homepage (abstract)
Web survey bibliography - General Online Research Conference (GOR) 2011 (17)
- Sampling v. Scale: An investigation the tension between convenience sampling, response rates, probability...; 2011; Garland, P.
- Effectiveness and consequences of various recruitment methods in psychological research: case study; 2011; Poltorak, M.
- A new approach to the analysis of survey drop-out. Results from Follow-up Surveys in the German Longitudinal...; 2011; Rossmann, J., Blumenstiel, J. E., Steinbrecher, M.
- Tracking the decision-making process – Findings from an Online Rolling Cross-Section Panel Study...; 2011; Faas, T.
- Should we use the progress bar in online surveys? A meta-analysis of experiments manipulating progress...; 2011; Callegaro, M., Yang, Y., Villar, A.
- From "Web Questions" to "Propensity Score Weighting": An Evaluation of Topics and...; 2011; Welker, M., Taddicken, M.
- Rich Profiles – Or: What's the problem with self-disclosure data?; 2011; Tress, F.
- Who are leaving our panel: panel attrition and personality traits; 2011; Marchand, M.
- Mobile Research Apps – Adding New Capabilities to Market Research; 2011; Rieber, D.
- The influence of personality traits and motives for joining on participation behavior in online panels...; 2011; Keusch, F.
- Asking sensitive questions in a recruitment interview for an online panel: the income question; 2011; Schaurer, I., Struminskaya, B., Kaczmirek, L., Bandilla, W.
- Speeders in Online Value Research: Cross-checking results of fast and slow respondents in two separate...; 2011; Beckers, T., Siegers, P., Kuntz, A.
- Effects of survey question clarity on data quality; 2011; Lenzner, T.
- Respondent Characteristics as Explanations for Uninformative Survey Response: Sources of Nondifferentiation...; 2011; Van Meurs, L., Klausch, L. T., Schoenbach, K.
- Response Quantity, Response Quality, and Costs of Building an Online Panel via Social Contacts.; 2011; Toepoel, V.
- The Influence Of The Direction Of Likert-Type Scales In Web Surveys On Response Behavior In Different...; 2011; Keusch, F.
- Social desirability and self-reported health risk behaviors in web-based research: three longitudinal...; 2010; Crutzen, R., Goeritz, A.