Web Survey Bibliography
Title Gamifying Questions Using Text Alone
Author Cape, P. J.
Year 2016
Access date 29.04.2016
Presentation PPT (4.64MB)
Abstract
Relevance & Research Question: Most practitioners will be aware of the concept of gamification. Fewer however will be aware of how gamification can be achieved in practice and most, we suspect, will be overwhelmed at the prospect of designing a ‘game’. In this presentation we propose a framework for understanding gamification, without the need for games. We define the key features of a game and link this to established theories of motivation and questioning practices emanating from behavioural economics. In experiment we ask the question – can simple text based gamification techniques give us richer and deeper data than our traditional questioning style?
Methods & Data: The results of two experiments will be presented. In both instances online interviewing was employed. The first experiment looks at a question of spontaneous brand awareness within the Mobile Phone category. 150 interviews per test (gamified) and control (standard) cell were undertaken. In this test we introduce a game mechanic, the question itself is unchanged. Data to be presented will be the number of brands mentioned and what those brands are. In the second experiment we conducted surveys in two countries with 600 and 300 interviews per country per cell (gamified vs non-gamified). In this experiment game consisted of adding a hypothetical scenario to and open question – getting the respondent to imagine they were speaking to the CEO. A rule that a maximum of only 3 things could be said to the CEO was added.
Results: In the first experiment the number of brands mentioned on average increased from 4 to 6. These brands were not obscure “extra” brands, but more mentions of the best known brands. This implies that our standard online questioning techniques encourage satisficing behaviour. The second experiment resulted in more content (measured by number of characters typed) and more codable content being given. The number of people giving 3 codable answers increased from 5% to 47%.
Added Value: In addition to proving again that gamification ‘works’ to increase data this paper also shows how simple it is to execute a gamified question using text alone.
Methods & Data: The results of two experiments will be presented. In both instances online interviewing was employed. The first experiment looks at a question of spontaneous brand awareness within the Mobile Phone category. 150 interviews per test (gamified) and control (standard) cell were undertaken. In this test we introduce a game mechanic, the question itself is unchanged. Data to be presented will be the number of brands mentioned and what those brands are. In the second experiment we conducted surveys in two countries with 600 and 300 interviews per country per cell (gamified vs non-gamified). In this experiment game consisted of adding a hypothetical scenario to and open question – getting the respondent to imagine they were speaking to the CEO. A rule that a maximum of only 3 things could be said to the CEO was added.
Results: In the first experiment the number of brands mentioned on average increased from 4 to 6. These brands were not obscure “extra” brands, but more mentions of the best known brands. This implies that our standard online questioning techniques encourage satisficing behaviour. The second experiment resulted in more content (measured by number of characters typed) and more codable content being given. The number of people giving 3 codable answers increased from 5% to 47%.
Added Value: In addition to proving again that gamification ‘works’ to increase data this paper also shows how simple it is to execute a gamified question using text alone.
Access/Direct link Conference Homepage (presentation)
Year of publication2016
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography (4086)
- Web Surveys Versus Other Survey Modes: An Updated Meta-analysis Comparing Response Rates ; 2016; Wengrzik, J.; Bosnjak, M.; Lozar Manfreda, K.
- The Effect of a Pre-due Date Reminder Letter on Non response in a Business Survey ; 2016; Hernandez, A. D.; Fan, C. C.; Tuttle, A.
- Adapting the Alternative Questionnaire Experiment for a Telephone Survey: Preparing for Changes to the...; 2016; Patten, E.; Brown, A.; Parker, K.
- Retrospective Measurement of Students’ Extracurricular Activities with a Self-administered Calendar...; 2016; Furthmueller, P.
- Privacy Concerns in Responses to Sensitive Questions. A Survey Experiment on the Influence of Numeric...; 2016; Bader, F., Bauer, J., Kroher, M., Riordan, P.
- Ballpoint Pens as Incentives with Mail Questionnaires – Results of a Survey Experiment; 2016; Heise, M.
- Non-Observation Bias in an Address-Register-Based CATI/CAPI Mixed Mode Survey; 2016; Lipps, O.
- Spatial Modeling through GIS to Reveal Error Potent ial in Survey Data: Where, What and How Much ; 2016; English, N.; Ventura, I.; Bilgen, I.; Stern, M. J.
- Bees to Honey or Flies to Manure? How the Usual Subject Recruitment Exacerbates the Shortcomings of...; 2016; Snell, S. A., Hillygus, D. S.
- Thinking Inside the Box Visual Design of the Response Box Affects Creative Divergent Thinking in an...; 2016; Mohr, A. H.; Sell, A.; Lindsay, T.
- Detecting Insufficient Effort Responding with an Infrequency Scale: Evaluating Validity and Participant...; 2016; Huang, J. L.; Bowling, N. A.; Liu, Me.; Li, Yu.
- Detecting careless respondents in web-based questionnaires: Which method to use?; 2016; Niesen, A. S. M.; Meijer, R. R.; Tendeiro, J. N.
- Web surveys for offline rural communities ; 2016; Gichohi, B. W.
- On-line life history calendar and sensitive topics: A pilot study; 2016; Morselli, D.; Berchtold, A.; Granell, J.-C. S.; Berchtold, And.
- Does survey mode matter for studying electoral behaviour? Evidence from the 2009 German Longitudinal...; 2016; Bytzek, E.; Bieber, I. E.
- The impact of visual design and response formats on data quality in a web survey of MOOC students; 2016; Maloshonok, N.; Terentev, E.
- An experiment comparing grids and item-by-item formats in web surveys completed through PCs and smartphones...; 2016; Revilla, M.; Toninelli, D.; Ochoa, C.
- Establishing the accuracy of online panels for survey research; 2016; Bruggen, E.; van den Brakel, J.; Krosnick, J. A.
- Gamifying Questions Using Text Alone; 2016; Cape, P. J.
- Assessing the Effects of Participant Preference and Demographics in the Usage of Web-based Survey Questionnaires...; 2016; Mlikotic, R.; Parker, B.; Rajapakshe, R.
- Improving Inpatient Surveys: Web-Based Computer Adaptive Testing Accessed via Mobile Phone QR Codes; 2016; Chien, T. S.; Lin, W.S.
- Surveying End-of-Life Medical Decisions in France: Evaluation of an Innovative Mixed-Mode Data Collection...; 2016; Legleye, S; Pennec, S.; Monnier, A.; Stephan, A.; Brouard, N.; Bilsen, J.; Cohen, J.
- Problems and Prospects in Survey Research; 2016; Moy, P.; Murphy, J.
- When will Nonprobability Surveys Mirror Probability Surveys? Considering Types of Inference and Weighting...; 2016; Pasek, J.
- Eye-tracking Social Desirability Bias; 2016; Kaminska, O.; Foulsham, T.
- Evaluating Three Approaches to Statistically Adjust for Mode Effects; 2016; Kolenikov, S.; Kennedy, C.
- Distractions: The Incidence and Consequences of Interruptions for Survey Respondents ; 2016; Ansolabehere, S.; Schaffner, B. F.
- The Effect of CATI Questions, Respondents, and Interviewers on Response Time; 2016; Olson, K.; Smyth, J. D.
- Pre-Survey Text Messages (SMS) Improve Participation Rate in an Australian Mobile Telephone Survey:...; 2016; Dal Grande, E.; Chittleborough, C. R.; Campostrini, S.; Dollard, M.; Taylor, A. W.
- Pitfalls, Potentials, and Ethics of Online Survey Research: LGBTQ and Other Marginalized and Hard-to...; 2016; McInroy, L. B.
- Effects of Personalization and Invitation Email Length on Web-Based Survey Response Rates; 2016; Trespalacios, J. H.; Perkins, R. A.
- Linearization Variance Estimators for Mixed ‒ mode Survey Data when Response Indicators are Modeled...; 2016; Demnati, A.
- Forecasting proportional representation elections from non-representative expectation surveys; 2016; Graefe, A.
- Short and Sweet? Length and Informative Content of Open-Ended Responses Using SMS as a Research Mode; 2016; Walsh, E.; Brinker, J. K.
- Adaptive survey designs to minimize survey mode effects – a case study on the Dutch Labor Force...; 2016; Calinescu, M.; Schouten, B.
- Mixing modes of data collection in Swiss social surveys: Methodological report of the LIVES-FORS mixed...; 2016; Roberts, C.; Joye, D.; Staehli, M. E.
- What is the gain in a probability-based online panel to provide Internet access to sampling units that...; 2016; Revilla, M.; Cornilleau, A.; Cousteaux, A-S.; Legleye, S; de Pedraza, P.
- Representative web-survey!; 2016; Linde, P.
- Assessing targeted approach letters: effects in different modes on response rates, response speed and...; 2016; Lynn, P.
- New Generation of Online Questionnaires?; 2016; Revilla, M.; Ochoa, C.; Turbina, A.
- The Analysis of Respondent’s Behavior toward Edit Messages in a Web Survey; 2016; Park, Y.
- Refining the Web Response Option in the Multiple Mode Collection of the American Community Survey; 2016; Hughes, T.; Tancreto, J.
- The Utility of an Online Convenience Panel for Reaching Rare and Dispersed Populations; 2016; Sell, R.; Goldberg, S.; Conron, K.
- Assessment of Innovations in Data Collection Technology for Understanding Society; 2016; Couper, M. P.
- Comparing online and telephone survey results in the context of a skin cancer prevention campaign evaluation...; 2016; Hollier, L.P.; Pettigrew, S.; Slevin, T.; Strickland, M.; Minto, C.
- Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk; 2016; Berinsky, A.; Huber, G. A.; Lenz, G. S.
- Setting Up an Online Panel Representative of the General Population The German Internet Panel; 2016; Blom, A. G.; Gathmann, C.; Krieger, U.
- Implementation of Web-Based Respondent Driven Sampling among Men Who Have Sex with Men in Sweden; 2016; Stroemdahl, S.; Lu, X.; Bengtsson, L.; Liljeros, F.; Thorson, A.
- Options for Fielding and Analyzing Web Surveys; 2016; Schonlau, M.; Couper, M. P.
- Report of the Inquiry into the 2015 British general election opinion polls; 2016; Sturgis, P., Baker, N., Callegaro, M., Fisher, St., Green, J., Jennings, W., Kuha, J., Lauderdale, B...