Web Survey Bibliography
Title Optimizing the Decennial Census for Mobile – A Case Study
Author Nichols, E. M.; Hawala, E. O.; Horwitz, R.; Bentley, M.
Source Federal Committee on Statistical Research Conference (FCSM), 2015
Year 2015
Access date 11.08.2016
Full text PDF (849 kB)
Abstract
The U.S. Census Bureau is committed to offering an Internet response option for the 2020 Census. We expect the majority of self-responses to come in through this medium. Decennial census field tests, such as the 2012 National Census Test and the 2014 Census Test, have used an online instrument to collect data in preparation for the 2020 Census. However, testing conducted through 2014 used online instruments that were designed for optimal view on a desktop or laptop. Although these surveys could be answered on tablets or smartphones, the design was not optimized for these smaller devices. On some mobile devices the screen display was very small and required the user to zoom or make other manipulations to enable the user to clearly read and answer the questions.
Mobile - ownership statistics show that, as of 2014, over half of adults owned a smartphone and some adults were dependent upon their smartphone for Internet access. These smartphone-dependent adults were more likely to be lower income, younger, and minority (Pew Internet Project, 2014). With the growth of mobile device ownership overall and the differences in device-dependent Internet access across subpopulations, the Census Bureau realized it must offer a responsive design for the online Census. That is, the questions and response categories must render optimally on the device, whether it is a large desktop computer or a small smartphone. A responsive design was developed for the 2015 Census Test. This means there was an optimized design for smaller devices such as smartphones and small tablets, and for larger devices such as large tablets, laptops, and desktops. Usability testing was conducted on different devices prior to fielding the survey.
This paper discusses the style rules we used to develop the mobile-optimized version of the 2015 Census Test instrument, and the issues that arose during usability testing. Additionally, we present device usage, completion time, and break-off data from the non-optimized 2014 and optimized 2015 Census Test online instruments. The two tests occurred in different geographic regions of the country with different population characteristics. So the typical usability metrics of time-on-task and task completion presented here to evaluate the effect of optimization are limited by sample confounds.
This paper discusses the style rules we used to develop the mobile-optimized version of the 2015 Census Test instrument, and the issues that arose during usability testing. Additionally, we present device usage, completion time, and break-off data from the non-optimized 2014 and optimized 2015 Census Test online instruments. The two tests occurred in different geographic regions of the country with different population characteristics. So the typical usability metrics of time-on-task and task completion presented here to evaluate the effect of optimization are limited by sample confounds.
Access/Direct link Conference Homepage (abstract) / (full tex)
Year of publication2015
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography (4086)
- Measuring Generalized Trust: An Examination of Question Wording and the Number of Scale Points; 2016; Lundmark, S.; Giljam, M.; Dahlberg, S.
- A Statistical Approach to Provide Individualized Privacy for Surveys; 2016; Esponda, F.; Huerta, K.; Guerrero, V. M.
- Online and Social Media Data As an Imperfect Continuous Panel Survey; 2016; Diaz, F.; Garmon, F.; Hofman, J. K.; Kiciman, E.; Rothschild, D.
- Social Media Analyses for Social Measurement; 2016; Schober, M. F.; Pasek, J.; Guggenheim, L.; Lampe, C.; Conrad, F. G.
- Equivalence of paper-and-pencil and computerized self-report surveys in older adults; 2016; Weigold, A.; Weigold, I. K.; Drakeford, M. K.; Dykema, S. A.; Smith, C. A.
- Quality of Different Scales in an Online Survey in Mexico and Colombia; 2016; Revilla, M.; Ochoa, C.
- A multi-group analysis of online survey respondent data quality: Comparing a regular USA consumer panel...; 2016; Golden, L.; Albaum, G.; Roster, C. A.; Smith, S. M.
- Does the Inclusion of Non-Internet Households in a Web Panel Reduce Coverage Bias?; 2016; Eckman, S.
- Investigating respondent multitasking in web surveys using paradata; 2016; Sendelbah, A.; Vehovar, V.; Slavec, A.; Petrovcic, A.
- The effect of email invitation elements on response rate in a web survey within an online community; 2016; Petrovcic, A.; Petric, G.; Lozar Manfreda, K.
- Respondent Conditioning in Online Panel Surveys: Results of Two Field Experiments; 2016; Struminskaya, B.
- Swapping bricks for clicks: Crowdsourcing longitudinal data on Amazon Turk; 2016; Daly, T. M.; Nataraajan, R.
- A reliability analysis of Mechanical Turk data; 2016; Rouse, S. V.
- Quota Controls in Survey Research.; 2016; Gittelman, S. H.; Thomas, R. K.; Lavrakas, P. J.; Lange, V.
- Presentation matters: how mode effects in item non-response depend on the presentation of response options...; 2016; Zeglovits, E.; Schwarzer, S.
- Internet-administered Health-related Quality of Life Questionnaires Compared With Pen and Paper in an...; 2016; Nitikman, M.; Mulpuri, K.; Reilly, C. W.
- Computers, Tablets, and Smart Phones: The Truth About Web-based Surveys; 2016; Merle, P.; Gearhart, S.; Craig, C.; Vandyke, M.; Brooks, M. E.; Rahimi, M.
- Scientific Surveys Based on Incomplete Sampling Frames and High Rates of Nonresponse; 2016; Fahimi, M.; Barlas, F. M.; Thomas, R. K.; Buttermore, N. R.
- Doing Surveys Online ; 2016; Toepoel, V.
- Exploring Factors in Contributing Student Progress in the Open University; 2016; Arifin, M. H.
- Taming Big Data: Using App Technology to Study Organizational Behavior on Social Media; 2015; Bail, C. A.
- The Use of a Nonprobability Internet Panel to Monitor Sexual and Reproductive Health in the General...; 2015; Legleye, S; Charrance, G.; Razafindratsima, N.; Bajos, N.; Bohet, A.; Moreau, C.
- Adapting Labour Force Survey questions from interviewer-administered modes for web self-completion in...; 2015; Betts, P.; Cubbon, B.
- ESOMAR/GRBN Online Research Guideline; 2015
- Taking MARS Digital; 2015; Melton, E.; Krahn, J.
- A Comparison of the Effects of Face-to-Face and Online Deliberation on Young Students’ Attitudes...; 2015; Triantafillidou, A.; Yannas, P.; Lappas, G.; Kleftodimos, A.
- A Privacy-Friendly Method to Reward Participants of Online-Surveys; 2015; Herfert, M.; Lange, B.; Selzer, A.; Waldmann, U.
- Doing Online Surveys: Zum Einsatz in der sozialwissenschaftlichen Raumforschung; 2015; Nadler, R.; Petzold, K.; Schoenduwe, R.
- Are Fast Responses More Random? Testing the Effect of Response Time on Scale in an Online Choice Experiment...; 2015; Boerger, T.
- The impact of frequency rating scale formats on the measurement of latent variables in web surveys -...; 2015; Menold, N.; Kemper, C. J.
- Investigating response order effects in web surveys using eye tracking; 2015; Karem Hoehne, J.; Lenzner, T.
- Implementation of the forced answering option within online surveys: Do higher item response rates come...; 2015; Decieux, J. P.; Mergener, A.; Neufang, K.; Sischka, P.
- Internet Panels, Professional Respondents, and Data Quality; 2015; Matthijsse, S.; De Leeuw, E. D.; Hox, J.
- Self-administered Questions and Interviewer–Respondent Familiarity; 2015; Rodriguez, L. A., Sana, M., Sisk, B.
- Comparing Food Label Experiments Using Samples from Web Panels versus Mall Intercepts; 2015; Chang, L. C., Lin, C. T. J.
- Translating Answers to Open-ended Survey Questions in Cross-cultural Research: A Case Study on the Interplay...; 2015; Behr, D.
- The impact of gamifying to increase spontaneous awareness; 2015; Cape, P.
- Using eye-tracking to understand how fourth grade students answer matrix items; 2015; Maitland, A.; Sun, H.; Caporaso, A.; Tourangeau, R.; Bertling, J.; Almonte, D.
- Incentive Types and Amounts in a Web-based Survey of College Students; 2015; Krebs, C.; Planty, M.; Stroop, J.; Berzofsky, M.; Lindquist, C.
- Response Rates and Response Bias in Web Panel Surveys; 2015; Boyle, J.; Berman, L.; Dayton, Ja.; Fakhouri, T.; Iachan, R.; Courtright, M.; Pashupati, K.
- Characteristics of the Population of Internet Panel Members; 2015; Boyle, J; Freedner, N.; Fakhouri, T.
- Internet and Smartphone Coverage in a National Health Survey: Implications for Alternative Modes; 2015; Couper, M. P.; Kelley, J.; Axinn, W.; Guyer, H.; Wagner, J.; West, B. T.
- An Overview of Mobile CATI Issues in Europe; 2015; Slavec, A.; Toninelli, D.
- Using Mobile Phones for High-Frequency Data Collection; 2015; Azevedo, J. P.; Ballivian, A.; Durbin, W.
- Willingness of Online Access Panel Members to Participate in Smartphone Application-Based Research; 2015; Pinter, R.
- Who Has Access to Mobile Devices in an Online Opt-in Panel? An Analysis of Potential Respondents for...; 2015; Revilla, M.; Toninelli, D.; Ochoa, C.; Loewe, G.
- Who Are the Internet Users, Mobile Internet Users, and Mobile-Mostly Internet Users?: Demographic Differences...; 2015; Antoun, C.
- A Meta-Analysis of Breakoff Rates in Mobile Web Surveys; 2015; Mavletova, A. M.; Couper, M. P.
- The Best of Both Worlds? Combining Passive Data with Survey Data, its Opportunities, Challenges and...; 2015; Duivenvoorde, S.; Dillon, A.
- Optimizing the Decennial Census for Mobile – A Case Study; 2015; Nichols, E. M.; Hawala, E. O.; Horwitz, R.; Bentley, M.