Web Survey Bibliography
Title Statistical Design for Online Experiments Across Desktops, Tablets, Smartphones (and Maybe Wearable Gadgets)
Author Qian, P.; Sadeghi, S.; Arora, N. K.
Year 2016
Access date 18.07.2017
Abstract A/B testing and multivariate testing have become the bread-and-butter for applications as varied as website optimization, mobile apps and email campaigns. An emerging problem in this area is how to conduct online experiments simultaneously across multiple platforms such as desktops, tablets, smartphones (and maybe wearable gadgets). A simple way is to run tests for different platforms separately. An obvious drawback of this approach is that it does not borrow information from all the sources. To overcome this limitation, we propose a new experimental design framework that allows for optimizing testing for different platforms but also enabling comparing and pooling data across the platforms. Based on a new criterion called sliced effect hierarchy, this framework introduces a "sliced design" idea to partition test units into homogenous slices. The different slices are then used to optimize testing for each platform and the combined design makes it possible to benchmark and correlate testing performance of the different platforms. We demonstrate the effectiveness of the proposed method by using email design application for an online magazine.
Access/Direct link Conference Homepage (abstract) / (full text)
Year of publication2016
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Joint Statistical Meetings 2016 (13)
- Development and Pilot Test of a Mobile Application for Field Data Collection; 2016; Chiappetta, L.; Kerr, M. M.
- Statistical Design for Online Experiments Across Desktops, Tablets, Smartphones (and Maybe Wearable...; 2016; Qian, P.; Sadeghi, S.; Arora, N. K.
- A Case Study on the Use of Propensity Score Adjustments with Web Survey Data; 2016; Parsons, V.
- Motivated Misreporting in Web Panels; 2016; Bach, R.; Eckman, S.
- Are Initial Respondents Different from the Nonresponse Follow-Up Cases? A Study of Probability-Based...; 2016; Zeng, W.; Dennis, J. M.
- Using official surveys to reduce bias of estimates from nonrandom samples collected by web surveys; 2016; Beresovsky, V.; Dorfman, A.; Rumcheva, P.
- Predicting and Preventing Break-Offs in Web Surveys; 2016; Mittereder, F.
- A Feasibility Study of Recruiting and Maintaining a Web Panel of People with Disabilities; 2016; Chandler, J.
- Exploration of Methods for Blending Unconventional Samples with Traditional Probability Samples; 2016; Gellar, J.; Zhou, H.; D.; Sinclair, M. D.
- Ratio of Vector Lengths as an Indicator of Sample Representativeness ; 2016; Shin, H. C.
- Design of Sample Surveys That Complement Observational Data to Achieve Population Coverage; 2016; Slud, E.; Ashmead, R.
- Inferences from Internet Panel Studies and Comparisons with Probability Samples; 2016; Lachan, R.; Boyle, J.; Harding, R.
- Exploring the Gig Economy Using a Web-Based Survey: Measuring the Online 'and' Offline Side...; 2016; Robles, B. J.; McGee, M.