Web Survey Bibliography
Title Does the Use of Smartphones to Participate in Web Surveys Affect the Survey Experience when Sensitive Questions are Proposed?
Author Toninelli, D.; Revilla, M.
Source General Research Conference (GOR) 2016
Year 2016
Access date 16.08.2016
Presentation PDF (378 KB)
Abstract
Relevance & Research Question: Survey methodologists recently started dealing with a rapid change observed in the web survey participation: the spread of mobile devices and of the mobile web usage made the mobile participation more and more common. This causes the rise of new methodological questions concerning, for example, the comparability of collected data. In fact, the different characteristics of mobile devices (reduced size of the screens, high portability, etc.) and the potentially different contexts of participation (wider range of places, presence of bystanders) can significantly affect the survey experience and, consequently, how the information is reported. This papers aims at understanding if the use of smartphones and the use of a questionnaire optimized for mobile participation can significantly affect respondents' survey experience, when sensitive questions are proposed.
Methods & Data: Our experiment was implemented in Spain at the beginning of 2015 by the online opt-in panel Netquest. It involved 1,800 panelists who were randomly assigned to PC, smartphone non-optimized or smartphone optimized, in two waves. This allows evaluating the device and the optimization effects for the same respondents.
Results: Our results confirm previous literature findings about the participation place (the preferred is “home”). Nevertheless, the survey context for smartphones respondents can be very different because of the higher variety of places and the more common presence of bystanders. Nevertheless the use of smartphones does not play a role in determining the survey experience measured by the following aspects: the trust in the survey confidentiality, the perceived sensitivity of the questions, the feeling uneasy during the survey. Nevertheless, with a smartphone it is more probable being distracted by other tasks. The role of the questionnaire optimization is also not significant.
Added Value: Our results provide new findings about the survey experience for PC and smartphone respondents in a country not studied before: Spain. The web survey participation by means of smartphones can be very different from the classic PC-based survey participation. Nonetheless, even if sensitive questions are proposed, the respondents are not influenced by the used device or by the different context and the survey experience is not affected.
Methods & Data: Our experiment was implemented in Spain at the beginning of 2015 by the online opt-in panel Netquest. It involved 1,800 panelists who were randomly assigned to PC, smartphone non-optimized or smartphone optimized, in two waves. This allows evaluating the device and the optimization effects for the same respondents.
Results: Our results confirm previous literature findings about the participation place (the preferred is “home”). Nevertheless, the survey context for smartphones respondents can be very different because of the higher variety of places and the more common presence of bystanders. Nevertheless the use of smartphones does not play a role in determining the survey experience measured by the following aspects: the trust in the survey confidentiality, the perceived sensitivity of the questions, the feeling uneasy during the survey. Nevertheless, with a smartphone it is more probable being distracted by other tasks. The role of the questionnaire optimization is also not significant.
Added Value: Our results provide new findings about the survey experience for PC and smartphone respondents in a country not studied before: Spain. The web survey participation by means of smartphones can be very different from the classic PC-based survey participation. Nonetheless, even if sensitive questions are proposed, the respondents are not influenced by the used device or by the different context and the survey experience is not affected.
Access/Direct link Conference Homepage (abstract) / (full tex)
Year of publication2016
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Revilla, M. (26)
- Ideal and maximum length for a web survey; 2017; Revilla, M.; Ochoa, C.
- Millennials and emojis in Spain and Mexico.; 2017; Bosch Jover, O.; Revilla, M.
- Analyzing Survey Characteristics, Participation, and Evaluation Across 186 Surveys in an Online Opt-...; 2017; Revilla, M.
- Making use of Internet interactivity to propose a dynamic presentation of web questionnaires; 2016; Revilla, M.; Ochoa, C.; Turbina, A.
- Smartphones vs PCs: Does the Device Affect the Web Survey Experience and the Measurement Error for...; 2016; Toninelli, D.; Revilla, M.
- Does the Use of Smartphones to Participate in Web Surveys Affect the Survey Experience when Sensitive...; 2016; Toninelli, D.; Revilla, M.
- An experiment comparing grids and item-by-item formats in web surveys completed through PCs and smartphones...; 2016; Revilla, M.; Toninelli, D.; Ochoa, C.
- What is the gain in a probability-based online panel to provide Internet access to sampling units that...; 2016; Revilla, M.; Cornilleau, A.; Cousteaux, A-S.; Legleye, S; de Pedraza, P.
- New Generation of Online Questionnaires?; 2016; Revilla, M.; Ochoa, C.; Turbina, A.
- Quality of Different Scales in an Online Survey in Mexico and Colombia; 2016; Revilla, M.; Ochoa, C.
- Who Has Access to Mobile Devices in an Online Opt-in Panel? An Analysis of Potential Respondents for...; 2015; Revilla, M.; Toninelli, D.; Ochoa, C.; Loewe, G.
- Impact of raising awareness of respondents on the measurement quality in a web survey; 2015; Revilla, M.
- Open narrative questions in PC and smartphones: is the device playing a role?; 2015; Revilla, M.; Ochoa, C.
- Can a non-probabilistic online panel achieve question quality similar to that of the European Social...; 2015; Revilla, M.; Saris, W. E.; Loewe, G.; Ochoa, C.
- What are the Links in a Web Survey Among Response Time, Quality, and Auto-Evaluation of the Efforts...; 2015; Revilla, M.; Ochoa, C.
- Do online access panels really need to allow and adapt surveys to mobile devices? ; 2014; Revilla, M.; Toninelli, D.; Ochoa, C.; Loewe, G.
- The need of and the demand for completing surveys on mobile devices; 2014; Toninelli, D., Revilla, M., Ochoa, C.
- What are the Links in a Web Survey Among Response Time, Quality, and Auto-Evaluation of the Efforts...; 2014; Revilla, M., Ochoa, C.
- Comparison of the quality estimates in a mixed-mode and a unimode design: an experiment from the European...; 2014; Revilla, M.
- Quality of Web surveys; 2013; Revilla, M.
- Relative Mode Effects on Data Quality in Mixed-Mode Surveys by an Instrumental Variable; 2013; Vannieuwenhuyze, J. T. A., Revilla, M.
- Measurement invariance and quality of composite scores in a face-to-face and a web survey; 2013; Revilla, M.
- A Comparison of the Quality of Questions in a Face-to-face and a Web Survey; 2013; Revilla, M., Saris, W. E.
- Quality in Unimode and Mixed-Mode designs: A Multitrait-Multimethod approach; 2010; Revilla, M.
- A comparison of surveys using different modes of data collection; 2010; Revilla, M., Saris, W. E.
- Comparison between Liss panel (web) and ESS data (face to face); 2009; Revilla, M., Saris, W. E.