Web Survey Bibliography
Title Initiative and Clarification in Web-Based Surveys
Author Schober, M. F., Conrad, F. G., Ehlen, P., Lind, L. H., Coiner, T.
Source Natural Language Generation in Spoken and Written Dialogue, AAAI Spring Symposium 2003, March 24-26, 2003, Palo Alto, CA
Year 2003
Access date 27.12.2005
Full text pdf (250k)
Abstract Respondents to computer-administered surveys don't
always interpret ordinary words and phrases uniformly;
clarification dialog can help improve uniformity of
interpretation, and thus survey data quality. Here we
explore two approaches to the interfaces for web-based
questionnaires that could increase the number of occasions
when helpful clarification is provided. One approach is to
increase respondents’ sensitivity to the possibility of
conceptual misalignment by rewording questions so that
they include part of the definition of the key concept(s).
We found that under some circumstances this led to
increased requests for the full definition, suggesting that
respondents recognize the potential for conceptual
misalignment. Another approach is to build respondent
models so that a mixed-initiative survey system can
determine when respondents are confused and volunteer
clarification. Such models can vary in their specificity from
generic respondents to groups of respondents (stereotypic
models) to models of individual respondents. Our data
show both potential benefits and pitfalls to this approach,
and they begin to map out the territory for dialog in
systems that collect data from users, as opposed to systems
that provide data to users. Our data also begin to help
determine the circumstances under which more
sophisticated survey dialog systems with Natural Language
generation and comprehension abilities are needed.
always interpret ordinary words and phrases uniformly;
clarification dialog can help improve uniformity of
interpretation, and thus survey data quality. Here we
explore two approaches to the interfaces for web-based
questionnaires that could increase the number of occasions
when helpful clarification is provided. One approach is to
increase respondents’ sensitivity to the possibility of
conceptual misalignment by rewording questions so that
they include part of the definition of the key concept(s).
We found that under some circumstances this led to
increased requests for the full definition, suggesting that
respondents recognize the potential for conceptual
misalignment. Another approach is to build respondent
models so that a mixed-initiative survey system can
determine when respondents are confused and volunteer
clarification. Such models can vary in their specificity from
generic respondents to groups of respondents (stereotypic
models) to models of individual respondents. Our data
show both potential benefits and pitfalls to this approach,
and they begin to map out the territory for dialog in
systems that collect data from users, as opposed to systems
that provide data to users. Our data also begin to help
determine the circumstances under which more
sophisticated survey dialog systems with Natural Language
generation and comprehension abilities are needed.
Access/Direct link Symposium homepage (full text)
Year of publication2003
Bibliographic typeConferences, workshops, tutorials, presentations
Web Survey Bibliography - Conrad, F. G. (70)
- The Design of Grids in Web Surveys; 2013; Couper, M. P., Tourangeau, R., Conrad, F. G., Zhang, C.
- The Science of Web Surveys; 2013; Tourangeau, R., Conrad, F. G., Couper, M. P.
- Up Means Good: The Impact of Screen Position on Evaluative Ratings in Web Surveys.; 2013; Tourangeau, R., Conrad, F. G., Couper, M. P.
- Disfluencies and Gaze Aversion in Unreliable Responses to Survey Questions; 2012; Schober, M. F., Conrad, F. G., Dijkstra, W., Ongena, Y. P.
- Database Lookup in Web Surveys; 2012; Couper, M. P., Zhang, C., Conrad, F. G., Tourangeau, R.
- Further research on the design of complex grids; 2011; Couper, M. P., Tourangeau, R.Conrad, F. G., Zhang, C.
- Interactive carrots and sticks to improve data quality; 2011; Conrad, F. G., Tourangeau, R., Couper, M. P., Zhang, C.
- Interactive interventions in web surveys can increase response accuracy.; 2011; Conrad, F. G.
- Race-of-Virtual-Interviewer Effects; 2011; Conrad, F. G., Schober, M. F., Nielsen, D.
- Which Web Survey Respondents Are Most Likely to Click for Clarification?; 2011; Coiner, T., Schober, M. F., Conrad, F. G.
- Should I Stay or Should I go: The Effects of Progress Feedback, Promised Task Duration, and Length of...; 2011; Yan, T., Conrad, F. G., Tourangeau, R., Couper, M. P.
- Designing Input Fields for Non-Narrative Open-Ended Responses in Web Surveys; 2011; Couper, M. P., Kennedy, C., Conrad, F. G., Tourangeau, R.
- Professional Web Respondents and Data Quality; 2010; Conrad, F. G., Tourangeau, R., Couper, M. P., Zhang, C.
- Increasing Respondents' Use of Definitions in Web Surveys; 2010; Peytchev, A., Conrad, F. G., Couper, M. P., Tourangeau, R.
- The impact of progress indicators on task completion ; 2010; Conrad, F. G., Couper, M. P., Tourangeau, R., Peytchev, A.
- Interactive Interventions in Web Surveys Can Increase Respondent Conscientiousness; 2009; Conrad, F. G., Tourangeau, R., Couper, M. P., Kennedy, C.
- Envisioning the Survey Interview of the Future ; 2009; Conrad, F. G., Schober, M. F.
- Experimenting With Speech Interactive Voice Response, Touchtone Data Entry and the Web for the National...; 2009; Cantor, D., Brick, P. D., Tourangeau, R., Conrad, F. G.
- Interactive feedback can improve accuracy of responses in web surveys; 2009; Conrad, F. G., Couper, M. P., Tourangeau, R., Galesic, M.
- Response Order and Response Distributions: The Format of the Response Options in a Web Survey; 2009; Tourangeau, R., Conrad, F. G., Couper, M. P., Balter, O.
- Improving the Design of Complex Matrix Questions; 2009; Couper, M. P., Tourangeau, R., Conrad, F. G.
- Interactive aspects of web surveys; 2009; Conrad, F. G.
- Eye-Tracking Data: New Insights on Response Order Effects and Other Cognitive Shortcuts in Survey Responding...; 2009; Galesic, M., Tourangeau, R., P.;Couper, M. P., Conrad, F. G.
- Classifying Open Occupation Descriptions in the Current Population Survey; 2008; Conrad, F. G., Couper, M. P.
- Social Cues Can Affect Answers to Threatening Questions in Virtual Interviews; 2008; Lind, L. H., Schober, M. F., Conrad, F. G.
- Virtual Interviews on Mundane, Non-Sensitive Topics: Dialog Capability Affects Response Accuracy More...; 2008; Conrad, F. G., Schober, M. F., Jans, M., Orlowski, R. A., Nielsen, D.
- The Impact of the Spacing of the Scale Options in a Web Survey; 2008; Kennedy, C., Tourangeau, R., Conrad, F. G., Couper, M. P., Redline, C. D.
- Interactive Interventions in Web Surveys Can Improve Data Quality; 2008; Conrad, F. G., Tourangeau, R., P., Kennedy, C.Couper, M. P.
- Risk of Disclosure, Perceptions of Risk, and Concerns about Privacy and Confidentiality as Factors in...; 2008; Couper, M. P.; Singer, E.; ; Conrad, F. G.; Groves, R. M.
- Surveys interviews and new communication technologies; 2007; Schober, M. F., Conrad, F. G.
- Interactive Features of Web Surveys; 2007; Conrad, F. G.
- The Impact of the Visible: The Design of Web Surveys; 2007; Tourangeau, R., Couper, M. P., Conrad, F. G.
- Color, Labels, and Interpretive Heuristics for Response Scales; 2007; Tourangeau, R., Couper, M. P., Conrad, F. G.
- Using Change to Improve Navigation in Grid Questions ; 2007; Galesic, M., Tourangeau, R., Couper, M. P., Conrad, F. G.
- Dialogue Capability and Perceptual Realism in Survey Interviewing Agents; 2007; Schober, M. F., Conrad, F. G.
- Minimizing Respondent Effort increases Use of Definitions in Web Surveys; 2007; Peytchev, A., Conrad, F. G., Couper, M. P., Tourangeau, R.
- Should I Stay or Should I Go? The Effects of Progress Indicators, Promised Duration, and Questinnaire...; 2007; Yan, T., Conrad, F. G., Tourangeau, R., Couper, M. P.
- Bringing features of human dialogue to web surveys; 2007; Conrad, F. G., Schober, M. F., Coiner, T.
- Use and Non-use of Clarification Features in Web Surveys; 2006; Conrad, F. G., Couper, M. P., Tourangeau, R., Peytchev, A.
- Color, Labels, and Interpretive Heuristics for Response Scales; 2006; Tourangeau, R., Couper, M. P., Conrad, F. G.
- Evaluating the Effectiveness of Visual Analog Scales: A Web Experiment; 2006; Couper, M. P., Tourangeau, R., Conrad, F. G., Singer, E.
- Interactive Feedback Can Improve the Quality of Responses in Web Surveys; 2005; Conrad, F. G., Couper, M. P., Tourangeau, R., Galesic, M.
- Promoting Uniform Question Understanding in Today's and Tomorrow's Surveys; 2005; Conrad, F. G., Schober, M. F.
- Visual Context Effects in Web Surveys; 2005; Couper, M. P., Conrad, F. G., Tourangeau, R.
- Interactive Feedback Can Improve Quality of Responses in Web Surveys; 2005; Conrad, F. G., Couper, M. P., Tourangeau, R., Galesic, M.
- Usability, Comparability And Data Quality Across Modes And Technologies In Census Data Collection; 2004; Conrad, F. G., Couper, M. P.
- Spacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions; 2004; Tourangeau, R., Conrad, F. G., Couper, M. P.
- Evaluating the Effects of Visual Analog Scales: A Web Experiment; 2004; Singer, E., Tourangeau, R., Conrad, F. G., Couper, M. P.
- Use of Don't Know and No Opinion Responses in Web Surveys; 2004; Tourangeau, R., Baker, R. P., Couper, M. P., Conrad, F. G.
- Effectiveness of Progress Indicators in Web Surveys; 2004; Conrad, F. G., Couper, M. P., Tourangeau, R., Peytchev, A.
