Web Survey Bibliography
Title Modeling Survey Respondents' Speech to Improve Speech Survey Interface
Author Ehlen, P., Schober, M. F., Conrad, F. G.
Year 2004
Access date 14.06.2004
Abstract Computer-based telephone interviewing systems of the future, with speech interfaces that recognize respondents' unconstrained speech, could exploit aspects of the respondents' speech to provide clarification only when it is needed. Respondents have been shown to subtly indicate their need for clarification with pauses and various speech disfluencies (Bloom & Schober, 2000); more generally, speakers of different ages have been shown to have different rates of speech and disfluency (Bortfeld et al., 2001). The current study tests whether models of different types of speakers ("stereotypes") could effectively identify and correct conceptual misalignment. The study uses a Wizard-of-Oz paradigm to simulate an advanced speech interviewing system; telephone respondents answer survey questions about facts and behaviors on the basis of fictional scenarios, so that response accuracy can be measured. The study contrasts interfaces that do not model respondents, and interfaces that rely on respondents to solicit clarification, with two kinds that model respondents to provide unsolicited clarification. One interface uses a generic, non-stereotyped respondent model to identify and correct cases of possible conceptual misalignment, and another uses a stereotyped respondent model to identify and correct respondents according to age. 120 respondents (60 aged 18-35, and 60 aged 65-80) answer survey questions presented in a synthesized voice by telephone. In the two modeling conditions, responses are monitored for indications of uncertainty, such as disfluent speech and inactivity, which serve as the basis of the respondent models. Scripted definitions are offered when disfluent responses appear to warrant further clarification. In the stereotyped condition, disfluent responses of the older group are treated differently from those produced by the younger group, allowing, for example, a longer average latency before deciding to help the respondent. Findings show when respondent modeling helps improve response accuracy in speech interfaces, and how modeling respondents according to group membership can aid detection of conceptual misalignment relative to modeling generic respondents.
Year of publication2004
Bibliographic typeConferences, workshops, tutorials, presentations
Web Survey Bibliography - Conrad, F. G. (70)
- The Design of Grids in Web Surveys; 2013; Couper, M. P., Tourangeau, R., Conrad, F. G., Zhang, C.
- The Science of Web Surveys; 2013; Tourangeau, R., Conrad, F. G., Couper, M. P.
- Up Means Good: The Impact of Screen Position on Evaluative Ratings in Web Surveys.; 2013; Tourangeau, R., Conrad, F. G., Couper, M. P.
- Disfluencies and Gaze Aversion in Unreliable Responses to Survey Questions; 2012; Schober, M. F., Conrad, F. G., Dijkstra, W., Ongena, Y. P.
- Database Lookup in Web Surveys; 2012; Couper, M. P., Zhang, C., Conrad, F. G., Tourangeau, R.
- Further research on the design of complex grids; 2011; Couper, M. P., Tourangeau, R.Conrad, F. G., Zhang, C.
- Interactive carrots and sticks to improve data quality; 2011; Conrad, F. G., Tourangeau, R., Couper, M. P., Zhang, C.
- Interactive interventions in web surveys can increase response accuracy.; 2011; Conrad, F. G.
- Race-of-Virtual-Interviewer Effects; 2011; Conrad, F. G., Schober, M. F., Nielsen, D.
- Which Web Survey Respondents Are Most Likely to Click for Clarification?; 2011; Coiner, T., Schober, M. F., Conrad, F. G.
- Should I Stay or Should I go: The Effects of Progress Feedback, Promised Task Duration, and Length of...; 2011; Yan, T., Conrad, F. G., Tourangeau, R., Couper, M. P.
- Designing Input Fields for Non-Narrative Open-Ended Responses in Web Surveys; 2011; Couper, M. P., Kennedy, C., Conrad, F. G., Tourangeau, R.
- Professional Web Respondents and Data Quality; 2010; Conrad, F. G., Tourangeau, R., Couper, M. P., Zhang, C.
- Increasing Respondents' Use of Definitions in Web Surveys; 2010; Peytchev, A., Conrad, F. G., Couper, M. P., Tourangeau, R.
- The impact of progress indicators on task completion ; 2010; Conrad, F. G., Couper, M. P., Tourangeau, R., Peytchev, A.
- Interactive Interventions in Web Surveys Can Increase Respondent Conscientiousness; 2009; Conrad, F. G., Tourangeau, R., Couper, M. P., Kennedy, C.
- Envisioning the Survey Interview of the Future ; 2009; Conrad, F. G., Schober, M. F.
- Experimenting With Speech Interactive Voice Response, Touchtone Data Entry and the Web for the National...; 2009; Cantor, D., Brick, P. D., Tourangeau, R., Conrad, F. G.
- Interactive feedback can improve accuracy of responses in web surveys; 2009; Conrad, F. G., Couper, M. P., Tourangeau, R., Galesic, M.
- Response Order and Response Distributions: The Format of the Response Options in a Web Survey; 2009; Tourangeau, R., Conrad, F. G., Couper, M. P., Balter, O.
- Improving the Design of Complex Matrix Questions; 2009; Couper, M. P., Tourangeau, R., Conrad, F. G.
- Interactive aspects of web surveys; 2009; Conrad, F. G.
- Eye-Tracking Data: New Insights on Response Order Effects and Other Cognitive Shortcuts in Survey Responding...; 2009; Galesic, M., Tourangeau, R., P.;Couper, M. P., Conrad, F. G.
- Classifying Open Occupation Descriptions in the Current Population Survey; 2008; Conrad, F. G., Couper, M. P.
- Social Cues Can Affect Answers to Threatening Questions in Virtual Interviews; 2008; Lind, L. H., Schober, M. F., Conrad, F. G.
- Virtual Interviews on Mundane, Non-Sensitive Topics: Dialog Capability Affects Response Accuracy More...; 2008; Conrad, F. G., Schober, M. F., Jans, M., Orlowski, R. A., Nielsen, D.
- The Impact of the Spacing of the Scale Options in a Web Survey; 2008; Kennedy, C., Tourangeau, R., Conrad, F. G., Couper, M. P., Redline, C. D.
- Interactive Interventions in Web Surveys Can Improve Data Quality; 2008; Conrad, F. G., Tourangeau, R., P., Kennedy, C.Couper, M. P.
- Risk of Disclosure, Perceptions of Risk, and Concerns about Privacy and Confidentiality as Factors in...; 2008; Couper, M. P.; Singer, E.; Daver, J. A.; Conrad, F. G.; Groves, R. M.
- Surveys interviews and new communication technologies; 2007; Schober, M. F., Conrad, F. G.
- Interactive Features of Web Surveys; 2007; Conrad, F. G.
- The Impact of the Visible: The Design of Web Surveys; 2007; Tourangeau, R., Couper, M. P., Conrad, F. G.
- Color, Labels, and Interpretive Heuristics for Response Scales; 2007; Tourangeau, R., Couper, M. P., Conrad, F. G.
- Using Change to Improve Navigation in Grid Questions ; 2007; Galesic, M., Tourangeau, R., Couper, M. P., Conrad, F. G.
- Dialogue Capability and Perceptual Realism in Survey Interviewing Agents; 2007; Schober, M. F., Conrad, F. G.
- Minimizing Respondent Effort increases Use of Definitions in Web Surveys; 2007; Peytchev, A., Conrad, F. G., Couper, M. P., Tourangeau, R.
- Should I Stay or Should I Go? The Effects of Progress Indicators, Promised Duration, and Questinnaire...; 2007; Yan, T., Conrad, F. G., Tourangeau, R., Couper, M. P.
- Bringing features of human dialogue to web surveys; 2007; Conrad, F. G., Schober, M. F., Coiner, T.
- Use and Non-use of Clarification Features in Web Surveys; 2006; Conrad, F. G., Couper, M. P., Tourangeau, R., Peytchev, A.
- Color, Labels, and Interpretive Heuristics for Response Scales; 2006; Tourangeau, R., Couper, M. P., Conrad, F. G.
- Evaluating the Effectiveness of Visual Analog Scales: A Web Experiment; 2006; Couper, M. P., Tourangeau, R., Conrad, F. G., Singer, E.
- Interactive Feedback Can Improve the Quality of Responses in Web Surveys; 2005; Conrad, F. G., Couper, M. P., Tourangeau, R., Galesic, M.
- Promoting Uniform Question Understanding in Today's and Tomorrow's Surveys; 2005; Conrad, F. G., Schober, M. F.
- Visual Context Effects in Web Surveys; 2005; Couper, M. P., Conrad, F. G., Tourangeau, R.
- Interactive Feedback Can Improve Quality of Responses in Web Surveys; 2005; Conrad, F. G., Couper, M. P., Tourangeau, R., Galesic, M.
- Usability, Comparability And Data Quality Across Modes And Technologies In Census Data Collection; 2004; Conrad, F. G., Couper, M. P.
- Spacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions; 2004; Tourangeau, R., Conrad, F. G., Couper, M. P.
- Evaluating the Effects of Visual Analog Scales: A Web Experiment; 2004; Singer, E., Tourangeau, R., Conrad, F. G., Couper, M. P.
- Use of Don't Know and No Opinion Responses in Web Surveys; 2004; Tourangeau, R., Baker, R. P., Couper, M. P., Conrad, F. G.
- Effectiveness of Progress Indicators in Web Surveys; 2004; Conrad, F. G., Couper, M. P., Tourangeau, R., Peytchev, A.
