Web Survey Bibliography
Title A Computer Tool that Helps Survey Methodologists Improve the Comprehensibility of Questions
Author Graesser, A., Karnavat, A., Daniel, K. F., Cooper, E., Cai, Z., Whitten, S., Louwerse, M., Bartlett, K., Tenneti, R., Ratnakar, V., Ajzen, I.
Year 2002
Access date 01.06.2004
Abstract Survey methodologists need analytical tools that help them identify problems with questions with respect to comprehension difficulty. We developed a computer tool (called QUAID) that assists survey methodologists in improving the wording, syntax, and semantics of questions. QUAID stands for Question Understanding Aid. The input to QUAID consists of a question on a questionnaire, context information, and answer alternatives. The output is a list of potential problems with the question, including: unfamiliar technical terms, vague or imprecise relative terms, vague or ambiguous noun-phrases, complex syntax, and working memory overload. QUAID is currently available on a web facility (http://mnemosyne.csl.psyc.memphis.edu/quaid/quaidindex.html). We have evaluated how well QUAID diagnoses five categories of problems with questions. We analyzed 550 questions sampled from 11 surveys of the US Census Bureau. Experts in language and cognition rated each question as to whether it had the five problems; the expert ratings were compared with QUAID output. Analyses of hit rates, false alarm rates, and discrimination scores confirmed there is a significant correspondence between QUAID and the judgments of experts. Eye tracking data have also been collected from respondents as they answer questions. We explored whether the patterns of eye fixations can be predicted by particular problems with questions.
Year of publication2002
Bibliographic typeConferences, workshops, tutorials, presentations
Web Survey Bibliography - The American Association for Public Opinion Research (AAPOR) 57th Annual Conference, 2002 (35)
- Navigating the Rapids of Change: Some Observations on Survey Methodology in the Early 21st Century; 2002; Dillman, D. A.
- Civic Engagement, Social Trust, and Online Deliberation; 2002; Goldthwaite, D., Price, V., Cappella, J. N.
- A Mixed-mode Internet and Telephone Survey in a Technology-rich Environment; 2002; Marton, K., Sumartojo, R. Kosicki, G. M., Horner, L. R.
- Comparison of Response Rates and Quality of Response in a Survey Conducted by Mail, Email and Web; 2002; Lesser, V. M., Newton, L.
- Face-to-Face vs. Web-enabled Panel Interviews on Magazine Reading: A Mode Comparison; 2002; Mattlin, J.
- Internet-based Survey Research in the U.S. Navy; 2002; Olmsted, M. G.
- Statistical Data Validation in Web Instruments:An Empirical Study; 2002; Peytchev, A., Petrova, E.A.
- Transitioning Phone and Mail Studies to an Online Venue: Factors for Consideration; 2002; Park, J. M., Collier, D.
- U.S. Army Web-based, Internet Surveys; 2002; Lynn, M.
- U. S. Air Force Surveys; 2002; Hamilton, C. H., Datko, L. M., Bell, J.
- A Computer Tool that Helps Survey Methodologists Improve the Comprehensibility of Questions; 2002; Graesser, A., Karnavat, A., Daniel, K. F., Cooper, E., Cai, Z., Whitten, S., Louwerse, M., Bartlett,...
- Using the Internet to Reach an Elite Population: What Works, What Doesn't?; 2002; Grigorian, K. H., Rosenlund, A., Sokolowski, J.
- Combining Online and CATI Data Collection Techniques With Web-Based Reporting to Measurably Improve...; 2002; Feld, K. G., Stone, W. K.
- Triangulation: Three Modes Measuring HIV-Related Knowledge and Stigma in the U.S; 2002; Fichtner, R., Knight, S., Lentine, D.
- Navigation Patterns in Web Surveys; 2002; Ramirez, C. M.
- Why Internet Samples Are Inherently Biased; 2002; Neustadtl, A., Kestnbaum, M., Robinson, J. P.
- Methods for Improving Compliance in Exposure Studies; 2002; Dimitropoulos, L., Thalji, L., Weibe, L.
- The Impact of Privacy and Security Concerns on the Willingness to Provide Sensitive Information about...; 2002; Aoki, K., Elasmar, M. G.
- Mode-Effects in Web Surveys?; 2002; Bandilla, W., Bosnjak, M.
- The Prospects for Electronic Mail Surveys; 2002; Groussett, R., Fournier, A., Kalinowski, L., Best, S. J.
- Prepaid and Promised Incentives in Web Surveys: An Experiment; 2002; Bosnjak, M., Tuten, T. L.
- A Nonresponse Analysis of a Mail-Web Mode Comparison; 2002; Boyd, C. J., Crawford, S. D., McCabe, S. E., Couper, M. P.
- An Experimental Comparison of Knowledge Networks and The GSS; 2002; Bradburn, N. M.
- Examining Item Non-Response in a Mixed Mode Customer Satisfaction Study; 2002; Burr, M. A., Famolaro, T., Levin, K.
- Web Survey Nonresponse Among Military Members; 2002; Caplan, J. R.
- Comparing Self-administered Computer Surveys and Auditory Interviews: An Experiment; 2002; Chang, L. C., Krosnick, J. A.
- Paper and Pencil versus Web Survey. Measurement Effects and Mode Differences; 2002; Fuchs, M.
- Usability Testing of Web Data Collection Instruments; 2002; Thalji, L., Antunes, M. J., Wiebe, E. F.
- Nonresponse Error and Mode Effects in the Web-Enabled Survey on Civic Attitudes and Behaviors after...; 2002; Thalji, L., Langer, M., Pulliam, P., Wiebe, E. F.
- Not Sure About "Don't Know"?: Effects of Response Choice in Mixed Mode Surveys; 2002; Terhanian, G., Thomas, R. K., Bremer, J., Smith, R.
- More Is Not Necessarily Better: Effects of Response Categories on Measurement Stability and Validity; 2002; Thomas, R. K., Uldall, B. R., Krosnick, J. A.
- A Web-based Experiment to Evaluate the Effectiveness of Vaccine Information Sheets; 2002; Turner, A., Thalji, L., Wagers, R., Laird, G., Heaps, W.
- Reliability and Validity of Web-based Surveys: Effects of Response Modality, Item Format, and Number...; 2002; Uldall, B. R., Thomas, R. K., Krosnick, J. A.
- Mode Effect in Web Surveys; 2002; Vehovar, V., Lozar Manfreda, K.
- Characteristics of Respondents to a Web Survey of the General Public; 2002; Tarnai, J., Thom, A.