Increasing prevalence of web data collection mode has led to considerable interest in measuring data quality in web surveys, especially when surveying youth and teens. In this paper, we examine data quality in a web survey context, using the Boys & Girls Clubs of America National Youth Outcomes Initiative (NYOI) member survey. The NYOI member survey is an annual survey of youth and teen members (ages 9-18) that measures academic success, good character and citizenship, healthy lifestyles, and club experience. With more than 100,000 online participants, the NYOI web dataset allows for exploration of the impacts of a number of factors on data quality. We utilize various respondent level data in this analysis. This data includes language (the survey was offered in English and Spanish), age, grade, gender, race, device used for survey completion (computer or tablet), use of an audio component, and an honesty question. In addition, we also utilize Paradata on number of survey items answered, accumulated time spent on the survey as a whole, time of day survey was taken, type of question, and operating system. Data flags were created, post data collection, to identify fast respondents and respondents who straight-line or exhibit other patterned responses. We examine correlation between self-reported honesty, speed of survey completion, and patterned responses. We also examine the relationships that exist between fast/patterned responses and age, sex, race/ethnicity, household income status, and club engagement. Our conclusions help shed light on factors associated with survey response in surveys of children and provide guidance to other practitioners.