Relevance & Research Questions: In online surveys social de-contextualisation (as the counterpart to social desirability) has an effect on response behaviour. More clearly: social values and norms become less important in online-surveys compared to other self administered questionnaire (Taddicken 2009). This fact may especially influence the response behaviour of pupils in class room inquiry – since paper and pencil (p&p) reminds them more strongly of the usual class test situation and not filling out an online-survey. Consequently, it is expected that pupils participating in p&p-surveys take them more seriously and respond more accurately than in online surveys. Accordingly, the paper focuses on differences based on i) response patterns (e.g. extreme response styles), ii) accurate answers vs. false statements (e.g. that appears in demographic data) and iii) the proportion of missing values.
Methods & Data: The aim of this research is to compare response behaviour between two schools and within one school. In order to measure differences, a stratified sample was drawn from two secondary schools - 22 classes from the first and 15 classes from the second school. The data collection in the first partner school was organized as a paper and pencil interview and in the second partner school (mainly) as an online survey and (additionally ) as paper and pencil interview.
Results: Regarding the above mentioned expected results, evidence will be presented concerning the presence or absence of an effect of social de-contextualisation. Moreover, the paper focuses on the relevance of considering social de-contextualisation in the process of data cleaning and the interpretation of the results. Finally, the concern of data quality in connection with social de-contextualisation (especially in case of using mixed data collection methods) will be discussed.
Added Value: Taddicken (2009) has already pointed out that more empirical research concerning social de-contextualisation is needed. This paper may represent a further step towards reliability of online-surveys.