Notice: the WebSM website has not been updated since the beginning of 2018.

Web Survey Bibliography

Title Three Methods for Occupation Coding Based on Statistical Learning
Author Geweon, H.; Schonlau, L.; Blohum, M.; Steiner, St.
Source Journal of Official Statistics; 33,1, pp. 101-122
Year 2017
Access date 17.03.2017
Abstract - optional
Occupation coding, an important task in official statistics, refers to coding a respondent’s text answer into one of many hundreds of occupation codes. To date, occupation coding is still at least partially conducted manually, at great expense. We propose three methods for automatic coding: combining separate models for the detailed occupation codes and for aggregate occupation codes, a hybrid method that combines a duplicate-based approach with a statistical learning algorithm, and a modified nearest neighbor approach. Using data from the German General Social Survey (ALLBUS), we show that the proposed methods improve on both the coding accuracy of the underlying statistical learning algorithm and the coding accuracy of duplicates where duplicates exist. Further, we find defining duplicates based on ngram variables (a concept from text mining) is preferable to one based on exact string matches.
Follow-up bibliography entriesAmbiguous suitability for inclusion
Year of publication2017

Web survey bibliography (4086)