Reducing the Need for Heuristic Rules – An Iterative Algorithm for Imputing the Education Variable in SIAB

Autor: Christian Hutter, Marion Penninger, Joachim Möller
Rok vydání: 2015
Předmět:
Zdroj: Schmollers Jahrbuch. 135:355-388
ISSN: 1439-121X
DOI: 10.3790/schm.135.3.355
Popis: The article proposes an iterative imputation algorithm based on the EM-Algorithm and employs it to improve the education variable in the Sample of Integrated Labour Market Biographies (SIAB), an administrative panel data set provided by the Institute for Employment Research (IAB). Since the education variable in SIAB is reported for statistical reasons only, it suffers from frequent inconsistent reports and a high and increasing share of missing values. Existing imputation procedures are mainly based on heuristic rules and there is no guidance of which procedure outperforms the others. Our iterative imputation algorithm reduces the role of heuristic decision rules and estimates the most likely educational or vocational status using information based on the employee’s whole employment biography. The resulting imputed education variable does not contain inconsistent reports. Furthermore, the share of missing spells is reduced by 87 percent. After imputation, the education variable shows better cong...
Databáze: OpenAIRE