High-Dimensional Imputation for the Social Sciences: A Comparison of State-of-The-Art Methods

Publication date

2025-05

Authors

Costantini, Edoardo
Lang, KyleORCID 0000-0001-5340-7849ISNI 0000000506790020
Reeskens, Tim
Sijtsma, Klaas

Editors

Advisors

Supervisors

Document Type

Article
Open Access logo

License

cc_by

Abstract

Including a large number of predictors in the imputation model underlying a multiple imputation (MI) procedure is one of the most challenging tasks imputers face. A variety of high-dimensional MI techniques can help, but there has been limited research on their relative performance. In this study, we investigated a wide range of extant high-dimensional MI techniques that can handle a large number of predictors in the imputation models and general missing data patterns. We assessed the relative performance of seven high-dimensional MI methods with a Monte Carlo simulation study and a resampling study based on real survey data. The performance of the methods was defined by the degree to which they facilitate unbiased and confidence-valid estimates of the parameters of complete data analysis models. We found that using lasso penalty or forward selection to select the predictors used in the MI model and using principal component analysis to reduce the dimensionality of auxiliary data produce the best results.

Keywords

Cart, High-dimensionality, Multiple imputation, Principal components, Random forest, Regularized regression

Citation

Costantini, E, Lang, K M, Reeskens, T & Sijtsma, K 2025, 'High-Dimensional Imputation for the Social Sciences : A Comparison of State-of-The-Art Methods', Sociological Methods and Research, vol. 54, no. 2, pp. 448-499. https://doi.org/10.1177/00491241231200194