Quality Control, Data Cleaning, Imputation

Publication date

2023-11-04

Authors

Liu, Dawei
Oberman, Hanne I.ORCID 0000-0003-3276-2141ISNI 0000000493077305
Muñoz, Johanna
Hoogland, Jeroen
Debray, Thomas P. A.

Editors

Advisors

Supervisors

Document Type

Part of book
Open Access logo

License

taverne

Abstract

This chapter addresses important steps during the quality assurance and control of RWD, with particular emphasis on the identification and handling of missing values. A gentle introduction is provided on common statistical and machine learning methods for imputation. We discuss the main strengths and weaknesses of each method, and compare their performance in a literature review. We motivate why the imputation of RWD may require additional efforts to avoid bias, and highlight recent advances that account for informative missingness and repeated observations. Finally, we introduce alternative methods to address incomplete data without the need for imputation.

Keywords

Missing data, Imputation, Missing atrandom, Missing not at random, Missingcompletely at rando, Informativemissingness, Sporadically missing, Systematically missing, Joint modelling imputation, Conditional modelling imputation, Machine learning imputation, Nearest neighbor, Matrix completion, Tree-based ensembles, Support vectormachines, Neural networks, Rubin’s rules, Pattern submodels, Surrogate splits, Missingindicator, Heckman selection model, Taverne

Citation

Liu, D, Oberman, H I, Muñoz, J, Hoogland, J & Debray, T P A 2023, Quality Control, Data Cleaning, Imputation. in Clinical Applications of Artificial Intelligence in Real-World Data. pp. 7-36. https://doi.org/10.1007/978-3-031-36678-9_2