Quality Control, Data Cleaning, Imputation
Publication date
2023-11-04
Editors
Advisors
Supervisors
Document Type
Part of book
Metadata
Show full item recordCollections
License
taverne
Abstract
This chapter addresses important steps during the quality assurance and control of RWD, with particular emphasis on the identification and handling of missing values. A gentle introduction is provided on common statistical and machine learning methods for imputation. We discuss the main strengths and weaknesses of each method, and compare their performance in a literature review. We motivate why the imputation of RWD may require additional efforts to avoid bias, and highlight recent advances that account for informative missingness and repeated observations. Finally, we introduce alternative methods to address incomplete data without the need for imputation.
Keywords
Missing data, Imputation, Missing atrandom, Missing not at random, Missingcompletely at rando, Informativemissingness, Sporadically missing, Systematically missing, Joint modelling imputation, Conditional modelling imputation, Machine learning imputation, Nearest neighbor, Matrix completion, Tree-based ensembles, Support vectormachines, Neural networks, Rubin’s rules, Pattern submodels, Surrogate splits, Missingindicator, Heckman selection model, Taverne
Citation
Liu, D, Oberman, H I, Muñoz, J, Hoogland, J & Debray, T P A 2023, Quality Control, Data Cleaning, Imputation. in Clinical Applications of Artificial Intelligence in Real-World Data. pp. 7-36. https://doi.org/10.1007/978-3-031-36678-9_2