Improving Uncertainty-Error Correspondence in Deep Bayesian Medical Image Segmentation

Publication date

2024-08-31

Authors

Mody, Prerak
Chaves-de-Plaza, Nicolas F.
Rao, Chinmay
Astrenidou, Eleftheria
de Ridder, MischaORCID 0000-0002-2530-3038
Hoekstra, Nienke
Hildebrandt, Klaus
Staring, Marius

Editors

Advisors

Supervisors

Document Type

Article

Collections

Open Access logo

License

cc_by

Abstract

Increased usage of automated tools like deep learning in medical image segmentation has alleviated the bottleneck of manual contouring. This has shifted manual labour to quality assessment (QA) of automated contours which involves detecting errors and correcting them. A potential solution to semi-automated QA is to use deep Bayesian uncertainty to recommend potentially erroneous regions, thus reducing time spent on error detection. Previous work has investigated the correspondence between uncertainty and error, however, no work has been done on improving the “utility” of Bayesian uncertainty maps such that it is only present in inaccurate regions and not in the accurate ones. Our work trains the FlipOut model with the Accuracy-vs-Uncertainty (AvU) loss which promotes uncertainty to be present only in inaccurate regions. We apply this method on datasets of two radiotherapy body sites, c.f. head-and-neck CT and prostate MR scans. Uncertainty heatmaps (i.e. predictive entropy) are evaluated against voxel inaccuracies using Receiver Operating Characteristic (ROC) and Precision-Recall (PR) curves. Numerical results show that when compared to the Bayesian baseline the proposed method successfully suppresses uncertainty for accurate voxels, with similar presence of uncertainty for inaccurate voxels. Code to reproduce experiments is available at https://github.com/prerakmody/bayesuncertainty-error-correspondence

Keywords

Bayesian Deep Learning, Bayesian Uncertainty, Uncertainty-Error Correspondence, Uncertainty Calibration, Contour Quality Assessment, Model Calibration

Citation

Mody, P, Chaves-de-Plaza, N F, Rao, C, Astrenidou, E, de Ridder, M, Hoekstra, N, Hildebrandt, K & Staring, M 2024, 'Improving Uncertainty-Error Correspondence in Deep Bayesian Medical Image Segmentation', Journal of Machine Learning for Biomedical Imaging, vol. 2, 2024:018, pp. 1048-1082. https://doi.org/10.59275/j.melba.2024-5gc8