Exploring contrast generalisation in deep learning-based brain MRI-to-CT synthesis

Publication date

2023-08

Authors

Nijskens, Lotte
van den Berg, CATORCID 0000-0002-5565-6889
Verhoeff, Joost J CORCID 0000-0001-9673-0793ISNI 0000000393929005
Maspero, MatteoORCID 0000-0003-0347-3375

Editors

Advisors

Supervisors

Document Type

Article

Collections

Open Access logo

License

cc_by

Abstract

BACKGROUND: Synthetic computed tomography (sCT) has been proposed and increasingly clinically adopted to enable magnetic resonance imaging (MRI)-based radiotherapy. Deep learning (DL) has recently demonstrated the ability to generate accurate sCT from fixed MRI acquisitions. However, MRI protocols may change over time or differ between centres resulting in low-quality sCT due to poor model generalisation. PURPOSE: investigating domain randomisation (DR) to increase the generalisation of a DL model for brain sCT generation. METHODS: CT and corresponding T 1-weighted MRI with/without contrast, T 2-weighted, and FLAIR MRI from 95 patients undergoing RT were collected, considering FLAIR the unseen sequence where to investigate generalisation. A "Baseline" generative adversarial network was trained with/without the FLAIR sequence to test how a model performs without DR. Image similarity and accuracy of sCT-based dose plans were assessed against CT to select the best-performing DR approach against the Baseline. RESULTS: The Baseline model had the poorest performance on FLAIR, with mean absolute error (MAE) = 106 ± 20.7 HU (mean ±σ). Performance on FLAIR significantly improved for the DR model with MAE = 99.0 ± 14.9 HU, but still inferior to the performance of the Baseline+FLAIR model (MAE = 72.6 ± 10.1 HU). Similarly, an improvement in γ-pass rate was obtained for DR vs Baseline. CONCLUSION: DR improved image similarity and dose accuracy on the unseen sequence compared to training only on acquired MRI. DR makes the model more robust, reducing the need for re-training when applying a model on sequences unseen and unavailable for retraining.

Keywords

Artificial intelligence, Computed tomography, Domain shift, Generalisation, Machine learning, Magnetic resonance imaging, Medical imaging, Radiotherapy, Regression, General Physics and Astronomy, Biophysics, Radiology Nuclear Medicine and imaging, Journal Article

Citation

Nijskens, L, van den Berg, C A T, Verhoeff, J J C & Maspero, M 2023, 'Exploring contrast generalisation in deep learning-based brain MRI-to-CT synthesis', Physica Medica, vol. 112, 102642. https://doi.org/10.1016/j.ejmp.2023.102642