Weakly Supervised 3d Image Segmentation in Fluorescence Microscopy Using Maximum Intensity Projections

Publication date

2024-08-22

Authors

De Wolf, Tijmen H.
Roman, Daria
Nonnekens, Julie
Smal, Ihor

Editors

Advisors

Supervisors

Document Type

Part of book
Open Access logo

License

taverne

Abstract

In recent years, biomedical research has greatly benefited from the developments of deep learning techniques for image and data analysis. Widespread adoption is, however, hampered by the annotation effort required to train deep learning algorithms. To alleviate this laborious task for 3D image data, we propose a solution based purely on 2D maximum intensity projections. By utilising "flip"symmetry of the data and a specifically designed loss function based on super-Gaussians, we demonstrate how a 3D semantic segmentation task can be solved using only a single annotated maximum intensity projection image for each 3D data sample, compared to training using full 3D ground truth annotations. The effectiveness of our approach is demonstrated using simulated images of virus particles and experimental data of radiation induced foci imaged using confocal microscopy.

Keywords

fluorescence microscopy, image segmentation, neural networks, weakly supervised, Taverne, Biomedical Engineering, Radiology Nuclear Medicine and imaging

Citation

De Wolf, T H, Roman, D, Nonnekens, J & Smal, I 2024, Weakly Supervised 3d Image Segmentation in Fluorescence Microscopy Using Maximum Intensity Projections. in IEEE International Symposium on Biomedical Imaging, ISBI 2024 - Conference Proceedings. Proceedings - International Symposium on Biomedical Imaging, IEEE, 21st IEEE International Symposium on Biomedical Imaging, ISBI 2024, Athens, Greece, 27/05/24. https://doi.org/10.1109/ISBI56570.2024.10635850, conference