Pitfalls in machine learning-based assessment of tumor-infiltrating lymphocytes in breast cancer: A report of the International Immuno-Oncology Biomarker Working Group on Breast Cancer

Publication date

2023-08

Authors

Thagaard, Jeppe
Broeckx, Glenn
Page, David B
Jahangir, Chowdhury Arif
Verbandt, Sara
Kos, Zuzana
Gupta, Rajarsi
Khiroya, Reena
Abduljabbar, Khalid
Acosta Haab, Gabriela

Editors

Advisors

Supervisors

Document Type

Article

Collections

Open Access logo

License

cc_by_nc

Abstract

The clinical significance of the tumor-immune interaction in breast cancer is now established, and tumor-infiltrating lymphocytes (TILs) have emerged as predictive and prognostic biomarkers for patients with triple-negative (estrogen receptor, progesterone receptor, and HER2-negative) breast cancer and HER2-positive breast cancer. How computational assessments of TILs might complement manual TIL assessment in trial and daily practices is currently debated. Recent efforts to use machine learning (ML) to automatically evaluate TILs have shown promising results. We review state-of-the-art approaches and identify pitfalls and challenges of automated TIL evaluation by studying the root cause of ML discordances in comparison to manual TIL quantification. We categorize our findings into four main topics: (1) technical slide issues, (2) ML and image analysis aspects, (3) data challenges, and (4) validation issues. The main reason for discordant assessments is the inclusion of false-positive areas or cells identified by performance on certain tissue patterns or design choices in the computational implementation. To aid the adoption of ML for TIL assessment, we provide an in-depth discussion of ML and image analysis, including validation issues that need to be considered before reliable computational reporting of TILs can be incorporated into the trial and routine clinical management of patients with triple-negative breast cancer.

Keywords

deep learning, digital pathology, guidelines, image analysis, machine learning, pitfalls, prognostic biomarker, triple-negative breast cancer, tumor-infiltrating lymphocytes, Pathology and Forensic Medicine, Review, Journal Article

Citation

Thagaard, J, Broeckx, G, Page, D B, Jahangir, C A, Verbandt, S, Kos, Z, Gupta, R, Khiroya, R, Abduljabbar, K, Acosta Haab, G, Acs, B, Akturk, G, Almeida, J S, Alvarado-Cabrero, I, Amgad, M, Azmoudeh-Ardalan, F, Badve, S, Baharun, N B, Balslev, E, Bellolio, E R, Bheemaraju, V, Blenman, K R, Botinelly Mendonça Fujimoto, L, Bouchmaa, N, Burgues, O, Chardas, A, Chon U Cheang, M, Ciompi, F, Cooper, L A, Coosemans, A, Corredor, G, Dahl, A B, Dantas Portela, F L, Deman, F, Demaria, S, Doré Hansen, J, Dudgeon, S N, Ebstrup, T, Elghazawy, M, Fernandez-Martín, C, Fox, S B, Gallagher, W M, Giltnane, J M, Gnjatic, S, Gonzalez-Ericsson, P I, Grigoriadis, A, Halama, N, Hanna, M G, Harbhajanka, A, Hart, S N, Hartman, J, Hauberg, S, Hewitt, S, Hida, A I, Horlings, H M, Husain, Z, Hytopoulos, E, Irshad, S, Janssen, E A, Kahila, M, Kataoka, T R, Kawaguchi, K, Kharidehal, D, Khramtsov, A I, Kiraz, U, Kirtani, P, Kodach, L L, Korski, K, Kovács, A, Laenkholm, A-V, Lang-Schwarz, C, Larsimont, D, Lennerz, J K, Lerousseau, M, Li, X, Ly, A, Madabhushi, A, Maley, S K, Manur Narasimhamurthy, V, Marks, D K, McDonald, E S, Mehrotra, R, Michiels, S, Minhas, F U A A, Mittal, S, Moore, D A, Mushtaq, S, Nighat, H, Papathomas, T, Penault-Llorca, F, Perera, R D, Pinard, C J, Pinto-Cardenas, J C, Pruneri, G, Pusztai, L, Rahman, A, Rajpoot, N M, Rapoport, B L, Rau, T T, Reis-Filho, J S, Ribeiro, J M, Rimm, D, Roslind, A, Vincent-Salomon, A, Salto-Tellez, M, Saltz, J, Sayed, S, Scott, E, Siziopikou, K P, Sotiriou, C, Stenzinger, A, Sughayer, M A, Sur, D, Fineberg, S, Symmans, F, Tanaka, S, Taxter, T, Tejpar, S, Teuwen, J, Thompson, E A, Tramm, T, Tran, W T, van der Laak, J, van Diest, P J, Verghese, G E, Viale, G, Vieth, M, Wahab, N, Walter, T, Waumans, Y, Wen, H Y, Yang, W, Yuan, Y, Zin, R M, Adams, S, Bartlett, J, Loibl, S, Denkert, C, Savas, P, Loi, S, Salgado, R & Specht Stovgaard, E 2023, 'Pitfalls in machine learning-based assessment of tumor-infiltrating lymphocytes in breast cancer : A report of the International Immuno-Oncology Biomarker Working Group on Breast Cancer', Journal of Pathology, vol. 260, no. 5, pp. 498-513. https://doi.org/10.1002/path.6155