A Machine Learning Algorithm for Predicting 6-Week Survival in Spinal Metastasis: An External Validation Study Using 2,768 Taiwanese Patients

Abstract

INTRODUCTION: There are predictive algorithms for predicting 3-month and 1-year survival in patients with spinal metastasis. However, advance in surgical technique, immunotherapy, and advanced radiation therapy has enabled shortening of postoperative recovery, which returns dividends to the overall quality-adjusted life-year. As such, the Skeletal Oncology Research Group machine learning algorithm (SORG-MLA) was proposed to predict 6-week survival in patients with spinal metastasis, whereas its utility for patients treated with nonsurgical treatment was untested externally. This study aims to validate the survival prediction of the 6-week SORG-MLA for patients with spinal metastasis and provide the measurement of model consistency (MC). METHODS: Discrimination using area under the receiver operating characteristic curve, calibration, Brier score, and decision curve analysis were conducted to assess the model's performance in the Taiwanese-based cohort. MC was also applied to detect the proportion of paradoxical predictions among 6-week, 3-month, and 1-year survival predictions. The long-term prognosis should not be better than the shorter-term prognosis in that of an individual. RESULTS: The 6-week survival rate was 84.2%. The SORG-MLA retained good discrimination with an area under the receiver operating characteristic curve of 0.78 (95% confidence interval, 0.75 to 0.80) and good prediction accuracy with a Brier score of 0.11 (null model Brier score 0.13). There is an underestimation of the 6-week survival rate when the predicted survival rate is less than 50%. Decision curve analysis showed that the model was suitable for use over all threshold probabilities. MC showed suboptimal consistency between 6-week and 90-day survival prediction (78%). CONCLUSIONS: The results of this study supported the utility of the algorithm. The online tool (https://sorg-apps.shinyapps.io/spinemetssurvival/) can be used by both clinicians and patients in informative decision-making discussion before management of spinal metastasis.