Development and validation of a radiomics model for differentiating bone islands and osteoblastic bone metastases at abdominal CT

Background: It is important to diagnose sclerotic bone lesions in order to determine treatment strategy. Purpose: To evaluate the diagnostic performance of a CT radiomics-based machine learning model for differentiating bone islands and osteoblastic bone metastases. Materials and Methods: In this retrospective study, patients who underwent contrast-enhanced abdominal CT and were diagnosed with a bone island or osteoblastic metastasis between 2015 to 2019 at either of two different institutions were included: institution 1 for the training set and institution 2 for the external test set. Radiomics features were extracted. The random forest (RF) model was built using 10 selected features, and subsequent 10-fold cross-validation was performed. In the test phase, the RF model was tested with an external test set. Three radiologists reviewed the CT images for the test set. The sensitivity, specificity, accuracy, and area under the receiver operating characteristic curve (AUC) were calculated for the models and each of the three radiologists. The AUCs of the radiomics model and radiologists were compared. Results: A total of 177 patients (89 with a bone island and 88 with metastasis; mean age, 66 years ± 12 [standard deviation]; 111 men) were in the training set, and 64 (23 with a bone island and 41 with metastasis; mean age, 69 years ± 14; 59 men) were in the test set. Radiomics features (n = 1218) were extracted. The average AUC of the RF model from 10-fold cross-validation was 0.89 (sensitivity, 85% [75 of 88 patients]; specificity, 82% [73 of 89 patients]; and accuracy, 84% [148 of 177 patients]). In the test set, the AUC of the trained RF model was 0.96 (sensitivity, 80% [33 of 41 patients]; specificity, 96% [22 of 23 patients]; and accuracy, 86% [55 of 64 patients]). The AUCs for the three readers were 0.95 (95% CI: 0.90, 1.00), 0.96 (95% CI: 0.90, 1.00), and 0.88 (95% CI: 0.80, 0.96). The AUC of radiomics model was higher than that of only reader 3 (0.96 vs 0.88, respectively; P =.03). Conclusion: A CT radiomics-based random forest model was proven useful for differentiating bone islands from osteoblastic metastases and showed better diagnostic performance compared with an inexperienced radiologist.