Clinical research

Clinical validation and application value exploration of multi-modal pulmonary nodule diagnosis model

  • Wanxing XU ,
  • Lin WANG ,
  • Qiaomei GUO ,
  • Xueqing WANG ,
  • Jiatao LOU
Expand
  • 1.Institute of Basic Medical Sciences, School of Medicine, Jiangsu University, Zhenjiang 212013, China
    2.Clinical Laboratory Medicine Center, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200080, China
    3.College of Health Science and Technology, Shanghai Jiao Tong University School of Medicine, Shanghai 200025, China
LOU Jiatao, E-mail: loujiatao@126.com.

Received date: 2024-01-10

  Accepted date: 2024-04-30

  Online published: 2024-08-27

Supported by

Innovation Group Project of Shanghai Municipal Health Commission(2019CXJQ03);Clinical Research Innovation Plan of Shanghai General Hospital(CTCCR-2021B06)

Abstract

Objective ·To verify the performance and explore the clinical application value of a multi-modal pulmonary nodule diagnosis model combined with metabolic fingerprints, protein biomarker CEA and Image-AI via random forest (MPI-RF). Methods ·This study enrolled 289 patients with pulmonary nodules who were admitted to the Shanghai Chest Hospital, Shanghai Jiao Tong University School of Medicine and were detected by low-dose helical computed tomography (LDCT). The patients were divided into malignant nodule group ( n=197) and benign nodule group ( n=92) based on postoperative pathological results, and the basic information of the two groups was collected and compared. Electrochemiluminescence was used to detect the preoperative serum CEA levels of the patients in the two groups, matrix-assisted laser desorption/ionization mass spectrometry (MALDI-MS) was used to detect the serum metabolic fingerprints, and the CT image artificial intelligence model Image-AI was used to calculate the image scores. CEA data, serum metabolic fingerprints data and image scores were integrated and input into MPI-RF to calculate the malignant probability score of each patient. The receiver operator characteristic curve (ROC curve) and area under the curve (AUC) were used to evaluate the performance of different models, and the DeLong test was used for comparative analysis, including the diagnostic performance of MPI-RF in different types (solid nodule, pure ground-glass nodule and part-solid nodule) and sizes (diameter<8 mm and diameter≥8 mm) of pulmonary nodules, the diagnostic performance comparison of MPI-RF with Mayo Clinic model, veterans administration (VA) model and Brock model, and the diagnostic performance comparison of MPI-RF with lung imaging reporting and data system (Lung-RADS) in benign and malignant nodules. Results ·MPI-RF had good diagnostic performance in the differentiation of benign and malignant pulmonary nodules (AUC=0.887, 95% CI 0.848?0.925, sensitivity 81.22%, specificity 83.70%). Among them, the AUC of MPI-RF for solid nodules was 0.877 (95% CI 0.820?0.934), for part-solid nodules was 0.858 (95% CI 0.771?0.946), and for pure ground-glass nodules was 0.978 (95% CI 0.923?1.000). The AUC of MPI-RF was 0.840 (95% CI 0.716?0.963) for nodules within 8 mm diameter and 0.891 (95% CI 0.849?0.933) for nodules larger than 8 mm diameter. Compared with the existing models, the diagnostic performance of MPI-RF was better than that of Mayo Clinic model, VA model and Brock model (all P=0.000). Compared with Lung-RADS, MPI-RF had better diagnostic performance in the total samples and different types of nodules (all P=0.000). Conclusion ·MPI-RF is a model for the differential diagnosis of benign and malignant pulmonary nodules with excellent performance, and has potential clinical application value.

Cite this article

Wanxing XU , Lin WANG , Qiaomei GUO , Xueqing WANG , Jiatao LOU . Clinical validation and application value exploration of multi-modal pulmonary nodule diagnosis model[J]. Journal of Shanghai Jiao Tong University (Medical Science), 2024 , 44(8) : 1030 -1036 . DOI: 10.3969/j.issn.1674-8115.2024.08.012

References

1 BADE B C, DELA CRUZ C S. Lung cancer 2020: epidemiology, etiology, and prevention[J]. Clin Chest Med, 2020, 41(1): 1-24.
2 SUNG H, FERLAY J, SIEGEL R L, et al. Global cancer statistics 2020: globocan estimates of incidence and mortality worldwide for 36 cancers in 185 countries[J]. CA Cancer J Clin, 2021, 71(3): 209-249.
3 WALTER K. Pulmonary nodules[J]. JAMA, 2021, 326(15): 1544.
4 BOISELLE P M. Computed tomography screening for lung cancer[J]. JAMA, 2013, 309(11): 1163-1170.
5 MACMAHON H, NAIDICH D P, GOO J M, et al. Guidelines for management of incidental pulmonary nodules detected on CT images: from the fleischner society 2017[J]. Radiology, 2017, 284(1): 228-243.
6 National Lung Screening Trial Research Team, ABERLE D R, ADAMS A M, et al. Reduced lung-cancer mortality with low-dose computed tomographic screening[J]. N Engl J Med, 2011, 365(5): 395-409.
7 VISSER O, VAN LEEUWEN F E. Stage-specific survival of epithelial cancers in North-Holland/Flevoland, The Netherlands[J]. Eur J Cancer, 2005, 41(15): 2321-2330.
8 HUANG L, WANG L, HU X M, et al. Machine learning of serum metabolic patterns encodes early-stage lung adenocarcinoma[J]. Nat Commun, 2020, 11(1): 3556.
9 WANG L, ZHANG M J, PAN X F, et al. Integrative serum metabolic fingerprints based multi-modal platforms for lung adenocarcinoma early detection and pulmonary nodule classification[J]. Adv Sci (Weinh), 2022, 9(34): e2203786.
10 GODOY M C B, ODISIO E G L C, TRUONG M T, et al. Pulmonary nodule management in lung cancer screening: a pictorial review of Lung-RADS version 1.0[J]. Radiol Clin North Am, 2018, 56(3): 353-363.
11 LIAO W J, SONG L J, YI H L, et al. Treatment choice by patients with obstructive sleep apnea: data from two centers in China[J]. J Thorac Dis, 2018, 10(3): 1941-1950.
12 YE M S, TONG L, ZHENG X X, et al. A classifier for improving early lung cancer diagnosis incorporating artificial intelligence and liquid biopsy[J]. Front Oncol, 2022, 12: 853801.
13 DE KONING H J, VAN DER AALST C M, DE JONG P A, et al. Reduced lung-cancer mortality with volume CT screening in a randomized trial[J]. N Engl J Med, 2020, 382(6): 503-513.
14 PATZ E F Jr, PINSKY P, GATSONIS C, et al. Overdiagnosis in low-dose computed tomography screening for lung cancer[J]. JAMA Intern Med, 2014, 174(2): 269-274.
15 MCWILLIAMS A, TAMMEMAGI M C, MAYO J R, et al. Probability of cancer in pulmonary nodules detected on first screening CT[J]. N Engl J Med, 2013, 369(10): 910-919.
16 MAZZONE P J, LAM L. Evaluating the patient with a pulmonary nodule: a review[J]. JAMA, 2022, 327(3): 264-273.
17 SAMMUT S J, CRISPIN-ORTUZAR M, CHIN S F, et al. Multi-omic machine learning predictor of breast cancer therapy response[J]. Nature, 2022, 601(7894): 623-629.
18 COHEN J D, LI L, WANG Y X, et al. Detection and localization of surgically resectable cancers with a multi-analyte blood test[J]. Science, 2018, 359(6378): 926-930.
Outlines

/