论著 · 技术与方法

多模态模型预测结肠息肉切除术后迟发性出血

  • 诸梦琳 ,
  • 刘骁 ,
  • 徐晓丹 ,
  • 王甘红 ,
  • 夏开建 ,
  • 陈健
展开
  • 1.苏州大学附属常熟医院(江苏省常熟市第一人民医院)消化内科,常熟 215500
    2.江苏省常熟市尚湖中心医院消化内科,常熟 215500
    3.江苏省常熟市中医院(南京中医药大学常熟附属医院)消化内科,常熟 215500
    4.苏州大学附属常熟医院(江苏省常熟市第一人民医院)苏州市数据创新应用实验室,常熟 215500
陈 健,副主任医师,硕士;电子信箱:szcs10132716@163.com

收稿日期: 2025-11-04

  录用日期: 2026-02-28

  网络出版日期: 2026-04-16

基金资助

苏州市临床重点病种诊疗技术专项(LCZX202334);苏州市科技攻关计划项目(SYW2025034);常熟市科技计划(社会发展)项目(CS202452);常熟市医学人工智能与大数据重点实验室能力提升项目(CYZ202301)

Prediction of delayed post-polypectomy bleeding using a multimodal model

  • Zhu Menglin ,
  • Liu Xiao ,
  • Xu Xiaodan ,
  • Wang Ganhong ,
  • Xia Kaijian ,
  • Chen Jian
Expand
  • 1.Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University (Changshu No. 1 People's Hospital, Jiangsu Province), Changshu 215500, China
    2.Department of Gastroenterology, Changshu Shanghu Central Hospital, Jiangsu Province, Changshu 215500, China
    3.Department of Gastroenterology, Changshu Traditional Chinese Medicine Hospital (Changshu Hospital Affiliated to Nanjing University of Chinese Medicine), Jiangsu Province, Changshu 215500, China
    4.Suzhou Data Innovation Application Laboratory, Changshu Hospital Affiliated to Soochow University (Changshu No. 1 People's Hospital, Jiangsu Province), Changshu 215500, China
Chen Jian,E-mail:szcs10132716@163.com.

Received date: 2025-11-04

  Accepted date: 2026-02-28

  Online published: 2026-04-16

Supported by

Special Project for Diagnosis and Treatment Technology of Clinical Key Diseases in Suzhou(LCZX202334);Suzhou Science and Technology Research Program Project(SYW2025034);Changshu Science and Technology Program (Social Development) Project(CS202452);Capacity Improvement Project of Changshu Key Laboratory of Medical Artificial Intelligence and Big Data(CYZ202301)

摘要

目的·构建一个多模态预测模型,将内镜创面图像与临床特征相结合,运用深度学习与机器学习技术,预测术后迟发性出血(delayed post-polypectomy bleeding,DPPB)的风险。方法·收集在2家医院行结肠息肉内镜下切除术患者的临床资料及术后内镜创面图像。研究共设计3个阶段:第一阶段,采用迁移学习训练的YOLOv11模型对创面图像进行自动识别与分割,提取感兴趣区域(region of interest,ROI);第二阶段,以ROI图像为输入项,构建基于ResNet50架构的深度神经网络,结合术后是否发生DPPB进行监督学习,输出标准化的内镜影像学评分(endoscopic score,E-Score);第三阶段,将E-Score与患者临床特征融合,利用LASSO回归进行特征选择,并将筛选后的变量输入多种机器学习模型训练,构建多模态DPPB预测模型。最终,基于Streamlit框架开发一款便于医护人员使用的网络应用工具(application,APP)。结果·共纳入2 782例接受结肠息肉切除术的患者,其中228例(8.20%)发生了DPPB。在测试集中,由XGBoost算法构建的多模态预测模型(PrismDPPB)表现最优,曲线下面积(area under the curve,AUC)达到0.831(95%CI 0.81~0.85),优于其他模型。此外,该模型在准确率(79.78%)、灵敏度(77.28%)、阳性预测值(81.32%)以及F1分数(79.25%)方面亦表现最佳。特征重要性分析显示,对模型预测贡献最大的6项变量依次为E-Score、息肉最大基底直径、性别、有无蒂、体质量指数以及息肉位置。模型解释性方面,使用SHAP图对预测结果进行了可视化解释。结论·融合创面影像组学特征与患者临床特征所构建的多模态预测模型及配套APP,在DPPB的风险评估中表现出良好的实用性与临床应用潜力。

本文引用格式

诸梦琳 , 刘骁 , 徐晓丹 , 王甘红 , 夏开建 , 陈健 . 多模态模型预测结肠息肉切除术后迟发性出血[J]. 上海交通大学学报(医学版), 2026 , 46(4) : 509 -520 . DOI: 10.3969/j.issn.1674-8115.2026.04.011

Abstract

Objective ·To develop a multimodal prediction model that integrates endoscopic wound images with clinical features, leveraging deep learning and machine learning techniques to predict the risk of delayed post-polypectomy bleeding (DPPB). Methods ·The clinical data and postoperative endoscopic wound images of patients who underwent endoscopic colorectal polypectomy at two hospitals were retrospectively collected. The study was designed in three stages. In the first stage, a YOLOv11 model trained via transfer learning was used to automatically detect and segment wound areas, extracting regions of interest (ROI). In the second stage, ROI images were input into a deep neural network based on the ResNet50 architecture. Supervised learning was performed using DPPB occurrence as the label, and a standardized endoscopic imaging score (E-Score) was generated. In the third stage, the E-Score was combined with clinical features. Feature selection was conducted using LASSO regression, and the selected variables were input into multiple machine learning algorithms to construct a multimodal DPPB prediction model. Finally, a web-based application was developed using the Streamlit framework to facilitate clinical use. Results ·A total of 2 782 patients who underwent colorectal polypectomy were included, among whom 228 (8.20%) developed DPPB. In the test set, the multimodal prediction model built using the XGBoost algorithm (PrismDPPB) achieved the best performance, with an area under the curve(AUC) of 0.831 (95%CI 0.81‒0.85), outperforming other models. It also showed superior performance in accuracy (79.78%), sensitivity (77.28%), positive predictive value (81.32%), and F1 score (79.25%). Feature importance analysis revealed that the six most contributive variables were E-Score, maximum polyp base diameter, sex, presence of a stalk, body mass index, and polyp location. For model interpretability, SHAP plots were used to visualize and explain the prediction results. Conclusion ·The multimodal prediction model developed by integrating image-based features with clinical characteristics, along with the accompanying web application, demonstrates strong practicality and clinical potential for DPPB risk assessment.

参考文献

[1] Bray F, Laversanne M, Sung H, et al. Global cancer statistics 2022: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries[J]. CA Cancer J Clin, 2024, 74(3): 229-263.
[2] Lopes S R, Martins C, Santos I C, et al. Colorectal cancer screening: a review of current knowledge and progress in research[J]. World J Gastrointest Oncol, 2024, 16(4): 1119-1133.
[3] Brenner H, Chang-Claude J, Seiler C M, et al. Protection from colorectal cancer after colonoscopy: a population-based, case-control study[J]. Ann Intern Med, 2011, 154(1): 22-30.
[4] Shaukat A, Levin T R. Current and future colorectal cancer screening strategies[J]. Nat Rev Gastroenterol Hepatol, 2022, 19(8): 521-531.
[5] Gupta S, Lieberman D, Anderson J C, et al. Recommendations for follow-up after colonoscopy and polypectomy: a consensus update by the US multi-society task force on colorectal cancer[J]. Gastrointest Endosc, 2020, 91(3): 463-485.e5.
[6] Jaruvongvanich V, Prasitlumkum N, Assavapongpaiboon B, et al. Risk factors for delayed colonic post-polypectomy bleeding: a systematic review and meta-analysis[J]. Int J Colorectal Dis, 2017, 32(10): 1399-1406.
[7] 王禹毅, 卜志军, 李元晞, 等. 临床预测模型变量筛选方法及比较[J]. 现代中医临床, 2024, 31(2): 6-12.
  Wang Y Y, Bu Z J, Li Y X, et al. Variable selection methods and comparison in clinical prediction models[J]. Modern Clinical Chinese Medicine, 2024, 31(2): 6-12.
[8] Cao J, Long S K, Liu H, et al. Constructing a prediction model for acute pancreatitis severity based on liquid neural network[J]. Sci Rep, 2025, 15(1): 16655.
[9] Zhang R F, Yin M Y, Jiang A Q, et al. Application value of the automated machine learning model based on modified computed tomography severity index combined with serological indicators in the early prediction of severe acute pancreatitis[J]. J Clin Gastroenterol, 2024, 58(7): 692-701.
[10] Liu L J, Zhang R F, Shi Y, et al. Automated machine learning for predicting liver metastasis in patients with gastrointestinal stromal tumor: a SEER-based analysis[J]. Sci Rep, 2024, 14(1): 12415.
[11] Russell B C, Torralba A, Murphy K P, et al. LabelMe: a database and web-based tool for image annotation[J]. Int J Comput Vis, 2008, 77(1): 157-173.
[12] Shin H C, Roth H R, Gao M C, et al. Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning[J]. IEEE Trans Med Imaging, 2016, 35(5): 1285-1298.
[13] Handelman G S, Kok H K, Chandra R V, et al. Peering into the black box of artificial intelligence: evaluation metrics of machine learning methods[J]. AJR Am J Roentgenol, 2019, 212(1): 38-43.
[14] Nohara Y, Matsumoto K, Soejima H, et al. Explanation of machine learning models using shapley additive explanation and application for real data in hospital[J]. Comput Meth Programs Biomed, 2022, 214: 106584.
[15] Fahmy A S, Csecs I, Arafati A, et al. An explainable machine learning approach reveals prognostic significance of right ventricular dysfunction in nonischemic cardiomyopathy[J]. JACC Cardiovasc Imaging, 2022, 15(5): 766-779.
[16] Bendall O, James J, Pawlak K M, et al. Delayed bleeding after endoscopic resection of colorectal polyps: identifying high-risk patients[J]. Clin Exp Gastroenterol, 2021, 14: 477-492.
[17] Zhang X Z, Jiang X X, Shi L. Risk factors for delayed colorectal postpolypectomy bleeding: a meta-analysis[J]. BMC Gastroenterol, 2024, 24(1): 162.
[18] Albouys J, Montori Pina S, Boukechiche S, et al. Risk of delayed bleeding after colorectal endoscopic submucosal dissection: the Limoges Bleeding Score[J]. Endoscopy, 2024, 56(2): 110-118.
[19] Lu Y, Zhou X Y, Chen H, et al. Establishment of a model for predicting delayed post-polypectomy bleeding: a real-world retrospective study[J]. Front Med, 2022, 9: 1035646.
[20] 王敏, 韦雪连, 李常伟, 等. 内镜下结直肠腺瘤性息肉的特征及经切除术后迟发出血的危险因素分析[J]. 胃肠病学和肝病学杂志, 2024, 33(6): 714-718.
  Wang M, Wei X L, Li C W, et al. Characteristics of colorectal adenomatous polyps under endoscopy and analysis of risk factors for delayed bleeding after resection[J]. Chinese Journal of Gastroenterology and Hepatology, 2024, 33(6): 714-718.
[21] 陈健, 王珍妮, 夏开建, 等. 基于深度学习的结直肠息肉内镜图像分割和分类方法比较[J]. 上海交通大学学报(医学版), 2024, 44(6): 762-772.
  Chen J, Wang Z N, Xia K J, et al. Comparative study on methods for colon polyp endoscopic image segmentation and classification based on deep learning[J]. Journal of Shanghai Jiao Tong University (Medical Science), 2024, 44(6): 762-772.
文章导航

/