Skip to content

Development and Preliminary Validation of an AI-Derived Hemorrhage Metric for Surgical Skill Assessment in Laparoscopic Cholecystectomy.

Oct 2026 · Journal of Surgical Research · Vol 328, pp. 378-389 · 0 citations · 23 references
Medicine

TL;DR

The developed model provides an objective, automated hemorrhage metric that is aligned with expert skill ratings and operative behavior during laparoscopic cholecystectomy, and may serve as a potential adjunct for postoperative, competency-based feedback rather than as a stand-alone measure of surgical skill.

Abstract

INTRODUCTION The objective assessment of technical skill remains a significant challenge in surgical training and quality control. Intraoperative hemorrhage, a direct consequence of tissue handling, may serve as a quantifiable proxy for surgical proficiency. This study aims to develop and validate an artificial intelligence-derived metric based on intraoperative hemorrhage for objective skill assessment in laparoscopic cholecystectomy.

Methods

Frames were sampled at 1 fps (every 25th frame) from videos recorded at 25 fps, and the 70 curated cases were split at the video (case) level into training, validation, and test sets (8:1:1; 56/7/7 videos). An external test set included 30 cases from Zhujiang Hospital. Hemorrhagic regions were manually annotated on 84,680 frames from 56 training videos. A PoolNet-based model quantified hemorrhagic pixels per frame during critical view of safety. Model outputs were validated against surgeon assessments (Fleiss' κ = 0.72) and operative metrics, with the modified Global Operative Assessment of Laparoscopic Skills (mGOALS) scale as the skill reference. Mean hemorrhagic pixels were correlated with skill scores, ratings, and maneuver frequencies.

Results

The hemorrhage identification model achieved dice scores of 0.819 ± 0.054 (internal) and 0.685 ± 0.031 (external). The proficiency metric negatively correlated with expert skill scores (Spearman's r = -0.93, P < 0.001), and strongly positively with subjective bleeding assessments (ρ = 0.89, P < 0.001) and hemostasis frequency (ρ = 0.94, P < 0.001). It effectively stratified surgeons by skill, with high-skill operators having fewer hemorrhagic pixels (Kruskal-Wallis H = 21.0-31.1, P < 0.001).

Conclusions

The developed model provides an objective, automated hemorrhage metric that, in this preliminary validation, aligned with expert skill ratings and operative behavior during laparoscopic cholecystectomy. Pending difficulty-adjusted, multicentre validation, it may serve as a potential adjunct for postoperative, competency-based feedback rather than as a stand-alone measure of surgical skill.

View source

Similar papers

Review Oct 2026

Proof-of-concept study toward the automated evaluation of surgical skills in laparoscopic liver resection using artificial intelligence.

AI-based BPC was associated with ESSQS-based surgical proficiency in LH, and this objective, scalable, high-specificity metric may help flag procedures warranting expert review and timely feedback, particularly in low-difficulty cases.

Keishiro Aoki, Shin Kobayashi, Kimimasa Sasaki et al. · 0 citations
Review Open access Sep 2026

Artificial intelligence assessment of Parkland's grading scale in laparoscopic cholecystectomy: a step toward real-world outcome prediction.

Routine real-world use of a surgical artificial-intelligence (AI) platform has led us to adopt Parkland's Grading Scale (PGS) for disease-severity in laparoscopic cholecystectomy (LC). We evaluated model performance in estimating PGS and explored correlations with surgical outcomes. The platform routinely video-capture...

Yuval Mirkin, M. Ortenzi, E. Nizri et al. · 0 citations
Open access Nov 2026

Surgeon-in-the-loop: expert-guided machine learning framework for continuous surgical performance assessment using operative video

A surgeon’s level of technical proficiency plays a significant role in surgical outcomes. Rating scales, such as the objective structured assessment of technical skills (OSATS), have been validated for surgical quality assurance, skills assessment, and training. However, they are subjective, time-consuming, and dep...

R. Yilmaz, Aaron H. Mun, Margaux Masson-Forsyth et al. · 0 citations
Open access Sep 2026

Video-based assessment of surgical skills using frozen pretrained video foundation models

Automated video-based surgical skill assessment has advanced rapidly, yet rigorous evaluation of continuous standardized score prediction under participant-level generalization to unseen trainees remains limited. We introduce VBA-Net+, a video-only framework for Fundamentals of Laparoscopic Surgery (FLS) score regressi...

Sangrock Lee, F. Rahul, S. De · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.