Oct 2026· Journal of Surgical Research· Vol 328, pp.
378-389
· 0 citations· 23 references
Medicine
TL;DR
The developed model provides an objective, automated hemorrhage metric that is aligned with expert skill ratings and operative behavior during laparoscopic cholecystectomy, and may serve as a potential adjunct for postoperative, competency-based feedback rather than as a stand-alone measure of surgical skill.
Abstract
INTRODUCTION
The objective assessment of technical skill remains a significant challenge in surgical training and quality control. Intraoperative hemorrhage, a direct consequence of tissue handling, may serve as a quantifiable proxy for surgical proficiency. This study aims to develop and validate an artificial intelligence-derived metric based on intraoperative hemorrhage for objective skill assessment in laparoscopic cholecystectomy.
Methods
Frames were sampled at 1 fps (every 25th frame) from videos recorded at 25 fps, and the 70 curated cases were split at the video (case) level into training, validation, and test sets (8:1:1; 56/7/7 videos). An external test set included 30 cases from Zhujiang Hospital. Hemorrhagic regions were manually annotated on 84,680 frames from 56 training videos. A PoolNet-based model quantified hemorrhagic pixels per frame during critical view of safety. Model outputs were validated against surgeon assessments (Fleiss' κ = 0.72) and operative metrics, with the modified Global Operative Assessment of Laparoscopic Skills (mGOALS) scale as the skill reference. Mean hemorrhagic pixels were correlated with skill scores, ratings, and maneuver frequencies.
Results
The hemorrhage identification model achieved dice scores of 0.819 ± 0.054 (internal) and 0.685 ± 0.031 (external). The proficiency metric negatively correlated with expert skill scores (Spearman's r = -0.93, P < 0.001), and strongly positively with subjective bleeding assessments (ρ = 0.89, P < 0.001) and hemostasis frequency (ρ = 0.94, P < 0.001). It effectively stratified surgeons by skill, with high-skill operators having fewer hemorrhagic pixels (Kruskal-Wallis H = 21.0-31.1, P < 0.001).
Conclusions
The developed model provides an objective, automated hemorrhage metric that, in this preliminary validation, aligned with expert skill ratings and operative behavior during laparoscopic cholecystectomy. Pending difficulty-adjusted, multicentre validation, it may serve as a potential adjunct for postoperative, competency-based feedback rather than as a stand-alone measure of surgical skill.
AI-based BPC was associated with ESSQS-based surgical proficiency in LH, and this objective, scalable, high-specificity metric may help flag procedures warranting expert review and timely feedback, particularly in low-difficulty cases.
Routine real-world use of a surgical artificial-intelligence (AI) platform has led us to adopt Parkland's Grading Scale (PGS) for disease-severity in laparoscopic cholecystectomy (LC). We evaluated model performance in estimating PGS and explored correlations with surgical outcomes. The platform routinely video-capture...
Yuval Mirkin, M. Ortenzi, E. Nizri et al.· Updates in Surgery· 0 citations
A surgeon’s level of technical proficiency plays a significant role in surgical outcomes. Rating scales, such as the objective structured assessment of technical skills (OSATS), have been validated for surgical quality assurance, skills assessment, and training. However, they are subjective, time-consuming, and dep...
R. Yilmaz, Aaron H. Mun, Margaux Masson-Forsyth et al.· International Journal of Sur...· 0 citations
Automated video-based surgical skill assessment has advanced rapidly, yet rigorous evaluation of continuous standardized score prediction under participant-level generalization to unseen trainees remains limited. We introduce VBA-Net+, a video-only framework for Fundamentals of Laparoscopic Surgery (FLS) score regressi...
Sangrock Lee, F. Rahul, S. De· npj Digital Medicine· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.