https://gut.bmj.com/content/68/1/94
Endoscopy
Original article
Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model
- Michael F Byrne1,
- Nicolas Chapados2,3,
- Florian Soudan2,
- Clemens Oertel2,
- Milagros Linares Pérez4,
- Raymond Kelly5,
- Nadeem Iqbal6,
- Florent Chandelier2,
- Douglas K Rex7
Author affiliations
- Division of Gastroenterology, Vancouver General Hospital, Vancouver, British Columbia, Canada
- Department of Technology, Imagia, Montreal, Quebec, Canada
- Department of Applied Mathematics, Ecole Polytechnique de Montreal, Montreal, Quebec, Canada
- Department of Gastroenterology, Universidad de Buenos Aires, Buenos Aires, Argentina
- Department of Anaesthetics, Beaumont Hospital, Dublin, Ireland
- Department of Gastroenterology, Saint Luke’s Hospital, Kilkenny, Ireland
- Division of Gastroenterology and Hepatology, Indiana University Medical Center, Indianapolis, Indiana, USA
- Correspondence toDr Michael F Byrne, Division of Gastroenterology, Vancouver General Hospital, University of British Columbia, Vancouver, BC V5Z 1M9, Canada; mike@ai4gi.com
Abstract
Background In general, academic but not community endoscopists have demonstrated adequate endoscopic differentiation accuracy to make the ‘resect and discard’ paradigm for diminutive colorectal polyps workable. Computer analysis of video could potentially eliminate the obstacle of interobserver variability in endoscopic polyp interpretation and enable widespread acceptance of ‘resect and discard’.
Study design and methods We developed an artificial intelligence (AI) model for real-time assessment of endoscopic video images of colorectal polyps. A deep convolutional neural network model was used. Only narrow band imaging video frames were used, split equally between relevant multiclasses. Unaltered videos from routine exams not specifically designed or adapted for AI classification were used to train and validate the model. The model was tested on a separate series of 125 videos of consecutively encountered diminutive polyps that were proven to be adenomas or hyperplastic polyps.
Results The AI model works with a confidence mechanism and did not generate sufficient confidence to predict the histology of 19 polyps in the test set, representing 15% of the polyps. For the remaining 106 diminutive polyps, the accuracy of the model was 94% (95% CI 86% to 97%), the sensitivity for identification of adenomas was 98% (95% CI 92% to 100%), specificity was 83% (95% CI 67% to 93%), negative predictive value 97% and positive predictive value 90%.
Conclusions An AI model trained on endoscopic video can differentiate diminutive adenomas from hyperplastic polyps with high accuracy. Additional study of this programme in a live patient clinical trial setting to address resect and discard is planned.
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
http://dx.doi.org/10.1136/gutjnl-2017-314547
Vancouver, Canada
2017-10 Accepted
-Hardware
NICE classification
Olympus
NBI
-Sofeware
CNN
DCNN
Training :
"For the training set, we used 223 polyp videos (29% NICE type 1, 53% NICE type 2 and 18% of
normal mucosa with no polyp), comprising 60 089 frames. For the validation set, we used 40 videos
(NICE type 1, NICE type 2 and two videos of normal mucosa). The final test set included 125
consecutively identified diminutive polyps, comprising 51 hyperplastic polyps and 74 adenomas. "
-Strong points
real-time
even in 2017
Endsocopy Journal
polyp differentiation
