Artificial Intelligence (AI) in Endoscopy – Deep Learning for Scoring of Ulcerative Colitis Disease Activity Under Multiple Scoring Systems.
M Byrne, MA MD Cantab MRCP FRCPC, J East, M Iacucci, R Panaccione, R Kalapala, N Duvvur, H Rughwani, A Singh, M Henkel, S Berry, L Canaran, G Laage, L St-Denis, S Nikfal, J Asselin, R Monsurate, E Cremonese, F Soudan, S Travis
Computer vision & deep learning(DL)to assess & help with tissue characterization of disease activity in Ulcerative Colitis(UC)through Mayo Endoscopic Subscore(MES)show good results in central reading for clinical trials.UCEIS(Ulcerative Colitis Endoscopic Index of Severity)being a granular index,may be more reflective of disease activity & more primed for artificial intelligence(AI). We set out to create UC detection & scoring,in a single tool & graphic user interface(GUI),improving accuracy & precision of MES & UCEIS scores & reducing the time elapsed between video collection,quality assurance & final scoring.We apply DL models to detect & filter scorable frames,assess quality of endoscopic recordings & predict MES & UCEIS scores in videos of patients with UC