TUNeS: A Temporal U-Net with Self-Attention for Video-based Surgical Phase Recognition

arXiv:2307.09997v3 Announce Type: replace
Abstract: To enable context-aware computer assistance in the operating room of the future, cognitive systems need to understand automatically which surgical phase is being performed by the medical team. The primary source of information for surgical phase recognition is typically video, which presents two challenges: extracting meaningful features from the video stream and effectively modeling temporal information in the sequence of visual features. For temporal modeling, attention mechanisms have gained popularity due to their ability to …

abstract arxiv attention challenges cognitive computer context cs.cv future information medical recognition room self-attention systems team temporal type video