Exploring Optical Flow Inclusion into nnU-Net Framework for Surgical Instrument Segmentation

arXiv:2403.10216v1 Announce Type: new
Abstract: Surgical instrument segmentation in laparoscopy is essential for computer-assisted surgical systems. Despite the Deep Learning progress in recent years, the dynamic setting of laparoscopic surgery still presents challenges for precise segmentation. The nnU-Net framework excelled in semantic segmentation analyzing single frames without temporal information. The framework's ease of use, including its ability to be automatically configured, and its low expertise requirements, have made it a popular base framework for comparisons. Optical flow (OF) is a …

abstract arxiv challenges computer cs.ai cs.cv deep learning dynamic flow framework inclusion information optical optical flow progress segmentation semantic surgery systems temporal type