General surgery vision transformer: A video pre-trained foundation model for general surgery

arXiv:2403.05949v1 Announce Type: cross
Abstract: The absence of openly accessible data and specialized foundation models is a major barrier for computational research in surgery. Toward this, (i) we open-source the largest dataset of general surgery videos to-date, consisting of 680 hours of surgical videos, including data from robotic and laparoscopic techniques across 28 procedures; (ii) we propose a technique for video pre-training a general surgery vision transformer (GSViT) on surgical videos based on forward video prediction that can run in …

abstract arxiv computational cs.cv cs.lg data dataset foundation foundation model general major openly q-bio.to research robotic surgery transformer type video videos vision