WeakSurg: Weakly supervised surgical instrument segmentation using temporal equivariance and semantic continuity

arXiv:2403.09551v1 Announce Type: new
Abstract: Weakly supervised surgical instrument segmentation with only instrument presence labels has been rarely explored in surgical domain. To mitigate the highly under-constrained challenges, we extend a two-stage weakly supervised segmentation paradigm with temporal attributes from two perspectives. From a temporal equivariance perspective, we propose a prototype-based temporal equivariance regulation loss to enhance pixel-wise consistency between adjacent features. From a semantic continuity perspective, we propose a class-aware temporal semantic continuity loss to constrain the semantic consistency …

abstract arxiv challenges continuity cs.cv domain labels paradigm perspective perspectives segmentation semantic stage temporal type