KDAS: Knowledge Distillation via Attention Supervision Framework for Polyp Segmentation

arXiv:2312.08555v2 Announce Type: replace-cross
Abstract: Polyp segmentation, a contentious issue in medical imaging, has seen numerous proposed methods aimed at improving the quality of segmented masks. While current state-of-the-art techniques yield impressive results, the size and computational cost of these models create challenges for practical industry applications. To address this challenge, we present KDAS, a Knowledge Distillation framework that incorporates attention supervision, and our proposed Symmetrical Guiding Module. This framework is designed to facilitate a compact student model with fewer …

arxiv attention cs.cv cs.lg distillation eess.iv framework knowledge segmentation supervision type via