Knowledge Distillation in YOLOX-ViT for Side-Scan Sonar Object Detection

arXiv:2403.09313v1 Announce Type: new
Abstract: In this paper we present YOLOX-ViT, a novel object detection model, and investigate the efficacy of knowledge distillation for model size reduction without sacrificing performance. Focused on underwater robotics, our research addresses key questions about the viability of smaller models and the impact of the visual transformer layer in YOLOX. Furthermore, we introduce a new side-scan sonar image dataset, and use it to evaluate our object detector's performance. Results show that knowledge distillation effectively reduces …

arxiv cs.ai cs.cv detection distillation knowledge object sonar type vit