A Large-scale Medical Visual Task Adaptation Benchmark

arXiv:2404.12876v1 Announce Type: cross
Abstract: Visual task adaptation has been demonstrated to be effective in adapting pre-trained Vision Transformers (ViTs) to general downstream visual tasks using specialized learnable layers or tokens. However, there is yet a large-scale benchmark to fully explore the effect of visual task adaptation on the realistic and important medical domain, particularly across diverse medical visual modalities, such as color images, X-ray, and CT. To close this gap, we present Med-VTAB, a large-scale Medical Visual Task Adaptation …

abstract arxiv benchmark cs.ai cs.cv cs.lg explore general however medical scale tasks tokens transformers type vision vision transformers visual