PathoTune: Adapting Visual Foundation Model to Pathological Specialists

arXiv:2403.16497v1 Announce Type: cross
Abstract: As natural image understanding moves towards the pretrain-finetune era, research in pathology imaging is concurrently evolving. Despite the predominant focus on pretraining pathological foundation models, how to adapt foundation models to downstream tasks is little explored. For downstream adaptation, we propose the existence of two domain gaps, i.e., the Foundation-Task Gap and the Task-Instance Gap. To mitigate these gaps, we introduce PathoTune, a framework designed to efficiently adapt pathological or even visual foundation models to …

abstract adapt arxiv cs.cv cs.lg domain focus foundation foundation model image imaging natural pathology pretraining research tasks type understanding visual