Towards Large-Scale Training of Pathology Foundation Models

arXiv:2404.15217v1 Announce Type: cross
Abstract: Driven by the recent advances in deep learning methods and, in particular, by the development of modern self-supervised learning algorithms, increased interest and efforts have been devoted to build foundation models (FMs) for medical images. In this work, we present our scalable training pipeline for large pathology imaging data, and a comprehensive analysis of various hyperparameter choices and training techniques for building pathology FMs. We release and make publicly available the first batch of our …

arxiv cs.cv cs.lg foundation pathology scale training type