Which Model to Transfer? A Survey on Transferability Estimation

arXiv:2402.15231v1 Announce Type: new
Abstract: Transfer learning methods endeavor to leverage relevant knowledge from existing source pre-trained models or datasets to solve downstream target tasks. With the increase in the scale and quantity of available pre-trained models nowadays, it becomes critical to assess in advance whether they are suitable for a specific target task. Model transferability estimation is an emerging and growing area of interest, aiming to propose a metric to quantify this suitability without training them individually, which is …

abstract advance arxiv cs.cv cs.lg datasets endeavor knowledge pre-trained models scale solve survey tasks transfer transfer learning type