AdaViPro: Region-based Adaptive Visual Prompt for Large-Scale Models Adapting

arXiv:2403.13282v1 Announce Type: new
Abstract: Recently, prompt-based methods have emerged as a new alternative `parameter-efficient fine-tuning' paradigm, which only fine-tunes a small number of additional parameters while keeping the original model frozen. However, despite achieving notable results, existing prompt methods mainly focus on `what to add', while overlooking the equally important aspect of `where to add', typically relying on the manually crafted placement. To this end, we propose a region-based Adaptive Visual Prompt, named AdaViPro, which integrates the `where to …

abstract arxiv cs.cv fine-tuning focus however large-scale models paradigm parameters prompt results scale small type visual