LP++: A Surprisingly Strong Linear Probe for Few-Shot CLIP

arXiv:2404.02285v1 Announce Type: new
Abstract: In a recent, strongly emergent literature on few-shot CLIP adaptation, Linear Probe (LP) has been often reported as a weak baseline. This has motivated intensive research building convoluted prompt learning or feature adaptation strategies. In this work, we propose and examine from convex-optimization perspectives a generalization of the standard LP baseline, in which the linear classifier weights are learnable functions of the text embedding, with class-wise multipliers blending image and text knowledge. As our objective …

arxiv clip cs.cv few-shot linear probe type