Leveraging Large Language Models for Multimodal Search

arXiv:2404.15790v1 Announce Type: new
Abstract: Multimodal search has become increasingly important in providing users with a natural and effective way to ex-press their search intentions. Images offer fine-grained details of the desired products, while text allows for easily incorporating search modifications. However, some existing multimodal search systems are unreliable and fail to address simple queries. The problem becomes harder with the large variability of natural language text queries, which may contain ambiguous, implicit, and irrelevant in-formation. Addressing these issues may …

abstract arxiv become cs.cv fine-grained however images language language models large language large language models multimodal natural press products search systems text type while