Evaluating the Efficacy of Prompt-Engineered Large Multimodal Models Versus Fine-Tuned Vision Transformers in Image-Based Security Applications

arXiv:2403.17787v1 Announce Type: cross
Abstract: The success of Large Language Models (LLMs) has led to a parallel rise in the development of Large Multimodal Models (LMMs), such as Gemini-pro, which have begun to transform a variety of applications. These sophisticated multimodal models are designed to interpret and analyze complex data, integrating both textual and visual information on a scale previously unattainable, opening new avenues for a range of applications. This paper investigates the applicability and effectiveness of prompt-engineered Gemini-pro LMMs …

abstract applications arxiv begun cs.ai cs.cr cs.cv development gemini image language language models large language large language models large multimodal models llms lmms multimodal multimodal models prompt security success transformers type vision vision transformers