all AI news
A survey on knowledge-enhanced multimodal learning
March 26, 2024, 4:44 a.m. | Maria Lymperaiou, Giorgos Stamou
cs.LG updates on arXiv.org arxiv.org
Abstract: Multimodal learning has been a field of increasing interest, aiming to combine various modalities in a single joint representation. Especially in the area of visiolinguistic (VL) learning multiple models and techniques have been developed, targeting a variety of tasks that involve images and text. VL models have reached unprecedented performances by extending the idea of Transformers, so that both modalities can learn from each other. Massive pre-training procedures enable VL models to acquire a certain …
abstract arxiv cs.ai cs.lg images knowledge multimodal multimodal learning multiple representation survey targeting tasks text type
More from arxiv.org / cs.LG updates on arXiv.org
Jobs in AI, ML, Big Data
Senior Machine Learning Engineer
@ GPTZero | Toronto, Canada
ML/AI Engineer / NLP Expert - Custom LLM Development (x/f/m)
@ HelloBetter | Remote
Doctoral Researcher (m/f/div) in Automated Processing of Bioimages
@ Leibniz Institute for Natural Product Research and Infection Biology (Leibniz-HKI) | Jena
Seeking Developers and Engineers for AI T-Shirt Generator Project
@ Chevon Hicks | Remote
Director, Venture Capital - Artificial Intelligence
@ Condé Nast | San Jose, CA
Senior Molecular Imaging Expert (Senior Principal Scientist)
@ University of Sydney | Cambridge (USA)