Essentials of Multi-modal/Visual-Language models (A video)

I just uploaded a video on my Youtube covering all the major techniques and challenges for training multi-modal models that can combine multiple input sources like images, text, audio, etc to perform amazing cross-modal tasks like text-image retrieval, multimodal vector arithmetic, visual question answering, and language modelling. So many amazing results of the past few years have left my jaws on the floor.

I thought it was a good time to make a video about this topic since more and …

audio challenges computervision etc image images language language models major modelling multimodal multiple question answering retrieval text text-image training vector video youtube