[Own work] VALSE 💃: Benchmark for Vision and Language Models Centered on Linguistic Phenomena

Let’s VALSE 💃! We present our own work on the VALSE benchmark testing large pretrained vision and language models by targeting linguistic phenomena. Work accepted at ACL 2022.

Paper 📜: Parcalabescu, Letitia, Michele Cafagna, Lilitta Muradjan, Anette Frank, Iacer Calixto, and Albert Gatt. "VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena." https://aclanthology.org/2022.acl-long.567/
🔗 Data: https://github.com/Heidelberg-NLP/VALSE

Check out our daily #MachineLearning Quiz Questions: https://www.youtube.com/c/AICoffeeBreak/community

Outline:
00:00 See you at ACL 2022?
00:50 State-of-the-art Vision and Language …

benchmark language language models vision work