[Research] Hypernymy-based approach for text-to-image models (Blog post)

Text-to-image models have rapidly progressed in recent years, but most popular evaluation metrics (such as FID) do not consider their linguistic abilities. A new approach measures how well these models understand subtype relations between concepts. Researchers from Yandex proposed two metrics that combine well-known tools like the WordNet database and ImageNet classifiers in a novel way, allowing them to analyze models like Stable Diffusion in more detail.

[Blog post](https://research.yandex.com/blog/how-much-do-text-to-image-models-know-a-hypernymy-based-approach).

blog classifiers concepts database evaluation evaluation metrics image imagenet machinelearning metrics popular relations research researchers text text-to-image tools wordnet yandex