Getting creative with embeddings

Getting creative with embeddings

Amelia Wattenberger describes a neat application of embeddings I haven't seen before: she wanted to build a system that could classify individual sentences in terms of how "concrete" or "abstract" they are. So she generated several example sentences for each of those categories, embedded then and calculated the average of those embeddings.

And now she can get a score for how abstract vs concrete a new sentence is by calculating its embedding and seeing where it …

abstract ai application build concrete creative embedded embeddings example generated generativeai llms terms