Taking LLMs out of the black box: A practical guide to human-in-the-loop distillation

LLMs have enormous potential, but also challenge existing workflows in industry that require modularity, transparency and data privacy. In this talk, Ines shows some practical solutions for using the latest models in real-world applications and distilling their knowledge into smaller and faster components that you can run and maintain in-house.

annotation applications black box box challenge components data data privacy distillation faster guide human industry knowledge latest llms loop potential practical privacy prodigy shows solutions spacy strategy talk transparency workflows world you