Structured Generative AI

How to constrain your model to output defined formats

In this post I will explain and demonstrate the concept of “structured generative AI”: generative AI constrained to defined formats. By the end of the post, you will understand where and when it can be used and how to implement it whether you’re crafting a transformer model from scratch or utilizing Hugging Face’s models. Additionally, we will cover an important tip for tokenization that is especially relevant for structured languages.

One …

concept generative generative ai tools nlp scratch sql the end tokenization transformer transformer model will