April 12, 2024, 11:54 p.m. | Erick Badillo

DEV Community dev.to

In this post, I present you a solution developed within the .NET ecosystem that shows how to integrate RAG with the ETL Medallion architecture using the Azure AI Document services, Pinecone vector database, Azure Cosmos DB, and the chat and embeddings OpenAI API endpoints to create a system capable of providing good responses in the context of Mexican Tax legislation.





Theoretical Framework





Medallion Architecture


The Medallion architecture organizes data transformation into three distinct layers—bronze, silver, and gold—each optimized for specific …

api architecture azure azure ai azure cosmos db chat cosmos database document dotnet ecosystem embeddings endpoints etl good llm openai openai api pinecone rag search semantic services shows solution vector vector database

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Business Data Scientist, gTech Ads

@ Google | Mexico City, CDMX, Mexico

Lead, Data Analytics Operations

@ Zocdoc | Pune, Maharashtra, India