May 25, 2023, 1:46 p.m. | tatyana

DEV Community dev.to


aimstack.io is an awesome tool for tracking metadata for your LLM app (e.g. experiments 🧪, prompts 📝, and more).


It’s the perfect tool for tracing within LlamaIndex, which manages multiple LLM calls on top of your data.


Now you can easily track intermediate prompts, responses, and context chunks through Aim’s sophisticated UI.


Full guide here: https://gpt-index.readthedocs.io/en/latest/examples/callbacks/AimCallback.html


Aim repo: https://github.com/aimhubio/aim

Llama_index: https://github.com/jerryjliu/llama_index

ai aim app context data intermediate llm metadata multiple opensource prompts responses through tool tracing tracking

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Data Strategy & Management - Private Equity Sector - Manager - Consulting - Location OPEN

@ EY | New York City, US, 10001-8604

Data Engineer- People Analytics

@ Volvo Group | Gothenburg, SE, 40531