Challenges of Evaluating and Understanding Foundation models

The process of evaluating and understanding foundation model such as LLMs or SLMs is complex. This involves finding Benchmarks needed to established performance thresholds as well as accelerating model improvement. It is vital to keep responsible AI practices in mind throughout the analysis cycle.

✨ Join the #MarchResponsibly challenge by learning responsible AI tools and services available to you.

In this video, Besmira Nushi, an AI researcher at Microsoft, discusses critical factors to consider when understanding or evaluating foundation models. …

analysis benchmarks challenge challenges foundation foundation model improvement join llms mind performance practices process responsible responsible ai responsible ai practices slms understanding vital