Assessing AI system performance: thinking beyond models to deployment contexts

AI systems are becoming increasingly complex as we move from visionary research to deployable technologies such as self-driving cars, clinical predictive models, and novel accessibility devices. Unlike singular AI models, it is more difficult to assess whether these more complex AI systems are performing consistently and as intended to realize human benefit. How do we […]

The post Assessing AI system performance: thinking beyond models to deployment contexts appeared first on Microsoft Research.

ai system deployment performance research blog thinking