Nvidia launches a set of microservices for optimized inferencing

At its GTC conference, Nvidia today announced Nvidia NIM, a new software platform designed to streamline the deployment of custom and pre-trained AI models into production environments. NIM takes the software work Nvidia has done around inferencing and optimizing models and makes it easily accessible by combining a given model with an optimized inferencing engine […]

© 2024 TechCrunch. All rights reserved. For personal use only.

ai ai models conference containers deployment enterprise environments gtc gtc conference inferencing microservices nim nvidia platform production production environments set software work