Nvidia banking on TensorRT to expand generative AI dominance

Nvidia looks to build a bigger presence outside GPU sales as it puts its AI-specific software development kit into more applications.

Nvidia announced that it’s adding support for its TensorRT-LLM SDK to Windows and models like Stable Diffusion. The company said in a blog post that it aims to make large language models (LLMs) and related tools run faster.

TensorRT speeds up inference, the process of going through pretrained information and calculating probabilities …

alex applications banking bigger blog build development diffusion generative gpu illustration llm nvidia sales sdk software software development software development kit stable diffusion support tensorrt tensorrt-llm windows