ProductAI Software / Framework

TensorRT-LLM

NVIDIA library for optimizing and serving large language models on its GPUs.

Made by NVIDIA
Mentioned in