ProductAI Software / Framework

FlashInfer

Open-source library of optimized GPU kernels for large-language-model inference and serving.

Mentioned in