Tensorrt-Llm

vLLM vs TensorRT-LLM: Inference Throughput Jan 20, 2026
A measured throughput comparison of vLLM and TensorRT-LLM on Llama-3 70B, and why the faster engine is not automatically the right one.
vLLM vs TensorRT-LLM: First Throughput Numbers on Llama-3 70B Jan 20, 2026
Quick benchmark comparing vLLM and TensorRT-LLM throughput on a single A100 80GB with Llama-3 70B. Setup notes, raw numbers, and what I'd investigate next.