Tensorrt-Llm on Zhanyl Abdybaeva

Tensorrt-Llm on Zhanyl Abdybaeva https://zhanyl-tech.github.io/tags/tensorrt-llm/ Recent content in Tensorrt-Llm on Zhanyl Abdybaeva Hugo en-us Tue, 20 Jan 2026 00:00:00 +0000 vLLM vs TensorRT-LLM: First Throughput Numbers on Llama-3 70B https://zhanyl-tech.github.io/experiments/2026-01-20-vllm-vs-tensorrt-llm-first-look/ Tue, 20 Jan 2026 00:00:00 +0000 https://zhanyl-tech.github.io/experiments/2026-01-20-vllm-vs-tensorrt-llm-first-look/ Quick benchmark comparing vLLM and TensorRT-LLM throughput on a single A100 80GB with Llama-3 70B. Setup notes, raw numbers, and what I'd investigate next.