Blog on Zhanyl Abdybaeva https://zhanyl-tech.github.io/blog/ Recent content in Blog on Zhanyl Abdybaeva Hugo en-us Fri, 30 Jan 2026 00:00:00 +0000 LServe and SampleAttention: What Sparse Attention Actually Changes in Prefill and Decode https://zhanyl-tech.github.io/blog/2026-01-30-lserve-sampleattention-sparse-attention/ Fri, 30 Jan 2026 00:00:00 +0000 https://zhanyl-tech.github.io/blog/2026-01-30-lserve-sampleattention-sparse-attention/ Structured sparsity aligned with GPU attention kernels: LServe’s unified serving stack for prefill and decode, and SampleAttention’s empirical patterns plus CRA as a runtime quality floor. How KV-Cache Paging Works in vLLM — and Why It Matters for Production https://zhanyl-tech.github.io/blog/2026-01-15-kv-cache-paging-vllm/ Thu, 15 Jan 2026 00:00:00 +0000 https://zhanyl-tech.github.io/blog/2026-01-15-kv-cache-paging-vllm/ A technical walkthrough of PagedAttention: the memory management innovation that makes vLLM practical for serving many concurrent LLM sessions without fragmenting GPU memory.