Kv-Cache
Kv-Cache
- LServe and SampleAttention: What Sparse Attention Actually Changes in Prefill and Decode
Structured sparsity aligned with GPU attention kernels: LServe’s unified serving stack for prefill and decode, and SampleAttention’s empirical patterns plus CRA as a runtime quality floor.
- How KV-Cache Paging Works in vLLM — and Why It Matters for Production
A walkthrough of PagedAttention, the KV-cache memory manager from the vLLM paper (Kwon et al., SOSP 2023), and why paging matters for serving many concurrent LLM sessions.