Skip to content
15-LLM-Inference-Scheduler
Search
K
Main Navigation
Guide
Features
API Reference
System Design
Interview Q&A
Checklist
Appearance
Menu
Return to top
On this page
14.6 Caching & Paged KV Allocator
Technical Specification & Deep Dive
Paged virtual memory management for Key-Value attention tensors.