Practical calculators and planning aids for KV cache and LLM serving systems.
KV Cache Size Calculator. Estimate KV cache capacity for common production LLM families, including DeepSeek, GLM, Kimi, Qwen, MiniMax, MiMo, and others.
Calculate KV cache hit rate of preset or your own trace, under different memory budgets.