When Prefix Cache Meets KDA: How Mooncake Enabled Day-0 Support for Kimi K3
On July 27, Moonshot AI officially open-sourced Kimi K3. Having been part of the journey across multiple Kimi generations, Mooncake, together with SGLang, vLLM, and TokenSpeed, delivered Day-0 support to enable efficient distributed inference for Kimi K3.
Aug 3, 2026
KT-FT v0.6.1: Closing the Loop from MoE Fine-Tuning to Local Serving
KT-FT v0.6.1 connects MoE SFT and local SGLang serving into an end-to-end loop; split LoRA serving bridges KT expert and SGLang non-expert adapters for Qwen3.5 MoE.
May 29, 2026
OpenClaw + Mooncake: A Stability Upgrade for Real-World Multi-Session Inference
By integrating Mooncake into OpenClaw's real inference path, we not only improved fast-path latency, but also sharply reduced TTFT tail latency in multi-session, long-context workloads, turning a system that was usually fast but occasionally slow into one that feels consistently smooth.
Mar 19, 2026
KTransformers + LLaMA-Factory + SGLang: Low-Cost Local Fine-Tuning and Inference
A low-cost, low-memory end-to-end fine-tuning and inference workflow for large MoE models with KTransformers, LLaMA-Factory, and SGLang.
Nov 1, 2025