Mooncake, delicious mooncake made with Moonshot AI! A KVCache-centric disaggregated architecture for LLM serving.
Jun 25, 2024