
FlashStates jointly manages recurrent state and KV caches for hybrid model inference (opens in a new tab)
FlashStates manages recurrent state and KV caches together for hybrids using KDA, GDN and Mamba-style layers. The team tests prefix reuse, prefill speed and tiered-cache benefits on B200 GPUs with long-context workloads.