Congestion Control

CONCUR: Controlling Mid-Phase Thrashing in Agentic Batch Inference
A technical note on CONCUR, an agent-level admission control layer that prevents KV cache collapse during long-running agentic LLM inference.
Zhisheng YE
May 17, 2026 5 min read
CONCUR: Controlling Mid-Phase Thrashing in Agentic Batch Inference