CoAgent: Concurrency Control for Multi-Agent Systems

The paper presents CoAgent, a concurrency control middleware designed for multi-agent systems that utilize large language models (LLMs) to manage shared states effectively. CoAgent implements a novel protocol called Monotonic Trajectory Pre-Order (MTPO), allowing agents to speculatively apply writes while maintaining a fixed serialization order, resulting in a 1.4x speedup and maintaining 95% serial correctness across ten contended workloads. This approach addresses the limitations of classical concurrency control mechanisms, offering a more efficient solution for practitioners dealing with parallel LLM agents in environments like git trees and Kubernetes clusters.