The Latent Bridge: A Continuous Slow-Fast Channel for Real-Time Game Agents

The paper introduces the Latent Bridge, a novel continuous communication channel that enhances the interaction between a slow reasoning VLM (Qwen3-VL-8B-Thinking) and a fast reactive VLM (MiniCPM-o 4.5) by projecting the slow model's residuals into the fast model's input-embedding space, eliminating the need for text round-trips. Evaluated on 7 Atari games and a driving domain (MetaDrive), the Latent Bridge outperforms the traditional Text Bridge in several cases, notably improving performance in MsPacman by 57% and RoadRunner by 28%. This development is significant for practitioners as it offers a method to optimize real-time decision-making in AI agents, particularly in environments where latency and planning quality are critical.