Excited to share that #LatentMAS has been accepted to ICML 2026 as a spotlight!
💻Code: https://github.com/Gen-Verse/LatentMAS 📄Paper: https://arxiv.org/abs/2511.20639
We push multi-agent collaboration into the latent space — beyond human language.
Most multi-agent systems rely on text: agents reason in words, exchange messages, and repeatedly decode/re-encode information. But language can be slow, lossy, and unnecessarily constrained.
💡LatentMAS takes a different path: LLM agents reason and communicate directly through hidden embeddings.
No text decoding. No extra training. No token-level message passing.
Instead, agents collaborate through: 🧠 Autoregressive Latent Thoughts — hidden-state-level reasoning steps 🔁 Latent Communication — information sharing via KV-cache transfer 📌 Input-output Alignment — keeping latent representations in-distribution 🚀 Training-free Collaboration — plug-and-play with existing LLMs
Why it matters: ✅ Up to +14.6% better accuracy on complex reasoning tasks ⚡ 4-4.6x faster end-to-end inference ✂️ 70.8%–83.7% reduction in output token usage
A step toward multi-agent systems that collaborate not by speaking more, but by thinking together in latent space.
#MultiAgentSystems #ModelCollaboration #LatentReasoning #LLM #AgenticAI #ICML
