Qwen Team
5 min
Qwen-AgentWorld addresses a critical gap in the development of general-purpose AI agents: the lack of a robust world model that can predict environment dynamics. While most research focuses on the agent's policy (the decision-making component), this paper argues that a world model—which predicts the next state given an action—is a necessary component for advanced reasoning and planning. The authors introduce Qwen-AgentWorld, a suite of foundation models trained to simulate seven distinct domains, including terminal operations, software engineering, and GUI-based environments.
The authors developed Qwen-AgentWorld using a three-stage training pipeline: Continual Pre-Training (CPT) to inject general world knowledge, Supervised Fine-Tuning (SFT) to activate next-state-prediction reasoning, and Reinforcement Learning (RL) to sharpen simulation fidelity using hybrid rubric-and-rule rewards. To ensure a unified approach across diverse domains, the researchers established a standard trajectory schema that formats interactions as a sequence of system prompts, actions, and observations. This allows the model to handle varied inputs, such as file-system snapshots for terminal tasks or accessibility trees for Android GUI interactions.
Qwen-AgentWorld demonstrates that world modeling is a powerful tool for agent development in two ways. First, as a decoupled simulator, it allows for scalable and controllable training of agents in environments that are otherwise difficult or unsafe to access, leading to performance gains that exceed those of agents trained only in real-world settings. Second, as a foundation model, it acts as an effective warm-up stage, providing agents with a better understanding of environment dynamics before they undergo downstream reinforcement learning. Empirical results show that these models significantly outperform existing frontier models across a wide range of benchmarks.
By providing a reliable way to simulate complex environments, Qwen-AgentWorld enables researchers to train agents more efficiently and safely. The ability to simulate edge cases and adversarial scenarios—which are rare in real-world interactions—allows for the development of more resilient agents. Furthermore, the success of this unified approach suggests that world modeling is a scalable path toward achieving more capable, autonomous agents that can reason about the future consequences of their actions.
A world model predicts environment dynamics based on current observations and actions, serving as a core cognitive mechanism for reasoning and planning. In this work, we investigate how world modeling based on language models can further push the boundaries of general agents. (i) We first focus on building foundation models for agentic environment simulation. We introduce Qwen-AgentWorld-35B-A3B and Qwen-AgentWorld-397B-A17B, the first language world models capable of simulating agentic environments covering 7 domains via long chain-of-thought reasoning. Leveraging more than 10M environment interaction trajectories of 7 domains in real-world environments, we develop Qwen-AgentWorld through a three-stage training pipeline: CPT injects general-purpose world modeling capabilities from the state transition dynamics and augmented professional corpora, SFT activates next-state-prediction reasoning, and RL sharpens simulation fidelity through a tailored framework with hybrid rubric-and-rule rewards. To evaluate language world models, we present AgentWorldBench, a comprehensive benchmark constructed from real-world interactions of 5 frontier models on 9 established benchmarks. Empirical results demonstrate that Qwen-AgentWorld significantly outperforms existing frontier models. (ii) Beyond foundation models, we further investigate two complementary paradigms through which world modeling enhances general agents. First, as a decoupled environment simulator, Qwen-AgentWorld supports scalable and controllable simulation of thousands of real-world environments for agentic RL, yielding gains that surpass real-environment training alone. Second, as a unified agent foundation model, world-model training acts as a highly effective warm-up that improves downstream performance across 7 agentic benchmarks. Code: https://github.com/QwenLM/Qwen-AgentWorld
Sam: So it's three layers: absorb the knowledge, practice the prediction skill, then get corrected until the predictions are reliable.
Alex: That's a clean summary. And the paper argues this structured approach produces something qualitatively different from a standard agent. Rather than guessing and hoping, the model can run a kind of internal rehearsal — simulating the outcome of an action in its own memory before committing to it.
Sam: Is that actually "thinking," or is it a very sophisticated form of pattern matching?
Alex: The paper frames it as a form of meta-reasoning — reasoning about your own reasoning. When the model predicts a future state, it's not just retrieving a memorized answer. It's constructing a plausible version of what comes next, based on its understanding of how the system works. Whether that constitutes genuine thinking is a philosophical question the paper doesn't fully resolve, but the practical effect is that the agent catches potential errors before they happen in the real world.
Sam: You mentioned two ways to actually deploy this — a decoupled approach and a unified one. What's the difference?
Alex: In the decoupled approach, the world model acts purely as a training environment for other agents. Think of it like a flight simulator. The simulator itself doesn't fly planes — it just creates a realistic environment where pilots can practice without real consequences. Here, the world model creates a realistic digital environment where other AI agents can train at scale, running thousands of practice scenarios that would be too slow or too expensive to run in the real world.
Sam: And the unified approach?
Alex: In the unified approach, the world model is built directly into the agent itself. So as the agent is deciding what to do, it's simultaneously running predictions about what each possible action would lead to. It's not a separate simulator — it's more like an internal voice saying "if I do this, here's what I expect to happen."
Sam: That second approach sounds more powerful, but also more complex to get right.
Alex: The paper suggests both approaches offer meaningful improvements over agents that don't simulate at all. The decoupled approach is particularly useful because it solves a practical problem: real environments are slow and limited. You can only try so many things in the real world. A simulator lets you generate training scenarios that might never appear in real data — edge cases, unusual failures, rare sequences of events. By practicing on those, the agent becomes more robust when it eventually faces the real thing.
Sam: So the simulation isn't just a shortcut — it's actually exposing the agent to situations it couldn't learn from otherwise.
Alex: That's the key insight. The paper's central claim is that this ability to simulate — to model the world internally — isn't a nice bonus feature. It's a prerequisite for building agents that can handle genuinely complex, multi-step tasks reliably. An agent that can only react to what it sees will always be limited by what it's already encountered. An agent that can predict what it hasn't seen yet has a fundamentally different kind of capability.
Sam: It's a meaningful shift in how we think about what an AI agent actually needs to do its job well.
Alex: And that's what makes this research worth paying attention to. It moves the conversation away from "how do we make agents faster or bigger?" toward a more foundational question: do our agents actually understand the environments they operate in? The evidence here suggests that teaching a model to predict the future, not just respond to the present, is a significant step toward answering that question. Thanks for listening to ResearchPod.