DEVOURED
Qwen-AgentWorld
Alibaba's new Qwen-AgentWorld models utilize 10 million interaction trajectories to simulate complex agentic environments for better reasoning.
What: Alibaba researchers released Qwen-AgentWorld, a series of models ranging from 35B to 397B parameters. These language world models were trained to predict environment dynamics and enable long-chain-of-thought reasoning across seven distinct domains using a three-stage training pipeline (CPT, SFT, and RL).
Why it matters: Building world models directly into LLMs allows agents to simulate the consequences of their actions internally, which is essential for planning in complex, non-static environments.
Deep dive
- Implemented as foundation models for agentic environment simulation.
- Trained on 10M+ environment interaction trajectories.
- Three-stage training pipeline: CPT (General world modeling), SFT (Next-state prediction), and RL (Simulation fidelity).
- Introduces AgentWorldBench for evaluating simulated environment dynamics.
- Acts as a scalable simulator for agentic reinforcement learning, reducing reliance on real-world environment training.
Decoder
- World Model: An AI model that learns the internal physics and state-transition rules of an environment, allowing it to predict future states based on current actions.
- CPT/SFT/RL: The standard sequence of training: Continual Pre-training, Supervised Fine-Tuning, and Reinforcement Learning.
Original article
Qwen-AgentWorld: Language World Models for General Agents
A world model predicts environment dynamics based on current observations and actions, serving as a core cognitive mechanism for reasoning and planning. In this work, we investigate how world modeling based on language models can further push the boundaries of general agents. (i) We first focus on building foundation models for agentic environment simulation. We introduce Qwen-AgentWorld-35B-A3B and Qwen-AgentWorld-397B-A17B, the first language world models capable of simulating agentic environments covering 7 domains via long chain-of-thought reasoning. Leveraging more than 10M environment interaction trajectories of 7 domains in real-world environments, we develop Qwen-AgentWorld through a three-stage training pipeline: CPT injects general-purpose world modeling capabilities from the state transition dynamics and augmented professional corpora, SFT activates next-state-prediction reasoning, and RL sharpens simulation fidelity through a tailored framework with hybrid rubric-and-rule rewards. To evaluate language world models, we present AgentWorldBench, a comprehensive benchmark constructed from real-world interactions of 5 frontier models on 9 established benchmarks. Empirical results demonstrate that Qwen-AgentWorld significantly outperforms existing frontier models. (ii) Beyond foundation models, we further investigate two complementary paradigms through which world modeling enhances general agents. First, as a decoupled environment simulator, Qwen-AgentWorld supports scalable and controllable simulation of thousands of real-world environments for agentic RL, yielding gains that surpass real-environment training alone. Second, as a unified agent foundation model, world-model training acts as a highly effective warm-up that improves downstream performance across 7 agentic benchmarks.
Explore all 57 articles in today's digest
Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi