2026 · Paper
AReaL-DTE: Sparse Policy-Weight Transfer for Online Agentic Reinforcement Learning
A snapshot-free Delta Transfer Engine that translates inference-visible weight sparsity into end-to-end system efficiency.
What's AReaL
A reinforcement learning (RL) infrastructure designed to bridge foundation model training with modern agent-based applications.
We are part of the PyTorch Foundation Landscape Project.
Research Publications
2026 · Technical Report
Next-Generation Agentic Reinforcement Learning Systems Enable Self-Evolving Agents
A microservice-based redesign of AReaL that decouples training, inference, agent execution and weight-update into independent services — enabling long-horizon, self-evolving agents at scale.
2026 · Paper
Post-training Multi-turn Interactive Tool-using Agents with Verifiable Rewards
AReaL-SEA, a self-evolving data-synthesis engine paired with RL training. A 235B MoE surpasses GPT-5 and matches Gemini 3.0 Pro on τ²-bench.
2026 · Paper
AReaL-DTA: Dynamic Tree Attention for Efficient Reinforcement Learning of Large Language Models
A DFS-based dynamic tree attention that exploits shared rollout prefixes during RL post-training — up to 8.31× throughput over dense training on τ²-bench, with a load-balanced distributed batching scheme across GPUs.
2025 · Paper
AReaL: A Large-Scale Asynchronous Reinforcement Learning System for Language Reasoning
The original AReaL system paper — a fully asynchronous training paradigm that achieves 2.77× speedup while matching or exceeding synchronous baselines on reasoning benchmarks.
