ROLL is an efficient and user-friendly RL library designed for Large Language Models (LLMs) utilizing Large Scale GPU resources. It significantly enhances LLM performance in key areas such as human preference alignment, complex reasoning, and multi-turn agentic interaction scenarios.

For Tech Pioneers
Fast and Cost-Effective.
Scalability and Fault Tolerance.
Flexible Hardware Usage.

For Product Developers
Diverse and Extensible Rewards/Environments.
Compositional Sample-Reward Route.
Easy Device-Reward Mapping.

For Algorithm Researchers
Constrained Device Execution.
Pluggable RLVR & Agentic RL Pipeline.
Transparent Experimentation