Skip to main content
ROLL
ROLL is an efficient and user-friendly RL library designed for Large Language Models (LLMs) utilizing Large Scale GPU resources. It significantly enhances LLM performance in key areas such as human preference alignment, complex reasoning, and multi-turn agentic interaction scenarios.
For Tech Pioneers

For Tech Pioneers

Fast and Cost-Effective.
Scalability and Fault Tolerance.
Flexible Hardware Usage.

For Product Developers

For Product Developers

Diverse and Extensible Rewards/Environments.
Compositional Sample-Reward Route.
Easy Device-Reward Mapping.

For Algorithm Researchers

For Algorithm Researchers

Constrained Device Execution.
Pluggable RLVR & Agentic RL Pipeline.
Transparent Experimentation