verl is a flexible, efficient and production-ready RL training library for large language models (LLMs). verl is the open-source version of HybridFlow: A Flexible and Efficient RLHF Framework paper.
💪 FP8 compatibility ! 🚀 Speed Up all Process 🚀 less VRAM consumption (Stay high, batch_size=1 for RTX4090 max, I'm trying to fix that) 🛠️ Better benchmark coming soon ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results