CarperAI/trlx

This is stars and forks stats for /CarperAI/trlx repository. As of 29 Apr, 2024 this repository has 3932 stars and 411 forks.

Transformer Reinforcement Learning X trlX is a distributed training framework designed from the ground up to focus on fine-tuning large language models with reinforcement learning using either a provided reward function or a reward-labeled dataset. Training support for 🤗 Hugging Face models is provided by Accelerate-backed trainers, allowing users to fine-tune causal and T5-based language models of up to 20B parameters, such as facebook/opt-6.7b, EleutherAI/gpt-neox-20b, and google/flan-t5-xxl. For...