This is stars and forks stats for /Guitaricet/relora repository. As of 03 May, 2024 this repository has 279 stars and 23 forks.
ReLoRA -- PEFT Pretraining Official code for Stack More Layers Differently: High-Rank Training Through Low-Rank Updates https://arxiv.org/abs/2307.05695 Setup All requirements are listed in requirements.txt and kept up-to-date. cd peft_pretraining pip install -r requirements.txt Usage To train a model using ReLoRA, first, perform a warmup through regular training. Train language model with PEFT torchrun --nproc-per-node <N_GPUS> torchrun_main.py \ --model_config configs/llama_250m.json...
ReLoRA -- PEFT Pretraining Official code for Stack More Layers Differently: High-Rank Training Through Low-Rank Updates https://arxiv.org/abs/2307.05695 Setup All requirements are listed in requirements.txt and kept up-to-date. cd peft_pretraining pip install -r requirements.txt Usage To train a model using ReLoRA, first, perform a warmup through regular training. Train language model with PEFT torchrun --nproc-per-node <N_GPUS> torchrun_main.py \ --model_config configs/llama_250m.json...
repo | techs | stars | weekly | forks | weekly |
---|---|---|---|---|---|
telekom-mms/sectpmctl-kmodsign-wrapper | MakefileShell | 0 | 0 | 0 | 0 |
nengyi1226/msfauto | MakefileShellC | 15 | 0 | 0 | 0 |
rocky/Perl-Devel-Trepan-Shell | PerlShell | 1 | 0 | 0 | 0 |
tejado/pgoapi | Protocol BufferPython | 1.4k | 0 | 497 | 0 |
haoheliu/AudioLDM2 | Python | 1.7k | 0 | 129 | 0 |
charlesbel/Microsoft-Rewards-Farmer | Python | 705 | 0 | 133 | 0 |
FlagOpen/FlagEmbedding | Python | 1.2k | 0 | 63 | 0 |
huggingface/trl | PythonShellMakefile | 5.9k | 0 | 627 | 0 |
NomaDamas/KICE_slayer_AI_Korean | Python | 344 | 0 | 20 | 0 |
conan-io/conan-center-index | PythonCMakeC++ | 816 | 0 | 1.4k | 0 |