OpenAccess-AI-Collective/axolotl

This is stars and forks stats for /OpenAccess-AI-Collective/axolotl repository. As of 06 Dec, 2023 this repository has 1234 stars and 157 forks.

Axolotl Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures. Features: Train various Huggingface models such as llama, pythia, falcon, mpt Supports fullfinetune, lora, qlora, relora, and gptq Customize configurations using a simple yaml file or CLI overwrite Load different dataset formats, use custom formats, or bring your own tokenized datasets Integrated with xformer, flash attention, rope scaling, and multipacking Works...