bigscience-workshop/petals

This is stars and forks stats for /bigscience-workshop/petals repository. As of 27 Apr, 2024 this repository has 7655 stars and 372 forks.

Run large language models at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading Generate text with distributed Llama 2 (70B), Falcon (40B+), BLOOM (176B) (or their derivatives), and fine‑tune them for your own tasks — right from your desktop computer or Google Colab: from transformers import AutoTokenizer from petals import AutoDistributedModelForCausalLM # Choose any model available at https://health.petals.dev model_name = "petals-team/StableBeluga2"...