alpa-projects/alpa

This is stars and forks stats for /alpa-projects/alpa repository. As of 02 May, 2024 this repository has 2789 stars and 328 forks.

Documentation | Slack Alpa is a system for training and serving large-scale neural networks. Scaling neural networks to hundreds of billions of parameters has enabled dramatic breakthroughs such as GPT-3, but training and serving these large-scale neural networks require complicated distributed system techniques. Alpa aims to automate large-scale distributed training and serving with just a few lines of code. The key features of Alpa include: 💻 Automatic Parallelization. Alpa automatically parallelizes...