microsoft/DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

PythonC++CudaShellDockerfileCmachine-learningcompressiondeep-learninggpuinferencepytorchzerodata-parallelismmodel-parallelismmixture-of-expertspipeline-parallelismbillion-parameterstrillion-parameters
This is stars and forks stats for /microsoft/DeepSpeed repository. As of 29 Mar, 2024 this repository has 28795 stars and 3493 forks.

Latest News DeepSpeed empowers ChatGPT-like model training with a single click, offering 15x speedup over SOTA RLHF systems with unprecedented cost reduction at all scales; learn how. [2023/10] DeepSpeed-VisualChat: Improve Your Chat Experience with Multi-Round Multi-Image Inputs [English] [中文] [日本語] [2023/09] Announcing the DeepSpeed4Science Initiative: Enabling large-scale scientific discovery through sophisticated AI system technologies [DeepSpeed4Science website] [Tutorials] [Blog] [中文] [日本語] [2023/08]...
Read on GithubGithub Stats Page
repotechsstarsweeklyforksweekly
facebookresearch/maePython6k+261k+7
elastic/logstashJavaRubyShell13.7k+73.5k+3
puma/pumaRubyCJava7.5k01.4k0
elastic/ansible-elasticsearchRubyJinjaPython1.6k08440
presidentbeef/brakemanRubyHTMLJavaScript6.8k07440
FrancescoXX/100-days-of-Web3CSSSolidityJavaScript3.4k0552+2
eugeneyan/applied-ml24.8k+243.5k+7
ashishpatel26/500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code13.5k+463.9k+9
Azure/missionlzBicepHCLDockerfile18301080
Xilinx/meta-xilinx-toolsTclBitBakeNASL40+1470