yandex/YaLM-100B

Pretrained language model with 100B parameters

PythonC++ShellCudaDockerfileTeXMakefile
This is stars and forks stats for /yandex/YaLM-100B repository. As of 02 May, 2024 this repository has 3662 stars and 297 forks.

YaLM 100B YaLM 100B is a GPT-like neural network for generating and processing text. It can be used freely by developers and researchers from all over the world. The model leverages 100 billion parameters. It took 65 days to train the model on a cluster of 800 A100 graphics cards and 1.7 TB of online texts, books, and countless other sources in both English and Russian. Training details and best practices on acceleration and stabilizations can be found on Medium (English) and Habr (Russian) articles. We...
Read on GithubGithub Stats Page
repotechsstarsweeklyforksweekly
openai/Video-Pre-TrainingPython1k01140
datafold/data-diffPythonOther2.5k01630
CFandR-github/PHP-binary-bugsPythonPHP1760380
lucidrains/parti-pytorchPython4770200
avo-hq/avoRubyHTMLJavaScript1.2k01650
Nigh/I-wanna-clean-keyboardHTMLAutoHotkeyMakefile501+2280
w3c/IntersectionObserverBikeshedMakefileShell3.6k0564-1
eserozvataf/hayalet-sevgilim-sarki-sozleriBrainfuckJavaScriptSwift5570740
helpsystems/nanodumpCAssemblyPython1.5k02090
topology-gg/isaacCairoPython86030