lucidrains/MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

Pythondeep-learningtransformersartificial-intelligenceattention-mechanismslong-contextlearned-tokenization
This is stars and forks stats for /lucidrains/MEGABYTE-pytorch repository. As of 27 Apr, 2024 this repository has 516 stars and 45 forks.

MEGABYTE - Pytorch Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch. Took the liberty to generalize it even further so one can have multiple local models. Similar independent research that is a further generalization Appreciation Stability and 🤗 Huggingface for the generous sponsorship to work on and open source cutting edge artificial intelligence research Install $ pip install MEGABYTE-pytorch Usage import torch from MEGABYTE_pytorch import...
Read on GithubGithub Stats Page
repotechsstarsweeklyforksweekly
homanp/superagentJavaScriptTypeScriptPython2.7k04880
Mixtape-Sessions/Heterogeneous-EffectsSchemeSASStata240200
wangjia184/diffusion_modelSCSSJavaScriptTypeScript900100
TristanCopley/delnorte-csaSvelteJavaTypeScript0070
urgent-learner/mlentaryTeXPython170170
kevinburleigh75/spriNGboard_week_16Vim ScriptPerlDockerfile0070
ReaVNaiL/New-Grad-2024Python4.8k04300
bigcode-project/starcoder.cppCC++Cuda4040320
ComparativeGenomicsToolkit/cactusCPythonMakefile4100920
wenda-LLM/wendaJavaScriptCSSPython5.5k07170