ridgerchu/SpikeGPT

Implementation of "SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks"

PythonCudaC++
This is stars and forks stats for /ridgerchu/SpikeGPT repository. As of 28 Apr, 2024 this repository has 595 stars and 54 forks.

SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks SpikeGPT is a lightweight generative language model with pure binary, event-driven spiking activation units. The arxiv paper of SpikeGPT can be found here. If you are interested in SpikeGPT, feel free to join our Discord using this link! This repo is inspired by the RWKV-LM. If you find yourself struggling with environment configuration, consider using the Docker image for SpikeGPT available on Github. Training on Enwik8 Download...
Read on GithubGithub Stats Page
repotechsstarsweeklyforksweekly
rosenpass/rosenpassRustTeXShell8800450
sfu-db/connector-xRustPythonOther1.5k01130
KusionStack/KCLVMRustC++LLVM835+666+2
Vonng/pigstyShellPLpgSQLJinja1.7k+10177+1
1989chenguo/CloudComputingSlidesAndCodesAssemblyCC++100280
libAudioFlux/audioFluxCPythonOther1.9k0890
microsoft/semantic-kernelC#Jupyter NotebookPython13.6k+1492k+33
mrexodia/lolbin-pocC++CMake1240170
lepture/shibuyaCSSHTMLJavaScript110010
PersistentSS13/NebulaDMPythonHTML170560