jaymody/picoGPT

This is stars and forks stats for /jaymody/picoGPT repository. As of 29 Apr, 2024 this repository has 2665 stars and 346 forks.

PicoGPT Accompanying blog post: GPT in 60 Lines of Numpy You've seen openai/gpt-2. You've seen karpathy/minGPT. You've even seen karpathy/nanoGPT! But have you seen picoGPT??!? picoGPT is an unnecessarily tiny and minimal implementation of GPT-2 in plain NumPy. The entire forward pass code is 40 lines of code. picoGPT features: Fast? ❌ Nah, picoGPT is megaSLOW 🐌 Training code? ❌ Error, 4️⃣0️⃣4️⃣ not found Batch inference? ❌ picoGPT is civilized, single file line, one at a time only top-p sampling?...