karpathy/ng-video-lecture

This is stars and forks stats for /karpathy/ng-video-lecture repository. As of 12 May, 2024 this repository has 2358 stars and 576 forks.

nanogpt-lecture Code created in the Neural Networks: Zero To Hero video lecture series, specifically on the first lecture on nanoGPT. Publishing here as a Github repo so people can easily hack it, walk through the git log history of it, etc. NOTE: sadly I did not go too much into model initialization in the video lecture, but it is quite important for good performance. The current code will train and work fine, but its convergence is slower because it starts off in a not great spot in the weight...