EleutherAI/pythia

This is stars and forks stats for /EleutherAI/pythia repository. As of 07 May, 2024 this repository has 1579 stars and 98 forks.

Pythia: Interpreting Transformers Across Time and Scale This repository is for EleutherAI's project Pythia which combines interpretability analysis and scaling laws to understand how knowledge develops and evolves during training in autoregressive transformers. For detailed info on the models, their training, and their behavior, please see our paper Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling. Contents Models Changelog Quickstart Reproducing Training Dataset Viewer Benchmark...