AlignmentResearch/tuned-lens

This is stars and forks stats for /AlignmentResearch/tuned-lens repository. As of 04 May, 2024 this repository has 293 stars and 27 forks.

Tuned Lens 🔎 Tools for understanding how transformer predictions are built layer-by-layer. This package provides a simple interface for training and evaluating tuned lenses. A tuned lens allows us to peek at the iterative computations a transformer uses to compute the next token. What is a Lens? A lens into a transformer with n layers allows you to replace the last m layers of the model with an affine transformation (we call these affine translators). Each affine translator is trained to minimize...