archinetai/surgeon-pytorch

This is stars and forks stats for /archinetai/surgeon-pytorch repository. As of 26 Apr, 2024 this repository has 457 stars and 15 forks.

A library to inspect and extract intermediate layers of PyTorch models. Why? It's often the case that we want to inspect intermediate layers of PyTorch models without modifying the code. This can be useful to get attention matrices of language models, visualize layer embeddings, or apply a loss function to intermediate layers. Sometimes we want extract subparts of the model and run them independently, either to debug them or to train them separately. All of this can be done with Surgeon without changing...