mosaicml/llm-foundry

This is stars and forks stats for /mosaicml/llm-foundry repository. As of 29 Apr, 2024 this repository has 3078 stars and 353 forks.

LLM Foundry This repository contains code for training, finetuning, evaluating, and deploying LLMs for inference with Composer and the MosaicML platform. Designed to be easy-to-use, efficient and flexible, this codebase is designed to enable rapid experimentation with the latest techniques. You'll find in this repo: llmfoundry/ - source code for models, datasets, callbacks, utilities, etc. scripts/ - scripts to run LLM workloads data_prep/ - convert text data from original sources to StreamingDataset...