scaleapi/llm-engine

This is stars and forks stats for /scaleapi/llm-engine repository. As of 09 May, 2024 this repository has 594 stars and 34 forks.

LLM Engine 🚀 The open source engine for fine-tuning and serving large language models. 🚀 Scale's LLM Engine is the easiest way to customize and serve LLMs. In LLM Engine, models can be accessed via Scale's hosted version or by using the Helm charts in this repository to run model inference and fine-tuning in your own infrastructure. 💻 Quick Install pip install scale-llm-engine 🤔 About Foundation models are emerging as the building blocks of AI. However, deploying these models to the cloud and fine-tuning...