setzer22/llama-rs

This is stars and forks stats for /setzer22/llama-rs repository. As of 23 Apr, 2024 this repository has 4980 stars and 281 forks.

llm - Large Language Models for Everyone, in Rust llm is an ecosystem of Rust libraries for working with large language models - it's built on top of the fast, efficient GGML library for machine learning. Image by @darthdeus, using Stable Diffusion The primary entrypoint for developers is the llm crate, which wraps llm-base and the supported model crates. Documentation for released version is available on Docs.rs. For end-users, there is a CLI application, llm-cli, which provides a convenient interface...