rustformers/llm

This is stars and forks stats for /rustformers/llm repository. As of 26 Apr, 2024 this repository has 4967 stars and 281 forks.

llm - Large Language Models for Everyone, in Rust llm is an ecosystem of Rust libraries for working with large language models - it's built on top of the fast, efficient GGML library for machine learning. Image by @darthdeus, using Stable Diffusion The primary entrypoint for developers is the llm crate, which wraps llm-base and the supported model crates. Documentation for released version is available on Docs.rs. For end-users, there is a CLI application, llm-cli, which provides a convenient interface...