serge-chat/serge

This is stars and forks stats for /serge-chat/serge repository. As of 28 Apr, 2024 this repository has 5027 stars and 355 forks.

Serge - LLaMA made easy 🦙 Serge is a chat interface crafted with llama.cpp for running Alpaca models. No API keys, entirely self-hosted! 🌐 SvelteKit frontend 💾 Redis for storing chat history & parameters ⚙️ FastAPI + LangChain for the API, wrapping calls to llama.cpp using the python bindings 🎥 Demo: demo.webm ⚡️ Quick start 🐳 Docker: docker run -d \ --name serge \ -v weights:/usr/src/app/weights \ -v datadb:/data/db/ \ -p 8008:8008 \ ghcr.io/serge-chat/serge:latest 🐙...