nsarrazin/serge

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

SveltePythonCSSTypeScriptSmartyShellOtherpythondockernginxwebsveltellamaalpacatailwindcssfastapisveltekitllamacpp
This is stars and forks stats for /nsarrazin/serge repository. As of 29 Apr, 2024 this repository has 5025 stars and 355 forks.

Serge - LLaMA made easy 🦙 Serge is a chat interface crafted with llama.cpp for running Alpaca models. No API keys, entirely self-hosted! 🌐 SvelteKit frontend 💾 Redis for storing chat history & parameters ⚙️ FastAPI + LangChain for the API, wrapping calls to llama.cpp using the python bindings 🎥 Demo: demo.webm ⚡️ Quick start 🐳 Docker: docker run -d \ --name serge \ -v weights:/usr/src/app/weights \ -v datadb:/data/db/ \ -p 8008:8008 \ ghcr.io/serge-chat/serge:latest 🐙...
Read on GithubGithub Stats Page
repotechsstarsweeklyforksweekly
zphang/minimal-llamaPythonShell4420390
lotabout/skimRustShellPython4.5k01630
napi-rs/napi-rsRustTypeScriptJavaScript4.6k01930
hmrc/help-to-save-stride-frontendScalaHTMLSCSS0010
ansys/jekyll-theme-corpSCSSHTMLJavaScript1000
SleepTheGod/iPhone-SSH-BackdoorShell1880190
Improwised/chartsSmartyMustacheShell3080
Figma-Linux/figma-linuxSvelteTypeScriptJavaScript2.3k+101470
NIAEFEUP/website-niaefeup-frontendSvelteTypeScriptJavaScript1000
Lissy93/cheat-codeSvelteSCSSTypeScript22070