mlc-ai/web-llm

This is stars and forks stats for /mlc-ai/web-llm repository. As of 28 Apr, 2024 this repository has 7567 stars and 443 forks.

Web LLM | NPM Package | Get Started | Examples | Documentation | MLC LLM | Discord | WebLLM is a modular, customizable javascript package that directly brings language model chats directly onto web browsers with hardware acceleration. Everything runs inside the browser with no server support and accelerated with WebGPU. We can bring a lot of fun opportunities to build AI assistants for everyone and enable privacy while enjoying GPU acceleration. Check out our demo webpage to try out! You can use...