r2d4/react-llm

Easy-to-use headless React Hooks to run LLMs in the browser with WebGPU. Just useLLM().

TypeScriptJavaScriptOtherreactheadlesswebgpullm
This is stars and forks stats for /r2d4/react-llm repository. As of 26 Apr, 2024 this repository has 609 stars and 30 forks.

@react-llm/headless Easy-to-use headless React Hooks to run LLMs in the browser with WebGPU. As simple as useLLM(). Live Demo Features: Supports Vicuna 7B Use custom system prompts and "user:"/"assistant:" role names Completion options like max tokens and stop sequences No data leaves the browser. Accelerated via WebGPU. Hooks built to 'Bring your own UI' Persistent storage for conversations in browser storage. Hooks for loading and saving conversations. Model caching for faster subsequent loads Installation npm...
Read on GithubGithub Stats Page
repotechsstarsweeklyforksweekly
bra1nDump/show-me-chatgpt-pluginTypeScriptHTMLOther6060560
formkit/formkitTypeScriptJavaScriptCSS3.6k01290
nuxtlabs/uiVueTypeScriptOther2k+52219+11
WanyueKJ/takeaway-uniappVueJavaScriptCSS3280550
delucis/astro-badgeAstroTypeScriptJavaScript67070
bigcode-project/starcoder.cppCC++Cuda4040320
robdelacruz/lkwebserverCHTMLCSS280090
Blueforcer/awtrix-lightC++COther4520440
helenmironova/final-taskCSSTypeScriptHTML00140
duiqt/herta_kuruJavaScriptCSSHTML60401470