Me163/rusty_llama

This is stars and forks stats for /Me163/rusty_llama repository. As of 10 May, 2024 this repository has 231 stars and 37 forks.

Rusty Llama Webapp A simple webapp to showcase the ability to write a simple chatbot webapp using only Rust, TailwindCSS and an Open Source language model such as a variant of GPT, LLaMA, etc. Setup Instructions Hardware By default, the project has Apple's Metal acceleration enabled. If you are not on a macOS system, you may need to disable the metal feature in Cargo.toml. Similarly, if you are on a system with an Nvidia GPU, you may need to add CUDA as a feature (I haven't tested this, anyone who...