phronmophobic/llama.clj

This is stars and forks stats for /phronmophobic/llama.clj repository. As of 05 May, 2024 this repository has 76 stars and 5 forks.

llama.clj Run LLMs locally. A clojure wrapper for llama.cpp. Quick Start If you're just looking for a model to try things out, try the 3.6Gb llama2 7B chat model from TheBloke. Make sure to check the link for important info like license and use policy. mkdir -p models # Download 3.6Gb model to models/ directory (cd models && curl -L -O 'https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGML/resolve/main/llama-2-7b-chat.ggmlv3.q4_0.bin') # mvn-llama alias pulls precompiled llama.cpp libs from...