abetlen/llama-cpp-python

This is stars and forks stats for /abetlen/llama-cpp-python repository. As of 20 Apr, 2024 this repository has 3624 stars and 454 forks.

🦙 Python Bindings for llama.cpp Simple Python bindings for @ggerganov's llama.cpp library. This package provides: Low-level access to C API via ctypes interface. High-level Python API for text completion OpenAI-like API LangChain compatibility Documentation is available at https://llama-cpp-python.readthedocs.io/en/latest. Warning Starting with version 0.1.79 the model format has changed from ggmlv3 to gguf. Old model files can be converted using the convert-llama-ggmlv3-to-gguf.py script in llama.cpp Installation...