kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference

This is stars and forks stats for /kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference repository. As of 05 May, 2024 this repository has 820 stars and 153 forks.

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A Clearly explained guide for running quantized open-source LLM applications on CPUs using LLama 2, C Transformers, GGML, and LangChain Step-by-step guide on TowardsDataScience: https://towardsdatascience.com/running-llama-2-on-cpu-inference-for-document-q-a-3d636037a3d8 Context Third-party commercial large language model (LLM) providers like OpenAI's GPT4 have democratized LLM use via simple API calls. However,...