ausboss/Local-LLM-Langchain

This is stars and forks stats for /ausboss/Local-LLM-Langchain repository. As of 02 May, 2024 this repository has 188 stars and 24 forks.

Notebook for Local LLMs The goal of this project is to allow users to easily load their locally hosted language models in a notebook for testing with Langchain. There are currently three notebooks available. Two of them use an API to create a custom Langchain LLM wrapper—one for oobabooga's text generation web UI and the other for KoboldAI. The third notebook loads the models without an API by leveraging the oobabooga's text-generation-webui virtual environment and modules for model loading. You...