Dicklesworthstone/llama_embeddings_fastapi_service

This is stars and forks stats for /Dicklesworthstone/llama_embeddings_fastapi_service repository. As of 29 Apr, 2024 this repository has 601 stars and 34 forks.

🇨🇭🎖️🦙 Swiss Army Llama Introduction The Swiss Army Llama is designed to facilitate and optimize the process of working with local LLMs by using FastAPI to expose convenient REST endpoints for various tasks, including obtaining text embeddings and completions using different LLMs via llama_cpp, as well as automating the process of obtaining all the embeddings for most common document types, including PDFs (even ones that require OCR), Word file, etc; it even allows you to submit an audio file and...