This is stars and forks stats for /PotatoSpudowski/fastLLaMa repository. As of 26 Apr, 2024 this repository has 389 stars and 24 forks.
fastLLaMa fastLLaMa is an experimental high-performance framework designed to tackle the challenges associated with deploying large language models (LLMs) in production environments. It offers a user-friendly Python interface to a C++ library, llama.cpp, enabling developers to create custom workflows, implement adaptable logging, and seamlessly switch contexts between sessions. This framework is geared towards enhancing the efficiency of operating LLMs at scale, with ongoing development focused on...
fastLLaMa fastLLaMa is an experimental high-performance framework designed to tackle the challenges associated with deploying large language models (LLMs) in production environments. It offers a user-friendly Python interface to a C++ library, llama.cpp, enabling developers to create custom workflows, implement adaptable logging, and seamlessly switch contexts between sessions. This framework is geared towards enhancing the efficiency of operating LLMs at scale, with ongoing development focused on...
| repo | techs | stars | weekly | forks | weekly |
|---|---|---|---|---|---|
| keijiro/StableDiffusionPlugin | C#SwiftShaderLab | 508 | 0 | 38 | 0 |
| microsoft/kiota | C#TypeScriptPowerShell | 852 | 0 | 99 | 0 |
| barncastle/Battle.Net-Installer | C# | 216 | 0 | 42 | 0 |
| neverlosecc/source2sdk | C++ | 100 | 0 | 18 | 0 |
| osbert/persona-kit | Clojure | 11 | 0 | 2 | 0 |
| viettranx/micro-clean-architecture-service-demo | GoDockerfile | 227 | 0 | 78 | 0 |
| indeedeng/iwf | GoMakefileShell | 397 | 0 | 44 | 0 |
| pterm/pterm | Go | 4.2k | 0 | 165 | 0 |
| supabase/gotrue | GoOther | 851 | 0 | 266 | 0 |
| tetratelabs/wazero | GoHTMLMakefile | 4k | 0 | 203 | 0 |