This is stars and forks stats for /turboderp/exllamav2 repository. As of 07 May, 2024 this repository has 1350 stars and 74 forks.
ExLlamaV2 This is a very initial release of ExLlamaV2, an inference library for running local LLMs on modern consumer GPUs. It still needs a lot of testing and tuning, and a few key features are not yet implemented. Don't be surprised if things are a bit broken to start with, as almost all of this code is completely new and only tested on a few setups so far. Overview of differences compared to V1 Faster, better kernels Cleaner and more versatile codebase Support for a new quant format (see below) Performance Some...
ExLlamaV2 This is a very initial release of ExLlamaV2, an inference library for running local LLMs on modern consumer GPUs. It still needs a lot of testing and tuning, and a few key features are not yet implemented. Don't be surprised if things are a bit broken to start with, as almost all of this code is completely new and only tested on a few setups so far. Overview of differences compared to V1 Faster, better kernels Cleaner and more versatile codebase Support for a new quant format (see below) Performance Some...
| repo | techs | stars | weekly | forks | weekly |
|---|---|---|---|---|---|
| ZiwenZhuang/parkour | Python | 245 | 0 | 37 | 0 |
| hyperledger-labs/open-enterprise-agent | ScalaKotlinJupyter Notebook | 24 | +1 | 3 | 0 |
| tiagoair/plataformaspjd4v2021 | ShaderLabC#HLSL | 0 | 0 | 47 | 0 |
| rocketseat-education/nlw-ai-mastery | TypeScriptJavaScriptCSS | 377 | +1 | 91 | 0 |
| FL33TW00D/whisper-turbo | TypeScriptCSSJavaScript | 1k | 0 | 40 | 0 |
| microsoft/azurechat | TypeScriptBicepJavaScript | 595 | 0 | 248 | 0 |
| OpenPipe/OpenPipe | TypeScriptPythonJavaScript | 1.8k | 0 | 76 | 0 |
| YordanPetrov/xhtml-information-retrieval | XMLJavaPython | 1 | 0 | 0 | 0 |
| fulcrum-so/ziggy-pydust-template | ZigPython | 13 | 0 | 0 | 0 |
| Metropollution/Metropollution | Classic ASPC#JavaScript | 0 | 0 | 0 | 0 |