marella/ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.

CC++CudaMetalObjective-CPythonOtheraitransformersllmctransformers
This is stars and forks stats for /marella/ctransformers repository. As of 28 Apr, 2024 this repository has 1154 stars and 86 forks.

CTransformers Python bindings for the Transformer models implemented in C/C++ using GGML library. Also see ChatDocs Supported Models Installation Usage 🤗 Transformers LangChain GPU GPTQ Documentation License Supported Models Models Model Type CUDA Metal GPT-2 gpt2 GPT-J, GPT4All-J gptj GPT-NeoX, StableLM gpt_neox Falcon falcon ✅ LLaMA, LLaMA 2 llama ✅ ✅ MPT mpt ✅ StarCoder, StarChat gpt_bigcode ✅ Dolly V2 dolly-v2 Replit replit Installation pip install ctransformers Usage It provides a unified...
Read on GithubGithub Stats Page
repotechsstarsweeklyforksweekly
Forairaaaaa/monicaCC++Python3160520
OpenDriver2/REDRIVER2CC++Lua9210590
unvell/ReoGridC#Other1.1k03460
axmolengine/axmolC++LuaC50201330
rime/weaselC++CBatchfile3.3k04570
huahaiy/Gibberish-detectorClojurePython5000
Johan511/AstroSimCMake0090
craigspaeth/goblintutorCoffeeScript0000
homebrewing/brauhausjsCoffeeScript1320310
Nimesia/google-storage-cfmlColdFusion2010