NouamaneTazi/bloomz.cpp

This is stars and forks stats for /NouamaneTazi/bloomz.cpp repository. As of 30 Apr, 2024 this repository has 798 stars and 83 forks.

bloomz.cpp Inference of HuggingFace's BLOOM-like models in pure C/C++. The repo was built on top of the amazing llama.cpp repo by @ggerganov, to support BLOOM models. It supports all models that can be loaded using BloomForCausalLM.from_pretrained(). Demo Usage First, you need to clone the repo and build it: git clone https://github.com/NouamaneTazi/bloomz.cpp cd bloomz.cpp make Convert weights Then, you must convert the model weights to the ggml format. Any BLOOM model can be converted. Some weights...