fauxpilot/fauxpilot

This is stars and forks stats for /fauxpilot/fauxpilot repository. As of 28 Apr, 2024 this repository has 13251 stars and 577 forks.

FauxPilot This is an attempt to build a locally hosted alternative to GitHub Copilot. It uses the SalesForce CodeGen models inside of NVIDIA's Triton Inference Server with the FasterTransformer backend. Prerequisites You'll need: Docker docker compose >= 1.28 An NVIDIA GPU with Compute Capability >= 6.0 and enough VRAM to run the model you want. nvidia-docker curl and zstd for downloading and unpacking the models. Note that the VRAM requirements listed by setup.sh are total -- if you have...