This is stars and forks stats for /EugenHotaj/zig_gpt2 repository. As of 06 May, 2024 this repository has 21 stars and 4 forks.
zig_gpt2 GPT-2 inference engine written in Zig. Generation time: ~28ms per token. Features: No third-party dependencies besides BLAS (Accelerate or OpenBLAS). No memory allocations at runtime. Can run NanoGPT. How to Run: Download the GPT-2 checkpoint from OpenAI. python3 download_weights.py Build the Zig binary and run it with a prompt to generate completions: zig build -DOptimize=ReleaseFast ./zig-out/bin/zig_gpt2 "Marcus Aurelius said" How to Test: Generate test data by forwarding random tensors...
zig_gpt2 GPT-2 inference engine written in Zig. Generation time: ~28ms per token. Features: No third-party dependencies besides BLAS (Accelerate or OpenBLAS). No memory allocations at runtime. Can run NanoGPT. How to Run: Download the GPT-2 checkpoint from OpenAI. python3 download_weights.py Build the Zig binary and run it with a prompt to generate completions: zig build -DOptimize=ReleaseFast ./zig-out/bin/zig_gpt2 "Marcus Aurelius said" How to Test: Generate test data by forwarding random tensors...
repo | techs | stars | weekly | forks | weekly |
---|---|---|---|---|---|
alibaba/async_simple | C++AssemblyCMake | 1.1k | 0 | 175 | 0 |
app-generator/free-site-builder | HTMLTypeScriptCSS | 212 | 0 | 44 | 0 |
blargg/dot_files | Vim ScriptShellHaskell | 0 | 0 | 0 | 0 |
cgisky1980/ai00_rwkv_server | RustPython | 178 | +4 | 27 | +1 |
pkazmier/erlang-port-howto | ErlangPython | 7 | 0 | 1 | 0 |
cardano-community/koios-artifacts | PLpgSQLShellPython | 16 | 0 | 18 | 0 |
dvruette/sd-webui-fabric | PythonOther | 315 | 0 | 17 | 0 |
WKL-Sec/dcomhijack | PythonCMakefile | 229 | 0 | 23 | 0 |
CodeAlchemyAI/ViLT-GPT | Python | 117 | -1 | 17 | 0 |
econaxis/time2reach | RustTypeScriptPython | 153 | 0 | 9 | 0 |