EugenHotaj/zig_gpt2

GPT-2 inference engine written in Zig

ZigPythonziginference-enginegpt-2
This is stars and forks stats for /EugenHotaj/zig_gpt2 repository. As of 06 May, 2024 this repository has 21 stars and 4 forks.

zig_gpt2 GPT-2 inference engine written in Zig. Generation time: ~28ms per token. Features: No third-party dependencies besides BLAS (Accelerate or OpenBLAS). No memory allocations at runtime. Can run NanoGPT. How to Run: Download the GPT-2 checkpoint from OpenAI. python3 download_weights.py Build the Zig binary and run it with a prompt to generate completions: zig build -DOptimize=ReleaseFast ./zig-out/bin/zig_gpt2 "Marcus Aurelius said" How to Test: Generate test data by forwarding random tensors...
Read on GithubGithub Stats Page
repotechsstarsweeklyforksweekly
alibaba/async_simpleC++AssemblyCMake1.1k01750
app-generator/free-site-builderHTMLTypeScriptCSS2120440
blargg/dot_filesVim ScriptShellHaskell0000
cgisky1980/ai00_rwkv_serverRustPython178+427+1
pkazmier/erlang-port-howtoErlangPython7010
cardano-community/koios-artifactsPLpgSQLShellPython160180
dvruette/sd-webui-fabricPythonOther3150170
WKL-Sec/dcomhijackPythonCMakefile2290230
CodeAlchemyAI/ViLT-GPTPython117-1170
econaxis/time2reachRustTypeScriptPython153090