Lightning-AI/lit-gpt

Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

PythonJupyter Notebook
This is stars and forks stats for /Lightning-AI/lit-gpt repository. As of 06 Dec, 2023 this repository has 3178 stars and 309 forks.

⚡ Lit-GPT   ⚡ Lit-GPT Hackable implementation of state-of-the-art open-source large language models released under the Apache 2.0 license. Supports the following popular model checkpoints: Model and usage Reference Meta AI Llama 2 Touvron et al. 2023 Stability AI FreeWilly2 Stability AI 2023 Stability AI StableCode Stability AI 2023 TII UAE Falcon TII 2023 OpenLM Research OpenLLaMA Geng & Liu 2023 LMSYS Vicuna Li et al. 2023 LMSYS LongChat LongChat Team 2023 Together RedPajama-INCITE Together...
Read on GithubGithub Stats Page
repotechsstarsweeklyforksweekly
vanessa-opensource/add1C EnterpriseHTMLGherkin30101960
pbobinski-WSB/WSB_NI_2023L_zaliczenieBatchfileJavaPython00580
trustedsec/CS_COFFLoaderC#PythonC1170180
Windscribe/Desktop-AppC++CObjective-C4640640
cocomelonc/meowC++CPython610170
mbucchia/Meta-FoveatedC++PythonHLSL53010
radian628/lispsmosCommon LispRacketTypeScript58+110
exercism/common-lispCommon LispPythonOther760720
tvraman/emacspeakEmacs LispHTMLXSLT2240470
linuxmobile/hyprland-dotsHTMLPythonShell1k+19720