Lightning-AI/lit-parrot

Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

PythonJupyter Notebook
This is stars and forks stats for /Lightning-AI/lit-parrot repository. As of 13 May, 2024 this repository has 3133 stars and 307 forks.

⚡ Lit-GPT   ⚡ Lit-GPT Hackable implementation of state-of-the-art open-source large language models released under the Apache 2.0 license. Supports the following popular model checkpoints: Model and usage Reference Meta AI Llama 2 Touvron et al. 2023 Stability AI FreeWilly2 Stability AI 2023 Stability AI StableCode Stability AI 2023 TII UAE Falcon TII 2023 OpenLM Research OpenLLaMA Geng & Liu 2023 LMSYS Vicuna Li et al. 2023 LMSYS LongChat LongChat Team 2023 Together RedPajama-INCITE Together...
Read on GithubGithub Stats Page
repotechsstarsweeklyforksweekly
yxuansu/PandaGPTPythonShell6460510
reactive-python/reactpyPythonTypeScriptOther6.9k03170
mitre/calderaPythonHTMLCSS4.7k09460
pentilm/FactAIPythonPureBasicDockerfile2140400
KAT-Advanced-Medical/KAMSQFPawnPython440620
chenyk1990/reproducible_researchTeXPythonMATLAB400200
gavalar/vimconfigVim ScriptPerlShell0010
jefftranter/6502AssemblyBASICC2570590
marella/ctransformersCC++Cuda1.2k+2986+6
Forairaaaaa/monicaCC++Python3160520