dvlab-research/LongLoRA

Code and documents of LongLoRA and LongAlpaca

Pythonloralarge-language-modelsllmlong-contextfine-tuning-llm
This is stars and forks stats for /dvlab-research/LongLoRA repository. As of 29 Apr, 2024 this repository has 1698 stars and 117 forks.

LongLoRA and LongAlpaca for Long-context LLMs TABLE OF CONTENTS News Highlights How to contribute Requirements Installation and quick guide LongAlpaca Data Models Training Evaluation Demo Data Generation via Pdf2Text Examples Citation Acknowledgement License News [2023.10.8] We release the long instruction-following dataset, LongAlpaca-12k and the corresponding models, LongAlpaca-7B, LongAlpaca-13B, and LongAlpaca-70B. (The previous sft models, Llama-2-13b-chat-longlora-32k-sft and Llama-2-70b-chat-longlora-32k-sft,...
Read on GithubGithub Stats Page
repotechsstarsweeklyforksweekly
irsl/curlshellPython292+2335+6
TIGER-AI-Lab/MAmmoTHJupyter NotebookPythonRoff1810170
daveshap/Medical_IntakePython1240430
jaytaph/gosub-browserRustPythonOther2k01270
mithril-security/blind_chatSvelteTypeScriptJavaScript151+3117+2
StanfordASL/PoRA-I-SectionsTeXPython0000
cornell-c2s2/c2s2_ipVerilogPythonMakefile1000
timeplus-io/protonC++PythonAssembly164040
Bruce-Lee-LY/cuda_hgemmCudaCC++55+315+1
lakesoul-io/LakeSoulJavaScalaRust1.7k03640