feizc/MLE-LLaMA

This is stars and forks stats for /feizc/MLE-LLaMA repository. As of 07 May, 2024 this repository has 292 stars and 19 forks.

MLE-LLaMA: Multi-Language Enhanced LLaMA This project aims to make LLaMa understand Chinese, and can generate fluency chinese. We are inspired that LLaMa have learned good English expression and a little alignment prompt can makes it capture Chinese. Token vocabulary support for multi-language. We found that llama tokenizer naturally support for Chinese. Fine-tuning llama script. (1) download original ckpt from huggingface, and put them into file path ckpt. (2) train.py original script must be...