pluiez/NLLB-inference

This is stars and forks stats for /pluiez/NLLB-inference repository. As of 08 May, 2024 this repository has 50 stars and 7 forks.

NLLB-inference A convenient script for running NLLB generation/inference without tangling with the config files. Usage Get the NLLB checkpoint and then find the code mapping for your languages from Languages in FLORES-200. NOTE: the following script only deals with dense model with params ranged from 600M to 3.3B, and inference with MoE requires extra arguments. The file size of the MoE model is 337G, actually most people don't have the resources to get such a large model running at least in a short...