OpenNMT/CTranslate2

This is stars and forks stats for /OpenNMT/CTranslate2 repository. As of 27 Apr, 2024 this repository has 1967 stars and 181 forks.

CTranslate2 CTranslate2 is a C++ and Python library for efficient inference with Transformer models. The project implements a custom runtime that applies many performance optimization techniques such as weights quantization, layers fusion, batch reordering, etc., to accelerate and reduce the memory usage of Transformer models on CPU and GPU. The following model types are currently supported: Encoder-decoder models: Transformer base/big, M2M-100, NLLB, BART, mBART, Pegasus, T5, Whisper Decoder-only...