| repo | techs | stars | weekly | forks | weekly |
|---|---|---|---|---|---|
| vllm-project/vllm | PythonCudaOther | 8.2k | +353 | 904 | +51 |
| google/mediapipe | C++PythonJava | 23.6k | +64 | 4.8k | +7 |
| PanQiWei/AutoGPTQ | PythonCudaC++ | 2.4k | +47 | 212 | +5 |
| OpenNMT/CTranslate2 | C++PythonCuda | 2k | +25 | 181 | +1 |
| aws/amazon-sagemaker-examples | Jupyter NotebookPythonRoff | 8.9k | +17 | 6.4k | +6 |
| basetenlabs/truss | PythonShellJinja | 718 | +8 | 41 | 0 |
| huggingface/huggingface.js | TypeScriptOther | 1k | +8 | 59 | 0 |
| FedML-AI/FedML | PythonJupyter NotebookJava | 3.2k | +4 | 720 | +1 |
| bytedance/lightseq | C++CudaPython | 2.9k | 0 | 311 | 0 |
| dusty-nv/jetson-inference | C++PythonCSS | 6.8k | 0 | 2.8k | 0 |
| Tencent/ncnn | C++CGLSL | 18k | 0 | 4k | 0 |
| triton-inference-server/server | PythonShellC++ | 6.2k | 0 | 1.3k | 0 |
| microsoft/DeepSpeed | PythonC++Cuda | 28.8k | 0 | 3.5k | 0 |
| NVIDIA/TensorRT | C++PythonJupyter Notebook | 7.9k | 0 | 1.8k | 0 |
| openvinotoolkit/openvino | C++PythonC | 4.8k | 0 | 1.8k | 0 |
| openvinotoolkit/openvino_notebooks | Jupyter NotebookPythonShell | 1.4k | 0 | 582 | 0 |
| hpcaitech/ColossalAI | PythonCudaC++ | 34.9k | 0 | 4k | 0 |
| bentoml/BentoML | PythonShellStarlark | 5.7k | 0 | 651 | 0 |
| openvinotoolkit/open_model_zoo | Python | 3.8k | 0 | 1.3k | 0 |
| Tencent/TNN | C++CObjective-C++ | 4.1k | 0 | 739 | 0 |
| vaticle/typeql | JavaRustStarlark | 199 | 0 | 43 | 0 |
| biaslab/ReactiveMP.jl | JuliaMakefile | 75 | 0 | 12 | 0 |
| Trusted-AI/adversarial-robustness-toolbox | PythonOther | 4k | 0 | 1.1k | 0 |
| zhiqwang/yolov5-rt-stack | PythonC++CMake | 674 | 0 | 151 | 0 |
| gvergnaud/ts-pattern | TypeScriptOther | 9.4k | 0 | 88 | 0 |