pytorch/serve

This is stars and forks stats for /pytorch/serve repository. As of 27 Apr, 2024 this repository has 3679 stars and 770 forks.

TorchServe TorchServe is a flexible and easy to use tool for serving and scaling PyTorch models in production. Requires python >= 3.8 curl http://127.0.0.1:8080/predictions/bert -T input.txt 🚀 Quick start with TorchServe # Install dependencies # cuda is optional python ./ts_scripts/install_dependencies.py --cuda=cu121 # Latest release pip install torchserve torch-model-archiver torch-workflow-archiver # Nightly build pip install torchserve-nightly torch-model-archiver-nightly torch-workflow-archiver-nightly 🚀...