basetenlabs/truss

The simplest way to serve AI/ML models in production

PythonShellJinjaDockerfileJupyter Notebookopen-sourcemachine-learningpackagingartificial-intelligencefalconeasy-to-usewhisperinference-servermodel-servinginference-apistable-diffusionwizardlm
This is stars and forks stats for /basetenlabs/truss repository. As of 27 Apr, 2024 this repository has 718 stars and 41 forks.

Truss The simplest way to serve AI/ML models in production Why Truss? Write once, run anywhere: Package and test model code, weights, and dependencies with a model server that behaves the same in development and production. Fast developer loop: Implement your model with fast feedback from a live reload server, and skip Docker and Kubernetes configuration with a batteries-included model serving environment. Support for all Python frameworks: From transformers and diffusors to PyTorch and Tensorflow...
Read on GithubGithub Stats Page
repotechsstarsweeklyforksweekly
vaastav/Fantasy-Premier-LeaguePython1.3k07720
ChristopherGS/ultimate-fastapi-tutorialPythonJavaScriptHTML79203060
Womsxd/AutoMihoyoBBSPythonHTMLDockerfile1.4k03610
qubvel/segmentation_modelsPython4.4k+131k+1
hgjazhgj/FGO-pyPythonHTMLOther1.1k01530
pytorch/tutorialsPythonJavaScriptC++7.3k03.8k0
eriklindernoren/PyTorch-GANPythonShell14.7k03.9k0
commclassroom/roadmaps3.5k01.1k0
Azure/reliability-workbookHCLShellMakefile380210
HVML/PurCCC++CSS1.1k0580