xorbitsai/inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

PythonJavaScriptOthermachine-learningdeploymentinferencepytorchartificial-intelligencewhisperopenai-apillmflan-t5chatglmggmlwizardlmchatglm2llama2
This is stars and forks stats for /xorbitsai/inference repository. As of 08 May, 2024 this repository has 1021 stars and 63 forks.

Xorbits Inference: Model Serving Made Easy πŸ€– English | 中文介绍 | ζ—₯本θͺž Xorbits Inference(Xinference) is a powerful and versatile library designed to serve language, speech recognition, and multimodal models. With Xorbits Inference, you can effortlessly deploy and serve your or state-of-the-art built-in models using just a single command. Whether you are a researcher, developer, or data scientist, Xorbits Inference empowers you to unleash the full potential of cutting-edge AI models. πŸ‘‰ Join our Slack community! πŸ”₯...
Read on GithubGithub Stats Page
repotechsstarsweeklyforksweekly
udawat/DIY-ElectronicsOther2000
theLSA/hack-er-toolsShellPython219065+1
pluralsh/module-libraryHCLSmartyMustache5000
OffchainLabs/boldSolidityGoStarlark57050
RicardoValdovinos/vite-react-boilerplateTypeScriptJavaScriptHTML3910260
Miazzy/oa-front-serviceVueJavaScriptLess21201030
slippedandmissed/XLSLCC++Yacc51010
digitalinnovationone/livecodingthefuture-docker-terraformDockerfilePython160100
KimJejun/lolviewGroovyGosuJavaScript0000
ryotsu/torrexElixirJavaScriptHTML21000