https://developers.llamaindex.ai/python/framework/integrations/llm/xinference_local_deployment/
Xorbits Inference | Developer Documentation
inferencedeveloperdocumentation
https://railway.com/deploy/xinference
Deploy Xinference (Xorbits Inference) | OpenAI-Compatible API
Deploy Xinference (Xorbits Inference) | OpenAI-Compatible API to the cloud for free with Railway, the all-in-one intelligent cloud provider. Self-host...
deployinferenceopenaicompatibleapi