https://awesomeosai.com/self-hosted/local-model-runtimes
Local model runtimes and inference servers | Awesome Open Source AI
Inference servers and local runtimes for serving models on your machine, server, or private cloud.
model runtimesopen sourcelocalinferenceservers