Robuta

https://github.com/fastmachinelearning/SuperSONIC GitHub - fastmachinelearning/SuperSONIC: Server infrastructure for GPU inference-as-a-service in... Server infrastructure for GPU inference-as-a-service in large scientific experiments - fastmachinelearning/SuperSONIC inference as a serviceserver infrastructurefor gpu