Robuta

https://www.crabtalk.ai/oss/crabllm CrabLLM — LLM API Gateway | CrabTalk Production LLM proxy in Rust. Sub-millisecond overhead, weighted routing, automatic failover, response caching, budget enforcement. Single binary. llm apicrabllmgatewaycrabtalk