cloud-fallback

LLMrPro: Open-Source LLM Balancer Pools Local Machines With Cloud Fallback

LLMrPro is an open-source, self-hosted LLM balancer that unifies your own machines and cloud providers behind one OpenAI-compatible API.