LiteLLM
OSS proxy that normalizes 100+ LLMs to the OpenAI format. Add routing, fallbacks, caching, and cost tracking in one layer.
Cloudflare AI Gateway
LLM gateway from Cloudflare that sits in front of any AI provider and adds request caching, cost analytics, rate limiting, and fallback routing. Zero-config for teams already on Cloudflare Workers. Free tier available on all Cloudflare plans.