Cloudflare AI Gateway
LLM gateway from Cloudflare that sits in front of any AI provider and adds request caching, cost analytics, rate limiting, and fallback routing. Zero-config for teams already on Cloudflare Workers. Free tier available on all Cloudflare plans.
LiteLLM
OSS proxy that normalizes 100+ LLMs to the OpenAI format. Add routing, fallbacks, caching, and cost tracking in one layer.