LLM InfrastructureCommercial✦ Free Tier

PortKey

AI gateway with routing, fallbacks, and caching

App Infrastructure
Open in Builder →Website ↗

About

Production AI gateway with smart routing, automatic fallbacks, semantic caching, and full observability. Drop-in replacement for direct LLM calls.

Choose PortKey when…

  • •You want LLM gateway with caching and guardrails
  • •Enterprise-grade LLM routing with reliability is needed
  • •You need audit logs and compliance controls

Builder Slot

Which models does your stack route through?Optional for most stacks

A gateway that normalizes calls across providers — one API for all models, with fallbacks

Dev Tools
Not applicable
App Infra
Optional
Hybrid
Optional

Other tools in this slot:

LiteLLMOpenRouterUnifyMartianNot Diamond

Stack Genome Detection

AIchitect's Genome scanner detects PortKey in your project via these signals:

npm packages
portkey-ai
pip packages
portkey-ai
env vars
PORTKEY_API_KEY

Integrates with (4)

LangfuseLLM Infrastructure

Portkey's gateway logs metadata to Langfuse via webhook integration, enriching Langfuse traces with gateway-level cost and caching data.

→ Combined gateway analytics and LLM trace quality in one view — Portkey's proxy layer meets Langfuse's evaluation depth.

Compare →
OpenAI APILLM Infrastructure

Portkey proxies OpenAI's API — change one base URL and every OpenAI call gets caching, retries, and load balancing.

→ Production-hardened OpenAI calls with automatic retry, prompt caching, and cost savings through Portkey's proxy layer.

Compare →
Anthropic APILLM Infrastructure

Portkey proxies Anthropic's API with the same gateway features — caching, retries, and automatic fallbacks.

→ Reliable Claude API calls with gateway-level resilience and prompt caching at the proxy layer.

Compare →
LangChainPipelines & RAG

Portkey provides a LangChain-compatible wrapper that routes all model calls through its gateway.

→ Caching, retries, and fallbacks for any LangChain chain without changing chain code — reliability added at the gateway.

Compare →

Alternatives to consider (1)

LiteLLMcompare →

Pricing

✦ Free tier available
Growth$49/mo

Badge

Add to your GitHub README

PortKey on AIchitect[![PortKey](https://aichitect.dev/badge/tool/portkey)](https://aichitect.dev/tool/portkey)

Explore the full AI landscape

See how PortKey fits into the bigger picture — browse all 207 tools and their relationships.

Explore graph →