AIchitect
StacksGraphBuilderSimulateCompareGenomeActivityPulse
235 tools · 33 stacks

AI tools are all over the place. This is the full landscape — 247 tools across 21 categories, mapped and connected. Ready to narrow it down? Build your stack →

Team size

Budget

Use case

Stage

Cluster

Stack Layers
What are you building and how is it defined?
How do you write and ship code?
How does your AI think and act?
Which models and infrastructure power it?
How do you build, observe, and extend it?
Browse all categories →
These tools integrates with
OpenAI API
vs
PromptFoo

Choose OpenAI API when…

  • •You need the broadest ecosystem and most integrations
  • •GPT-4 or o-series reasoning models are required
  • •Assistants API, fine-tuning, or batch API are needed

Choose PromptFoo when…

  • •You want CLI-first, config-driven LLM evals
  • •Running eval suites in CI/CD pipelines is a goal
  • •You need red-teaming and safety testing built in
Field
OpenAI API
PromptFoo
Category
LLM Infrastructure
Prompt & Eval
Type
SaaS
OSS
Free Tier
✗ No
✓ Yes
Plans
API: Per token
—
Stars
—
⭐ 5,000
Health
—
●95 — Active
Trajectory
— not enough data
— not enough data
Synced
—
today

OpenAI API

API access to GPT-5, GPT-5.5, o3/o4 reasoning models, and the Responses API; plus embeddings, image, audio, and Realtime endpoints. The most widely deployed LLM API in production.

PromptFoo

Test and compare prompts across models. Built-in red-teaming, regression testing, and side-by-side model comparison.

OpenAI API Website ↗
PromptFoo Website ↗GitHub ↗

Shared Connections (3)

LangfuseDeepEvalGalileo

Only OpenAI API (35)

CrewAIAutoGenLangChainLlamaIndexMastraPydanticAIsmolagentsAgno

Only PromptFoo (3)

OpenAI APIVellumAgenta
See full comparison in Explore →