AI agents · OpenClaw · self-hosting · automation

Quick Answer

Managed vs Self-Hosted vs Hybrid Agent Gateway Vendors

Published:

The short answer

Decide where prompts are allowed to flow first; the vendor follows. Agent gateway vendors by deployment model, as of October 27, 2026:

  • Managed SaaS: Cloudflare AI Gateway (cheapest start — core features free) and AWS Bedrock AgentCore Gateway (best if agents run on AWS).
  • Self-hosted: LiteLLM (best open-source LLM gateway, with an Enterprise licence for SSO and audit) and agentgateway (best open-source gateway for LLM, MCP and A2A traffic together).
  • Hybrid (vendor-hosted control plane, your data plane): Kong Konnect (best for teams that already run Kong for APIs) and Portkey Enterprise (best for guardrails and prompt management with private deployment).

For the narrower question of which gateway to use for model routing alone, see our best LLM gateway ranking.

The comparison

Prices and versions from vendor pages and GitHub on October 27, 2026.

VendorDeploymentTraffic coveredPriceBest for
Cloudflare AI GatewayManaged SaaSLLM calls (caching, rate limits, DLP, logs)Core features free on all plans; logs per Workers Logs pricingFast start, global edge
AWS AgentCore GatewayManaged (AWS)Tools, models and other agents; MCPConsumption-based per API call, search query and indexed targetAgents already on AWS
LiteLLMSelf-hosted (open source)100+ LLM APIs, budgets, keys, guardrailsOpen source free; Enterprise licence by quote (SOC 2 Type II)Platform teams, VPC-only data
agentgatewaySelf-hosted (Apache 2.0, v1.6.0)HTTP/gRPC services, LLM, MCP, A2AFreeOne data plane for services and agents
Kong KonnectHybrid (SaaS control plane, your gateways)LLM, MCP and A2A traffic plus APIsPlus from $25/month plus usage; Enterprise customExisting Kong or API-management estates
PortkeyManaged, or hybrid/private on EnterpriseLLM routing, guardrails, prompts, logsDeveloper free (10k logs/month); Production $49/month; Enterprise customGuardrails and prompt management

Managed SaaS: start in an afternoon

Cloudflare AI Gateway sits in front of OpenAI, Anthropic, Google, Workers AI and others with one line of code. Analytics, caching and rate limiting are free on all plans, and DLP scanning is free too; accounts that created their first gateway on or after September 24, 2026 store logs in Workers Logs and pay its rates. AWS AgentCore Gateway lets agents reach tools, models and other agents through one governed endpoint, with no upfront commitment: you pay for operations such as listing and invoking tools, search queries and indexed targets, and AgentCore Policy checks each tool call against your rules. The trade-off for both is that every prompt passes through the vendor’s infrastructure.

Self-hosted: prompts never leave

LiteLLM is the most widely deployed open-source LLM gateway (about 62,000 GitHub stars, release v1.106.4 on October 25, 2026). The open-source gateway gives virtual keys, budgets, fallbacks and cost tracking; LiteLLM Enterprise is a licence key on the same image that adds SSO/SCIM, audit logs, delegated admin and support, aimed at organisations with 100+ users or 10+ production AI use cases. agentgateway (Apache 2.0, a Linux Foundation project) is the newer option built for agent traffic: one binary routes services, LLM providers, self-hosted inference, MCP servers and A2A calls, with mTLS, OIDC, token budgets and an audit trail of tool invocations.

Hybrid: the enterprise compromise

Kong Konnect runs the control plane as a service — configuration, developer portal, analytics — while the gateways themselves run in your clusters, so traffic stays local. Its AI Management plan covers LLM, MCP and A2A traffic from $25 a month plus usage, with a 30-day free trial; Enterprise adds agent identity management and runs workloads “everywhere”. Portkey is SaaS by default; its Enterprise tier adds private cloud deployment, VPC hosting, data isolation, custom BAAs and SSO, which is the hybrid path for regulated teams that want Portkey’s guardrails.

How to choose

  • Small team, no data-residency rule: Cloudflare AI Gateway, then add Portkey Production if you need guardrails.
  • All agents on AWS: AgentCore Gateway with AgentCore Policy.
  • Prompts must stay in your VPC, platform team available: LiteLLM for models plus agentgateway for MCP and A2A.
  • Regulated enterprise with an API-management team: Kong Konnect hybrid.
  • Governing agents from many vendors, not just traffic: pair the gateway with a control plane; see best AI agent control planes and API gateway vendors extending into agent governance.

Last verified: October 27, 2026.

Sources