A BAA is just the start of what it takes to safely run the AI your team is already using.
BAA coverage, audit logging, and access control
Cost and usage controls
Coming soon
De-identification and safety guardrails, defined in your code
View docs
Building for the AI-native era
AI is raising the bar on what attackers can do and what regulated buyers expect from their infrastructure. Some of LLM Gateway's highest-usage accounts already run Claude Code and other coding agents against regulated data, often without governance built specifically for that pattern. Here's what's coming soon to close that gap.
Budget alerts & usage reporting
Get alerted before a key hits its spend limit, with usage broken down by key, model, and scope.
Secure cloud-hosted agents
Run agents in a sandboxed environment with no open network access, routing every request through the Gateway.
Data residency
Keep all gateway infrastructure within a required region. Keys are automatically restricted to in-region models.
Product roadmap
Get through health system security reviews faster
Security review evidence is available for all model usage instantly, so you can turn a conversation that used to kill deals into a non-issue.
Protect PHI from model training
Training on PHI is disabled at the infrastructure layer; that protection holds regardless of any provider's own data-use policy or default settings.
Separate keys for internal tools and production AI
Give internal automations and agent harnesses their own keys so usage is attributable, with an org-wide spend limit that stops runaway loops before they become an incident.
Stay online when a model provider goes down
When a model is served by more than one provider, the gateway fails over automatically; you can also name backup models in the request and the gateway tries each in order.
FAQs
How much does LLM Gateway cost?
$200/month plus usage, with volume and Startup Program discounts available. Usage is billed at list model pricing plus a 15% markup, detailed in our pricing docs. Qualified teams can start with a $100 trial credit.
What happens when I hit my spend limit?
Your admin sets a monthly spend limit for the organization. Once you hit it, requests return an error until the limit resets or an admin raises it. More granular controls, like alerts before you hit your limit, are on the roadmap (see What’s Next, above).
How do I stay in the loop on new features?
Our team maintains a public roadmap (and reviews feature requests) here: https://portal.productboard.com/aptible/2-aptible-roadmap-portal/tabs/10-in-progress. You can also keep an eye on our changelog: www.aptible.com/changelog for latest releases.
If you want to speak to an engineer about what’s coming soon, visit www.aptible.com/contact to book a call.
Which model providers are covered?
LLM Gateway covers Anthropic, OpenAI, Google, and a range of open-weight models, all under a single BAA, so you don’t need to negotiate separate compliance agreements with each provider. See the full list of supported models for current pricing and context windows. See www.aptible.com/platform/llm-gateway/models for more information.
Does integrating LLM Gateway require any changes to my existing applications?
LLM Gateway is compatible with the OpenAI and Anthropic APIs, so most teams switch by pointing their existing client at our base URL with a new key, no other code changes required. Setting up a key takes a few minutes in the Aptible dashboard.
