For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.
Cost controls
Attribute, observe, enforce, and optimize LLM spend through agentgateway.
Control LLM spend end to end, in stages:
- Attribute: Tie usage to teams and keys with virtual keys.
- Observe: Compute the realized USD cost of every request with a model cost catalog, see spend by model, provider, and user in the built-in cost dashboard, or estimate it from token metrics with LLM cost tracking.
- Enforce: Set per-key and per-route spend caps with budget and spend limits, built on rate limiting.
Virtual keys
Issue API keys with per-key token budgets and cost tracking (also known as virtual keys).
Model costs
Price LLM requests with a model cost catalog and expose realized USD costs in logs, traces, and …
Cost dashboard
View LLM spend, tokens, and traffic in the built-in Admin UI when running agentgateway on …
LLM cost tracking
Track and monitor LLM costs per request using token usage metrics.
Budget and spend limits
Control LLM spending by enforcing token budget limits per API key or user.
Was this page helpful?
