Skip to content
CTRL K
    Docs Standalone Kubernetes Models Blog Enterprise Community Get Started GitHub
    agentgateway has joined the Agentic AI Foundation — Learn more

    For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.

    Page as Markdown
    Cost controls
    Attribute, observe, enforce, and optimize LLM spend through agentgateway.
    Control LLM spend end to end. Attribute usage to teams and keys, observe the realized cost of every request, enforce budgets and rate limits, and optimize routing and caching for cost.
    Virtual keys
    Issue API keys with per-key token budgets and cost tracking (also known as virtual keys).
    LLM cost tracking
    Track and monitor LLM costs per request using token usage metrics.
    Budget and spend limits
    Control LLM spending by enforcing token budget limits per API key or user.
    GuardrailsPrompt enrichment
    Was this page helpful?
    

    
Agentgateway assistant
    


    Ask me anything about agentgateway configuration, features, or usage.
    Note: AI-generated content might contain errors; please verify and test all returned information.
    Tip: one topic per conversation gives the best results. Use the + button in the chat header to start a new conversation.
    Switching topics? Starting a new conversation improves accuracy.

    ↑↓ navigate
↵ select
esc dismiss
    

    

    What could be improved?
    Your feedback helps us improve assistant answers and identify docs gaps we should fix.
    Need more help? Join us on Discord:
https://discord.gg/y9efgEmppm
    Want to use your own agent? Add the Solo MCP server to query our docs directly. Get started here:
https://search.solo.io/.