# AI Gateway

Observe and control your AI applications

> Links below point directly to Markdown versions of each page. Any page can also be retrieved as Markdown by sending an `Accept: text/markdown` header to the page's URL without the `index.md` suffix (for example, `curl -H "Accept: text/markdown" https://developers.cloudflare.com/ai-gateway/`).
>
> For other Cloudflare products, see the [Cloudflare documentation directory](https://developers.cloudflare.com/llms.txt).
>
> Use [AI Gateway llms-full.txt](https://developers.cloudflare.com/ai-gateway/llms-full.txt) for the complete AI Gateway documentation in a single file, intended for offline indexing, bulk vectorization, or large-context models.

## Overview

- [Cloudflare AI Gateway](https://developers.cloudflare.com/ai-gateway/index.md)

## Getting started

- [Getting started](https://developers.cloudflare.com/ai-gateway/get-started/index.md)

## Using AI Gateway

- [Using AI Gateway](https://developers.cloudflare.com/ai-gateway/usage/index.md)
- [Unified API (OpenAI compat)](https://developers.cloudflare.com/ai-gateway/usage/chat-completion/index.md)
- [Provider Native](https://developers.cloudflare.com/ai-gateway/usage/providers/index.md)
- [Anthropic](https://developers.cloudflare.com/ai-gateway/usage/providers/anthropic/index.md)
- [Azure OpenAI](https://developers.cloudflare.com/ai-gateway/usage/providers/azureopenai/index.md)
- [Baseten](https://developers.cloudflare.com/ai-gateway/usage/providers/baseten/index.md)
- [Amazon Bedrock](https://developers.cloudflare.com/ai-gateway/usage/providers/bedrock/index.md)
- [Cartesia](https://developers.cloudflare.com/ai-gateway/usage/providers/cartesia/index.md)
- [Cerebras](https://developers.cloudflare.com/ai-gateway/usage/providers/cerebras/index.md)
- [Cohere](https://developers.cloudflare.com/ai-gateway/usage/providers/cohere/index.md)
- [Deepgram](https://developers.cloudflare.com/ai-gateway/usage/providers/deepgram/index.md)
- [DeepSeek](https://developers.cloudflare.com/ai-gateway/usage/providers/deepseek/index.md)
- [ElevenLabs](https://developers.cloudflare.com/ai-gateway/usage/providers/elevenlabs/index.md)
- [Fal AI](https://developers.cloudflare.com/ai-gateway/usage/providers/fal/index.md)
- [Google AI Studio](https://developers.cloudflare.com/ai-gateway/usage/providers/google-ai-studio/index.md)
- [xAI](https://developers.cloudflare.com/ai-gateway/usage/providers/grok/index.md)
- [Groq](https://developers.cloudflare.com/ai-gateway/usage/providers/groq/index.md)
- [HuggingFace](https://developers.cloudflare.com/ai-gateway/usage/providers/huggingface/index.md)
- [Ideogram](https://developers.cloudflare.com/ai-gateway/usage/providers/ideogram/index.md)
- [Mistral AI](https://developers.cloudflare.com/ai-gateway/usage/providers/mistral/index.md)
- [OpenAI](https://developers.cloudflare.com/ai-gateway/usage/providers/openai/index.md)
- [OpenRouter](https://developers.cloudflare.com/ai-gateway/usage/providers/openrouter/index.md)
- [Parallel](https://developers.cloudflare.com/ai-gateway/usage/providers/parallel/index.md)
- [Perplexity](https://developers.cloudflare.com/ai-gateway/usage/providers/perplexity/index.md)
- [Replicate](https://developers.cloudflare.com/ai-gateway/usage/providers/replicate/index.md)
- [Google Vertex AI](https://developers.cloudflare.com/ai-gateway/usage/providers/vertex/index.md)
- [Workers AI](https://developers.cloudflare.com/ai-gateway/usage/providers/workersai/index.md)
- [Universal Endpoint](https://developers.cloudflare.com/ai-gateway/usage/universal/index.md)
- [WebSockets API](https://developers.cloudflare.com/ai-gateway/usage/websockets-api/index.md)
- [Non-realtime WebSockets API](https://developers.cloudflare.com/ai-gateway/usage/websockets-api/non-realtime-api/index.md)
- [Realtime WebSockets API](https://developers.cloudflare.com/ai-gateway/usage/websockets-api/realtime-api/index.md)

## Features

- [Features](https://developers.cloudflare.com/ai-gateway/features/index.md)
- [Caching](https://developers.cloudflare.com/ai-gateway/features/caching/index.md): Override caching settings on a per-request basis.
- [Data Loss Prevention (DLP)](https://developers.cloudflare.com/ai-gateway/features/dlp/index.md)
- [Set up Data Loss Prevention (DLP)](https://developers.cloudflare.com/ai-gateway/features/dlp/set-up-dlp/index.md)
- [Dynamic routing](https://developers.cloudflare.com/ai-gateway/features/dynamic-routing/index.md)
- [JSON Configuration](https://developers.cloudflare.com/ai-gateway/features/dynamic-routing/json-configuration/index.md)
- [Using a dynamic route](https://developers.cloudflare.com/ai-gateway/features/dynamic-routing/usage/index.md)
- [Guardrails](https://developers.cloudflare.com/ai-gateway/features/guardrails/index.md)
- [Set up Guardrails](https://developers.cloudflare.com/ai-gateway/features/guardrails/set-up-guardrail/index.md)
- [Supported model types](https://developers.cloudflare.com/ai-gateway/features/guardrails/supported-model-types/index.md)
- [Usage considerations](https://developers.cloudflare.com/ai-gateway/features/guardrails/usage-considerations/index.md)
- [Rate limiting](https://developers.cloudflare.com/ai-gateway/features/rate-limiting/index.md)
- [Unified Billing](https://developers.cloudflare.com/ai-gateway/features/unified-billing/index.md): Use the Cloudflare billing to pay for and authenticate your inference requests.

## Configuration

- [Configuration](https://developers.cloudflare.com/ai-gateway/configuration/index.md)
- [Authenticated Gateway](https://developers.cloudflare.com/ai-gateway/configuration/authentication/index.md): Add security by requiring a valid authorization token for each request.
- [BYOK (Store Keys)](https://developers.cloudflare.com/ai-gateway/configuration/bring-your-own-keys/index.md)
- [Custom costs](https://developers.cloudflare.com/ai-gateway/configuration/custom-costs/index.md): Override default or public model costs on a per-request basis.
- [Custom Providers](https://developers.cloudflare.com/ai-gateway/configuration/custom-providers/index.md): Create and manage custom AI providers for your account.
- [Fallbacks](https://developers.cloudflare.com/ai-gateway/configuration/fallbacks/index.md)
- [Manage gateways](https://developers.cloudflare.com/ai-gateway/configuration/manage-gateway/index.md)
- [Request handling](https://developers.cloudflare.com/ai-gateway/configuration/request-handling/index.md)

## Observability

- [Observability](https://developers.cloudflare.com/ai-gateway/observability/index.md)
- [Analytics](https://developers.cloudflare.com/ai-gateway/observability/analytics/index.md)
- [Costs](https://developers.cloudflare.com/ai-gateway/observability/costs/index.md)
- [Custom metadata](https://developers.cloudflare.com/ai-gateway/observability/custom-metadata/index.md)
- [Logging](https://developers.cloudflare.com/ai-gateway/observability/logging/index.md)
- [Workers Logpush](https://developers.cloudflare.com/ai-gateway/observability/logging/logpush/index.md)
- [OpenTelemetry](https://developers.cloudflare.com/ai-gateway/observability/otel-integration/index.md)

## Integrations

- [Integrations](https://developers.cloudflare.com/ai-gateway/integrations/index.md)
- [Agents](https://developers.cloudflare.com/ai-gateway/integrations/agents/index.md): Build AI-powered Agents on Cloudflare
- [Workers AI](https://developers.cloudflare.com/ai-gateway/integrations/aig-workers-ai-binding/index.md): This guide will walk you through setting up and deploying a Workers AI project. You will use Workers, an AI Gateway binding, and a large language model (LLM) to deploy your first AI-powered application on the Cloudflare global network.
- [Vercel AI SDK](https://developers.cloudflare.com/ai-gateway/integrations/vercel-ai-sdk/index.md)
- [AI Gateway Binding Methods](https://developers.cloudflare.com/ai-gateway/integrations/worker-binding-methods/index.md): This guide provides an overview of how to use the latest Cloudflare Workers AI Gateway binding methods. You will learn how to set up an AI Gateway binding, access new methods, and integrate them into your Workers.

## Tutorials

- [Tutorials](https://developers.cloudflare.com/ai-gateway/tutorials/index.md)
- [Create your first AI Gateway using Workers AI](https://developers.cloudflare.com/ai-gateway/tutorials/create-first-aig-workers/index.md): This tutorial guides you through creating your first AI Gateway using Workers AI on the Cloudflare dashboard.
- [Deploy a Worker that connects to OpenAI via AI Gateway](https://developers.cloudflare.com/ai-gateway/tutorials/deploy-aig-worker/index.md): Learn how to deploy a Worker that makes calls to OpenAI through AI Gateway
- [Use Pruna P-video through AI Gateway](https://developers.cloudflare.com/ai-gateway/tutorials/pruna-p-video/index.md): Learn how to call prunaai/p-video on Replicate through AI Gateway

## Platform

- [Platform](https://developers.cloudflare.com/ai-gateway/reference/index.md)
- [Audit logs](https://developers.cloudflare.com/ai-gateway/reference/audit-logs/index.md)
- [Limits](https://developers.cloudflare.com/ai-gateway/reference/limits/index.md)
- [Pricing](https://developers.cloudflare.com/ai-gateway/reference/pricing/index.md)
- [Troubleshooting](https://developers.cloudflare.com/ai-gateway/reference/troubleshooting/index.md)

## Changelog

- [Changelog](https://developers.cloudflare.com/ai-gateway/changelog/index.md)

## Header Glossary

- [Header Glossary](https://developers.cloudflare.com/ai-gateway/glossary/index.md)

## REST API reference

- [REST API reference](https://developers.cloudflare.com/ai-gateway/api-reference/index.md)

## MCP server

- [MCP server](https://developers.cloudflare.com/ai-gateway/mcp-server/index.md)

## AI Assistant

- [AI Assistant](https://developers.cloudflare.com/ai-gateway/ai/index.md)

## Evaluations

- [Evaluations](https://developers.cloudflare.com/ai-gateway/evaluations/index.md)
- [Add Human Feedback using Dashboard](https://developers.cloudflare.com/ai-gateway/evaluations/add-human-feedback/index.md)
- [Add Human Feedback using API](https://developers.cloudflare.com/ai-gateway/evaluations/add-human-feedback-api/index.md)
- [Add human feedback using Worker Bindings](https://developers.cloudflare.com/ai-gateway/evaluations/add-human-feedback-bindings/index.md)
- [Set up Evaluations](https://developers.cloudflare.com/ai-gateway/evaluations/set-up-evaluations/index.md)

## Architectures

- [Architectures](https://developers.cloudflare.com/ai-gateway/demos/index.md)