Cloud AI Gateway

Documentation for Helicone’s cloud-based AI Gateway

Cloud AI Gateway Features

Here’s the complete documentation for all available features:

Core Gateway Features

Custom Rate Limits

Configure request rate limiting and spending controls for your applications

Gateway Fallbacks

Set up automatic fallback providers when your primary LLM provider fails

LLM Security

Implement security measures and content filtering for your LLM requests

Content Moderation

Automatically detect and filter inappropriate content in requests and responses

Automatic Retries

Configure retry logic for failed requests with exponential backoff