Connect Providers
After setting up the basic AI Gateway with the mock backend, you can configure it to work with real AI model providers. This section will guide you through connecting different AI providers to your gateway.
Example Providers
In this getting started guide you'll find quickstart setups to connect to the following providers:
- Tetrate Agent Router Service (TARS) - Connect to Tetrate Agent Router Service's models
- OpenAI - Connect to OpenAI's GPT models
- Anthropic - Connect to Anthropic's Claude models
- AWS Bedrock - Access AWS Bedrock's suite of foundation models
- Azure OpenAI - Access Azure OpenAI's suite of foundation models
- GCP VertexAI - Access GCP Gemini and Anthropic models on VertexAI
tip
To learn how to connect to providers see Connecting to AI Providers and you can view all Supported Providers.
Before You Begin
Before configuring any provider, complete the Basic Usage guide.
Security Best Practices
When configuring AI providers, keep these security considerations in mind:
- Store credentials securely using Kubernetes secrets
- Never commit API keys or credentials to version control
- Regularly rotate your credentials
- Use the principle of least privilege when setting up access
- Monitor usage and set up appropriate rate limits
Next Steps
Choose your provider to get started: