Custom LLM providers
LLM Providers
Overview of Ona Agent LLM provider integrations
This feature is only available on the Enterprise tier
Supported providers
- Anthropic: Set up Ona Agent to use Anthropic as your LLM Provider.
- AWS Bedrock: Set up Ona Agent to use AWS Bedrock.
- Google Vertex AI: Set up Ona Agent to use Google Vertex.
- Portkey (LLM Gateway): Use Portkey to route requests to multiple providers with advanced features.
Choosing a provider
- Anthropic (direct): Lowest latency for Claude models; simple API key setup.
- AWS Bedrock: Enterprise-grade IAM, regional availability; use existing AWS controls.
- Google Vertex AI: Integrate with GCP stack; global endpoint option for routing.
- Portkey: Centralize keys, routing, failover, and observability across providers.
Next steps
- Configure a provider from the list above, then test the integration by starting an Ona Agent session and making a sample request.