LLM providers overview¶
An LLM provider is an integration with an AI service platform that offers language models. By configuring providers in AI Workspace, you can:
- Centralize credential management: Store API keys and authentication details securely
- Connect multiple providers: Integrate with leading LLM services
- Monitor provider status: Track availability and health of connected services
- Reuse configuration: Use one provider across multiple proxies without duplicating credentials
Supported providers¶
AI Workspace supports the following LLM providers:
| Provider | Description | Learn more |
|---|---|---|
 OpenAI |
Access GPT-4, GPT-3.5, and other OpenAI models | OpenAI documentation |
 Anthropic |
Integrate Anthropic Claude models | Anthropic documentation |
 Azure OpenAI |
Use OpenAI models hosted on Microsoft Azure | Azure OpenAI documentation |
 Azure AI Foundry |
Access models through Azure AI Foundry platform | Azure AI Foundry documentation |
 Gemini |
Integrate Google's Gemini language models | Gemini documentation |
 Mistral AI |
Access Mistral's open and commercial models | Mistral AI documentation |
 AWS Bedrock |
Access Anthropic, Meta, Mistral, and Amazon models through Amazon Bedrock | AWS Bedrock documentation |
Connect a custom provider¶
If the LLM service you use isn't in the list above, a user with template-management access can define a reusable LLM Provider Template under Settings > LLM Provider Templates. A template captures the endpoint and authentication shape for a custom provider. It then appears in the provider type selector alongside the built-in providers whenever you add a provider.
Next step¶
Configure an LLM provider: set up your first provider.