> ## Documentation Index
> Fetch the complete documentation index at: https://docs.onyx.app/llms.txt
> Use this file to discover all available pages before exploring further.

# Overview

> Configure language model providers and models in Onyx

<Tip>
  Use this page to configure the language models available for chat, agents, and other text-based workflows in Onyx.
</Tip>

<Note>
  Image generation and voice are configured separately in [Image Generation](/admins/actions/image_generation)
  and [Voice Mode](/admins/actions/voice_mode).
</Note>

## Language Models

Navigate to **Admin Panel → Language Models** to choose which providers your workspace can use,
which models are visible, and which models should be the default or fast option in Onyx.

<img className="rounded-image" src="https://mintcdn.com/danswer/sZSCgOqeRdUK59k_/assets/admins/ai_models/ai_config_overview.png?fit=max&auto=format&n=sZSCgOqeRdUK59k_&q=85&s=9895a4eccff2ef2a8d25b17e49b3d9f0" alt="Language Models page overview" width="3308" height="1790" data-path="assets/admins/ai_models/ai_config_overview.png" />

### Provider Types

<AccordionGroup>
  <Accordion title="Direct Model Providers" icon="cloud">
    These providers give you direct access to a model vendor's hosted API.

    Common choices include **OpenAI** and **Anthropic**.
    This is usually the simplest setup when you want fast access to the provider's latest flagship models.
  </Accordion>

  <Accordion title="Cloud Platforms and Aggregators" icon="server">
    These providers expose language models through a broader cloud or routing layer.

    Common choices include **Azure OpenAI**, **Amazon Bedrock**, **Google Vertex AI**, **OpenRouter**,
    **LiteLLM Proxy**, and **Bifrost**. They are useful when you need enterprise controls, cloud alignment,
    regional hosting options, or access to multiple model families from one integration point.
  </Accordion>

  <Accordion title="Self-Hosted and Local Runtimes" icon="desktop">
    These options let you run open-weight models on your own infrastructure or local hardware.

    Onyx includes built-in integrations for [Ollama](/admins/ai_models/ollama)
    and [LM Studio](/admins/ai_models/lm_studio). This is a good fit when your team needs local development workflows,
    tighter data residency, or lower per-token costs.
  </Accordion>

  <Accordion title="OpenAI-Compatible Custom Providers" icon="cpu">
    If your provider is not listed directly, you can still connect it through an OpenAI-compatible API.

    This covers custom gateways, hosted inference endpoints,
    and internal model platforms that expose an OpenAI-style `/chat/completions` or `/models` interface.
  </Accordion>
</AccordionGroup>

### Choosing a Good Starting Setup

<Note>
  If cloud-hosted models are approved for your organization,
  they are usually the best default choice because they are easier to operate and generally provide the best
  capability-to-cost tradeoff.
</Note>

* Start with one primary provider for most users.
* Use a recent **GPT**, **Claude**,
  or **Gemini** family model as your default if you want the strongest out-of-the-box experience.
* Use **Bedrock**, **Vertex AI**, **Azure OpenAI**, **OpenRouter**, **LiteLLM Proxy**, or **Bifrost** when procurement,
  routing, or cloud alignment matters more than a direct vendor integration.
* Use open-weight families such as **Llama**, **Qwen**, **DeepSeek**, or **gpt-oss** if you are self-hosting.
* Keep the visible model list short so users are choosing between a few intentional options instead of every possible
  version.

<Info>
  Self-hosting is best for advanced teams that already know which models they want to run and how they will operate
  them.
</Info>

## Configure Your Providers

<Columns cols={3}>
  <Card title="OpenAI" icon="bolt" href="/admins/ai_models/openai" />

  <Card title="Azure OpenAI" icon="microsoft" href="/admins/ai_models/azure_openai" />

  <Card title="Anthropic" icon="brain" href="/admins/ai_models/anthropic" />

  <Card title="AWS Bedrock" icon="aws" href="/admins/ai_models/bedrock" />

  <Card title="Google Vertex AI" icon="google" href="/admins/ai_models/google_ai" />

  <Card title="OpenRouter" icon="robot" href="/admins/ai_models/openrouter" />

  <Card title="Bifrost" icon="server" href="/admins/ai_models/bifrost" />

  <Card title="LiteLLM Proxy" icon="server" href="/admins/ai_models/litellm_proxy" />

  <Card title="Ollama" icon="robot" href="/admins/ai_models/ollama" />

  <Card title="LM Studio" icon="desktop" href="/admins/ai_models/lm_studio" />

  <Card title="OpenAI-Compatible Providers" icon="server" href="/admins/ai_models/custom_inference_provider" />
</Columns>

## Best Practices

* Review the terms, privacy posture, and data processing terms of every provider you enable.
* Limit the visible model list to the models you actually want users to choose from.
* Use private providers and access controls for costly, experimental, or team-specific models.
* Decide on a default model at the organization level before rolling the page out broadly.
* Make sure internal guidance is clear about what data users can send to each provider.
