> ## Documentation Index
> Fetch the complete documentation index at: https://docs.onyx.app/llms.txt
> Use this file to discover all available pages before exploring further.

# Ollama

> Using Ollama with Onyx

## Guide

Configure Onyx to use models served by [Ollama](https://ollama.com/).

<Steps>
  <Step title="Setup Ollama and Deploy your Models">
    The [Ollama GitHub repository](https://github.com/ollama/ollama?tab=readme-ov-file#ollama)
    details how to download and deploy models on Ollama.

    If self-hosting, Ollama is configured to run on port `11434` by default.

    You can also configure Onyx to use [Ollama's managed cloud service](https://ollama.com/cloud).
  </Step>

  <Step title="Navigate to Language Models">
    Access the Admin Panel from your user profile icon, then navigate to **Configuration → Language Models**.
  </Step>

  <Step title="Configure Ollama">
    Select **Ollama** from the available providers.

    Give your provider a **Display Name**.

    If using Ollama Cloud, enter your Ollama Cloud **API Key**.

    Click the **Fetch Available Models** button to see the models available in your Ollama instance.

    <img className="rounded-image" src="https://mintcdn.com/danswer/sZSCgOqeRdUK59k_/assets/admins/ai_models/ollama_config.png?fit=max&auto=format&n=sZSCgOqeRdUK59k_&q=85&s=85e03f5066b61c1d7f9c8d628ab4c6bf" alt="Ollama Provider Configuration" width="1778" height="1024" data-path="assets/admins/ai_models/ollama_config.png" />
  </Step>

  <Step title="Choose Visible Models">
    In the **Advanced Options**, you will see a list of all models available from this provider.
    You may choose which models are visible to your users in Onyx.

    Setting visible models is useful when a provider publishes multiple models and versions of the same model.
  </Step>

  <Step title="Designate Provider Access">
    Lastly, decide whether the provider should be public to all users in Onyx.

    If set to private,
    the provider's models will be available to Admins and User Groups you explicitly assign the provider to.
  </Step>
</Steps>