Bring Your Own LLM

Holistics lets you use your own AI provider with your own API key, and choose your preferred AI models for better control and visibility over AI usage.

SECURITY NOTE

You are responsible for configuring your own data and security controls with your provider. For reference, check out Holistics' data controls for default AI providers.

Connect your AI provider

Holistics currently supports these AI providers:

• OpenAI
• Gemini
• Anthropic

Go to Organization settings > AI settings > AI providers. Select your preferred provider, then add your API key.

Here is an example of how to add your own OpenAI API key:

1. Go to your OpenAI API Keys management page

2. Click Create new secret key and fill in details

   

3. Securely save the generated key

4. Edit the key to restrict its permissions

   • Current required permissions:
     • Write on "Model capabilities"
   

5. In Holistics, go to AI settings -> AI providers

   
   1. Enable OpenAI integration
   2. Input your API Key
   3. Click Verify & Save

Choose your preferred AI model

When you use your own AI provider, you can choose a model for each model class in Holistics:

• Agentic chat model: Used for conversational and complex workflows, such as querying data, visualizing data, modeling, and building dashboards.

• Quick generation model: Used for fast, non-conversational tasks, such as generating object descriptions and commit messages.