docs/source/configuration/models/providers/google.md

Google

Feature	Available
Tools	No
Multimodal	No

Chat UI can connect to the google Vertex API endpoints (List of supported models).

To enable:

1. Select or create a Google Cloud project.
2. Enable billing for your project.
3. Enable the Vertex AI API.
4. Set up authentication with a service account so you can access the API from your local workstation.

The service account credentials file can be imported as an environmental variable:

GOOGLE_APPLICATION_CREDENTIALS = clientid.json

Make sure your docker container has access to the file and the variable is correctly set. Afterwards Google Vertex endpoints can be configured as following:

MODELS=`[
  {
    "name": "gemini-1.5-pro",
    "displayName": "Vertex Gemini Pro 1.5",
    "endpoints" : [{
      "type": "vertex",
      "project": "abc-xyz",
      "location": "europe-west3",
      "model": "gemini-1.5-pro-preview-0409", // model-name

      // Optional
      "safetyThreshold": "BLOCK_MEDIUM_AND_ABOVE",
      "apiEndpoint": "", // alternative api endpoint url,
      "tools": [{
        "googleSearchRetrieval": {
          "disableAttribution": true
        }
      }]
    }]
  }
]`

GenAI

Or use the Gemini API API provider from:

Make sure that you have an API key from Google Cloud Platform. To get an API key, follow the instructions here.

MODELS=`[
  {
    "name": "gemini-1.5-flash",
    "displayName": "Gemini Flash 1.5",
    "multimodal": true,
    "endpoints": [
      {
        "type": "genai",
        "apiKey": "abc...xyz"
      }
    ]

    // Optional
    "safetyThreshold": "BLOCK_MEDIUM_AND_ABOVE",
  },
  {
    "name": "gemini-1.5-pro",
    "displayName": "Gemini Pro 1.5",
    "multimodal": false,
    "endpoints": [
      {
        "type": "genai",
        "apiKey": "abc...xyz"
      }
    ]
  }
]`