Google Gemini/Vertex
OpenHands uses LiteLLM for completion calls. The following resources are relevant for using OpenHands with Google's LLMs:
Gemini - Google AI Studio Configs
When running OpenHands, you'll need to set the following in the OpenHands UI through the Settings:
LLM Provider
toGemini
LLM Model
to the model you will be using. If the model is not in the list, toggleAdvanced Options
, and enter it inCustom Model
(i.e. gemini/<model-name>).API Key
to your Gemini API key
VertexAI - Google Cloud Platform Configs
To use Vertex AI through Google Cloud Platform when running OpenHands, you'll need to set the following environment
variables using -e
in the docker run command:
GOOGLE_APPLICATION_CREDENTIALS="<json-dump-of-gcp-service-account-json>"
VERTEXAI_PROJECT="<your-gcp-project-id>"
VERTEXAI_LOCATION="<your-gcp-location>"
Then set the following in the OpenHands UI through the Settings:
LLM Provider
toVertexAI
LLM Model
to the model you will be using. If the model is not in the list, toggleAdvanced Options
, and enter it inCustom Model
(i.e. vertex_ai/<model-name>).