OpenHands uses LiteLLM to make calls to chat models on Groq. You can find their documentation on using Groq as a provider here.
LLM
tab:
LLM Provider
to Groq
LLM Model
to the model you will be using. Visit here to see the list of
models that Groq hosts. If the model is not in the list,
enable Advanced
options, and enter it in Custom Model
(e.g. groq/<model-name> like groq/llama3-70b-8192
).API key
to your Groq API key. To find or create your Groq API Key, see here.LLM
tab:
Advanced
optionsCustom Model
to the prefix openai/
+ the model you will be using (e.g. openai/llama3-70b-8192
)Base URL
to https://api.groq.com/openai/v1
API Key
to your Groq API key