This integration method is maintained but no longer actively developed. For the best experience and latest features, use our new AI Gateway with unified API access to 100+ models.
Depending on the model you are using, you may need to adjust the base URL.
For most cases with Groq, the base URL will be https://groq.helicone.ai/openai/v1.However, in some cases, you may need to use https://groq.helicone.ai/v1.
Create an account + Generate an API Key
Log into helicone or create an account. Once you have an account, you
can generate an API key. Set HELICONE_API_KEY as an environment variable
HELICONE_API_KEY=<your API key>
Modify the base path and add a Helicone-Auth header
client = Groq(
api_key=os.environ.get("GROQ_API_KEY"),
base_url="https://groq.helicone.ai/openai/v1",
default_headers={
"Helicone-Auth": f"Bearer {os.environ.get('HELICONE_API_KEY')}",
}
)