Azure OpenAI

Helicone can be seamlessly integrated with your Azure-OpenAI deployment. This integration requires no additional code changes beyond importing the OpenAI package with Helicone.

MODEL OVERRIDE

When using Azure, the model may sometimes display differently than expected. We have implemented a series of logic to parse out the model, but the returned body of the model can be inconsistent in most cases.

Helicone-Model-Override: [MODEL_NAME]

Click here to learn more about model override

• Python
• Node.js
• Python w/package
• LangChain JS
• LangChain
• cURL

Please ensure to include the ‘api-version’ in all of your requests.

OpenAI v1+

It is mandatory to include the ‘api-key’ in both locations.

  client = OpenAI(
    api_key="[AZURE_OPENAI_API_KEY]",
    base_url="https://oai.helicone.ai/openai/deployments/[DEPLOYMENT]",
    default_headers={
        "Helicone-OpenAI-Api-Base": "https://[AZURE_DOMAIN].openai.azure.com",
        "Helicone-Auth": "Bearer [HELICONE_API_KEY]",
        "api-key": "[AZURE_OPENAI_API_KEY]",
    },
    default_query={
        "api-version": "[API_VERSION]"
    
    }
)

OpenAI <v1

Modify the API base and add a Helicone-Auth header

import openai

openai.api_base = "https://oai.helicone.ai"
openai.api_key = "[AZURE_OPENAI_API_KEY]"
openai.api_version = "[API_VERSION]"
openai.api_type = "azure"

# Create the completion request
openai.ChatCompletion.create(
    model="[DEPLOYMENT]",
    messages=[{"role": "User", "content": "Say hi!"}],
    headers={
        "Helicone-Auth": "Bearer [HELICONE_API_KEY]",
        "Helicone-OpenAI-Api-Base": "https://[AZURE_DOMAIN].openai.azure.com",
    }
)

Congratulations! Your Azure OpenAI requests are now configured to log results to Helicone.