User Feedback

Collect and analyze user feedback on LLM responses. Evaluate output quality, identify trends, and optimize your AI application’s performance based on user satisfaction.

Who can use this feature: Anyone on any plan.

Introduction

User feedback is a feature that allows users to evaluate the responses generated by the LLM. This feedback can be either positive or negative, offering crucial insights into the effectiveness and relevance of the LLM’s outputs based on user’s satisfaction.

Why User Feedback

User feedback allows you to:

• Gauge the efficacy of the LLM’s responses.
• Optimize the user experience of your LLM app as you modify your prompts or models based on the received feedback.
• Identify trends in feedback to make informed decisions about model training or fine-tuning.

Quick Start

Option 1: Logging Feedback using Helicone’s Node Package

If you’re using Helicone’s Node package, here’s a simplified example to log feedback:

Option 2: Logging Feedback using Fetch

Without Helicone’s Node package, you can still log feedback using the Fetch API. For detailed documentation, refer to:

Fetch API for Feedback

Not using Helicone’s Node Package? We got you, too.

In some packages or scenarios, you may not be able to retrieve headers to get the helicone-id. However, you can still log feedback by supplying a UUID as the helicone-id.

Here’s a simple example:

import OpenAI from "openai";

// Initialize the OpenAI client with Helicone integration
const openai = new OpenAI({
  apiKey: process.env.OPENAI_API_KEY,
  baseURL: "https://oai.helicone.ai/v1",
  defaultHeaders: {
    "Helicone-Auth": `Bearer ${process.env.HELICONE_API_KEY}`,
  },
});

// Generate a chat completion
const {
  data: completions,
  response,
}: { data: ChatCompletion, response: Response } = await openai.chat
  .completions({
    model: "gpt-3.5-turbo",
    messages: [{ role: "user", content: "Say hi!" }],
  })
  .withResponse();

// Retrieve the heliconeId header
const heliconeId = response.headers.get("helicone-id");

// Log feedback
const options = {
  method: "POST",
  headers: {
    "Helicone-Auth": "YOUR_HELICONE_AUTH_HEADER",
    "Content-Type": "application/json",
  },
  body: JSON.stringify({
    rating: true, // true for positive, false for negative
  }),
};

const response = await fetch(
  `https://api.helicone.ai/v1/request/${heliconeId}/feedback`,
  options
);