This integration method is maintained but no longer actively developed. For the best experience and latest features, use our new AI Gateway with unified API access to 100+ models.

Proxy Integration

Create an account + Generate an API Key

Log into helicone or create an account. Once you have an account, you can generate an API key.

Set HELICONE_API_KEY as an environment variable

HELICONE_API_KEY=<your API key>

Run the Bedrock command with the Helicone Proxy

import {
  BedrockRuntimeClient,
  InvokeModelCommand,
} from "@aws-sdk/client-bedrock-runtime";

const REGION = "ap-south-1"; // or any other region
const client = new BedrockRuntimeClient({
  region: REGION,
  endpoint: `https://bedrock.helicone.ai/v1/${REGION}`,
});

// Add middleware to inject custom headers
client.middlewareStack.add(
  (next, context) => async (args: any) => {
    if (!args.request.headers) {
      args.request.headers = {};
    }

    // Add your custom headers here
    args.request.headers["Helicone-Auth"] = `Bearer ${process.env.HELICONE_API_KEY}`;
    args.request.headers["aws-access-key"] = "<AWS ACCESS KEY>";
    args.request.headers["aws-secret-key"] = "<AWS SECRET KEY>";
    // optionally, you can pass the aws-session-token instead of access and secret key if you are using temporary credentials
    args.request.headers["aws-session-token"] = "<AWS SESSION TOKEN>";

    return next(args);
  },
  {
    step: "build",
    name: "addCustomHeaders",
  }
);

const model_id = "meta.llama3-8b-instruct-v1:0";

export const main = async () => {
  const command = new InvokeModelCommand({
    modelId: model_id,
    body: JSON.stringify({
      prompt: "Hello, world!",
      max_gen_len: 512,
      temperature: 0.5,
      top_p: 0.9,
    }),
    accept: "application/json",
    contentType: "application/json",
  });

  const response = await client.send(command);
  console.log(response.body?.transformToString());
};

main();

Async Integration

Create an account + Generate an API Key

Log into Helicone or create an account. Once you have an account, you can generate an API key.

Set API keys as environment variables

export HELICONE_API_KEY=<your Helicone API key>
export AWS_ACCESS_KEY_ID=<your AWS access key ID>
export AWS_SECRET_ACCESS_KEY=<your AWS secret access key>
export AWS_REGION=<your AWS region>

Install necessary packages

Ensure you have the necessary packages installed in your JavaScript project:

npm install @helicone/async @aws-sdk/client-bedrock-runtime

Import required modules and initialize Helicone Logger

import { HeliconeAsyncLogger } from "@helicone/async";
import * as bedrock from "@aws-sdk/client-bedrock-runtime";
import util from "util";

const logger = new HeliconeAsyncLogger({
  apiKey: process.env.HELICONE_API_KEY,
  providers: {
    bedrock: bedrock,
  },
  baseUrl: "https://api.helicone.ai/v1/trace/log",
});
logger.init();

Configure AWS Bedrock client

const client = new bedrock.BedrockRuntimeClient({
  region: process.env.AWS_REGION,
  credentials: {
    accessKeyId: process.env.AWS_ACCESS_KEY_ID,
    secretAccessKey: process.env.AWS_SECRET_ACCESS_KEY,
  },
});

Create a command for the Bedrock model

const command = new bedrock.ConverseCommand({
  messages: [
    {
      role: "user",
      content: [{ text: "Why is the unix epoch measured from 1970?" }],
    },
  ],
  modelId: "meta.llama2-13b-chat-v1",
});

Send the request and handle the response

async function sendRequest() {
  try {
    const data = await client.send(command);
    console.log(
      "Response:\n",
      util.inspect(data, { showHidden: false, depth: null, colors: true })
    );
  } catch (error) {
    console.error("Error:", error);
  }
}

sendRequest();

Complete Async Example

Here’s a complete example that puts all the steps together:

import { HeliconeAsyncLogger } from "@helicone/async";
import * as bedrock from "@aws-sdk/client-bedrock-runtime";
import util from "util";

// Initialize Helicone Logger
const logger = new HeliconeAsyncLogger({
  apiKey: process.env.HELICONE_API_KEY,
  providers: {
    bedrock: bedrock,
  },
  baseUrl: "https://api.helicone.ai/v1/trace/log",
});
logger.init();

// Configure AWS Bedrock client
const client = new bedrock.BedrockRuntimeClient({
  region: process.env.AWS_REGION,
  credentials: {
    accessKeyId: process.env.AWS_ACCESS_KEY_ID,
    secretAccessKey: process.env.AWS_SECRET_ACCESS_KEY,
  },
});

// Create a command for the Bedrock model
const command = new bedrock.ConverseCommand({
  messages: [
    {
      role: "user",
      content: [{ text: "Why is the unix epoch measured from 1970?" }],
    },
  ],
  modelId: "meta.llama2-13b-chat-v1",
});

// Send the request and handle the response
async function sendRequest() {
  try {
    const data = await client.send(command);
    console.log(
      "Response:\n",
      util.inspect(data, { showHidden: false, depth: null, colors: true })
    );
  } catch (error) {
    console.error("Error:", error);
  }
}

sendRequest();

This integration allows you to use AWS Bedrock with Helicone’s async logging. The Helicone logger will automatically capture traces of your AWS Bedrock API calls, providing you with valuable insights and analytics through the Helicone dashboard. For more information on using async logging, visit the Async Logging documentation.

Getting Started

AI Gateway

Observability & Analytics

Prompt Management

Legacy Integrations

References

AWS Bedrock JavaScript SDK Integration

Proxy Integration

Async Integration

Complete Async Example

​Proxy Integration

​Async Integration

​Complete Async Example

Proxy Integration

Async Integration

Complete Async Example