Azure OpenAI Integration

DokuMetry SDKs (dokumetry) empowers you to effortlessly track and monitor Azure OpenAI usage data and metrics from your Python/NodeJS code.

Get Started

The integration is compatible with

• OpenAI Python SDK client >=1.13.0
• OpenAI JS/TS SDK client >=4.28.0

Python

pip install dokumetry==0.1.1

from openai import AzureOpenAI
import dokumetry

client = AzureOpenAI(
  api_key = "YOUR_AZURE_OPENAI_API_KEY",  
  api_version = "2024-02-01",
  azure_endpoint = "YOUR_AZURE_OPENAI_API_ENDPOINT"
)

dokumetry.init(llm = client, doku_url = "YOUR_DOKU_INGESTER_URL", api_key = "YOUR_DOKU_TOKEN")

Javascript

npm install dokumetry@0.1.1

import OpenAI from "openai";
import DokuMetry from 'dokumetry';

const client = new OpenAI({
  apiKey: "YOUR_AZURE_OPENAI_API_KEY",
  baseURL: `https://YOUR_AZURE_OPENAI_RESOURCE.openai.azure.com/openai/deployments/YOUR_AZURE_OPENAI_DEPLOYMENT`,
  defaultQuery: { 'api-version': "2024-02-01" },
  defaultHeaders: { 'api-key': "YOUR_AZURE_OPENAI_API_KEY" },
});

DokuMetry.init({llm: client, dokuUrl: "YOUR_DOKU_INGESTER_URL", apiKey: "YOUR_DOKU_TOKEN"})

Supported Endpoints

The following Azure OpenAI Endpoints are supported for monitoring with DokuMetry

• Chat completions
• Image Create
• Embeddings
• Completions

Parameters

Python

Parameter	Description	Required
llm	Azure OpenAI Object to track	Yes
doku_url	URL of your Doku Ingester	Yes
api_key	Your Doku API key	Yes
environment	Custom environment tag to include in your metrics	Optional
application_name	Custom application name tag for your metrics	Optional
skip_resp	Skip response from the Doku Ingester for faster execution	Optional

NodeJS

Parameter	Description	Required
llm	Azure OpenAI Object to track	Yes
dokuUrl	URL of your Doku Ingester	Yes
apiKey	Your Doku API key	Yes
environment	Custom environment tag to include in your metrics	Optional
applicationName	Custom application name tag for your metrics	Optional
skipResp	Skip response from the Doku Ingester for faster execution	Optional

Advanced Usage

When using DokuMetry in Production environments, It is recommened to set Skip response parameter to true for faster porcessing.

To filter your LLM Usage according application or the environment, set the Application name and Environment paramaters with the actual values.

---

Connections

Connect to your existing Observablity Platform

API Reference

OpenAPI specification for API Endpoints in Doku