Skip to content

OpenTelemetry Setup

This guide covers how to configure organization-level telemetry in Raikoo to send AI operation data to your own observability platform.

Overview

Raikoo supports "Bring Your Own Telemetry" (BYOT), allowing organizations to route AI operation telemetry to their own observability platforms.

When enabled, telemetry automatically traces your entire execution stack—including chat interactions, workflow execution, operations, tool invocations, and LLM calls—with no additional configuration required.

Currently supported providers:

  • Azure Application Insights - Microsoft's application performance monitoring service

Prerequisites

  • Organization Admin role in Raikoo
  • Azure subscription with permissions to create resources

Setting Up Azure Application Insights

Create Application Insights Resource

From Azure Portal, navigate to "Create a resource" and search for "Application Insights".

Basics

  • Subscription: Select your Azure subscription
  • Resource Group: Select existing or create new
  • Name: Choose a descriptive name (e.g., raikoo-telemetry-prod)
  • Region: Select region close to your Raikoo deployment
  • Resource Mode: Workspace-based (recommended)

Workspace Details

  • Log Analytics Workspace: Select existing or create new
  • If creating new, use same resource group and region

Click Review + create, then Create.

Get Connection String

  1. Navigate to your Application Insights resource in Azure Portal
  2. Go to Overview
  3. Find Connection String in the Essentials section (top right)
  4. Click the copy icon to copy the full connection string

The connection string looks like:

InstrumentationKey=00000000-0000-0000-0000-000000000000;IngestionEndpoint=https://eastus-0.in.applicationinsights.azure.com/;LiveEndpoint=https://eastus.livediagnostics.monitor.azure.com/;ApplicationId=00000000-0000-0000-0000-000000000000

Configuring Telemetry in Raikoo

  1. Click on your organization name in the navigation
  2. Select Settings from the dropdown
  3. Click the Telemetry tab

Configure Provider

  1. In the Provider dropdown, select Azure Application Insights
  2. Paste your connection string into the Connection String field
  3. Configure privacy options (see below)
  4. Click Save

Privacy Options

Option Default Description
Record Input Prompts Enabled Include prompts and inputs in telemetry
Record Output Responses Enabled Include AI responses in telemetry

When to disable:

  • Compliance requirements - If prompts contain PII or sensitive data
  • Cost optimization - Reduce telemetry volume and storage costs
  • Security policies - When AI inputs/outputs should not leave your system

Verify Configuration

After saving, the status indicator shows:

  • Configured - Telemetry is set up and active
  • Not Configured - No telemetry provider configured

To verify data is flowing:

  1. Run an AI operation in Raikoo
  2. Wait 2-5 minutes for data propagation
  3. In Azure Portal, navigate to your Application Insights resource
  4. Go to Transaction search or Logs to see incoming telemetry

Removing Configuration

  1. Navigate to Organization Settings → Telemetry
  2. Click Remove Configuration
  3. Confirm the removal

When removed:

  • Telemetry stops flowing immediately
  • Existing data in Application Insights is retained (managed by Azure retention policies)
  • The connection string is deleted from Raikoo

Troubleshooting

Connection String Invalid

Cause: The connection string format is incorrect or incomplete.

Solution:

  • Ensure you copied the complete connection string from Azure
  • Verify the string starts with InstrumentationKey=
  • Do not modify the connection string

Telemetry Not Appearing in Application Insights

Cause: Propagation delay or network issues.

Solution:

  • Wait 2-5 minutes for initial data to appear
  • Verify the Application Insights resource is in an active state
  • Check that your Raikoo organization has active AI operations running
  • Verify there are no firewall rules blocking outbound connections to Azure

Permission Errors When Saving

Cause: Insufficient permissions in Raikoo.

Solution:

  • Verify you have the Organization Admin role
  • Contact your organization administrator to grant necessary permissions

Getting Help

If you encounter issues not covered here:

  1. Check the Raikoo Telemetry concepts guide
  2. Review Azure Application Insights documentation
  3. Contact Raikoo support