AutoGen Multi-Agent Telemetry

Implementation evidence

AutoGen Multi-Agent Telemetry: from boundary to verified row

Use AutoGen Multi-Agent Telemetry at a controlled application boundary, keep the event contract small, and verify a known outcome before building aggregate views.

1
Choose the outcome
AutoGen multi-agent monitoring
2
Define the contract
run_id, workflow, team_name, agent_count, model_alias, termination_reason, and release
3
Instrument the boundary
Wrap the public agent or team run boundary and emit one terminal outcome; avoid one business event per message unless a specific query requires that grain.
4
Verify the evidence
Exercise a known fixture, then inspect agent_run_completed for one correctly typed terminal row.

Before you start

Prerequisites and boundaries

AutoGen and telemetry-sh initialized in a trusted Python process
An application-owned run ID and stable team, workflow, model, termination, and release names
OpenTelemetry export configured separately when detailed AutoGen traces are required

Delivery setup

Install and initialize server-side

Initialize Telemetry for synchronous code or TelemetryAsync for asyncio code once per process with a server-side key. Keep ingestion credentials out of browser bundles, client-visible environment variables, source control, logs, and exception messages.

autogen-install

pip installation

bash

python -m pip install telemetry-sh

1Prepare one reusable server-side delivery client with bounded network behavior.
2Add the outcome event at the success, failure, retry, or timeout boundary.
3Send controlled fixtures and inspect the stored rows before enabling an alert.

Snippet

Start with one structured event

Add this shape where the workflow completes, fails, or retries. Then build the dashboard from real fields.

autogen

AutoGen Multi-Agent Telemetry event

python

from time import perf_counter

async def run_agent_team(team, task: str, run_id: str):
    started_at = perf_counter()
    status = "success"
    error_type = None
    result = None

    try:
        result = await team.run(task=task)
        return result
    except Exception as error:
        status = "failed"
        error_type = classify_agent_error(error)
        raise
    finally:
        await telemetry.log("agent_run_completed", {
            "run_id": run_id,
            "workflow": "support_resolution",
            "team_name": "support_team",
            "status": status,
            "error_type": error_type,
            "message_count": len(result.messages) if result else 0,
            "duration_ms": round((perf_counter() - started_at) * 1000),
            "release": APP_RELEASE,
        })

Event contract

run_id, workflow, team_name, agent_count, model_alias, termination_reason, and release

status, duration_ms, message_count, tool_call_count, handoff_count, and error_type

estimated_cost_usd, accepted, human_handoff, evaluation_score, and environment when approved

Implementation checkpoints

Checkpoint 1

Wrap the public agent or team run boundary and emit one terminal outcome; avoid one business event per message unless a specific query requires that grain.

Checkpoint 2

AutoGen supports OpenTelemetry tracing for detailed agent and tool execution. Keep those traces in an OTLP-compatible backend and correlate the outcome by an approved identifier.

Checkpoint 3

Never emit task text, agent messages, tool arguments, tool results, memory, unrestricted stop messages, or exception text by default.

Verification

Prove the event arrived

Run this after exercising known success and failure cases. Replace the fallback table name if your final event contract differs from the snippet.

autogen-verification

AutoGen Multi-Agent Telemetry verification query

sql

SELECT *
FROM agent_run_completed
ORDER BY timestamp_utc DESC
LIMIT 20;

Confirm one terminal row per logical outcome, with the expected status, identifiers, units, and UTC time.

Inspect the inferred schema and verify that retries do not change field types or generate a new logical event ID.

Search the stored fields for credentials, raw payloads, prompts, private content, and unbounded error messages.

Exercise a provider timeout, ingestion rejection, and process shutdown before treating the dashboard as complete.

Implementation references

Review the event contract, data-safety guidance, and upstream primary documentation before enabling a new production path.

OpenTelemetry GenAI outcome events Workflow correlation SQL Agent loop detection SQL AutoGen AgentChat user guide AutoGen tracing and observability

Production boundary

Keep the outcome event small and recoverable

This pattern provides

A bounded, SQL-ready outcome beside the upstream workflow.
Stable fields for dashboards, alerts, and cross-event correlation.
A fixture-driven path for validating success, failure, retry, and timeout behavior.

This pattern does not provide

An OTLP exporter, automatic collection pipeline, or replacement for detailed traces and diagnostic logs.
Exactly-once delivery merely because the payload contains an event ID.
Permission to collect raw provider payloads, user content, credentials, or regulated data.

Delivery and idempotency Batching and shutdown Troubleshoot ingestion

Event schema starting points

Review the row grain, emit boundary, required types, privacy classes, example payload, and validation checklist before adapting a query or snippet to production.

AI agent operations10 fields