Claude Agent SDK Telemetry: from boundary to verified row
Use Claude Agent SDK Telemetry at a controlled application boundary, keep the event contract small, and verify a known outcome before building aggregate views.
- 1
Choose the outcome
Claude agent run observability
- 2
Define the contract
run_id, workflow, agent_name, model_alias, and prompt_version
- 3
Instrument the boundary
Wrap the public query or client boundary and emit one application outcome after the SDK stream reaches a terminal result; do not depend on undocumented message fields.
- 4
Verify the evidence
Exercise a known fixture, then inspect agent_run_completed for one correctly typed terminal row.
Before you start
Prerequisites and boundaries
- @anthropic-ai/claude-agent-sdk and telemetry-sh running in a trusted server or worker process
- An application-owned run ID, workflow name, and terminal outcome taxonomy
- A reviewed policy for permissions, prompt content, tool inputs, tool results, and file paths
Delivery setup
Install and initialize server-side
Import telemetry-sh in server-only code and initialize it once with process.env.TELEMETRY_API_KEY. Keep ingestion credentials out of browser bundles, client-visible environment variables, source control, logs, and exception messages.
npm installation
npm install telemetry-sh- 1Prepare one reusable server-side delivery client with bounded network behavior.
- 2Add the outcome event at the success, failure, retry, or timeout boundary.
- 3Send controlled fixtures and inspect the stored rows before enabling an alert.
Snippet
Start with one structured event
Add this shape where the workflow completes, fails, or retries. Then build the dashboard from real fields.
Claude Agent SDK Telemetry event
import { query } from "@anthropic-ai/claude-agent-sdk";
async function runSupportAgent(prompt, runId) {
const startedAt = performance.now();
let status = "success";
let turnCount = 0;
let toolCallCount = 0;
try {
for await (const message of query({
prompt,
options: { maxTurns: 8 },
})) {
turnCount += message.type === "assistant" ? 1 : 0;
toolCallCount += countToolCalls(message);
}
} catch (error) {
status = "failed";
throw error;
} finally {
await telemetry.log("agent_run_completed", {
run_id: runId,
workflow: "support_resolution",
agent_name: "support_agent",
status,
turn_count: turnCount,
tool_call_count: toolCallCount,
duration_ms: Math.round(performance.now() - startedAt),
release: process.env.APP_RELEASE,
});
}
}Event contract
run_id, workflow, agent_name, model_alias, and prompt_version
status, duration_ms, turn_count, tool_call_count, and estimated_cost_usd
permission_denial_count, max_turns_reached, reviewer_outcome, release, and environment
Implementation checkpoints
Checkpoint 1
Wrap the public query or client boundary and emit one application outcome after the SDK stream reaches a terminal result; do not depend on undocumented message fields.
Checkpoint 2
Keep Anthropic's SDK observability or traces for step-level diagnostics and send only approved aggregate outcome fields to Telemetry.
Checkpoint 3
Exercise permission denial, tool failure, maximum-turn, cancellation, and process-shutdown paths before alerting on completion rate.
Verification
Prove the event arrived
Run this after exercising known success and failure cases. Replace the fallback table name if your final event contract differs from the snippet.
Claude Agent SDK Telemetry verification query
SELECT *
FROM agent_run_completed
ORDER BY timestamp_utc DESC
LIMIT 20;Implementation references
Review the event contract, data-safety guidance, and upstream primary documentation before enabling a new production path.
Production boundary
Keep the outcome event small and recoverable
This pattern provides
- A bounded, SQL-ready outcome beside the upstream workflow.
- Stable fields for dashboards, alerts, and cross-event correlation.
- A fixture-driven path for validating success, failure, retry, and timeout behavior.
This pattern does not provide
- An OTLP exporter, automatic collection pipeline, or replacement for detailed traces and diagnostic logs.
- Exactly-once delivery merely because the payload contains an event ID.
- Permission to collect raw provider payloads, user content, credentials, or regulated data.
Event schema starting points
Event contracts for this workflow
Review the row grain, emit boundary, required types, privacy classes, example payload, and validation checklist before adapting a query or snippet to production.
llm_request_completed
One completed model-provider request.
Inspect contractai_agent_run_completed
One terminal outcome per logical agent run.
Inspect contractagent_tool_call_completed
One completed tool-call attempt within an agent run.
Inspect contractRelated product capability
Continue this workflow in AI agent monitoring
Connect agent runs, tool use, model cost, quality, and product outcomes with reviewable SQL.
Related SQL recipes
Answer the next question with SQL
Run the query against the structured fields from this workflow, inspect the example result, and turn a useful answer into a dashboard or alert.
Measure AI Agent Task Success and Human Handoff
Which agent workflows finish successfully and produce accepted outcomes?
Open recipeQuery Nested AI Tool-Call Events
Which AI tools and arguments are associated with the most failed calls?
Open recipeDetect Repeating AI Agent Tool Loops
Which agent runs appear stuck in a repetitive tool loop?
Open recipeReconstruct a Correlated Workflow Timeline
What happened, in order, during the latest failed workflow?
Open recipeCalculate LLM Cost by Feature and Model
Which product features and models are driving LLM spend?
Open recipeMeasure Accepted AI Outputs per Dollar
Which model and feature combination produces the most accepted outputs per dollar?
Open recipeBrowse by implementation family
Compare related integration patterns
Templates to pair with this integration
AI Agent Observability Template
Track agent runs, tool calls, retries, model latency, errors, and accepted outcomes with structured SQL-ready events.
Open templateAI Agent Security Audit Template
Instrument tool authorization decisions, policy versions, human approvals, and terminal outcomes with privacy-safe structured events.
Open templateLLM Cost Tracker
Measure model spend, token usage, latency, failure rate, and value signals by feature, user, and account.
Open templateMore integrations
OpenAI Agent Telemetry
Log OpenAI agent runs, tool calls, model usage, latency, cost, and final outcomes with structured events.
Open guideCrewAI Workflow Telemetry
Track CrewAI crew and flow outcomes, task counts, handoffs, retries, latency, cost, and accepted results without retaining agent conversations.
Open guidePydantic AI Agent Telemetry
Measure Pydantic AI run outcomes, validated outputs, retries, tool activity, latency, usage, and product acceptance with safe structured events.
Open guide