Telemetry
For teams governing AI agents that can call tools or change external state

AI Agent Security Monitoring

Monitor tool authorization, policy denials, approval queues, risky action classes, and release changes without storing prompts, credentials, or tool payloads.

Reviewed by the Telemetry product team on . Event contract, recommended analysis, and privacy boundaries. Review standards and ownership

Why this works
  • Keep the agent's requested action separate from the policy engine's decision.
  • Measure denied, allowed, and approval-required outcomes by tool and risk class.
  • Build an investigation timeline from bounded decisions and terminal tool outcomes.
Use-case evidence path

AI Agent Security Monitoring: from implementation to decision

A complete ai agent security monitoring measurement loop connects one owned workflow, a bounded event contract, a controlled fixture, and a question someone can act on.

  1. 1

    Set the boundary

    Inventory tools that read data, write data, execute code, or affect external systems.

  2. 2

    Capture the outcome

    Begin with agent_tool_authorization_decided, agent_tool_completed, agent_policy_changed and document the grain of each event.

  3. 3

    Prove the rows

    Review policy-version changes, denial spikes, and approval backlogs before enabling alerts.

  4. 4

    Make the decision

    Which high-risk tools are denied or routed to approval most often?

Use case versus template

This page explains what to measure and why

Use the use-case guide to choose outcomes, event boundaries, and analysis questions. Open the matching template when you are ready for a shorter copy-paste implementation brief.

Open AI Agent Security Audit Template

Scope and neighboring use cases

Choose this page for the right measurement boundary

  • Use this page for agent tool authorization, human approval, and policy-decision analysis.
  • Use AI agent observability for latency, cost, retries, and end-to-end run reliability.
  • Use security audit-log analytics for authentication and privileged actions outside the agent boundary.

Agent prompt

Paste this into your coding agent

Replace YOUR_API_KEY after signup, then ask the agent to run the product flow and verify the first events.

agent prompt

AI Agent Security Monitoring setup prompt

text
Instrument AI agent security decisions with Telemetry.

Use /skill.md and this Telemetry API key: YOUR_API_KEY

Before every consequential tool call, log agent_tool_authorization_decided with event_id, run_id, tool_call_id, workflow, tool_name, action_class, risk_level, decision, reason_code, policy_version, release, environment, and timestamp_utc. Use only bounded values. Log the terminal tool outcome separately with the same run_id and tool_call_id.

Create dashboards for decisions by tool and risk level, denial rate, approval-required volume, policy-version changes, and allowed actions that later fail. Keep counts beside rates and require a minimum sample size before alerting.

Never log raw prompts, completions, credentials, authorization headers, tool arguments, tool results, retrieved documents, customer content, or free-form policy explanations. Do not treat these analytics as a replacement for least privilege, sandboxing, authorization enforcement, or an immutable security evidence store.

Setup steps

  1. 1Inventory tools that read data, write data, execute code, or affect external systems.
  2. 2Define controlled action, risk, decision, and reason fields with the security owner.
  3. 3Emit an authorization decision before each consequential tool call and a separate terminal outcome afterward.
  4. 4Review policy-version changes, denial spikes, and approval backlogs before enabling alerts.

Events to capture

agent_tool_authorization_decidedagent_tool_completedagent_policy_changedagent_approval_resolvedagent_run_completed

Questions unlocked

  • Which high-risk tools are denied or routed to approval most often?
  • Did a policy or agent release change the authorization mix?
  • Which allowed actions later fail or require an incident review?

Event schema starting points

Review the row grain, emit boundary, required types, privacy classes, example payload, and validation checklist before adapting a query or snippet to production.

Related product capability

Continue this workflow in AI agent monitoring

Connect agent runs, tool use, model cost, quality, and product outcomes with reviewable SQL.

Related SQL recipes

Answer the next question with SQL

Run the query against the structured fields from this workflow, inspect the example result, and turn a useful answer into a dashboard or alert.

Browse all recipes

Next step

Create the API key your agent will use

The free plan is enough to run the prompt, send test events, and review the first dashboard.

Related pages