Temporal Workflow Observability: from boundary to verified row
Use Temporal Workflow Observability at a controlled application boundary, keep the event contract small, and verify a known outcome before building aggregate views.
- 1
Choose the outcome
Workflow completion monitoring
- 2
Define the contract
workflow_type, workflow_id, run_id, and status
- 3
Instrument the boundary
Send Telemetry events from an activity or worker interceptor, not directly from deterministic workflow code.
- 4
Verify the evidence
Exercise a known fixture, then inspect workflow_completed for one correctly typed terminal row.
Before you start
Prerequisites and boundaries
- A server-side TELEMETRY_API_KEY
- Stable workflow and activity type names
- A non-replayed boundary for external telemetry calls
Delivery setup
Install and initialize server-side
Import telemetry-sh in server-only code and initialize it once with process.env.TELEMETRY_API_KEY. Keep ingestion credentials out of browser bundles, client-visible environment variables, source control, logs, and exception messages.
npm installation
npm install telemetry-sh- 1Prepare one reusable server-side delivery client with bounded network behavior.
- 2Add the outcome event at the success, failure, retry, or timeout boundary.
- 3Send controlled fixtures and inspect the stored rows before enabling an alert.
Snippet
Start with one structured event
Add this shape where the workflow completes, fails, or retries. Then build the dashboard from real fields.
Temporal Workflow Observability event
await telemetry.log("workflow_completed", {
workflow_type: info.workflowType,
workflow_id: info.workflowId,
run_id: info.runId,
task_queue: info.taskQueue,
status: "success",
duration_ms: Date.now() - startedAt,
business_outcome: result.category,
});Event contract
workflow_type, workflow_id, run_id, and status
activity_type, attempt, queue_name, and duration_ms
error_type, business_outcome, and release
Implementation checkpoints
Checkpoint 1
Send Telemetry events from an activity or worker interceptor, not directly from deterministic workflow code.
Checkpoint 2
Keep the logical workflow ID stable while recording Temporal run IDs separately.
Checkpoint 3
Do not log workflow arguments, search attributes containing private data, or activity results.
Verification
Prove the event arrived
Run this after exercising known success and failure cases. Replace the fallback table name if your final event contract differs from the snippet.
Temporal Workflow Observability verification query
SELECT *
FROM workflow_completed
ORDER BY timestamp_utc DESC
LIMIT 20;Implementation references
Review the event contract, data-safety guidance, and upstream primary documentation before enabling a new production path.
Production boundary
Keep the outcome event small and recoverable
This pattern provides
- A bounded, SQL-ready outcome beside the upstream workflow.
- Stable fields for dashboards, alerts, and cross-event correlation.
- A fixture-driven path for validating success, failure, retry, and timeout behavior.
This pattern does not provide
- An OTLP exporter, automatic collection pipeline, or replacement for detailed traces and diagnostic logs.
- Exactly-once delivery merely because the payload contains an event ID.
- Permission to collect raw provider payloads, user content, credentials, or regulated data.
Event schema starting points
Event contracts for this workflow
Review the row grain, emit boundary, required types, privacy classes, example payload, and validation checklist before adapting a query or snippet to production.
Related product capability
Continue this workflow in Alerts
Promote the reviewed reliability query into an owned threshold and response workflow.
Related SQL recipes
Answer the next question with SQL
Run the query against the structured fields from this workflow, inspect the example result, and turn a useful answer into a dashboard or alert.
Measure Background Job Retry and Failure Rate
Which background jobs consume the most retries or still fail?
Open recipeMeasure Queue Wait Time by Job
Which jobs wait longest before a worker starts them?
Open recipeFind Stalled Background Jobs With SQL
Which jobs started but never produced a terminal event?
Open recipeDetect Background-Job Retry Storms
Which job types are spending the most work on retries right now?
Open recipeBrowse by implementation family
Compare related integration patterns
Templates to pair with this integration
More integrations
Sidekiq Job Telemetry
Track Sidekiq execution outcomes, attempts, queue wait, errors, and releases from server middleware without copying job arguments.
Open guideInngest And Trigger.dev Job Telemetry
Instrument async workers, scheduled jobs, retries, failures, and dead-letter events with SQL-ready logs.
Open guideBullMQ Queue Monitoring
Measure BullMQ queue wait, execution duration, retries, failures, and dead-letter growth with SQL-ready lifecycle events.
Open guide