Send and verify events with Kubernetes workload telemetry
Use Kubernetes workload telemetry where your app knows the final result. Collect only the fields you need, then verify a test event before building charts.
- 1
Choose the outcome
Container restart analysis
- 2
Define the contract
cluster, namespace, workload, pod, event_name, and environment
- 3
Log the final result
Resolve each pod to its Deployment, StatefulSet, DaemonSet, or Job owner before reporting so dashboards do not fragment across short-lived pod names.
- 4
Check the stored event
Exercise a known fixture, then inspect kubernetes_workload_event for one correctly typed terminal row.
Before you start
Before you start
- A collector or controller with read-only access to the workload status fields in scope
- Stable cluster, namespace, workload-owner, and application-release labels
- A redaction policy that excludes Secrets, manifests, environment values, raw logs, and customer payloads
Delivery setup
Install and initialize server-side
Import telemetry-sh in server-only code and initialize it once with process.env.TELEMETRY_API_KEY. Keep ingestion credentials out of browser bundles, client-visible environment variables, source control, logs, and exception messages.
npm installation
npm install telemetry-sh- 1Create one reusable server-side client. Set its timeout and retry limit.
- 2Log an event when the operation succeeds, fails, retries, or times out.
- 3Send test events with known results and inspect the stored rows before enabling an alert.
Snippet
Start with one structured event
Add this shape where the workflow completes, fails, or retries. Then build the dashboard from real fields.
Kubernetes workload telemetry event
import telemetry from "telemetry-sh";
export async function logKubernetesWorkloadSample({
cluster,
namespace,
workload,
pod,
restartCount,
ready,
applicationRelease,
previousRestartCount,
}) {
const eventName =
restartCount > previousRestartCount
? "container_restarted"
: "workload_sampled";
await telemetry.log("kubernetes_workload_event", {
cluster,
namespace,
workload,
pod,
event_name: eventName,
restart_count: restartCount,
ready,
application_release: applicationRelease,
environment: "production",
});
}Event schema
cluster, namespace, workload, pod, event_name, and environment
restart_count, ready, rollout_id, application_release, and observed_generation
A reason category from a fixed list, only when the source value is approved for collection
Check your setup
Checkpoint 1
Resolve each pod to its Deployment, StatefulSet, DaemonSet, or Job owner before reporting so dashboards do not fragment across short-lived pod names.
Checkpoint 2
Emit a container_restarted transition when the cumulative counter increases; keep the counter as context and never sum gauge samples.
Checkpoint 3
Correlate repeated restarts with sustained readiness loss and application outcomes before paging.
Verification
Prove the event arrived
Run this after exercising known success and failure cases. Replace the fallback table name if your final event contract differs from the snippet.
Kubernetes workload telemetry verification query
SELECT *
FROM kubernetes_workload_event
ORDER BY timestamp_utc DESC
LIMIT 20;Implementation references
Review the event contract, data-safety guidance, and upstream primary documentation before enabling a new production path.
Where to log
Keep the outcome event small and recoverable
This pattern provides
- Record the outcome as an event you can query with SQL.
- Stable fields for dashboards, alerts, and cross-event correlation.
- Test events for checking success, failure, retries, and timeouts.
This pattern does not provide
- An OTLP exporter, automatic collection pipeline, or replacement for detailed traces and diagnostic logs.
- Exactly-once delivery merely because the payload contains an event ID.
- Permission to collect raw provider payloads, user content, credentials, or regulated data.
Example event schemas
Event schemas for this workflow
Check what each event records, when to send it, and which field types it needs. Review the example payload and privacy checklist before using it in production.
Use these queries in Telemetry
Learn about Alerts
Add a threshold and recipients to your reliability query to get alerts.
Related SQL recipes
More SQL recipes
Run the query using this workflow's event fields and check the example result. Save the result to a dashboard or set up an alert.
Find Kubernetes restarts by workload
Which Kubernetes workloads are restarting and failing readiness checks?
Open recipeFind host and container resource saturation
Which infrastructure sources are persistently resource constrained?
Open recipeCalculate incident detection and recovery time
How long does each service take to detect and recover from incidents?
Open recipeDetect missing service heartbeats
Which expected telemetry sources have stopped sending heartbeats?
Open recipeBrowse by implementation family
Compare related integration patterns
Templates to pair with this integration
More integrations
AWS ECS and Fargate telemetry integration
Add ECS task family, revision, availability zone, and release context to application outcomes using the local task metadata endpoint.
Open guiden8n workflow telemetry
Use the n8n HTTP Request node to send approved fields for workflow completion, failure, retries, item counts, and downstream delivery results to Telemetry.
Open guideAWS Lambda structured event monitoring
Track Lambda invocations, cold starts, duration, retries, and business outcomes with compact structured events.
Open guide