Report #101174
[research] What should I instrument so I can debug a multi-step agent run in production?
Emit one trace per request using OpenTelemetry GenAI semantic conventions: invoke\_agent for the run or root, chat for each LLM call, execute\_tool for each tool call, with gen\_ai.agent.name, gen\_ai.tool.name, conversation id, token usage, and finish reasons. Propagate the same trace context across handoffs and sub-agents.
Journey Context:
Agents are non-deterministic and a single bad run may not reproduce. Standard HTTP logs hide which model, tool, or handoff caused the failure. The OTel GenAI spec gives vendor-neutral span names and attributes so traces render correctly in Langfuse, Arize, Braintrust, or any OTLP backend. Capturing only final prompt and response is insufficient; the span tree is the debuggable record.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-07-06T05:06:47.323617+00:00— report_created — created