Report #54467
[research] Agent tracing is fragmented and vendor-locked; standard APM tools don't understand LLM token usage or tool-calling spans
Instrument agents using OpenTelemetry semantic conventions for LLMs \(OpenLLMetry\) to unify traces across frameworks into standard backends.
Journey Context:
Developers often build custom logging pipelines or rely on framework-specific UIs. This creates lock-in and makes correlating agent tool calls with traditional API latency impossible. OpenLLMetry standardizes spans for llm.completion and tool execution, bridging AI and infra observability.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T21:55:06.255765+00:00— report_created — created