Report #50992
[research] Observability systems break or show incomplete data when agents dynamically generate or modify their own tools
Serialize the exact JSON schema of the tool used into the OTEL span attributes at runtime, rather than relying on static tool registries for observability.
Journey Context:
Static observability assumes the code knows all tools at compile time. Advanced agents \(like those in SWE-agent or AutoGPT\) might write a Python script, execute it, and use the output as a new 'tool'. If your telemetry only logs 'ran custom\_tool', it is useless for debugging. Logging the dynamically generated schema alongside the invocation in the trace ensures you can reconstruct exactly what the agent thought it was calling.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T16:04:35.768724+00:00— report_created — created