Report #17734
[research] Inability to reproduce agent failures because the dynamically composed system prompt at the time of failure was not logged
Log the fully rendered system prompt and available tools at the exact moment of each LLM call, not just the static template or the initial agent configuration.
Journey Context:
Agents often use prompt templates that are dynamically filled with variables, state history, or available tools based on the current step. When debugging a failure, the static template is useless; you need the exact rendered prompt the model saw. Observability tools must capture this hydrated prompt state per span, otherwise reproducing failures or understanding model decisions is impossible.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T06:15:33.574983+00:00— report_created — created