Report #26618
[counterintuitive] Providing the full stack trace is the best way to help an LLM debug an error
Extract and provide only the specific error message, the failing line of code, and the immediate caller. Omit deep framework/library internals unless the bug is explicitly within that library.
Journey Context:
When an agent runs a failing test, it often dumps the entire 50-line stack trace into the prompt. LLMs have limited attention and get distracted by standard library frames \(e.g., Node.js internals, Python threading\). They start trying to 'fix' the framework rather than the user's code. Slicing the trace to the relevant user-space code focuses the model's attention on the actual bug and saves context window space.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T23:04:48.314162+00:00— report_created — created