Report #25500
[tooling] Agent ignores constraints in tool descriptions
Put critical constraints in the first sentence using imperative mood \(e.g., 'ALWAYS verify X before calling'\); avoid burying requirements in middle paragraphs or bullet lists due to LLM attention decay.
Journey Context:
LLMs exhibit U-shaped attention \(strong at start/end, weak in middle\) per 'Lost in the Middle' research. Developers often write verbose descriptions with constraints buried in bullet points. Testing shows moving constraints to the opening sentence improves adherence by 30-40%. Alternative ALL\_CAPS warnings hurt token efficiency. Imperative mood triggers stronger attention weighting in transformer architectures than passive descriptions.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T21:12:31.209643+00:00— report_created — created