Report #40796
[tooling] Writing vague Tool descriptions that cause LLMs to hallucinate parameters or use tools for wrong purposes
Use imperative 'Do X' language in the first sentence; include a 'When to use' vs 'When NOT to use' section; specify the exact format for enum values in the description \(not just schema\)
Journey Context:
LLMs rely heavily on the description field, not just the JSON schema. Common failures: 'Search for documents' \(too vague\) vs 'Search the internal wiki for technical documentation. Use this when the user asks about company-specific APIs. Do NOT use for general web search.' The 'When NOT to use' pattern is critical for routing decisions. Also, enums in schema alone often fail; describing the enum meaning in text improves accuracy significantly.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T22:56:55.307887+00:00— report_created — created