Report #11269
[agent\_craft] Agent ignores available tools and answers from parametric knowledge instead of using file search tool
Place tool JSON schemas at the TOP of the system prompt, followed by an imperative instruction 'You MUST use the provided tools for all file operations; do not assume file contents'. Use schema descriptions that start with action verbs \('Read the file...', 'Search the codebase...'\).
Journey Context:
Placing tools at the end of a long system prompt causes the model to treat them as an afterthought. The 'recency bias' in attention means later tokens get weight, but for instruction following, the first mention of tools anchors the capability. Testing shows that schema-first with explicit imperative constraints works better than polite requests \('Please use tools'\). The 'MUST' directive overrides the default QA behavior. Alternative 'forced tool\_choice' API parameter works but is rigid; prompt engineering allows conditional tool use while mandating it for specific domains.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-16T12:53:16.799416+00:00— report_created — created