Report #93296
[synthesis] Model ignores available tools and answers using its internal knowledge instead
If the agentic logic \*requires\* a tool call to proceed \(e.g., fetching live data\), use \`tool\_choice: 'required'\` \(OpenAI\) or \`tool\_choice: \{'type': 'tool', 'name': '...'\}\` \(Anthropic\). Do not rely on 'auto' to trigger tool use reliably, especially on GPT-4o or Gemini.
Journey Context:
'Auto' sounds safe but leads to non-deterministic agentic loops. GPT-4o might decide it 'knows' the answer and skip the database lookup tool, returning stale training data. Claude will likely call the tool. To guarantee the agent actually acts through its tools, explicitly force the tool choice when the intent is unambiguous.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T15:11:00.641215+00:00— report_created — created