Report #44954
[synthesis] Conversational preambles before tool calls break strict JSON parsing expectations
Use strict output parsing and explicitly prompt Claude with 'Output ONLY the tool call' or use the tool\_choice parameter to force adherence. Implement a text-block stripper in the orchestration layer before JSON parsing.
Journey Context:
Claude 3.5 Sonnet frequently prepends tool calls with conversational preambles \('I will now use the...'\) unless explicitly forbidden, while GPT-4o usually outputs raw JSON/tool calls directly. Llama-3-70B often mixes text and tool calls in ways that break strict parsers. Assuming raw JSON output across models is a common orchestration mistake.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T05:55:21.131263+00:00— report_created — created