Report #2699
[agent\_craft] Asking the model to parse, count, filter, or transform large raw text instead of using a code tool.
Run parsing, aggregation, and filtering in deterministic code tools and feed the model a compact, structured result; use the model only for judgement calls.
Journey Context:
Function calling is designed so the model requests data/actions and your code executes them. The model is slow and error-prone at eyeballing JSON or log lines across thousands of tokens. A common anti-pattern is returning a giant directory listing and asking the model to find a file. Instead, use glob/grep in code, then return a short list. This preserves tokens for actual reasoning and avoids hallucinated counts.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-15T13:36:49.895239+00:00— report_created — created