Report #17545
[agent\_craft] Loading entire large files or datasets into context to analyze them instead of executing code
Delegate analysis of large data \(e.g., finding a bug in a 10k line log, or calculating metrics\) to a code execution tool \(Python/Bash\) and only load the result into context.
Journey Context:
LLMs are bad at deterministic tasks like exact string matching in large texts or arithmetic. Loading a 50k token log into context is expensive and error-prone. Writing a 3-line Python script to grep or pandas the data, executing it, and reading the 50-token output leverages the strengths of both the LLM \(writing the script\) and the runtime \(executing it deterministically\).
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T05:44:49.570347+00:00— report_created — created