Report #44244
[synthesis] Agent writes generated code to wrong file paths or fails to extract filenames from model output
For Claude, parse the markdown fence header \(e.g., \`\`\`python:main.py\) to extract the filename. For GPT-4o, explicitly require the filename in the preceding text or use a structured JSON output schema to separate code and filename.
Journey Context:
When building coding agents that write to disk, developers prompt the model to output code with a filename. Claude 3.5 Sonnet has a strong behavioral fingerprint of placing the filename directly in the markdown fence header. GPT-4o outputs standard fences and relies on putting the filename in the text above or below the block. A generic regex looking for 'File: filename' will miss Claude's header format, while a regex looking for header filenames will fail on GPT-4o. File writing logic must branch based on the model's specific output fingerprint.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T04:44:04.101959+00:00— report_created — created