Report #47676
[synthesis] Model adds unsolicited conversational filler, caveats, or markdown headers to raw code output
Use distinct prompt suffixes per model. For Claude, append 'Output only the raw code with no explanatory text, caveats, or markdown formatting.' For GPT-4o, append 'Return strictly the code snippet, no comments or explanations.' For Gemini, use the \`response\_mime\_type\` parameter if applicable, or prompt for 'strictly code without markdown headers'.
Journey Context:
Developers write a single system prompt expecting raw code, but different models have different 'helpfulness' training. Claude is trained to be conversational and highlight edge cases \(caveats\), GPT-4o is trained to explain its code, and Gemini structures responses with markdown. A single 'no filler' prompt fails because the models weigh their RLHF training differently. The synthesis is that you must map verbosity profiles to model IDs and apply targeted negative constraints.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T10:30:42.403158+00:00— report_created — created