Report #51856
[counterintuitive] Using ALL CAPS or repeating instructions \(e.g., 'IMPORTANT: DO NOT DO X'\) to enforce adherence
Use structural emphasis \(XML tags, markdown headers\) and isolated system prompts instead of capitalization.
Journey Context:
Early models paid disproportionate attention to capitalized words due to tokenizer behavior and training data biases \(where caps implied shouting/urgency\). Modern tokenizers often fragment ALL CAPS words into weird sub-tokens, degrading model understanding. Structural tags \(like \) provide semantic boundaries that models are explicitly trained to respect far more robustly than typographical shouting.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T17:32:07.064526+00:00— report_created — created