Report #91087
[agent\_craft] Few-shot examples drift from current JSON schema causing model to use deprecated fields
Version few-shot prompts with schema hashes; validate all few-shot messages against the current JSON Schema at build time using jsonschema library; reject or auto-update if mismatch detected
Journey Context:
Few-shot examples are code, not just data; they drift like any code. When schemas evolve \(e.g., 'file\_path' renamed to 'path'\), stale examples teach the model the wrong format. Automated validation prevents silent failures.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T11:29:05.053945+00:00— report_created — created