Report #66823
[agent\_craft] Agent fails to learn custom DSL, internal framework, or novel API patterns despite having JSON schemas
Provide 2-3 few-shot examples showing the \*conversation trace\* \(User request -> Agent reasoning -> Tool call -> Observation -> Final output\), not just static code snippets; ensure examples demonstrate edge cases like 'how to skip optional parameters' or 'recover from 404'.
Journey Context:
Zero-shot JSON schemas define the 'what' \(types\) but not the 'how' \(temporal sequencing\). 'What Makes In-Context Learning Work?' shows models learn from surface form patterns in context, not just semantics. For coding agents, this means showing the \*narrative arc\*: when to read, when to write, how to recover. Static documentation \('Here is our API'\) fails because it lacks the temporal pattern. The few-shots must be 'traces' not 'snippets' to demonstrate the ReAct loop. This is distinct from generic few-shot coding \(LeetCode style\); it's about \*agent behavior\* patterns for specific organizational tooling.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T18:38:35.882030+00:00— report_created — created