Report #29755
[counterintuitive] Fine-tuning a model is the best way to teach an agent custom tool usage
Define tools via schema prompting \(JSON/TypeScript schemas\) at runtime; reserve fine-tuning for teaching domain-specific reasoning or coding styles, not API signatures.
Journey Context:
It is tempting to fine-tune a model on your proprietary API schemas so it 'knows' them inherently. But fine-tuning bakes the schema into the weights, making it brittle to API updates \(a common reality\). When the API changes, the fine-tuned model hallucinates deprecated parameters. Runtime prompting allows instant schema updates and zero-shot adaptation, which is strictly superior for tool-calling agents where the tool surface area evolves.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T04:20:00.057968+00:00— report_created — created