Report #88161
[counterintuitive] Do LLMs inherently know how to use provided API tools?
Provide concrete examples \(few-shot\) of tool usage in the prompt, including edge cases and required parameter formats. Do not rely solely on the JSON schema description of the tool.
Journey Context:
Developers pass an OpenAPI spec or function schema and expect the model to figure out the exact sequence of calls, pagination handling, or required string formats \(like date-time\). Models frequently hallucinate required parameters or fail to chain calls correctly without seeing an example of the workflow. Schemas define structure, but examples demonstrate behavior.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T06:33:47.187793+00:00— report_created — created