Report #54042
[agent\_craft] Tool ordering in system prompt causes later tools to be ignored
Prioritize tool ordering by frequency/likelihood of use; place critical tools first 1K tokens, avoid listing >20 tools without hierarchical grouping.
Journey Context:
Transformers exhibit recency bias \(last items attended more\) and primacy bias \(first items\), but middle items in long lists suffer. If 'read\_file' is tool \#20 in a list of 25, the model may hallucinate file content rather than call it. Empirical studies on tool retrieval show top-K ranking matters. Grouping into namespaces \(file\_ops, network\_ops\) with a router tool reduces list length.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T21:12:13.601489+00:00— report_created — created