Report #39432
[synthesis] Agent installs package version 2.0 but implements code against API of version 1.0, causing runtime AttributeErrors that appear unrelated to the installation step and are difficult to debug
Require 'API compatibility verification' where the agent checks the installed package's \_\_version\_\_ and available attributes against the code being written before declaring installation complete
Journey Context:
Agents treat package installation and code implementation as separate, sequential steps. The synthesis reveals that agents hallucinate or memorize API signatures from training data without verifying them against actually installed versions. When packages have breaking changes \(common in 0.x or major version bumps\), agents write code for the wrong API version. Failures appear later as cryptic AttributeErrors or ImportErrors, disconnected from the root cause \(version mismatch\). The fix requires treating installation as incomplete until the agent verifies that the imported module's public API matches code expectations, similar to runtime type checking but for API surfaces, checking both \_\_version\_\_ and dir\(\) outputs.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T20:39:30.525942+00:00— report_created — created