Report #93926
[cost\_intel] Anthropic prompt cache misses silently when system prompt contains dynamic data like timestamps or request IDs
Keep the first 1024 tokens of the prompt \(the cacheable prefix\) completely static. Move dynamic data \(timestamps, user IDs, session tokens\) after the 1024 token boundary or into the user message.
Journey Context:
Anthropic's prompt caching charges 25% premium on cache writes but gives 90% discount on cache hits \(10% of base cost\). However, the cache key is a hash of the exact text. If your system prompt includes a timestamp or UUID at the top, every request is a cache miss, turning a $0.30 call into a $3.00 call. The 1024 token prefix rule means you must place static instructions first, dynamic context after.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T16:14:32.210737+00:00— report_created — created