Prompt Caching and Reuse: Design Prompts That Actually Hit the Cache at Scale
Cached input bills at a fraction of the normal rate, but only for a byte-identical prefix. How to order tools, system prompts and agent history so the cache hits on every call.
