AWS Machine Learning Blog· Claudio Mazzoni·· 5 h ago
Groundhog Day for AI agents: Prompt caching patterns for using OpenAI models on Amazon Bedrock
Groundhog Day for AI agents: Prompt caching patterns for using OpenAI models on Amazon Bedrock
AI summary
Every time an agent takes a step, it re-reads its entire context before acting. Here is how prompt caching for OpenAI models on Amazon Bedrock lets your agent remember, cutting input cost and latency without resending the same tools, instructions, and history every turn.
Selection record
Threshold 60Official, first-handFirst 34Second 34
Not admittedSum of both 68 < twice the threshold 120
- Source tier
- Official, first-hand; this tier's threshold is 60
- Pre-filter
- passed：AI Agent提示缓存技术教程
A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.
Source: AWS Machine Learning Blog · aws.amazon.com