AWS Machine Learning Blog· Dustin Liu·· 11 h ago
Use prompt caching with open-weight models on Amazon Bedrock
Use prompt caching with open-weight models on Amazon Bedrock
AI summary
Many generative AI applications resend the same long context on every request. Prompt caching lets open-weight models on Amazon Bedrock reuse it to reduce input cost and latency. This post shows implicit and explicit caching through the Chat Completions API and applies caching to an OpenCode coding agent session.
Selection record
Threshold 60Official, first-handFirst 34Second 38
Not admittedSum of both 72 < twice the threshold 120
- Source tier
- Official, first-hand; this tier's threshold is 60
- Pre-filter
- passed:AWS博客讲Bedrock提示缓存与AI模型推理
A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.
Source: AWS Machine Learning Blog · aws.amazon.com