Skip to content
AWS Machine Learning Blog· Dustin Liu·· 11 h ago

Use prompt caching with open-weight models on Amazon Bedrock

Use prompt caching with open-weight models on Amazon Bedrock

AI summary

Many generative AI applications resend the same long context on every request. Prompt caching lets open-weight models on Amazon Bedrock reuse it to reduce input cost and latency. This post shows implicit and explicit caching through the Chat Completions API and applies caching to an OpenCode coding agent session.

Selection record

Not admittedSum of both 72 < twice the threshold 120

Source tier
Official, first-hand; this tier's threshold is 60
Pre-filter
passed:AWS博客讲Bedrock提示缓存与AI模型推理

A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.

Source: AWS Machine Learning Blog · aws.amazon.com