Skip to content

AWS Bedrock adds prompt caching for open-weight models

What happened

AI digest

On 16 November 2026, the AWS Machine Learning Blog published a post on using prompt caching with open-weight models on Amazon Bedrock. According to the post, open-weight models on Bedrock now support explicit prompt caching, which reuses the computed state of an identical prompt prefix to cut input costs and response latency. Caching comes in two modes: implicit caching is automatic and best-effort, while explicit caching marks breakpoints via prompt_cache_options. Cache reads are billed below the standard input price. This is the only report on the matter so far, with no follow-up developments or contradictions from other reports.

Written by AI from the reports · updated 10 h ago

Timeline

Follow the reports to see the event from each side.

Nov 16
  1. AWS Machine Learning Blog
    Use prompt caching with open-weight models on Amazon Bedrock

    Many generative AI applications resend the same long context on every request. Prompt caching lets open-weight models on Amazon Bedrock reuse it to reduce input cost and latency. This post shows implicit and explicit caching through the Chat Completions API and applies caching to an OpenCode coding agent session.

Heat of this event

Current heat 7·Peak in the comparable range 10(Nov 17 01:00)·Change over 24 hours in the comparable range –

02.557.510Nov 1701:00Nov 1704:00Nov 1707:00Nov 1710:00

The trend compares only the same accounts observed without a break, so its range can be narrower than the current heat count. Move the pointer or tap the chart to see each hour; with a keyboard, use the left and right arrow keys.