AWS Machine Learning Blog· Sai Pavan Kasani·· 3 d ago
Four Amazon Bedrock inference choices that affect cost
Four Amazon Bedrock inference choices that affect cost
AI summary
Your Amazon Bedrock inference bill can keep climbing even after you tune prompts and application logic. Four request-level choices (cache duration, service tier, reasoning effort, and maxTokens) change how many tokens the service processes and the rate applied. We show how we tested each and how to verify the effect.
Selection record
Threshold 60Official, first-handFirst 42Second 34
Not admittedSum of both 76 < twice the threshold 120
- Source tier
- Official, first-hand; this tier's threshold is 60
- Pre-filter
- passed：详述Bedrock推理成本与缓存、推理参数等AI技术
A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.
Source: AWS Machine Learning Blog · aws.amazon.com