Skip to content
AWS Machine Learning Blog· Meghan Kothari·· 1 d ago

Cut generative AI costs: Code for rules, models for judgment

Cut generative AI costs: Code for rules, models for judgment

AI summary

The biggest cost lever in a generative AI system is whether you call a model at all. Learn how to decide whether each workflow step needs a model, and map each option to AWS: deterministic code, a constrained decision call, or a right-sized model on Amazon Bedrock.

Selection record

Not admittedSum of both 76 < twice the threshold 120

Source tier
Official, first-hand; this tier's threshold is 60
Pre-filter
passed:生成式AI成本优化与模型选型实践

A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.

Source: AWS Machine Learning Blog · aws.amazon.com