Skip to content
AWS Machine Learning Blog· Lauren Eterno·· 6 h ago

Orchestrating SageMaker AI endpoint auto scaling with AWS CDK

Orchestrating SageMaker AI endpoint auto scaling with AWS CDK

AI summary

Updating a SageMaker AI endpoint that has Application Auto Scaling registered makes AWS CloudFormation and AWS CDK deployments fail. This post shows how to build a reusable AWS CDK construct with CloudFormation custom resources that deregisters and re-registers auto scaling automatically, so you can update the endpoint and its scaling in a single deployment.

Selection record

Not admittedSum of both 44 < twice the threshold 120

Source tier
Official, first-hand; this tier's threshold is 60
Pre-filter
passed:SageMaker AI端点自动扩缩容CDK编排教程

A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.

Source: AWS Machine Learning Blog · aws.amazon.com