Skip to content

CDK solution to update SageMaker endpoints with auto-scaling

Save

In brief

  1. Updating SageMaker endpoints with auto-scaling fails via CloudFormation/CDK without prior deregistration.
  2. A CDK construct automates deregistration and re-registration of auto scaling during deployments.
  3. The solution uses three custom resources and a ConfigHash to synchronize parameters.

AWS CloudFormation and AWS CDK deployments fail when updating an Amazon SageMaker AI endpoint configured with Application Auto Scaling. According to the announcement, SageMaker blocks the update as long as the scalable target remains registered, causing deployment errors.

This post introduces a reusable CDK construct that combines CloudFormation custom resources to automatically deregister and re-register auto scaling during endpoint updates. The approach uses three custom resources managing operation order through explicit dependencies in CDK.

This solution prevents deployment failures and corrupted states, ensuring auto scaling remains active after updates. A sample stack is available for immediate implementation or integration into existing projects.

What it changes for you

  • Public SectorPublic administrations using SageMaker for public services must update their CI/CD pipelines to prevent service disruptions during endpoint updates.

This summary gives you the essentials. The full article, its figures and quotes are on Artificial Intelligence.

Read the original article

AI-generated summary of the source, checked by rules. How we write · Report an error

Cookies and privacy

BrefAI only uses strictly necessary storage (language, theme, this choice). With your consent, we also measure traffic anonymously, without cookies, to improve the site. Learn more