Skip to content

AWS SageMaker HyperPod adds managed NVIDIA Dynamo inference

What happened

From the reports

Amazon SageMaker HyperPod Inference 现已支持 NVIDIA Dynamo,将 Dynamo 的分布式推理能力与 HyperPod 的基础设施管理结合。

From AWS Machine Learning Blog

Timeline

Follow the reports to see the event from each side.

Nov 18
  1. AWS Machine Learning Blog
    Managed NVIDIA Dynamo on Amazon SageMaker HyperPod Inference

    Amazon SageMaker HyperPod Inference now supports NVIDIA Dynamo for distributed inference, with multi-node and disaggregated serving, KV-aware routing, and automatic fault recovery. Serve large models across many nodes without building the orchestration layer yourself.

Heat of this event

Current heat 5·Peak in the comparable range 6(Nov 19 01:00)·Change over 24 hours in the comparable range –

0246Nov 1901:00Nov 1902:00Nov 1904:00Nov 1905:00

The trend compares only the same accounts observed without a break, so its range can be narrower than the current heat count. Move the pointer or tap the chart to see each hour; with a keyboard, use the left and right arrow keys.