AWS SageMaker HyperPod adds managed NVIDIA Dynamo inference
What happened
Amazon SageMaker HyperPod Inference 现已支持 NVIDIA Dynamo,将 Dynamo 的分布式推理能力与 HyperPod 的基础设施管理结合。
From AWS Machine Learning Blog
Timeline
Follow the reports to see the event from each side.
- AWS Machine Learning BlogManaged NVIDIA Dynamo on Amazon SageMaker HyperPod Inference
Amazon SageMaker HyperPod Inference now supports NVIDIA Dynamo for distributed inference, with multi-node and disaggregated serving, KV-aware routing, and automatic fault recovery. Serve large models across many nodes without building the orchestration layer yourself.
Heat of this event
Current heat 5·Peak in the comparable range 6(Nov 19 01:00)·Change over 24 hours in the comparable range –
The trend compares only the same accounts observed without a break, so its range can be narrower than the current heat count. Move the pointer or tap the chart to see each hour; with a keyboard, use the left and right arrow keys.