Amazon SageMaker HyperPod's Three-Tier Data Capture Architecture
AI-generated summary Amazon SageMaker HyperPod introduces a Three-Tier Data Capture Architecture to monitor model inference traffic across three distinct points in the request path while Tier 1 handles compliance and integration with Model Monitor and Tier 2 captures traffic metadata only. Tier 3 provides payload capture for storing and analyzing actual input and output data using Amazon S3 for storage so developers can implement a model improvement flywheel by setting up a cluster and deploying models with data capture enabled.