AWS Adds NVIDIA GPU Partitioning to SageMaker Inference Endpoints
AI-generated summary Amazon Web Services introduced Multi-Instance GPU support for Amazon SageMaker Inference on November 6, 2026, allowing multiple hardware-isolated models to share a single accelerator. Salesforce helped define the requirements and validate the initial implementation, while AWS reported performance and cost advantages from the H100 partition in testing.