What is SageMaker Model Training?
Amazon SageMaker Model Training reduces the time and cost to train and tune machine learning (ML) models at scale without the need to manage infrastructure. You can take advantage of the highest-performing ML compute infrastructure currently available, and SageMaker can automatically scale infrastructure up or down, from one to thousands of GPUs. Since you pay only for what you use, you can manage your training costs more effectively. To train deep learning models faster, SageMaker distributed training libraries can automatically split large models and training datasets across AWS GPU instances, or you can use third-party libraries, such as DeepSpeed, Horovod, or Megatr.
What is SageMaker Model Training?
Amazon SageMaker Model Training reduces the time and cost to train and tune machine learning (ML) models at scale without the need tomanage infrastructure. You can take advantage of the highest-performingML compute infrastructure currently available, and SageMaker canautomatically scale infrastructure up or down, from one to thousands ofGPUs. Since you pay only for what you use, you can manage your trainingcosts more effectively. To train deep learning models faster, SageMakerdistributed training libraries can automatically split large models andtraining datasets across AWS GPU instances, or you can use third-partylibraries, such as DeepSpeed, Horovod, or Megatr.
How it works
How it works
Benefits of cost effective training
Train models at scale
-
Fully Managed Infrastructure
-
High-performance distributed training
-
Fully Managed Infrastructure
-
Fully managed infrastructure at scaleEfficiently manage system resources with a wide choice of GPUs and CPUs. This includes NVIDIA A100 and H100 GPUs as well as AWS accelerators like AWS Trainium and AWS Inferentia. SageMaker automatically scale infrastructure up or down, from one to thousands of GPUs.
-
High-performance distributed training
-
High-performance distributed training
With only a few lines of code, you can add either data parallelism or model parallelism to your training scripts. SageMaker makes it faster to perform distributed training by automatically splitting your models and training datasets across AWS GPU instances.
Learn more
Built-in tools for the highest accuracy and lowest cost
-
Automatic model tuning
-
Spot training
-
Debugging
-
Profiler
-
Automatic model tuning
-
Automatic model tuning
SageMaker can automatically tune your model by adjusting thousands of algorithm parameter combinations to arrive at the most accurate predictions, saving weeks of effort. It helps you to find the best version of a model by running many training jobs on your dataset.
Learn more
-
Spot training
-
Managed Spot training
SageMaker helps reduce training costs by up to 90 percent by automatically running training jobs when compute capacity becomes available. These training jobs are also resilient to interruptions caused by changes in capacity.
Learn more
-
Debugging
-
Debugging
Amazon SageMaker Debugger captures metrics and profiles training jobs in real time, so you can quickly correct performance issues before deploying the model to production.
Learn more
-
Profiler
-
Profiler Amazon SageMaker Profiler helps you optimize training performance with granular hardware profiling insights including aggregated GPU and CPU utilization metrics, high resolution GPU/CPU trace plots, custom annotations, and visibility into mixed precision utilization. Learn more
Built-in tools for interactivity and monitoring
-
Experiment management
-
TensorBoard
-
Experiment management
-
Experiment management
Amazon SageMaker Experiments captures input parameters, configurations, and results, and it stores them as experiments to help you track ML model iterations.
Learn more
-
TensorBoard
-
Amazon SageMaker with TensorBoard
Amazon SageMaker with TensorBoard helps you to save development time by visualizing the model architecture to identify and remediate convergence issues, such as validation loss not converging or vanishing gradients.
Learn more
Flexible and faster training
-
Customization
-
Local code conversion
-
Automated training workflows
-
Customization
-
Full customization SageMaker comes with built-in libraries and tools to make model training easier and faster. SageMaker works with popular open-source ML models such as GPT, BERT, and DALL·E; ML frameworks, such as PyTorch and TensorFlow; and transformers, such as Hugging Face. With SageMaker, you can use popular open source libraries and tools, such as DeepSpeed, Megatron, Horovod, Ray Tune, and TensorBoard, based on your needs.
-
Local code conversion
-
Local code conversion
Amazon SageMaker Python SDK helps you execute ML code authored in your preferred IDE and local notebooks along with the associated runtime dependencies as large-scale ML model training jobs with minimal code changes. You only need to add a line of code (Python decorator) to your local ML code. SageMaker Python SDK takes the code along with the datasets and workspace environment setup and runs it as a SageMaker Training job.
Learn more
-
Automated training workflows
-
Automated training workflows
Automating training workflows using Amazon SageMaker Pipelines helps you create a repeatable process to orchestrate model development steps for rapid experimentation and model retraining. You can run automatically at regular intervals or when certain events are initiated, or you can run them manually as needed.
Learn more