AWS Neuron SageMaker Samples

This repository contains SageMaker Samples using ml.inf2 and ml.trn1 instances for machine learning (ML) inference and training workloads on the AWS ML accelerator chips Inferentia and Trainium.

If you have additional SageMaker samples that you would like to contribute to this repository, please submit a pull request following the repository's contribution guidelines.

Samples are organized by use case (training, inference) below:

Training

Name	Description	Instance Type
BERT Fine-tuning on SageMaker	Sample training notebook using Hugging Face Trainer API with leveraging Neuron Persistent Cache	Trn1
neuron_parallel_compile on SageMaker	Sample training notebook showing how to leverage the neuron_parallel_compile utility for ahead-of-time compilation.	Trn1

Inference

Name	Description	Instance Type
BERT Inference on SageMaker	Sample inference notebook using Hugging Face BERT model	Inf2, Trn1, Trn1n
Stable Diffusion Inference on SageMaker	How to compile and run HF Stable Diffusion model on SageMaker	Inf2, Trn1, Trn1n

Getting Help

If you encounter issues with any of the samples in this repository, please open an issue via the GitHub Issues feature.

Contributing

Please refer to the CONTRIBUTING document for details on contributing additional samples to this repository.

Release Notes

Please refer to the Change Log.