hyperpod

Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.

Create and manage Amazon SageMaker HyperPod clusters, run distributed model training

This collection of helper scripts/ and guides for AWS SageMaker HyperPod and ParallelCluster makes it easy to get started with large-scale distributed training on Slurm-based HPC clusters and Kubernetes-based EKS clusters, as well as AI/ML model inference deployment.

Infrastructure deployment automation of SageMaker HyperPod clusters based on EKS and SLURM orchestration and Protein Language ESM-2 model training job definitions including NVIDIA BioNemo

Experimental scripts for Amazon SageMaker HyperPod