[PCS-002] Your first cluster with AWS Parallel Computing Service

Brendan Bouffler
Date : August 28, 2024
Categories : AI/ML ,AWS Batch ,AWS ParallelCluster ,Amazon NICE DCV ,Elastic Fabric Adapter ,Life Sciences
Tags : ai ml ,aws ,aws pc s ,batch ,cpus ,dcv ,ec2 ,efa ,gpus ,hpc ,hpc as a service ,hpcaa s ,high performance computing ,lustre ,mpi ,nccl ,pc s ,parallel computing service ,parallel cluster ,schedulers ,storage ,autoscaling ,aws batch ,bioinformatics ,cloud computing ,elastic ,elastic fabric adapter ,hpc instances ,infiniband ,job scheduling ,scientific computing ,supercomputing ,technical computing ,tightly coupled ,virtualization ,vizualization ,techshorts

In 45 minutes you’ll pick up all you need to know to build a complete HPC cluster on AWS. Imagine: an entire HPC cluster - soup to nuts, including fast network, high performance Lustre storage, and hundreds or even thousands of cores at your fingertips - in just a morning’s work.

This uses the new AWS Parallel Computing Service, which is for customers who run high performance computing (HPC) workloads and build scientific and engineering models so they can accelerate their R&D and drive innovation.

If you have ideas for technical topics you’d like to see us cover in a future show, let us know by emailing us at ask-hpc@amazon.com.

Chapters

00:00 - Start 02:05 - File systems 06:33 - Security group 11:21 - Creating a cluster 15:21 - Creating Lustre 20:23 - IAM instance profile 32:16 - Creating queues 34:16 - Login to your cluster 42:29 - Tear down