[PCS-007] - Using Hashicorp Packer for AWS PCS machine images

Brendan Bouffler
Date : November 13, 2024
Categories : AI/ML ,AWS Batch ,AWS ParallelCluster ,Amazon NICE DCV ,Elastic Fabric Adapter ,Life Sciences
Tags : ai ml ,aws ,aws pc s ,batch ,cpus ,dcv ,ec2 ,efa ,gpus ,hpc ,high performance computing ,lustre ,mpi ,nccl ,pc s ,parallel computing service ,parallel cluster ,schedulers ,storage ,autoscaling ,aws batch ,bioinformatics ,cloud computing ,elastic ,elastic fabric adapter ,hpc instances ,infiniband ,job scheduling ,scientific computing ,supercomputing ,technical computing ,tightly coupled ,virtualization ,vizualization ,techshorts

Are you interested in learning how to automate building machine images for HPC?

Matt walks you through using HashiCorp Packer to efficiently create Amazon Machine Images (AMIs) tailored for AWS Parallel Computing Service.

You’ll see a full demonstration of developing a template, configuring builders and provisioners, and launching a complete AMI build process. And it all uses a recipe which we’ve provided in the HPC Recipe Library.

If you have ideas for technical topics you’d like to see us cover in a future show, let us know by emailing us at ask-hpc@amazon.com.

Chapters

00:00 - Start 00:29 - Packer’s anatomy 02:15 - Anatomy of our Packer template 04:11 - Packer Provisioners 09:05 - Adding a provisioner (for Spack)