Infrastructure as Code - ParallelCluster 3's config

Brendan Bouffler
Date : October 7, 2021
Categories : AWS ParallelCluster ,Amazon NICE DCV ,Life Sciences
Tags : cpus ,covid 19 ,dcv ,ec2 ,gpus ,hpc ,high performance computing ,lustre ,parallel cluster ,schedulers ,storage ,virtualization ,vizualization ,techshorts

‘Infrastructure as Code’ has a weird meaning in HPC, because it says we can write a script which stands up the entire incredibly complex software stack that is an HPC cluster, complete with MPIs, math libraries, schedulers - and even a parallel file system and visualization server.

Austin Cherian takes us for a walk through the new ParallelCluster 3 config file and shows how the syntax aligns with the significant elements of the cluster architecture. He also talks about a few quirks we found along the way.

If you have ideas for technical topics you’d like to see us cover in a future show, let us know by finding us on Twitter (@TechHpc) and DM’ing us with your idea.