The HPC portfolio from AWS (including PCS, which is new)

Brendan Bouffler
Date : November 13, 2024
Categories : AI/ML ,AWS Batch ,AWS ParallelCluster ,Amazon NICE DCV ,Elastic Fabric Adapter ,Life Sciences
Tags : ai ml ,aws ,aws pc s ,batch ,cpus ,dcv ,ec2 ,efa ,gpus ,hpc ,high performance computing ,lustre ,mpi ,nccl ,parallel computing service ,parallel cluster ,schedulers ,storage ,autoscaling ,aws batch ,bioinformatics ,cloud computing ,elastic ,elastic fabric adapter ,hpc instances ,infiniband ,job scheduling ,scientific computing ,supercomputing ,technical computing ,tightly coupled ,virtualization ,vizualization ,techshorts

Feel limited by the computing resources available to you locally? Are you looking for ways to supercharge your research and engineering projects?

This tech short video introduces powerful cloud-based tools that can help you achieve the near impossible.

Learn how AWS services can help remove the barriers holding you back.

We’ll explain how these tools allow you to spin up resources right away, collaborate seamlessly, and run workloads at scales previously unimaginable.

Whether you’re a researcher, engineer, or admin, this video demystifies HPC in the cloud.

If you have ideas for technical topics you’d like to see us cover in a future show, let us know by emailing us at ask-hpc@amazon.com.

Chapters

00:00 - Start 00:49 - Reducing complexity 01:05 - Compute 01:32 - GPUs in Ultra clusters 01:40 - Networking (EFA) 02:48 - Storage (including Lustre) 03:40 - Slurm-based clusters 04:31 - AWS Parallel Computing Service 06:11 - AWS Batch 07:15 - Research and Engineering Studio on AWS 08:48 - HPC Recipes 09:39 - Where to get hel