Now that AWS Batch supports AWS Fargate, you can submit jobs any time you like, and AWS just spins up the resources you need when you need them, REALLY quickly (because that’s what Fargate is awesome at). You don’t need to keep …
Read More
In recent years, we’ve all been amazed at how large areas of scientific computing have moved to abstract their workflows away from the details of systems and cluster architecture. Bioinformatics has really lead the way in this regard - …
Read More
Arm and AWS are jointly sponsoring a summer hackathon that’s being run by the Arm HPC User group (A-HUG - and definitely we send a hug to everyone out there). The goal of the hackathon is to get loads of codes with Spack recipes …
Read More
Some workloads generate a LOT of output files and sometimes quite suddenly. For codes like OpenFOAM, this is data that you may not need until later when you run a post-processing job. Given the amount of data isn’t always predictable, there …
Read More
In the search for HPC application performance, there’s more than one way to build a network. HPC applications (or “codes” as we usually call them) are often at the mercy of the network underpinning an HPC cluster. If your CPUs aren’t busy, …
Read More
By popular request, we’re looking today at the EFA software stack and environment: how to make sure it’s set up correctly (so you get great performance from your codes), how to tell if it’s not, and how to fix that. Austin Cherian, our …
Read More
(A complete teardown of WRF performance on x86 and AWS Graviton, from memory subsystems, compilers and MPI stacks). Weather simulation is a reliably difficult workload for almost any HPC architecture and is often used as a litmus test by …
Read More
AWS’s compute infrastructure is very much not like a ‘normal’ supercomputer (whatever that is). We don’t start with a blank page every few years and design the next big system. It’s more like a city where we have to build on what’s there …
Read More