NF Core is an open source repository of Nextflow workflows that can be downloaded, shared, forked, updated, tested and validated. If you’ve ever heard that quote from Isaac Newtown about seeing further by standing on the shoulders of …
Read More
AWS has a LOT of storage options (block, PIOPS, object, volume, loads of file sytems), pretty much all of which can be used for HPC. That’s because we’re not forced to come up with one single massively fast storage solution that …
Read More
In recent years, we’ve all been amazed at how large areas of scientific computing have moved to abstract their workflows away from the details of systems and cluster architecture. Bioinformatics has really lead the way in this regard - …
Read More
Arm and AWS are jointly sponsoring a summer hackathon that’s being run by the Arm HPC User group (A-HUG - and definitely we send a hug to everyone out there). The goal of the hackathon is to get loads of codes with Spack recipes …
Read More
Some workloads generate a LOT of output files and sometimes quite suddenly. For codes like OpenFOAM, this is data that you may not need until later when you run a post-processing job. Given the amount of data isn’t always predictable, there …
Read More
In the search for HPC application performance, there’s more than one way to build a network. HPC applications (or “codes” as we usually call them) are often at the mercy of the network underpinning an HPC cluster. If your CPUs aren’t busy, …
Read More
By popular request, we’re looking today at the EFA software stack and environment: how to make sure it’s set up correctly (so you get great performance from your codes), how to tell if it’s not, and how to fix that. Austin Cherian, our …
Read More
(A complete teardown of WRF performance on x86 and AWS Graviton, from memory subsystems, compilers and MPI stacks). Weather simulation is a reliably difficult workload for almost any HPC architecture and is often used as a litmus test by …
Read More