Nextflow Tower became necessary when lots of Nextflow users started to leave the confines of their existing environments in search of more compute, more storage, more capabilities. Nextflow made their workflows portable, but there was still …
Read More
NF Core is an open source repository of Nextflow workflows that can be downloaded, shared, forked, updated, tested and validated. If you’ve ever heard that quote from Isaac Newtown about seeing further by standing on the shoulders of …
Read More
AWS has a LOT of storage options (block, PIOPS, object, volume, loads of file sytems), pretty much all of which can be used for HPC. That’s because we’re not forced to come up with one single massively fast storage solution that …
Read More
Now that AWS Batch supports AWS Fargate, you can submit jobs any time you like, and AWS just spins up the resources you need when you need them, REALLY quickly (because that’s what Fargate is awesome at). You don’t need to keep …
Read More
In recent years, we’ve all been amazed at how large areas of scientific computing have moved to abstract their workflows away from the details of systems and cluster architecture. Bioinformatics has really lead the way in this regard - …
Read More
Arm and AWS are jointly sponsoring a summer hackathon that’s being run by the Arm HPC User group (A-HUG - and definitely we send a hug to everyone out there). The goal of the hackathon is to get loads of codes with Spack recipes …
Read More
Some workloads generate a LOT of output files and sometimes quite suddenly. For codes like OpenFOAM, this is data that you may not need until later when you run a post-processing job. Given the amount of data isn’t always predictable, there …
Read More
In the search for HPC application performance, there’s more than one way to build a network. HPC applications (or “codes” as we usually call them) are often at the mercy of the network underpinning an HPC cluster. If your CPUs aren’t busy, …
Read More