Netflix has a really ambitious goal to create more content than practically anyone, but ran into headwinds when Covid-19 forced us all to lock down: it became hard to recruit and support artists, editors and other creatives without finding …
Read More
Batch processing is a common need across varied machine learning use cases such as video production, financial modeling, drug discovery, or genomic research. The elasticity of the cloud provides efficient ways to scale and simplify batch …
Read More
Nextflow Tower became necessary when lots of Nextflow users started to leave the confines of their existing environments in search of more compute, more storage, more capabilities. Nextflow made their workflows portable, but there was still …
Read More
NF Core is an open source repository of Nextflow workflows that can be downloaded, shared, forked, updated, tested and validated. If you’ve ever heard that quote from Isaac Newtown about seeing further by standing on the shoulders of …
Read More
AWS has a LOT of storage options (block, PIOPS, object, volume, loads of file sytems), pretty much all of which can be used for HPC. That’s because we’re not forced to come up with one single massively fast storage solution that …
Read More
In recent years, we’ve all been amazed at how large areas of scientific computing have moved to abstract their workflows away from the details of systems and cluster architecture. Bioinformatics has really lead the way in this regard - …
Read More
AWS worked backwards from an essential problem in HPC networking (MPI ranks need to exchange lots of data quickly) and found a different solution for our unique circumstances, without trading off the things customers love the most about …
Read More
Containers are rapidly maturing within the high performance computing (HPC) community and we’re excited to be part of the movement: listening to what customers have to say and feeding this back to both the community and our own product and …
Read More