Building ParallelClusters that span multiple Availability Zones in a region take some careful planning with respect to storage and networking, but opens up options for more capacity - which is often the driver behind this design. Matt …
Read More
Complicated multi-step workflows can be challenging to deploy, especially when using a variety of high-compute resources. Covalent is an open-source orchestration tool that streamlines the deployment of distributed workloads on AWS …
Read More
AWS ParallelCluster 3.6.0 can now detect GPU failures in HPC and AI/ML tasks. Health checks run at the start of Slurm jobs and if they fail, the job is requeued on another instance. This can increase reliability and prevent wasted spend. …
Read More
Compute queues are where all the action is on an HPC cluster. In the cloud, you get the chance to customize the queues to match the code you’re going to run on them - which is actually pretty fancy when you think about it. Matt Vaughn …
Read More
Oxford Nanopore sequencers enables direct, real-time analysis of long DNA or RNA fragments. They work by monitoring changes to an electrical current as nucleic acids are passed through a protein nanopore. The resulting signal is decoded to …
Read More
Celery is a great distributed task processing system and gets used in websites and enterprise apps everywhere. But sometimes those tasks aren’t little things that can be handled by microservices - they might need some heavy CPU or …
Read More
AWS is developing new tools to enable easier and faster deployment of level 3 digital twin virtual sensors. in this post we show why L3 digital twins are needed for virtual sensors and how to elastically deploy one the cloud at scale. Read …
Read More
Today we are launching I4g instances powered by AWS Graviton2 processors that deliver up to 15% better compute performance than our other storage-optimized instances. With up to 64 vCPUs, 512 GiB of memory, and 15 TB of NVMe storage, one of …
Read More