AWS Batch is a fully-managed AWS service that orchestrates vast numbers of jobs using containers. It leverages some of your favorite container systems - Amazon ECS and Kubernetes, and - above all: makes your life easier because it handles …
Read More
We just released version 3.3 of AWS ParallelCluster, and it has a whole bag of new features. instance type allocation diversity in your queues; separation of shred volumes from the cluster lifecycle SLURM ACCOUNTING (this is pretty popular) …
Read More
Pay-as-you-go resources are a compelling but budget-limited researchers performing HPC workloads need help working within the bounds of their grants. In this post, we show how to build a real-time cost guardian for AWS Batch to help enforce …
Read More
Today we announced the AWS Impact Computing Project at the Harvard Data Science Initiative (HDSI) to identify potential solutions that can improve the lives of humans, other species, and natural ecosystems. Deb Goldfarb describes its goals …
Read More
The Elastic Fabric Adapter was created so HPC and machine-learning customers could scale their tightly-coupled codes and models to thousands (and thousands) of cores without missing any performance. It has some very cool design features …
Read More
The Elastic Fabric Adapter was created so HPC and machine-learning customers could scale their tightly-coupled codes and models to thousands (and thousands) of cores without missing any performance. It has some very cool design features …
Read More
AWS ParallelCluster 3.3.0 now lets you define a list of Amazon EC2 instance types for resourcing a compute queue. This gives you more flexibility to optimize the cost and total time to solution of your HPC jobs, especially when capacity is …
Read More
Since it was launched in 2017, AWS Batch has used the Amazon Elastic Container Service (Amazon ECS) to create the clusters it uses for deploying container jobs. That included AWS Fargate, which is a serverless face to ECS. But starting …
Read More