On May 17, 2022, AWS Backup announced support for Amazon FSx for OpenZFS, adding to the supported AWS services across compute, storage, and databases. Amazon FSx for OpenZFS customers can now leverage centralized, policy-based management of …
Read More
ParallelCluster can now mount lots and lots of file systems that you’ve previously created in your AWS account, in addition to the scratch filesystem you can ask it to create for you when you launch your cluster. And as of today, …
Read More
If you’ve ever had to iteratively guess how much memory is left in a bunch of compute nodes in order to get your memory-hungry jobs running, then this feature will save your sanity. It’s a new integration between ParallelCluster …
Read More
In part 1, we covered all the aspects of designing and creating ParallelClusters in PCluster Manager. Today we delve into some more advanced topics like debugging your stack when something goes wrong, managing access to the cluster via the …
Read More
Today is the first part of a 2-part series and we’re covering all the aspects of designing and creating ParallelClusters using PCluster Manager, which is a graphical user interface tool for making all the hard bits of cluster …
Read More
Machine Learning is a huge workload, and one of the most demanding when it comes to scaling to thousands (and thousands) of CPUs. Some of the largest workloads customers run in the cloud are deep learning models, which require huge numbers …
Read More
As companies shift high-performance workloads toward cloud solutions, data storage and data protection go side-by-side. Many companies have both internal and external security rules and regulations they must adhere to when storing their …
Read More
The Ampersand Data Science team had a challenge: their Bayesian statistical models needed more than half a million core-hours of runtime, regularly, if they were to get an answer fast enough for it to be useful to their customers. Scaling …
Read More