Creating and tweaking Slurm queues for your clusters

Compute queues are where all the action is on an HPC cluster. In the cloud, you get the chance to customize the queues to match the code you’re going to run on them - which is actually pretty fancy when you think about it. Matt Vaughn …

Read More

Sending Celery tasks to AWS Batch for heavy lifting

Celery is a great distributed task processing system and gets used in websites and enterprise apps everywhere. But sometimes those tasks aren’t little things that can be handled by microservices - they might need some heavy CPU or …

Read More