YellowDog make scaling to crazy large workloads easy

Brendan Bouffler
Date : April 29, 2022
Categories : AWS ParallelCluster ,Amazon NICE DCV ,Life Sciences
Tags : cgi ,cpus ,covid 19 ,dcv ,ec2 ,gpus ,hpc ,high performance computing ,lustre ,parallel cluster ,schedulers ,storage ,compound screening ,drug discovery ,virtualization ,visual effects ,vizualization ,yellowdog ,techshorts

YellowDog (yellowdog.co) cut their teeth in the media and entertainment industry working on orchestrating really large workloads for CGI and FX companies. They’ve generalized the platform and now they’re able to do the same thing for nearly any kind of workload in the cloud (or hybrid on-prem/cloud scenarios).

They understand the complexities of doing this, and have features and tooling for dealing with the nitty gritty (rationing licenses for ISV applications, data movement and staging etc etc).

Alan Parry, their Director of Engineering showed us how easy it is.

In the show, we mentioned a blog post, which you can find here: https://hpc.news/hawking901

If you have ideas for technical topics you’d like to see us cover in a future show, let us know by finding us on Twitter (@TechHpc) and DM’ing us with your idea.