Fidelity and AWS have teamed up to put their brains together and create a Combinatorial Brain Surgeon (iCBS) to operate on AI models. This innovative pruning algorithm is just what the doctor ordered for your large-scale AI needs. Check out …
Read More
LLMs are scaling exponentially. Learn how advanced technologies like Triton, TRT-LLM and EKS enable seamless deployment of models like the 405B parameter Llama 3.1. Let’s go large. Read the Post on the AWS Blog Channel
Read More
Learn how to deploy AI models at scale with @AWS using NVIDIA’s NIM and Amazon EKS! This step-by-step guide shows you how to create a GPU cluster for inference. Don’t miss part 1 of this 2-part blog series! Read the Post on the AWS Blog …
Read More
AWS Batch multi-node parallel jobs can now run on Amazon EKS to provide gang scheduling of pods across nodes for large scale distributed computing like ML model training. More details here. Read the Post on the AWS Blog Channel
Read More
This post was contributed by Akshit Arora (NVIDIA), Peter Dykas (NVIDIA), Aman Shanbhag (AWS), Sean Smith (AWS), Pierre-Yves (AWS) Today we’ll take you on a step-by-step guide to help you to create a cluster of p5.48xlarge instances, using …
Read More
Launching distributed GPT training? See how AWS ParallelCluster sets up a fast shared filesystem, SSH keys, host files, and more between nodes. Our guide has the details for creating a Slurm-managed cluster to train NeMo Megatron at scale. …
Read More
See how researchers are using ML to try to predict aerodynamics and airflow for concept vehicle designs orders of magnitude faster than traditional methods. Today we dive into the metrics for the work we’ve been doing with some key …
Read More
Do you wish you could get CFD results for your latest design iteration in seconds rather than days? Work on new machine-learning techniques might take your CFD simulations from days down to seconds. Today, we discuss an open collaborative …
Read More