This presentation walks through how data flows through GPUs during Large Language Model training. There is an introduction to LLM neural networks and how they map to the GPU arrays. We look at the challenges of current GPU topologies and look at how these topologies will evolve with the introduction of UEC and UALink.
Learning Objectives
Understand the basics of Neural Networks
Understand how a Neural Network map to a group of GPUs
Understand how data flows into and between GPUs
Understand the roles UEC and UALink play in large GPU arrays
Main Speaker / Moderator
Webform Submission ID
109