Sorry, you need to enable JavaScript to visit this website.

SNIA Developer Conference September 15-17, 2025 | Santa Clara, CA

Demystifying Data Flows During LLM Training

Abstract

This presentation walks through how data flows through GPUs during Large Language Model training.  There is an introduction to LLM neural networks and how they map to the GPU arrays.  We look at the challenges of current GPU topologies and look at how these topologies will evolve with the introduction of UEC and UALink.

Learning Objectives

Understand the basics of Neural Networks Understand how a Neural Network map to a group of GPUs Understand how data flows into and between GPUs Understand the roles UEC and UALink play in large GPU arrays