SNIA Developer Conference September 15-17, 2025 | Santa Clara, CA
Ace Stryker
Director of Market Development
Solidigm
Ace Stryker is the director of market development at Solidigm, a California-based maker of SSDs, where he focuses on emerging AI technologies and the value of storage. He previously worked at Intel. He has an MBA from Cornell University and is based in the Sacramento area. In 2006, he was named the TIME Magazine person of the year.
Related Sessions
Data-Intensive Inference Done Better: Scaling Models and RAG in Limited Memory with SSD Offload
Enterprises are rushing to adopt AI inference solutions with RAG to solve business problems, but enthusiasm for the technology's potential is outpacing infrastructure readiness. It quickly becomes prohibitively expensive or even impossible to use more complex models and bigger RAG data sets due to the cost of memory. Using open-source software components and high-performance NVMe SSDs, we explore two different but related approaches for solving these challenges and unlocking new levels of scale: offloading model weights to storage using DeepSpeed, and offloading RAG data to storage using DiskANN. By combining these, we can achieve (a) more complex models running on GPUs that it was previously impossible to use, and (b) greater cost efficiency when using large amounts of RAG data. We'll talk through the approach, share benchmarking results, and show a demo of how the solution works in an example use case.