Scaling beyond memory: fine-grained GPU access to unbounded data for vector databases and graph neural networks

The drumbeat for supporting trillion-entry vector databases and graph neural networks is getting louder. System-level storage architecture issues are hot. Ecosystem challenges are getting slowly addressed. This talk will share highlights of usage models, scaled POC results, system considerations, and ecosystem progress. We’ll also touch on some work on relevant NVMe standards.