AI Memory at Meta: Challenges and Potential Solutions

webinar

Author(s)/Presenter(s):

Chris Petersen

Library Content Type

Presentation

Library Release Date

Focus Areas

Abstract

AI at Meta is across many applications/services and at scale - driving a portion of Meta's overall hardware and software infrastructure.  AI models scale faster than the underlying memory technology. This presentation discusses how an additional tier of memory can help and the options to enable this new memory tier.