Data architecture for a data driven enterprise

Author(s)/Presenter(s):
Library Content Type:
Publish Date: 
Friday, August 3, 2018
Event Name: 
Focus Areas:
Abstract: 

More than a decade old data architecture isn’t enough for today’s data-driven businesses which are heavily dependent on AI/ML/DL. As the enterprises begin to operationalize these AI/ML workflows, they would need to optimize on storage I/O performance to feed to massively parallel GPU based compute. With growing IoT footprint, data management and AI/ML based compute challenges span across from edge, to the core and to the cloud. In this talk we propose a need for a modern data engineering and management pipeline to address the above challenges. Specific learning objectives being, how some of the existing data engineering workflows need to be re-thought, which includes dynamic data indexing, access pattern aware data layout etc. The talk would also cover other emerging data engineering challenges like data reduction and data quality assessment with specific focus on edge/core vs. cloud. The talk would also bring out any ongoing research towards addressing the mentioned challenges.

Watch video:

Keywords: