Hadoop: Embracing Future Hardware

webinar

Author(s)/Presenter(s):

Sanjay Radia

Suresh Srinivas

Library Content Type

Presentation

Library Release Date

Focus Areas

Abstract

This talk looks at the implications to Hadoop of future server hardware - and to start preparing for them. What would a pure SSD Hadoop filesystem look like, and how to get there via a mixed SSD/HDD storage hierarchy? What impact would that have on ingress, analysis and HBase? What could we do do better if network bandwidth and latency became less of a bottleneck, and how should interprocess communication change? Would it make the graph layer more viable? What would massive arrays of WIMPy cores mean -or a GPU in every sever. Will we need to schedule work differently? Will it make per-core RAM a bigger issue? Finally: will this let us scale Hadoop down?