GraphChi: Large-Scale Graph Computation on Just a PC

webinar

Author(s)/Presenter(s):

Aapo Kyrola

Ph.D.

Library Content Type

Presentation

Library Release Date

Focus Areas

Abstract

In "GraphChi: Large-Scale Graph Computation on Just a PC" at OSDI '12, we proposed Parallel Sliding Windows (PSW), a novel method for efficiently processing large graphs from external memory (disk). Based on PSW, we designed and implemented a complete system, GraphChi, for vertex-centric graph computation. We demonstrated that GraphChi is capable of solving even the biggest graph computation problems on just a single PC, with performance often matching distributed computation frameworks.

In this talk I discuss the motivations for single-computer computation, present the GraphChi system and its design and talk about some recent work for extending and improving GraphChi, including a novel random walk engine DrunkardMob (to be presented in ACM RecSys'13). I will also talk about challenges of graph computation on general level and discuss future directions of my research.