LustreFS and its ongoing Evolution for High Performance Computing and Data Analysis Solutions

The Lustre file system was born out of the need to deliver huge amounts of data to the fastest high performance computing systems in the world. Research institutions adopted it quickly and helped to create the fastest and most widely adopted parallel file system for research computing systems. From its early days in environments accepting a fair amount of instability, Lustre deployments are now found in commercial research labs across oil and gas, manufacturing, rich media, and finance sectors. This presentation will cover the elements and architecture of Lustre and several current technology developments helping to continue its evolution as a solid foundation for High Performance Computing and Data Analysis (HPDA).

Learning Objectives

High level understanding of the Lustre filesystem architecture and elements
Lustre recent and upcoming improvements for small file IO including architectural changes and the use of flash caches
An approach to extending Lustre access beyond the data center and into the cloud for tiering, collaboration and disaster recovery