High Performance Storage for Science Workloads - DSI 2016

The unique challenges in the field of nuclear high energy physics are already pushing the limits of storage solutions today, however, the projects planned for the next ten years call for storage capacities, performance and access patterns that exceed the limits of many of today's solutions.

This talk will present the limitations in network and storage and explain the architecture chosen for tomorrow's storage implementations in this field. Tests of various file systems (Lustre, NFS, Block Object storage, GPFS ..) have been performed and the results of performance measurements for different hardware solutions and access patterns will be presented.

Learning Objectives

Shared file system and storage performance requirements in science workloads
Setup and results of performance measurements of different file systems: the LUSTRE FS, GPFS
Technology differences between several file systems and storage solutions