S3 API Deep Storage Extensions for Hadoop

Given the frantic pace of storage technology innovation today it is more important than ever to sort out real customer value from marketing hype. “1 million IOPs!” makes a great headline but may have no correlation to the performance that can be achieved under a production workload. This presentation will discuss Storage Performance Council benchmarks and their application to new storage technologies. Subjects will include the value of using complex workloads, solution and component applications, the SPC benchmark disclosure as well as benchmark applications for end users, product architects, planners, development, marketing and sales. Current benchmark results will be used to demonstrate how SPC benchmarks are applied to the latest storage technologies including flash and hybrid configurations. The presentation will conclude with a discussion of future directions for storage benchmarking.

Learning Objectives

Understand the difference between focused and comprehensive benchmarks
Develop a basic understanding of the SPC-1 and SPC-2 benchmarks and applications
Learn how to relate benchmark results to production applications
Learn how to use benchmark results during throughout the product life cycle