Hardware Based Compression in Ceph OSD with BTRFS

Library Content Type:
Publish Date: 
Monday, September 19, 2016
Event Name: 
Focus Areas:

Ceph is a distributed object store and file system designed to provide excellent performance, reliability and scalability. BTRFS with the compelling set of features is recommended for non-production Ceph environments. In this talk we will introduce our experiment work on integrating the hardware acceleration in BTRFS to optimize the data compression workload in Ceph OSD, we analyze the nature of compression feature in BTRFS file system and the cost of the software compression library, and present the optimized solution to reduce the CPU cycles, disk IO with the hardware compression accelerator enabled in Ceph OSD.

Learning Objectives

BTRFS compression architecture
Hardware based compression acceleration integration with BTRFS
Ceph performance improvement with the hardware acceleration