SNIA Podcasts

Storage Developer Conference Podcast Series

Every week the Storage Developer Conference (SDC) podcast series presents important technical topics to the Storage Developer community. Each episode is hand selected by the SNIA Technical Council from the presentations at SDC.

This week’s highlighted Podcast: #98: Rethinking Ceph Architecture for Disaggregation Using NVMe-over-Fabrics by Yi Zou, Research Scientist, Intel; Arun Raghunath, Research Scientist, Intel; Tushar Gohad, Principal Engineer, Intel (MP3, Video, PDF of Slides)

Ceph protects data by making 2-3 copies of the same data but that means 2-3x more storage servers and related costs. It also means higher write latencies as data hops between OSD nodes. Customers are now starting to deploy Ceph using SSDs for high-performance workloads and for data lakes supporting real-time analytics. We describe a novel approach that eliminates the added server cost by creating Containerized, stateless OSDs and leveraging NVMe-over-fabrics to replicate data in server-less storage nodes. We propose redefining the boundaries of separation within SDS architectures to address disaggregation overheads. Specifically, we decouple control and data plane operations and transfer block ownership to execute on remote storage targets. It also dramatically reduces write latency to enable Ceph to be used for databases and to speed up large file writes. As part of the solution, we also describe how OSD node failover is preserved via a novel mechanism using standby stateless OSD nodes.

Learning Objectives: 1) Storage disaggregation; 2) NVMe over fabrics; 3) Ceph architecture.

The Podcast can be downloaded at iTunes. Download a copy of the original presentation slides as well.



Note: SNIA Podcasts are provided as information only. Articles and guests that appear on any SNIA programs express the opinions, experience, technical positions, and research of those authors and guests and not necessarily those of the SNIA.

SNIA Podcasts Copyright 2007, 2008, 2009, 2010, 2011, 2012, 2013. All rights reserved. No part of any SNIA Podcast may be reproduced, stored in a retrieval system, or transcribed, in any form or by any means, photocopying, electronic, mechanical recording or otherwise for personal or professional financial gain, without prior permission in writing of the publisher, The Storage Networking Industry Association, 4410 ArrowsWest Drive, Colorado Springs, CO 80907-3444 USA