Cloud service providers offer a range of storage services to enterprises, such as block storage and object storage. Currently, more data is being created, stored, and analyzed than ever before. Cloud service providers tend to extend storage capacity to meet the requirement of high-growth technologies, such as big data analytics, real-time databases, and high-performance computing. All these technologies require not only high performance but also ever-expanding data volumes.

Ceph is an open source distributed storage solution. This presentation shows the implementation of Persistent Write Log Cache(PWL cache) at Ceph client side to handle burst writes to reduce backend pressure. PWL cache is a kind of Write Back Cache, but it leverages log to ensure the I/O order. Compared with the traditional volatile cache, PWL cache persists the data to Persistent memory (PMEM). In order to prevent data loss caused by abnormal conditions, we implement Replication for PWL.

Edge is becoming the new core .More and more data will live in edge environments rather than in traditional data centers/cloud due to reasons ranging from data gravity to data sovereignty.Different data sources(block,object,streaming etc) require different kind of storage architecture at edge. Data movement and data storage are key components of edge computing. Also Taking cloud operating model at edge is gaining momentum. In this talk we will try to demystify different cloud native storage services that can be use at the edge nodes for different data types and advantages it brings .

With Amazon S3 celebrating its sixteenth birthday this year, it's easy to forget just how revolutionary it was at its release. S3's buckets and objects were profoundly different from the directories and files that developers had been manipulating through filesystem APIs. What drove this innovation, and how does cloud object storage actually work?

Many years ago SPDK introduced the “Copy Framework”, a light weight framework for supporting one HW accelerator, Intel® IOAT, behind a generic API so that acceleration would be used if available and if not the operations would be carried out in software. That has since evolved into what we now call the Accelerator Framework and we’ve gone from 2 operations and one accelerator to 8 operations, 7 accelerators (including the brand new Intel® Data Streaming Accelerator) with the ability to either automatically or manually map operations to specific offload engines.

Samsung recently contributed Poseidon project, which is an OCP-based industry collaboration between component vendor (Samsung), system vendor(Inspur) and data center.

Poseidon is an open-source storage software and hardware platform for NVMe-oF based systems. It's an EDSFF based storage reference system, targeted for performance and density, suitable for cloud data center.

Today cloud service providers (CSP) are constantly challenged with large volumes of data and increasing demand from customers for cost effective storage.

The major Cloud Providers such as VMWare, Microsoft and Google provide workload suites to deploy and manage container microservices and cloud storage through data models. Each of the vendor has their own storage model and format of storage(file, block). Meeting all of the requirements for a multi-cloud storage deployments with a generic cloud solution is challenging due to differences in the details of the models and behaviors across the Cloud Providers as well as the distributed nature of the configurations and deployments.

Azure Container Storage is a container native, microservices-based storage service providing unified volume management across different cloud storage backends, enabling consistency and portability. Azure Elastic SAN, which is one such backend, is a purpose-built, highly available block storage solution designed to scale to millions of IOPS at low ms latency. In this talk, we will deep dive into how Azure Container Storage uses Azure Elastic SAN to provide elastic bursting of stateful pods for large scale data processing at low cost.

The cloud storage market is expected to exceed $390B by 2028. Data growth is driven by new cloud-native applications incl. AI/ML, continued enterprise application migration to the cloud, and the continued growth of hybrid deployments . This explosive growth in cloud storage is expanding the manner in which the underlying storage technologies - HDDs, Flash, archival media - are used by the cloud storage platform, and is also driving the need for innovation in storage media technologies.

Amazon S3 is one of the oldest and most widely used object storage services, and its API has become the industry standard for object storage. Ensuring compatibility with Amazon S3 API is crucial for object storage developers who want to benefit from the wide ecosystem of the existing applications. However, achieving 100% compatibility can be challenging due to the complexity and variety of S3 APIs, access control mechanisms, and performance and scalability requirements.