Donpaul Stephens

As industries grapple with an ever-expanding and complex sea of data, there is a paramount need for rethinking storage and analytics. Traditionally, data is categorized as structured or unstructured, but at AirMettle, we perceive data through a different lens. Most data embodies a semi-structured nature, an overlooked characteristic that holds the key to unlocking unprecedented efficiency in data analytics. Through this revelation, AirMettle has created a Real-Time Smart Data Lake (RT-SDL), a trailblazing software-defined object storage service that astoundingly accelerates Big Data analytics operations up to 100 times compared to conventional methods. In this talk, we will explain our perspective on the nature of data, how this led to the conception of RT-SDL, including how our internal architecture stores and processes semi-structured data. Performance results will be showcased, bearing testimony to the groundbreaking speed and agility that RT-SDL brings to the analytics landscape. Furthermore, we will share insights into our vision for integrating computational storage devices, which would preferably be addressed in standards-based approach.

Donpaul Stephens

Staff Engineer

Samsung Semiconductor India Research

As industries grapple with an ever-expanding and complex sea of data, there is a paramount need for rethinking storage and analytics. For decades, the industry has tried to push analytics closer to the data to accelerate analytics and reduce costs – with varying degrees of success. Data warehouses can accelerate repeated queries on known relevant data, but require significant copying and pre-processing of data, and get very expensive as datasets grow. New “data lakehouse” approaches aim to directly query raw data objects in storage, but introduce new data formats, metadata catalogs, and additional compute resources. At AirMettle, we approach this differently – leveraging existing data formats, storage server infrastructure, and even commodity SSDs to dramatically accelerate analytics, lower costs, and reduce power consumption. AirMettle’s Analytical Data Platform is a trailblazing software-defined object storage service that accelerates Big Data analytics operations up to 100 times compared to conventional methods.

In this talk, we will discuss the nature of data, how this influenced the development of our Analytical Data Platform, and how its internal architecture stores and processes semi-structured data. Use cases and performance results will be showcased, bearing testimony to the groundbreaking speed and agility that the platform brings to the analytics landscape. Furthermore, we will share insights into our vision and progress in delegating processing to commodity storage devices.

Donpaul Stephens

Staff Engineer

Samsung Semiconductor India Research