Distributed Data Integrity Assurance and Repair Using the LOCKSS Content Audit Protocol

Author(s)/Presenter(s):
Library Content Type:
Publish Date: 
Thursday, September 27, 2018
Event Name: 
Focus Areas:
Abstract: 

A research collaboration in the early aughts between Stanford University, Sun Microsystems, Hewlett-Packard and Intel yielded LOCKSS (Lots Of Copies Keep Stuff Safe), a novel, open-source, peer-to-peer system built to mitigate comprehensive threats to the long-term durability of digital information. Stanford Libraries went onto productize the technology, initially supporting distributed preservation of scholarly electronic journals and books and later expanding to arbitrary types of digital content. Adoption of LOCKSS outside of memory institutions has been limited by an architecture constrained to end-to-end implementations.

However, a recent re-architecture effort is now making individual LOCKSS components available as standalone web services. The core of LOCKSS' unique data integrity assurance and repair capabilities is the LOCKSS Content Audit Protocol. Integration of this functionality into other storage systems may bolster their capabilities to detect and mitigate damage to stored data.

Learning Objectives:
1. What are the unique capabilities of the LOCKSS Content Audit Protocol for ensuring data integrity?
2. What use cases has LOCKSS been used for, what could prospective use cases are envisioned?
3. How could developers leverage the LOCKSS Content Audit Protocol as a web service?

Watch video: