Long Term Retention
The Long Term Retention (LTR) Technical Working Group (TWG) is addressing the "grand technical challenges" of long term digital information retention & preservation, namely both physical ("bit") and logical preservation. A major component of the TWG's Program of Work is the creation of a logical container format, named the Self-contained Information Retention Format (SIRF), for the long-term storage of digital information.
SNIA’s Long Term Retention technical group is developing a SNIA standard for a logical container format called the Self-contained Information Retention Format (SIRF). This new standard, currently available for public review, enables long-term storage and tape-based containers effective and efficient ways to preserve and secure digital information for many decades, even with the ever-changing technology landscape.
The work of the Long Term Retention technical group ensures that SNIA plays a full part in addressing the "grand technical challenges" of long term digital information retention & preservation, namely both physical ("bit") and logical preservation.
More information about the SIRF standard:
SIRF is a storage container for a set of digital preservation objects that provides a catalog with metadata related to the entire contents of the container, individual objects, and their relationships. It Is designed to be media agnostic, vendor agnostic, extensible, self-described and self-contained.
Aspects of SIRF serialization for the cloud are being experimented with OpenStack Swift object storage and the stored data is designed to be understandable and does not need specialized software to interpret it.
SIRF is interpretable by future data preservation systems, thus reducing the associated costs of digital preservation. SIRF plays a key role in the preservation and retention of important data. Typical use cases for SIRF would be the preservation of data attached to medical records, libraries and in the Movie/Film industry.
SIRF technical documents released in SNIA public review site and we encourage everyone to review and comment on the current draft v1.0 that is now available for review.
- Self-contained Information Retention Format (SIRF) Specification v1.0
SIRF Use Cases and Functional Requirements document
SIRF Scientific papers:
- Simona Rabinovici-Cohen, Roger Cummings and Sam Fineberg, "Self-contained Information Retention Format For Future Semantic Interoperability", Proceedings of the 4th International Workshop on Semantic Digital Archives (SDA), September 2014, London, UK
- Simona Rabinovici-Cohen, Mary G. Baker, Roger Cummings, Sam Fineberg, and John Marberg, "Towards SIRF: Self-contained Information Retention Format”, Proceedings of the Annual International Systems and Storage Conference (SYSTOR), May 30-June 1, 2011, Haifa, Israel
Selected LTR public presentations:
- A SNIA tutorial "SIRF: Self-contained Information Retention Format", presented by Sam Fineberg and co-authored by Simona Rabinovici-Cohen (IBM), Roger Cummings (Antesignanus) & Phillip Viana (IBM) at the 2015 USENIX Conference on File and Storage Technologies (FAST), February 2015, Santa Clara, CA, USA;
- A SNIA tutorial "Combining SNIA Cloud, Tape and Container Format Technologies for Long Term Retention", presented by Sam Fineberg and co-authored by Simona Rabinovici-Cohen (IBM) & Roger Cummings (Antesignanus) at the 2014 SNIA Data Storage Innovations Conference (DSI), April 2014, Santa Clara, CA, USA;
- A SNIA tutorial "Combining SNIA Cloud, Tape and Container Format Technologies for the Long Term Retention of Big Data", presented by Sam Fineberg and co-authored by Roger Cummings (Antesignanus) & Simona Rabinovici-Cohen (IBM) at the 2013 SNIA Analytics and Big Data Summit, September 2013, Santa Clara, CA, USA;
- A webcast "Digital Content ‐ Challenges of Long‐term Storage", presented by Mary Baker (HP) to the Society of Motion Picture and Television Engineers (SMPTE) on May 10, 2012;
- A SNIA tutorial "Bringing Light to the “Digital Dark Age” – Preserving Digital Information for the Long Term", presented by Roger Cummings (Symantec) at the Spring 2012 StorageNetworkingWorld conference (April 2-5) in Dallas, Texas, USA;
- A presentation entitled "Long Term Information Retention" given by Sam Fineberg (HP) & Simona Rabinovici-Cohen (IBM) as part of the SNIA 2011 Storage Developer Conference (September 19-22) in Santa Clara, CA;
- A tutorial "Long Term Preservation of Digital Information" that has been presented by Mary Baker (HP) and Roger Cummings (Symantec) at a number of StorageNetworkingWorld conferences in the US and elsewhere for the last two years;
- An extended webinar version of the above tutorial;
- A presentation "Long Term Retention Format" made by Sam Fineberg (HP) and Simona Cohen (IBM) at the 2009 SNIA Storage Developers Conference;
- A keynote "Long Term Retention Work @ SNIA" presented by Roger Cummings (Symantec) at the ECMA 1st International Workshop on Standards and Technologies in Multimedia Archives and Records (STAR), plus a video of the presentation;
References for Long-Term Retention & Preservation:
- Long term Retention related work from MSST 2013
- LTR cost modeling work from UC Santa Cruz
- Dagstul Seminar report, "Is the future of preservation cloudy?"
- Links related to the economics of long term retention
- LTR Related papers from the 2012 SNIA Storage Developers Conference
- Alliance for Permanent Access 2012 Conference Presentations
- 2012 Creative Storage Conference http://www.creativestorage.org/
- US Workshop on Roadmap for Digital preservation Interoperability Framework
Liaison Organizations with LTR TWG:
- EU FP7 Integrated Project ForgetIT- Concise Preservation by combining Managed Forgetting and Contextualized Remembering
- The TIMBUS project: http://timbusproject.net
- EU FP7 Integrated Project ENSURE - Enabling kNowledge, Sustainability, Usability and Recovery for Economic Value
- Long-Term Digital Retention & Preservation Reference Model
- SNIA Cloud Archive and Preservation Special Interest Group
- Preservation and Archiving Special Interest Group