32
BEYOND BACKUPS Lessons Learned From Disaster Planning for a Digital Archive Lance Stuchell 2010 SAA Preservation Section Meeting

Preservation Section Disaster Planning Presentation (SAA 2010)

Embed Size (px)

Citation preview

Page 1: Preservation Section Disaster Planning Presentation (SAA 2010)

BEYOND BACKUPSLessons Learned From Disaster Planning for a Digital Archive

Lance Stuchell

2010 SAA Preservation Section Meeting

Page 2: Preservation Section Disaster Planning Presentation (SAA 2010)

Overview

This slideshow was originally presented at the

2010 SAA Preservation Sectionon Friday, August 13th 2010

(some slides have been added for clarity)

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License.

Page 3: Preservation Section Disaster Planning Presentation (SAA 2010)

Disaster Planning Case Study

• Overview of ICPSR– Campus of the University of Michigan– An archive of digital social science research data– Preserves over 500,000 files of research data– Disaster planning process formalized in 2007• Gained new urgency after 2008 power outage

• Lessons learned– The disaster planning process– Incorporating digital asset protection

Page 4: Preservation Section Disaster Planning Presentation (SAA 2010)

"By failing to prepare you are preparing to fail."

-Benjamin Franklin

Page 5: Preservation Section Disaster Planning Presentation (SAA 2010)

THE PLANNING PROCESS

Page 6: Preservation Section Disaster Planning Presentation (SAA 2010)

“What Could Happen” Approach

Drawings by Rebecca Goldman

Page 7: Preservation Section Disaster Planning Presentation (SAA 2010)

Core Functions Approach

• Identify core functions of organization– Safety of employees and guests – Basic financial procedures (payroll)– Access to collections– Preservation of digital assets

• Determine allowable downtime• Risk management does play a role• Identify other planning mandates

Page 8: Preservation Section Disaster Planning Presentation (SAA 2010)

Benefits of Functions Approach

• Helps frame entire disaster planning process – Identifies and prioritizes functions of organization

• Allocation of resources– Resources can be used to protect and recover

most important functions – Prioritize and allocate time and funding

• Helps define and identify disasters– Events that threaten core functions are “disasters”– Less likely to miss the “small” events

Page 9: Preservation Section Disaster Planning Presentation (SAA 2010)

Core Functions at ICPSR

Core Function Application Allowable Time Lapse Lead / Support

Access to data ICPSR website ASAP Coll. Delivery; CNS

IT Infrastructure Servers, networks ASAP CNS

Preserve data Repository, offsite copies

1 day DPO; CNS

Process data Pipeline, workflow 1-2 days Coll. Dev; CNS

Administration-HR Electronic, print files 1 day HR; CNS

Administration-$$ Electronic, print files 1-2 days Finance; CNS

Summer Institute Electronic, print files seasonal Summer Institute; CNS

Conduct Research Electronic, print files 1 week DPO; CNS

Initial Core Function Identification and Allowable Downtime

Page 10: Preservation Section Disaster Planning Presentation (SAA 2010)

Core Functions at ICPSR

• Web access identified as vital core function– Allowable downtime is minimal

• Led to development of webserver backup– Server is backed up in the cloud – Switches over in event of a primary outage – Facilitates continuity of web delivered content

• Resources allocated to recover this function

Page 11: Preservation Section Disaster Planning Presentation (SAA 2010)

Access During a Disaster

POWER OUTAGE

OAIS Function Model

2008 Power Outage (before backup)

Page 12: Preservation Section Disaster Planning Presentation (SAA 2010)

Access During a Disaster

POWER OUTAGE

OAIS Function Model

2009 Power Outage (after backup)

Access

DIP

Amazon Cloud

Page 13: Preservation Section Disaster Planning Presentation (SAA 2010)

“The Plan”

Page 14: Preservation Section Disaster Planning Presentation (SAA 2010)

Planning Components

“Ultimately, an organization would use a suite of plans to properly prepare response,

recovery, and continuity activities for disruptions affecting the organization’s IT

systems, business processes, and the facility.”

From NIST Contingency Planning Guide for Information Technology Systems, pg. 7.

Page 15: Preservation Section Disaster Planning Presentation (SAA 2010)

Advantages of the Planning Suite

• Implementation at appropriate levels– Administration approves and guides overall policy– Finance manages emergency funds or agreements– IT handles technical recovery plans

• Improves the updating process – By the people who have ownership of the process– Can be scheduled at different times

• Plans are shareable and modular

Page 16: Preservation Section Disaster Planning Presentation (SAA 2010)

Crisis Communication

Plan

First Steps at ICPSRDisaster Training

Plan

Disaster PlanningPolicy

Page 17: Preservation Section Disaster Planning Presentation (SAA 2010)

First Steps at ICPSR

• Initial policies and plans guided process• Disaster Planning Policy– Created standing disaster planning committee – Identified stakeholders and subordinate plans

• Disaster Training Plan– Identified process for promulgating awareness

• Crisis Communication Plan– Identified communication process which will be

utilized during and after a disaster

Page 18: Preservation Section Disaster Planning Presentation (SAA 2010)
Page 19: Preservation Section Disaster Planning Presentation (SAA 2010)

DIGITAL ASSET PROTECTION

Page 20: Preservation Section Disaster Planning Presentation (SAA 2010)

Physical Asset Protection

Page 21: Preservation Section Disaster Planning Presentation (SAA 2010)

Research for Guidance

• Archive and library community– Guidance and importance of managed backups– Stresses continued access and public services

• Government and educational communities – Digital content as organizational assets– Guidance on the incorporation of IT– Sharing results, high-level polices and procedures

• Private and for-profit sector– Often based on legal requirements– Very difficult to find details and examples

Page 22: Preservation Section Disaster Planning Presentation (SAA 2010)
Page 23: Preservation Section Disaster Planning Presentation (SAA 2010)

Planning ComponentsBusiness Continuity

Plan (BCP)

Business Recovery Plan (BRP)

Continuity of Operations Plan

(COOP)

IT ContingencyPlan

Crisis Communication

Plan

Cyber Incident Response Plan

Disaster Recovery Plan (DRP)

Occupant Emergency Plan

(OEP)

From NIST Contingency Planning Guide for Information Technology Systems, pg. 10.

Page 24: Preservation Section Disaster Planning Presentation (SAA 2010)

Digital Centered ComponentsBusiness Continuity

Plan (BCP)

Business Recovery Plan (BRP)

Continuity of Operations Plan

(COOP)

IT ContingencyPlan

Crisis Communication

Plan

Cyber Incident Response Plan

Disaster Recovery Plan (DRP)

Occupant Emergency Plan

(OEP)

From NIST Contingency Planning Guide for Information Technology Systems, pg. 10.

Page 25: Preservation Section Disaster Planning Presentation (SAA 2010)

Plans for Digital Assets

• IT Contingency Plan – Provide procedures and capabilities for recovering

a major application or general support system– Addresses IT interruptions – At ICPSR: CNS (IT) is currently documenting and

sharing specific system recovery procedures – At ICPSR: Many plans already existed, but needed

further documentation and sharing

From NIST Contingency Planning Guide for Information Technology Systems, pg. 10.

Page 26: Preservation Section Disaster Planning Presentation (SAA 2010)

Plans for Digital Assets

• Cyber Incident Response Plan – Provide strategies to detect, respond to, and limit

consequences of malicious cyber incident – Focuses on information security responses to

incidents affecting systems and/or networks– At ICPSR: Existing plan incorporated into suite

From NIST Contingency Planning Guide for Information Technology Systems, pg. 10.

Page 27: Preservation Section Disaster Planning Presentation (SAA 2010)

Plans for Digital Assets

• Disaster Recovery Plan (DRP) – Provide detailed procedures to facilitate recovery

of capabilities at an alternate site– Limited to major disruptions with long-tem effects– At ICPSR: Web Continuity Plan (cloud backup)– At ICPSR: Archival backups stored at different

locations and documenting recovery procedures

From NIST Contingency Planning Guide for Information Technology Systems, pg. 10.

Page 28: Preservation Section Disaster Planning Presentation (SAA 2010)

Implementation and Maintenance

• Standing Disaster Planning Committee– Headed by Assistant Director for Administration

• Web Continuity Plan – Tested in controlled environment several times– Provided access to content during 1 power outage

in May 2009

• To Do List– Have a tabletop exercise centered around IT

assets– Get a better hold of in-house digital assets

Page 29: Preservation Section Disaster Planning Presentation (SAA 2010)

Promulgate Results

From http://www.icpsr.umich.edu/icpsrweb/ICPSR/curation/disaster/index.jsp

Page 30: Preservation Section Disaster Planning Presentation (SAA 2010)

Takeaways

• Disaster Planning Process– Core functions provide framework for process– Disaster plan is composed of a suite of plans,

procedures, and policies

• Planning for digital assets – Some plans are suited to cover digital content– Recommend using NIST Guide for guidance – Archive community needs more accessible

guidance on planning for digital asset protection

Page 31: Preservation Section Disaster Planning Presentation (SAA 2010)

Acknowledgements • Nancy McGovern, Digital Preservation Officer, ICPSR• Content for this presentation was initially developed for the

Digital Preservation Management Workshops http://www.icpsr.umich.edu/dpm/workshops/fiveday.html • Rebecca Hatcher and the SAA Preservation Section

• Slides 1 and 32: “and you thought you had computer problems” by mandyxclear http://www.flickr.com/photos/mandyxclear/3461234232/

• Slide 4: “Benjamin Franklin - 270/365, 6/24/10” by vpickeringhttp://www.flickr.com/photos/vpickering/4783819450/

• Slide 5: “ServerBurn2” by Topatohttp://www.flickr.com/photos/roadhunter/68017721/

• Slide 6: Drawings by Rebecca Goldmanhttp://derangementanddescription.wordpress.com/2010/08/12/dangers-and-derangers/

• Slide 19: “Motherboard flame” by Alfo23 http://www.flickr.com/photos/alfo23/1809728501/

Page 32: Preservation Section Disaster Planning Presentation (SAA 2010)

QUESTIONS?Please contact Lance [email protected]