Upload
lenguyet
View
214
Download
0
Embed Size (px)
Citation preview
Oakville Hydro January 14, 2016
BUSINESS CONTINUITY
Oakville Enterprises Corporation
Oakville Hydro Electricity Distribution
13th largest electricity distributor in Ontario
OUR ASSETS Total asset base of $230 million
Distribution system consisting of
o Underground cable: 1,348 km
o Overhead circuit wires: 486 km
OUR CUSTOMERS 67,821
OUR SERVICE AREA 143 square km
Business Continuity vs Emergency Operation Plan 2013 Ice Storm Oakville Hydro’s Initiatives “Mock Disaster” of the Emergency Operations Plan “Casper Test” of the Business Continuity Plan Test
Lessons Learned Conclusions
Outline
Business Continuity Plans at OEC
Emergency Operation
Plan
IT DRP
Pandemic Plan
Emergency Communication
Plan Customer Service
Plan Affiliate
Emergency Plans
Background
Timeline of Events
2015
EOP Review
Q4
Impact Analysis & Mitigation
Casper Test
2014 2013 Q1 Q3 Q1 Q2 Q3 Q4 Q1 Q2
Ongoing Business Continuity Program
2016
Ice Storm
Q2 Q4
Mock Disaster
Potential Business Interruptions
Enterprise Critical Functions
Vulnerability? Interruption Tolerance?
Impacts
Mitigate Probability Mitigate Impact
Provide for Interruption
Emergency Incident
Response & Recovery Emergency Command
Communications
Continuous Enterprise
Risk Management
Risks
Tracking
BCP Framework Implementation
First Phase: The Mock Disaster
Scope: major ice storm increased customer calls loss of power from the Grid loss of feeder to office and control room
Mitigations to be tested – prepared simulations Departments’ preparations including I.T. support Test performed June 2015
Second Phase: The Casper Event
Why a Second test?
Major Interruption: Building unavailable
What did we want to achieve out of the test? Test Performed October 2015
Casper Event
Distribution Operations
Consists of: Line Operations
Maintenance
Construction
Warehouse
Distribution Operations
Operations: Ice Storm Response
Our Experience of the Ice Storm Customers Feedback was lost High volume of customer calls Met customer needs but took a large concerted effort
Used scouts to locate the worst hit areas
Constantly prioritized work – in a reactive nature
Paper based planning and reporting
Operations: Mock Disaster
The Strategy Leveraged the work order system
Moved away from paper
Trained staff in new process
Provide more accurate Estimated Time of Restoration
(ETR)
Operations: Casper Event
An event with significant preparation Challenges Find locations for: vehicles equipment material
Relocation of critical staff to “Hotel”
Operations: Casper Event
Lessons Learned Long preparation time Resource availability
Next Steps How can we shorten the lag Continually assess your tolerances for business
interruptions
Engineering & Construction
Consists of: Planning, Design & Standards
Construction Management
GIS & Records Management
New Customer Connections
Engineering: Ice Storm Response
All Staff Re-deployed to Emergency Operations
Prioritized Customer Calls
Managed Scout Deployment
Prepared Paper “Work Packages” for Operations team
Entered Trouble Calls into GIS
Engineering: Mock Disaster
Customer Calls Logged in Service Manager Dispatched Electronically to Scouts Service Calls Logged Manually into GIS Scouts: Assigned To Geographic Zones Redeploy as Required Updated Calls on Laptop
Service Manager Dispatch Board
GIS Overall Showing Trouble Calls
Home Office set up for Technical Staff
Mobile Office set up for Field Staff
Hoteling organized for critical Administrative Staff What About All of that Paper in the Office?
GIS/CAD – “The Need For Speed”
Engineering: Casper Event
Engineering: Future Considerations
Automate Interface Between Service Manager & GIS
Accelerate current project – Paperless Filing System Enhance Mobile & Off Site Access Capabilities Cloud Solutions For Access to Information Secure Offsite Facilities for “Heavy Users” - GIS
Customer Service
Customer Service: Providing our customers with a positive experience
when they interact with Oakville Hydro
Billing
Electricity and Water
Bi-monthly
Customer Service: Ice Storm Response
Issues Identified Limited phone capacity – simultaneous calls Limitations to Call Centre capabilities – few
options Limitations with after hours service Logging calls into excel – need for a common
database
Customer Service: Casper Event
Onsite – Staff available to serve customers
Offsite – Vendor Facility
Field Services
Home setup with Jabber software for phones
Customer Service: Enhancements and Future Considerations
1. Call Centre - Simultaneous calls and flow
2. After Hours Service – Power Assist
3. Data base – Outage Management System, Great Plains
4. Social Media – Twitter and Facebook
5. Interactive Voice Response (IVR)
Information Technology
IT Staff servicing Oakville Enterprises Corporation and responsible for: Infrastructure Core Business Applications Client services
Operation technology (OT)
Disaster Recovery Plan (DRP) vs Business Continuity Plan (BCP)
Information Technology: Ice Storm Response
Building availability, systems intact
Providing access to data externally, VPN, Citrix was available
Challenges Web site, phone lines capacity Communications to the customers Field Mobility
Information Technology: Mock Disaster
Mock Disaster Emergency Operating Plan (EOP) IT department fully engaged Innovation for new ways to provide for the business
needs Short term planning for next test
Facilities – Generator power requirements for IT
Infrastructure
Information Technology: Casper Event New services Jabber – VPN access to the CS queues Support of OMS initiatives New Citrix environment New business applications for field work order management Upgrade of mobile devices Casper IT enhances its understanding of the expectations of the
business Business’s understanding of IT team support
Information Technology: Future Considerations
Ongoing technical and system improvements
Building on Collaboration
Long term capital planning
Lessons Learned
Modular Testing Formal Preparation Clear Objectives & Goals Proper Planning Debrief and learn
Conclusions
Support from the leaders of the organization Significant commitment and effort required Goals and targets Reaching elevated levels of engagement and
collaboration Conducting “Test without warning” Journey of continual improvement