18
2015 Engineering & Construction Conference Bona Allen Mark Blumkin David Pulido Patrick Williams June 18, 2015 Managing Project Risk Using Predictive Project Analytics

2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

Embed Size (px)

Citation preview

Page 1: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

2015 Engineering & Construction Conference

Bona Allen Mark Blumkin David Pulido Patrick Williams June 18, 2015

Managing Project Risk Using Predictive Project Analytics

Page 2: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

Is the E&C Industry Ready for Data Analytics

Predictive Project Analytics Overview

Discussion Topics

Q&A

Contents

Member Firms and DTTL: Insert appropriate copyright (Go Header & Footer to edit this text) 2

Page 3: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

Why Analytics?

3 Member Firms and DTTL: Insert appropriate copyright (Go Header & Footer to edit this text)

Page 4: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

Why risk analytics: Analysis • smart people gathering some data • calculating some options

• using excel spreadsheets • making recommendations

Challenges • data gathering is difficult and time

consuming • can often show that different views are ‘right

• often considers decisions in isolation of other planned changes

• often retrospective and fails the ‘so what’ test

• leads to a focus on a few key datasets

Analytics • identify patterns and correlations in

existing data • assess confidence in models/courses of

action

• use inputs to project future trends • use of specific analytic tools

• statistical modelling to develop scenarios

Page 5: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

Why risk analytics (con’t):

Area Typical Analysis Target Analytics

Datasets Considers a few key datasets Considers a broader picture of data

Focus Key indicators Relationships between different indicators

Projects forward

On the basis of all other things being equal

On the basis of relationships between indicators

Tools Excel SPSS / SAS

Repeat use None/limited Strategic picture enhances over time

Data quality Informally considers “error margin”

Formally considers confidence factors in conclusions

Robustness As good as people doing the work Statistical techniques embedded with the system

Assessment Good for simple decision making Good for complex systems

Page 6: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

• Many companies in other industries are using predictive data analytics to boost their competitive advantage

− Retailers, airlines, banks for example all use data to grow their business

• Engineering firms are ahead of constructors in the use of data

− BIM for increased efficiency in the design process

− Previous project design components and metrics used on current projects

− Data driven design for operational efficiencies

• Many contractors are still not applying data analytics

− Contractors are data consumers, not necessarily data generators

− Thin margins – not much appetite for investment

− Every project is different and data is not stored consistently

Is the E&C Industry Ready for Data Analytics? Competitive advantages may be the incentive

6 Member Firms and DTTL: Insert appropriate copyright (Go Header & Footer to edit this text)

Page 7: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

• However a growing number of contractors are finding ways to use their own data

− Comparisons of profitability (by industry, customer, region, etc.)

− Estimating quantities and costs based on past history

− Putting technology in the field (iPads for PMs and Superintendents)

− Codifying processes in software

• Other methods could be used to improve performance, compliance and win rate

− Monitoring unstructured data (e.g. e-mails) for key words/phrases

− Linking payroll data, including subcontractors, to schedule performance, labor rate compliance and future estimating

• We will explore the concept of predictive analytics – using previous project data to predict risks and shift management focus to deliver successful projects

Is the E&C Industry Ready for Data Analytics? Competitive advantages may be the incentive

7 Member Firms and DTTL: Insert appropriate copyright (Go Header & Footer to edit this text)

Page 8: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

Predictive Project Analytics New generational project management

8 Member Firms and DTTL: Insert appropriate copyright (Go Header & Footer to edit this text)

Page 9: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

© Deloitte LLP and affiliated entities.

What if there was a way to predict and avoid performance strains?

9

Predictive Project Analytics (PPA): an analytical project risk management capability that examines a project’(s) characteristics and assesses the appropriate level of oversight and governance: • Identifies project performance execution shortfalls • Avoids/mitigates execution performance strains and risks • Decreases likelihood of schedule overruns • Minimizes financial and reputation losses • Provides quantitative and defendable data to drive management

decisions

Ensures appropriate project controls are in place to improve project performance and probability of success.

Project Predictive Analytics

Page 10: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

© Deloitte LLP and affiliated entities.

A project risk management methodology based on a quantitative analytical engine.

VA

LU

E C

HA

IN

MARKET

MARKET DEMAND

GENERATION

SALES & SERVICE

SUPPORT FUNCTIONS

AND ACTIVITIES

Customer

Retailer

Business Development Marketing & Planning

E BasedG Based Other Related Functions / Orgs.Location WLocation XLocation YLocation Z

New Product Development Strategy & Planning MarketingTraining Relationship Mgmt 3rd Party Network Business Development

OTHER RELATED

FUNCTIONS

Call Centre

Application ProcessingEnquiries

Fraud Collections

Central Support

Merchant Support

Merchant Records

Chargebacks

Authorisations

Card Rewards

Supplier Management

Merchant Liaison

Operational Finance

Glasgow OPD

Programme / Change Management

OPD Issuing

OPD Acquiring

Management Information

Programme / Change Management

OPD Issuing

OPD Acquiring

Management Information

Operational Accounting

Risk

Business Intelligence

Business Analysis

Finance

Operational Risk

Compliance and Continuity

Business Development Helpdesk Card Risk Function YLondon Function X

Function X Cards IT Acquisition Finance Major Programmes DeliveryCard Admin

28 complexity factors, within 5 areas, are based on research that has identified the key characteristics that drive complexity on all projects

Comprehensive assessment of project performance and use analytics to highlight priority areas for improvement based on the project’s unique complexity

Database contains over 2,000 successfully completed projects from various industries, sizes, complexities and magnitude ranging up to US$5B

Navigator Project Database Complexity Assessment Risk Assessment/Health Check

PPA Overview

Project Predictive Analytics 10

Analytical tool with “Big Data” capabilities

PPA provides insights derived from systemic, scientific, and statistically-significant methodologies allowing for evidence based decision making.

Page 11: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

© Deloitte LLP and affiliated entities.

Complexity Summary Project Performance Summary

Actual vs. expected project practices for the project is 100% which is within the range of expected success, however there were key areas that showed controls/performance below what is expected.

Complexity Details

Summary Analysis

Project Controls Summary

• Average project complexity is 6.5

• Multi disciplinary team

• Requires board attention

Below AboveGovernance 23% 21%Ownership 7% 0%Delivery Management 13% 26%Business Unit 25% 25%Resource Management 0% 14%Risk Management 50% 0%Contracting Approach 21% 21%

% of factors outside of expected results

11 Project Predictive Analytics

Reporting Results & Visualization SAMPLE REPORTING DASHBOARDS

Page 12: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

© Deloitte LLP and affiliated entities.

Complexity Distribution of Project Portfolio Project Performance Comparison Performance Cliff Analysis

Explore the data you have • Reveal better Insight • Ask new questions

• Understand at what level of complexity projects begin to decrease in effective execution within an organization.

• Leverage existing data to uncover organizational project management capability strengths and weaknesses.

• Provide additional insight in project prioritization and fiscal planning.

• Better manage risk levels related to complexity across portfolio projects.

• Identify systemic issues within project execution and management.

• Identify areas that are consistently over controlled .

• Enable risk balanced adjustments to maximize capital efficiency.

12 Project Predictive Analytics

Reporting Results & Visualization – Program Level ADDITIONAL PPA REPORTING DASHBOARDS

Page 13: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

© Deloitte LLP and affiliated entities.

Discussion Topics

13 Member Firms and DTTL: Insert appropriate copyright (Go Header & Footer to edit this text)

Page 14: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

What metrics do E&C Firms measure? Examples of key performance indicators • Profitability by:

− Project, region, type of project, owner, etc.

• Estimate or cost at completion vs. initial estimate

• Change orders and claims, by cause, as a percent of original contract value

• Profit/margin fade over time

• Productivity/efficiency by subcontractor

Member Firms and DTTL: Insert appropriate copyright (Go Header & Footer to edit this text) 14

You can’t improve what

you don’t measure

Page 15: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

How to utilize analytics in Compliance and ERM programs

• Drive insight from dashboards: • statistical correlations between input and output indicators • identify leading and trailing indicators of performance • understand the value and indicators • link to business planning processes and plans • use all of the above to create a better dashboard

• Challenge plans and proposals

• review and enhance evidence behind current proposals • provide clarity on ambiguity • scenario model future events to stress test existing plans and approaches

• Check ‘pressure’ across activities

• compare and contrast plans across differing domains • understand pressures impact these domains and where they will first manifest • considering areas of overlaps and gaps between existing plans

• Data driven searches for new efficiency opportunities

• comparative analysis across departments and services • comparative analysis across comparator organisations • analysis to focus resources in areas most significantly impacting outcomes

• Build trusts in analytics capabilities

• review/improve existing information • enhance technology tools and techniques

Page 16: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

Other Risk Management Techniques

16

Velocity (risk manifestation): Slow Medium Fast

Risk Category: 1. Governance and Ownership 2. Risk Management 3. Delivery Management 4. Resource Management 5. Vendor Contract & Relationship Management 6. Change Management / Business Unit Impact

Risk Factor Low 1-5

Medium 6-10

High 11-16

Very High 17-25

Movement of risk classification Shift between

Date 1 & Date 2 Minimal/No

Change

Next Generation Risk Assessment Heat Map

Impa

ct

5

4

3

2

1

1 2 3 4 5

Likelihood

1

2 2 3

3

4 4

5 5

6 6

Project Predictive Analytics

• Lessons learned database • Cost estimating data updated frequently with

as-built costs • Subcontractor pre-qualification • Contractual protections • Insurance, including subcontractor default,

CCIP, etc. • Alignment of skill set and culture with customer,

region, industry and project type • Close scrutiny of design/engineering documents

during bid phase • Monitoring quality, safety and productivity during

construction

Page 17: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

17 Footer Copyright © 2014 Deloitte Development LLC. All rights reserved.

A copy of this presentation may be downloaded from the conference website.

To access this presentation – and all other presentations from this conference, please use the following url:

www2.deloitte.com/us/2015ECConference

You may also access all presentations and thoughtware through our conference app

Conference Resources

17 Copyright © 2014 Deloitte Development LLC. All rights reserved.

Page 18: 2014 Engineering & Construction Conference - Deloitte US · 2015 Engineering & Construction Conference Bona Allen Mark ... SPSS / SAS . Repeat use . ... A project risk management

Note: Insert information as indicated below, and replace fields with appropriate DTTL or member firm required language. DTTL communications should comply with the DTTL Language & Style Guide and the DTTL Required Legal Language document, accessible from Brand Space’s “Templates” section. Member Firms should consult with their legal counsel and/or Reputation and Risk Leader for the required language. Deloitte refers to one or more of Deloitte Touche Tohmatsu Limited, a UK private company limited by guarantee (“DTTL”), its network of member firms, and their related entities. DTTL and each of its member firms are legally separate and independent entities. DTTL (also referred to as “Deloitte Global”) does not provide services to clients. Please see www.deloitte.com/about for a more detailed description of DTTL and its member firms. [Member Firms: Insert description of your Member Firm’s national structure, confirmed with your Member Firm Legal Counsel and/or Member Firm Reputation and Risk Leader] [Member Firms and DTTL: Insert appropriate internal or external disclaimer language] [Member Firms and DTTL: Insert appropriate copyright] 18