37
Sustaining Success by Achieving Excellence “Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016 1 st Annual Hadoop in Enterprise Architecture Summit Karachi, Pakistan Integration and Governance in a Big Data World Presenter: Prof. Dr. Frank L. Harper, Jr., Ph.D., PMP, PIF, ITIL, CSSGB, CGEIT(c.) Author A.G.I.L.E. L.E.A.D.E.R.S.H.I.P. with a G.R.I.P. Strategic Advisor & Consultant Innovative Management Systems, Pvt. President and Chief Performance Officer Intelligent Systems Services, LLC.

Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Embed Size (px)

Citation preview

Page 1: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success by Achieving Excellence “Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

1st Annual Hadoop in Enterprise Architecture

Summit – Karachi, Pakistan

Integration and Governance in a Big Data World Presenter:

Prof. Dr. Frank L. Harper, Jr., Ph.D., PMP, PIF, ITIL, CSSGB, CGEIT(c.)

Author – A.G.I.L.E. L.E.A.D.E.R.S.H.I.P. with a G.R.I.P.

Strategic Advisor & Consultant – Innovative Management Systems, Pvt.

President and Chief Performance Officer Intelligent Systems Services, LLC.

Page 2: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Assalamu Aleikom

Page 3: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

• Introduction

• Trip Down Memory Lane

• Information (Data) Governance

• Why Govern BIG DATA?

– Data Lifecycle Management

– Benefits of Information Integration Governance

• Big Data, Trust, and Risk Assessment

• Business Transformation, Information Integration and

Governance

• An Information Governance Process

• Questions and Answers

AGENDA

Page 4: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

About Dr. Frank L. Harper, Jr., Ph.D., PMP®, PIF, ITIL, CSSGB, CGEIT (c.)

• Current: President & Chief Performance Officer, Author, Speaker, Adjunct Associate

Professor, Leadership Coach, Advisory Board Member

• Professional Experience: 35+ Years

• Professional Roles: CEO, Chief Information Officer, Deputy Chief Information Officer,

Sr. Process Strategist/Manager - IT Governance, Business, Process Strategist,

Process Excellence Director, Chief Program Management Officer, Global Practice

Director, Sr. Project Manager, PMI OPM3 Team Leader, Chief Information Engineer,

Software Architect, Enterprise Architect, Data Governance Architect, Lead Systems

Analyst, Program Analyst-Engineer, Programmer/Analyst,

• Competencies: Leadership Coaching, Strategic Management, Enterprise Architecture,

Business Transformation, Governance [IT, Program, Project, Data], and Organizational

Behavior

• Author: IT and personal development courses, articles, and books on Organizational

Leadership and Transformation

• Researcher: Project Management Institute, Cambridge Corporate University

• Education: PhD in Administration & Management [Organizational Leadership &

Transformation], MBA in Marketing, MS in Industrial Engineering, BS in Computer

Technology (Cum Laude)

• MPAs: Family, Project Success Rate of 96%, Uplifting of 1000’s leaders

Page 5: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Information (Data) and Integration Governance Programs

• McDonald’s & Countrywide Funding (ensuring high quality Master Data while supporting clear roles and responsibility and controls, formalized Governance and Stewardship and support SOX-compliance as they realign data and processes to use Oracle, COBIT)

• The Coca Cola Company, USAA, Warner Brothers (address legacy data integration and sourcing issues, standards, customer data, product data)

• Merial Pharmaceutical (support Data Quality, focus on improvement of Key Master Data for Business Process Transformation project)

• City of Atlanta (supporting Data Quality of Business Intelligence metrics for Balanced Scorecarding, enterprise process, enterprise decision-making)

• 3M (supporting Data Quality for customer DW, enterprise process, enterprise decision-making)

• Sterling Software/Knowledgeware (global competency expert in information management practice defining standards for enterprise encyclopedia management)

Page 6: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Seven Roles of Highly Effective CIOs

Page 7: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Seven Roles of Highly Effective CIOs

Role One - Utility Provider

Oversee building and sustaining robust, reliable, and economical IT infrastructure

services; direct addition of key utility services such as helpdesk and the

deployment of communication, collaboration and productivity tools

Role Two - Information Steward

Development of an enterprise architecture, standards, compliance, integrity and

privacy information

Role Three - Educator

Raise the awareness of business peers about strategic role and relevance of key

information technologies and help them become more “savvy” in making strategic

IT decisions

Role Four - Integrator

Lead enterprise efforts to digitize and integrate processes, information and

decision-support; oversees the implementation of crucial program management

offices and portfolio management systems

Page 8: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Seven Roles of Highly Effective CIOs

Role 5 - Relationship Architect

Connect, Communicate, Coordinate, and Collaborate – Internally and Externally

Roles 6 - Strategist

Actively serve as innovation catalyst and work with your business peers in

discovering opportunities to leverage IT in innovative business models, customer

relationship, and the pursuit of agility

Roles 7 - Leader

Lead, design, and govern the IT organization ensuring that the IT organization has

the right staff, works actively on developing human capital, and inspires IT

professionals to contribute to the organization’s mission and achieve their full

potential

Source: Society of Information Management

Page 9: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Information (Data) Governance

Page 10: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Defined as: The management of risk & compliance.

“The overall methodology by which Information

(Data) is directed, administered and controlled to

ensure it is TRUSTED”

Compliance Governance

Information (Data) Governance

Page 11: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Why Govern Big Data?

Page 12: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Identity Manager

Why Govern Big Data?: Your Data Life Cycle Management

Firewall Network

Applications

Switch

Load Balancer Portal

SAP

PSFT

Siebel

Web Services

3rd Party applications

End User

Web Servers

Databases

Router

Mainframe

Database

Black Box

Page 13: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Why Govern Big Data?: Your Data Life Cycle Management

Question!

1. Do you know expiry data and

aging policy?

2. Do you know archive policy?

Page 14: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Why Govern Big Data?: Your Data’s Lifecycle Management

More Issues

1. Retention problem

2. Security, Monitor, Enforce

3. Data Quality

4. Data Integrity

Page 15: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Why Govern Big Data?: Your Data’s Lifecycle Management

Data Usage

1. Big Data and MDM

2. MDM and Governance

Page 16: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Why Govern Big Data?: Your Data’s Lifecycle Management

Strategic Pitfalls:

1. Research initiative

2. New capabilities

Page 17: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Enterprise (Universal) Commerce

Source: Effective Leadership for Enterprise Commerce Management

Page 18: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Big Data, Trust, and Risk

Assessment

Page 19: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Competing on Information and Analytics

Business reason: Competitive advantage

1. Trusted Information

2. Risk assessment

3. 2015 – 80% data uncertainty

4. Information Integration Governance

Page 20: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Business Transformation

Information Integration and

Governance

Page 21: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Business Transformation and Information Integration & Governance

Integration

and

Governance

Page 22: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

IT and Data Governance Relationship

Corporate

Governance

IT

Governance

Data

Governance IT DM Council

Data

Quality

Data Quality

Strategy Standards and

Policies ………… Data

Architecture Data Management

Processes

Governance

Management

Page 23: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Information (Data) Governance Focus Areas

A single framework can help organize efforts.

Information (Data)

Governance Focus

Area

Page 24: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Believability

Objectivity

Ease of

Manipulation

Understandability

Interpretability

Consistent

Representation

Appropriate

Amount

Currency

Completeness

Relevancy

Accuracy

Trusted Information- Part 1

Security /

Accessibility

Contextual Information

Quality Criteria

Intrinsic The extent to which information is

regarded as true and credible

The extent to which information is highly

regarded in terms of its source or content

The extent to which information is

applicable and helpful for the task at hand

The extent to which information is not

missing and is of sufficient depth and

breadth for the task at hand

The extent to which information is

sufficiently up to date for the task at hand

The extent to which volume of

information is appropriate for task at hand

The extent to which information is

presented in the same format

The extent to which information is in

appropriate languages/symbols, and clear

The extent to which information is easily

comprehended

The extent to which information is easy to

manipulate and apply to different tasks

The extent to which information is correct

and reliable

The extent to which information is

unbiased, unprejudiced and impartial

The extent to which

information is

applicable to the task

of the information use

and is presented in

an intelligible and

clear manner,

recognizing that

information quality

depends on the

context of use

Reputation The extent to which

data values are in

conformance with the

actual or true values

The extent to which

information is available

or obtainable

Page 25: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Restricted

Access

Availability

Ease of

Manipulation

Relevancy

Accuracy

Trusted Information- Part 2

Security /

Accessibility

Contextual

Intrinsic

The extent to which information is highly

regarded in terms of its source or content

The extent to which information is

applicable and helpful for the task at hand

The extent to which information is easy to

manipulate and apply to different tasks

The extent to which information is

available when required, or easily and

quickly retrievable

The extent to which access to information

is restricted appropriately to authorized

parties

The extent to which information is correct

and reliable

The extent to which

information is

applicable to the task

of the information use

and is presented in

an intelligible and

clear manner,

recognizing that

information quality

depends on the

context of use

Reputation The extent to which

data values are in

conformance with the

actual or true values

Information

Quality Criteria

The extent to which

information is available

or obtainable

Page 26: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

An Information Governance

Process

Page 27: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

1. Establish Goals for Data Governance

2. Engage Data Governance Stakeholders

3. Align Data Governance Activities

4. Exercise Data Governance through Key Activities

5. Communicate Achievements

Process of Governing Data

Page 28: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

1. Establish Goals for Data Governance

Page 29: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

2. Engage Governance Stakeholders

Page 30: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

3. Align Data Governance Activities

Page 31: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

4. Exercise Data Governance Through Key Activities

Page 32: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Exercise Data Governance – Technical Platform

Set of tools needed for enterprise data governance

Page 33: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Exercise Data Governance – Technical Platform

Page 34: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

The Logical Data Warehouse

Page 35: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Summary of Presentation

• Big Data must be governed

• You can’t have quality analytics without quality data

• Information integration and governance is a business strategy.

• Implement governance technology to be successful

Page 36: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

THANK YOU!

‘Jazakum Allah Khayran’( ُ َخْيًرا ) َجَزاُكُم َّللاه ‘

"May Allah reward you [in] goodness."

Page 37: Open-BDA Hadoop Summit 2014 - Prof. Dr. Frank L Harper Jr. (Integration & Governance in a Big Data World)

Sustaining Success By Achieving Excellence

“Inspiring Leaders Globally Through Transformation” ©Copyright 2014 to 2016

Contact Information

USA Email: [email protected]

Web: www.intelligentsystemsservices.com

Skype: dr.frank.l.harper.jr

Phone: 877-740-9634

PAKISTAN Email: [email protected]

Web: www.innovative-management.org

Skype:dr.frank.l.harper.jr

Phone: +92 21 3588 3381-3

SWITZERLAND Email: [email protected]

Web: www.cambridgecu.ch

Skype:dr.frank.l.harper.jr

Phone: 877-740-9634