43
© Ronald D. Damhof Januari 2016 All About Data - UMCG It’s all about the data: A Managerial Perspective By Ronald Damhof

It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

Embed Size (px)

Citation preview

Page 1: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

It’s all about the data: A Managerial Perspective

By Ronald Damhof

Page 2: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

I am an opinionated kind a guy….

My Data Manifesto:

The X commandments of data management

Page 3: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

I. Thou shall always respect

& consider the context.

Context is leading

Cynafin: D.Snowden (cognitive-edge)

Page 4: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

II. Thou shall love your

(meta)data. Data is the

ultimate proprietary

asset:

- Manage it

- Govern it

- Utilise it

But do it ethically

“Most companies manage their

parking lot better than their data” —Gartner, Frank Buytendijk (paraphrased)

Page 5: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

III.Thou shall stop centering

apps over data: data first

Page 6: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

IV.Thou shall strive for

accurate, relevant, timely,

reliable and accessible data:

It is all about the quality of

the product

Deming’s point 3 of 14:

”Cease dependence on inspection to

achieve quality. Eliminate the need for

massive inspection by building quality

into the product in the first place."

Page 7: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

V. Thou shall abstract

Page 8: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

VI.Thou shall make a

‘fundamentalistic’ separation

between facts & context

Page 9: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

VI. Thou shall not forsake ‘TIME’

Page 10: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

VIII.Thou shall uphold, improve

and teach the science and

practice of Information- &

data modeling

Page 11: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

IX.Thou shall Specify,

Standardise, Automate &

Productise

Page 12: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

X. Thou can not buy your

way out of the data

misery you are in

Page 13: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

‘XI’ There is a new saviour in town. Its name is Hadoop

and it calls to us from its mountain:

‘we got a lake and thou shall throw all your data in

it. The water will be clean so you can drink it, the

water will flow so it will irrigate your lands, grow

your stock, feed your kids and of course bring you

world peace…..’

Page 14: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

A sensemaking framework

for a

Managerial Perspective on Data

Back to the topic at hand…

Page 15: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Page 16: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Page 17: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Page 18: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Page 19: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Page 20: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Page 21: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Page 22: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Page 23: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Push/Supply/Source driven Pull/Demand/Product driven

Mass deployment

Control > Agility

Validation of “ingredients”

Repeatable & predictable proces

Standardized processes

High level of automation

High Information Engineers (≠IT!)

Piece deployment

Agility > Control

Plausibility

User-friendliness

Relatively low IT expertise

Domain expertise essential

All facts, fully temporal Truth, Interpretation, Context

Business Rules Downstream

The Data Push Pull Point

Page 24: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Systematic

Opportunistic

User & developer are separated

Defensive Governance

Focus on non-functionals

Centralised

Proper system development

User = developer

Offensive governance

Decentralised

“System development” in production

The Development Style

Page 25: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

The Data Quadrant Model

Page 26: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

7 Applications of the Quadrant

How 2 produce

How 2 automate

How 2 organize

How 2 govern

How about people

How about technology

How 2 model

Page 27: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

(1) How 2 produce

Page 28: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

X

(1) How 2 produce, variants

Page 29: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Production-line: Data orientation

Data Products Information

Products

Access to data

Analytical tools

Processing Power

Production-line: Forms orientation

Eg. XBRL/JSON

(1) How 2 produce,production lines

Production-line: Poly Structured

Page 30: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

(2) How 2 automate

Page 31: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Rephrased - somewhat more nerdy:

• Model-driven, metadata driven

Or

• Declarative instead of Imperative

Rephrased - somewhat more popular:

“In Data, the developer is the data modeller”

(2) How 2 automate

Page 32: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

(3) How 2 organize

Page 33: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

To Centralize or to Decentralize

Page 34: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

(4) How 2 govern

Page 35: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

How 2 govern, Innovation in Data

Page 36: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

I II

III IV

Deliverant is

Accountable

Demandee is

Accountable

Data scientist/Analyst/Researcher accountable

How 2 govern, Accountability Never, never, never ‘ownership’

In- en outbound

Data Delivery

Agreements

With great power comes great responsibility

Page 37: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

(5) How do people excel

Page 38: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Storage: (R)DBMS

Processing: Automation Software

Data Quality: Validation, Profiling

Development: Data Modeling

Accessibility: Data Virtualization

Storage: Pattern based

Processing: Automation/limited ETL

Data Quality: DQ rules/dashboards

User tooling: Reporting, dashboards,

Data Visualization

Storage: Analytical

Processing: Preptools for Data Analyst

User tooling: Advanced Analytics,

Data Visualization

(6) How about Technology

Infrastructure-as-service

Datalakes

Fileservers

Page 39: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

(7) Business-,Information- or

Data Modeling is key

Conceptual

Logical

e.g

Fact based,

Graph,

Key-value

Models that fit

the need At least the Logical Model

drives the technical data

architecture, design and

implementation

Ontology

Facts

Relational

Natural Language

ORM / FCO-IM

Page 40: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Please (!) have a holistic view &

strategy of data – it’s a supply

chain.

Data isn't ‘One size fits all’

If you have x Euro to invest, what

quadrant would you invest in?

If you want to be data-driven,

how would you organize

yourselves?

What kind of competencies and skills would you need?

Think before you buy, think hard. Do not follow blindly the

latest tech fad, protocol x, method y, best practice z.

Fight the entropy! It isn't free….

Page 41: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Page 42: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Page 43: It’s all about the data: A Managerial Perspective · PDF fileIt’s all about the data: A Managerial Perspective ... Data Modeling Accessibility ... Preptools for Data Analyst User

© Ronald D. Damhof – Januari 2016 – All About Data - UMCG

Thank

you