Upload
phamhanh
View
217
Download
1
Embed Size (px)
Citation preview
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
It’s all about the data: A Managerial Perspective
By Ronald Damhof
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
I am an opinionated kind a guy….
My Data Manifesto:
The X commandments of data management
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
I. Thou shall always respect
& consider the context.
Context is leading
Cynafin: D.Snowden (cognitive-edge)
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
II. Thou shall love your
(meta)data. Data is the
ultimate proprietary
asset:
- Manage it
- Govern it
- Utilise it
But do it ethically
“Most companies manage their
parking lot better than their data” —Gartner, Frank Buytendijk (paraphrased)
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
III.Thou shall stop centering
apps over data: data first
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
IV.Thou shall strive for
accurate, relevant, timely,
reliable and accessible data:
It is all about the quality of
the product
Deming’s point 3 of 14:
”Cease dependence on inspection to
achieve quality. Eliminate the need for
massive inspection by building quality
into the product in the first place."
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
V. Thou shall abstract
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
VI.Thou shall make a
‘fundamentalistic’ separation
between facts & context
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
VI. Thou shall not forsake ‘TIME’
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
VIII.Thou shall uphold, improve
and teach the science and
practice of Information- &
data modeling
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
IX.Thou shall Specify,
Standardise, Automate &
Productise
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
X. Thou can not buy your
way out of the data
misery you are in
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
‘XI’ There is a new saviour in town. Its name is Hadoop
and it calls to us from its mountain:
‘we got a lake and thou shall throw all your data in
it. The water will be clean so you can drink it, the
water will flow so it will irrigate your lands, grow
your stock, feed your kids and of course bring you
world peace…..’
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
A sensemaking framework
for a
Managerial Perspective on Data
Back to the topic at hand…
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
Push/Supply/Source driven Pull/Demand/Product driven
Mass deployment
Control > Agility
Validation of “ingredients”
Repeatable & predictable proces
Standardized processes
High level of automation
High Information Engineers (≠IT!)
Piece deployment
Agility > Control
Plausibility
User-friendliness
Relatively low IT expertise
Domain expertise essential
All facts, fully temporal Truth, Interpretation, Context
Business Rules Downstream
The Data Push Pull Point
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
Systematic
Opportunistic
User & developer are separated
Defensive Governance
Focus on non-functionals
Centralised
Proper system development
User = developer
Offensive governance
Decentralised
“System development” in production
The Development Style
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
The Data Quadrant Model
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
7 Applications of the Quadrant
How 2 produce
How 2 automate
How 2 organize
How 2 govern
How about people
How about technology
How 2 model
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
(1) How 2 produce
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
X
(1) How 2 produce, variants
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
Production-line: Data orientation
Data Products Information
Products
Access to data
Analytical tools
Processing Power
Production-line: Forms orientation
Eg. XBRL/JSON
(1) How 2 produce,production lines
Production-line: Poly Structured
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
(2) How 2 automate
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
Rephrased - somewhat more nerdy:
• Model-driven, metadata driven
Or
• Declarative instead of Imperative
Rephrased - somewhat more popular:
“In Data, the developer is the data modeller”
(2) How 2 automate
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
(3) How 2 organize
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
To Centralize or to Decentralize
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
(4) How 2 govern
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
How 2 govern, Innovation in Data
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
I II
III IV
Deliverant is
Accountable
Demandee is
Accountable
Data scientist/Analyst/Researcher accountable
How 2 govern, Accountability Never, never, never ‘ownership’
In- en outbound
Data Delivery
Agreements
With great power comes great responsibility
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
(5) How do people excel
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
Storage: (R)DBMS
Processing: Automation Software
Data Quality: Validation, Profiling
Development: Data Modeling
Accessibility: Data Virtualization
Storage: Pattern based
Processing: Automation/limited ETL
Data Quality: DQ rules/dashboards
User tooling: Reporting, dashboards,
Data Visualization
Storage: Analytical
Processing: Preptools for Data Analyst
User tooling: Advanced Analytics,
Data Visualization
(6) How about Technology
Infrastructure-as-service
Datalakes
Fileservers
…
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
(7) Business-,Information- or
Data Modeling is key
Conceptual
Logical
e.g
Fact based,
Graph,
Key-value
Models that fit
the need At least the Logical Model
drives the technical data
architecture, design and
implementation
Ontology
Facts
Relational
Natural Language
ORM / FCO-IM
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
Please (!) have a holistic view &
strategy of data – it’s a supply
chain.
Data isn't ‘One size fits all’
If you have x Euro to invest, what
quadrant would you invest in?
If you want to be data-driven,
how would you organize
yourselves?
What kind of competencies and skills would you need?
Think before you buy, think hard. Do not follow blindly the
latest tech fad, protocol x, method y, best practice z.
Fight the entropy! It isn't free….
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
© Ronald D. Damhof – Januari 2016 – All About Data - UMCG
Thank
you