48
Building a Big Data Maturity Model Samudra Kanankearachchi NGTC Conference (c)

Unicom Big Data Conference

Embed Size (px)

DESCRIPTION

Building a Big Data Maturity Model

Citation preview

Page 1: Unicom  Big Data Conference

Building a Big Data Maturity ModelSamudra Kanankearachchi

NGTC Conference (c)

Page 2: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Big Data Conference India

Page 3: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Hype of Big Data is around Quantity

Page 4: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Semantic Web (POC)

MSc Project Travel Planner

Page 5: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Why Big Data is Not Popular yet in Sri Lanka?

Page 6: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Does Sri Lanka have a real big data business case ?

How big are we in global?

Is Sri Lanka is too Small ?

Page 7: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Is it Enough?

Only focus on Volume , Velocity Variety

Page 8: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Let’s take real life example

Page 9: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Impact of unplanned growth

Page 10: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Infrastructure not mature for sustainable growth

Shared (Water , Food , Land , Energy …)

Popu

latio

n G

row

th

Qua

lity

of L

ife

Lack of Infrastructure for

growth

Page 11: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Moral of the Story

Qualitative Quantity

Page 12: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Why our tourism is a right match ?

Quantity Quality

Page 13: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Many government initiative

Page 14: Unicom  Big Data Conference

Next Generation Testing Conference (c)

State of Software/IT Eco System

Lack of personalization.

Unable to convert information into Action

Lack of Timely information.

Mostly Surrounded with silos

Page 15: Unicom  Big Data Conference

Next Generation Testing Conference (c)

We need a maturity model

Page 16: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Maturity Model

Optimizing

Intelligent/insight

Social Interaction

Semantic Connectivity

Basic Enterprise (Volume/Variety/Velocity )

Core Infrastructure ( Storage / Compute/ Internets)

Level 1

Level 2

Level 3

Level 4

Level 5

Big Data in Silos

If they can’t express

If they can’t Socialize

If not intelligent

If cannot scale and optimize

Page 17: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Maturity Level 1 (Current State)

5. Optimizing

4. Intelligent insight

3. Social Interaction

2. Semantic Connectivity

1. Basic Enterprise (Volume/Variety/Velocity )

Core Infrastructure ( Storage / Compute/ Internets)

Page 18: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Basic system

Page 19: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Business Silos

Bus Providers

Flying /Shipping providers

TravelersHotels

Agencies Entertainment Providers

Page 20: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Enterprise Silos

Cinnamon group

Amaya Group

Chaya Group

Page 21: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Impact of Silos

As a traveler I wanted to find travel information to plan a trip to Sri Lanka

Page 22: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Approach 1

Travel AgencyTraveler

Call

E-mail

Web System

Impact : [Lot of manual work for integration]

Page 23: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Approach 2

Page 24: Unicom  Big Data Conference

Next Generation Testing Conference (c)

It is a web of documents

Impact : [Lot more manual work to find details]

Page 25: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Maturity Level 2

5. Optimizing

4. Intelligent insight

3. Social

2. Semantic Connectivity

1. Basic Enterprise (Volume/Variety/Velocity )

Core Infrastructure ( Storage / Compute/ Internets)

Page 26: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Web of Things

Hotels

SitesTaxi

Travelers

Night Clubs

Travel Agency

Page 27: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Web of People , Places , Things

Page 28: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Developing semantic graph

Page 29: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Basic Ontology Sample

Page 30: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Querying the Ontology

• Places near by “Hambanthota” ?• Places that are famous for wild life ?

Page 31: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Facebook Graph Search

Page 32: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Places in Kandy

Page 33: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Openness- Standards

Page 34: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Linking Ontologies Together

Linked Ontology/ Linked Data

XYZ Hotel Ontology

ABC Travel Agency

PQR Taxi Service Ontology

Page 35: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Now I can query Complete travel plan

Linked Ontology/ Linked Data

• How to travel ?• Where to Stay ?• Food to eat ?• Options to Enjoy ?

Page 36: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Maturity Level 3

5. Optimizing

4. Intelligent insight

3. Social

2. Semantic Connectivity

1. Basic Enterprise (Volume/Variety/Velocity )

Core Infrastructure ( Storage / Compute/ Internets)

Page 37: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Adding Social Layer

Linked Ontology/ Linked Data

XYZ Hotel Ontology

ABC Travel Agency

PQR Taxi Service

Ontology

Social Layer (Sharing / Ranking /Tagging…)

Identity Collaboration

Page 38: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Example

Page 39: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Maturity Level 4

Optimizing

4. Intelligent insight

3. Social

2. Semantic Connectivity

1. Basic Enterprise (Volume/Variety/Velocity )

Core Infrastructure ( Storage / Compute/ Internets)

Page 40: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Insights

5. Optimizing

4. Intelligent insight

3

2

1. Basic Enterprise (Volume/Variety/Velocity )

What can you offer with out level 2, Level 3 ?

Page 41: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Insight

• Insight what you users wants• Your Ontologies has insight what the system

can offer • Integrating Internet of Things

• Analytics

Page 42: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Maturity Level 5

Optimizing

4. Intelligent insight

3. Social

2. Semantic Connectivity

1. Basic Enterprise (Volume/Variety/Velocity )

Core Infrastructure ( Storage / Compute/ Internets)

Page 43: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Apache Jena (Middleware)

Page 44: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Scaling and Tooling

• https://jena.apache.org/• Microsoft.Net Port– http://www.linkeddatatools.com/downloads/jena-

net

Page 45: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Facebook Open Graph (Alternative)

Page 46: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Future (Apps , IOT, API)

Devices AppsUsers

Management. Access. Protection.

Data

Page 47: Unicom  Big Data Conference

Next Generation Testing Conference (c)

Developing a Market Place

Page 48: Unicom  Big Data Conference

Your Contact

NGTC Conference (c)