Big Data

9 September 2017

Sprekers

Kees Cassee Caroline van Zeggeren

Big Data? We hebben jaren ‘veul’ data

Advanced Analytics is changing the world

“The next big innovation is going to take place at the intersection of hardware & software, with Artificial Intelligence in the center”

(Google, 2016)

Exponential growth in dataInternet of Things

Amazon echo Amazon Go August Smart Lock

Impact

In 2020, 50+ Bn devices will be connected to the internet, making everyday objects smart; this unlocks massive data as source of new services and business models. Data science will become key capability to analyze, interpret and monetize this

Supply chain & Store optimization: Smart store infrastructure, smart shelves, smart

checkout

Customer Experience: Automated ordering (smart fridge, washing machine) &

fulfillment. Personal health monitoring via wearables & healthy eating

inspiration/advice

Timing<2yrs 4yrs >5yrs

Artificial Intelligence

Chef Watson (IBM) Google TensorFlow Open AI/Elon Musk

Impact

Artificial intelligence (AI) are self learning/ problem solving algorithms, adding cognitive functions to services and robots. AI algorithms need vast amounts of data to deduct patterns to learn, generated by a.o. IoT. IBM Watson, Google Tensorflow and Musk’s OpenAI bring self learning algorithms as Open Source service to boost application

Machine/deep learning will be applied on personalisation in the short term, whereas

AI will take some time to become commercially viable.

According to the World Development Bank (2016) 45% of jobs in the USA & 35%

UK jobs will be replaced by algorithms & robots.

Personalized content will be produced ‘on the fly’ by AI, demonetizing for example

Allerhande content

Timing<2yrs 4yrs >5yrs

Machines starting to out-think humans

Faster than ever before5G Network

Impact

5G is not just another G, it will trigger a wave of innovation. It has an increased data volume (1.000x over current levels), low latency (5x reduction in transit time), 10-100x faster data-transfer speed, it is energy efficient and it can support more devices in a given area (factor 10-100).

5G is widely expected to be a defining stage in the global evolution of IT in general,

affecting almost all parts of industry and society.

Without 5G the predicted IoT, AI and new interfaces impact would not be possible.

5G is the enabler for connecting more devices, transferring more data and creating

new services upon the analysed data.

Timing<2yrs 4yrs >5yrs

All done 100% securelyDigital Trust

Impact

According to numerous studies, cyberattacks and cybercrime are on the rise globally. And as our economies, infrastructure, societies, and lives becomes increasingly digital and Internet connected in the future, the consequences of vulnerabilities may be much more significant.

Juniper research recently predicted that the rapid digitization of consumers’ lives

and enterprise records will increase the cost of data breaches to $2.1 trillion globally

by 2019, increasing to almost four times the estimated cost of breaches in 2015.

Companies are cooperating with ethical hacker communities to detect ‘zero days’ in

their software before criminals/ other governments do.

Timing<2yrs 4yrs >5yrs

Blockchain/Bitcoin ING fingerprint payment DigID

Real-world benefits across the business

Ons AH IT programma gebruikt een wijde range van personas

Customers

Thomas

Inspiration Shopper

Max

Healthy Shopper

Anna

Budget Shopper

Casper

Enjoyment ShopperEmma

Customer in Control

Katrien

Sustainable Shopper

Internal staff

Otto

Digital Designer

Mike

Promotion Analyst/

Data Scientist

Sarah

Merchandising &

Sourcing Analyst

Clara

Customer Service

Agent

De rol van IT

Data & Analytics

Data Science

Reporting

Analytics

Data

Go

vern

an

ce

Pre-requisites

+

-

Co

mp

lexit

y

What? Data roles

Often backward looking

Reports tend to be “static”

Traditional Business Intelligence (BI)

Standard reporting, limited discovery

Can be forward looking

Develop analytical dashboard

Advanced insights analysis (trends/patterns)

Ability to load and explore data to gain insight

Provisioning of data for analytical applications

Data driven algorithms to create insights or real-

time recommendations & decision making

Machine learning, deep learning, neural

networks, Artificial Intelligence

Forward looking

Demo Actionable analytics & insights

Wat is Data Science ?

“ Data science is emerging at the intersection of statistics,

computer science and business expertise. Having evolved from

data mining, it is the process of making discoveries in and

deriving business benefit from data”

“Crucially when we enter the realm of Big Data, scalable

technologies become a necessary component of Data Science”

Data

Science

StatisticsComputer

Science

Business

Expertise

Traditional

Research

Traditional

Software

Machine

Learning

Data Science positionering

PRIVACY &

INFORMATION

SECURITY

● Effectieve data science vereist samenwerking tussen

verschillende discipines

o Business

o Data Science

o Technology

● Heeft een governance functie om compliancy te

garanderen met information security en data privacy

● Standardisatie levert de volgende voordelen op:

o Efficiency

o Team ontwikkeling

o Hergebruik

o Information security & compliancy

o Consistentheid in aanpak en weg naar produktie

● Focused centraal team

Demo Predict My List

Cloud Data Platform – Modern en Open

Governance & Security

• Encryption

• Tokenisation

• AD/Kerberos Integration

• Information Governance

• Data Management

• Network & Storage Security

• Application Security

• Data Security

Cost Management

• Application Store Approach

(Choose what you use)

• Usage based pricing

• Low cost storage

• Elastic compute (base & burst)

Diverse Functionality

The Traditional:

• Traditional BI

• Data Warehousing

• Reporting

• Dashboarding

The New:

• Big Data

• Advanced Analytics

• Machine Learning

• Artificial Intelligence

• Bots

• Streaming

• Unstructured Data

• Machine Data

• …and more

Cloud Data Platform

TRANSPORT TRANSFORM

STORE

OBSERVE

ANALYSE

DATA PLATFORM

DATAWAREHOUSE

HDFSDATABASEDATA

LAKE

BLOBTABLES

STREAM

ANALYTICS

WINDOWEVENT

HUB

STRUCTURE SERVICE

FABRIC

ENRICHAGGREGATING

FILTERINDEX

OLAP STATISTICSIN MEMORY

TOPICS

QUEUES

SERVICE BUS

DATA

FACTORY

COPY

UPLOAD

API

LEARN

MACHINE

LEARNING

DEEP

LEARNING

JOININGCLEANING

MESSAGES SECURE FTP PULL PUSH BATCH REAL TIME

STREAMS

fx

SOURCE DATA

DEVICES

SENSORS AND IOT

FILES

SAAS

APPLICATIONS

OTHER

SOCIAL

PUBLIC DATA

BOTS CRAWLERS

INDUSTRY DATA

ACCESS

VISUALISE

CONSUME DATA

API

EVENTS NOTIFICATIONS

STREAMS DOWNLOAD/

EXPORTS

RELAYSODATA

POLYBASE

MAP

REDUCE

PORTAL WEBSITE

MOBILE DASHBOARD

SEARCHTABLEAU

EXCEL

REPORT

POWER BI

Demo Chatbots