29
Public Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto [email protected]

Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto [email protected]

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

Public

Intelligence at the EdgeEmbracing the Data Flood

Andrzej Wieczorek

IoT, Connectivity & Traffic, Tieto

[email protected]

Page 2: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

2

IoT is about making decisions in the right place, at the right time and in time

Page 3: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

3

Network Proximity

At the Edge

Page 4: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

4

CloudEdge

gateways

Things /

Edge things

Backhaul

Core Network

Local

connectivity

Edge is local

Page 5: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

5

Fog computing (Cisco)

Many names similar concept

Cloudlet (Carnegie Mellon

University)

Micro datacenter (Microsoft)

Mobile Edge Computing (ETSI)

Page 6: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

6

CloudEdge

gateways

Edge things

Backhaul

Core Network

Local

connectivity

Getting beyond the Edge

Page 7: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

7

Behaviors detection

Ecosystems applications

Self learning

What else?

Pattern recognition

Access point

Programming

Calls

Edge evolving

Page 8: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

8

Example: Edge camera

Source: http://www.westjr.co.jp/press/article/2015/08/page_7489.html

Tokio metro, Kyobashi station

Suspicious behavior detection

Page 9: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

Public

Data at the Edge

Page 10: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

10

Knowledge

Information

DataFacts, figures, signals

Structure, meaning, context, importance

Ability to use information to achieve objectives

Choosing objectives based on values

Wisdom

Are not important, knowledge is!

Page 11: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

11

http://www.juniperresearch.com/press/press-releases/iot-connected-devices-to-triple-to-38-bn-by-2020

http://www.cisco.com/c/dam/en_us/about/ac79/docs/innov/IoT_IBSG_0411FINAL.pdf

http://www.gartner.com/newsroom/id/3165317

Gartner

Cisco

Juniper Research

IoT is BIG

Page 12: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

12

In 2019 –> 507 ZB (507E+9 TB) data from IoT devices[source: Global Cloud Index: Forecast and Methodology, 2014–2019]

SSD 1TB 2.5’’32 millions km [~20 millions miles]

light ray would need 1 min 45 sec

How BIG?

Page 13: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

13

Metal bar manufacturing process

5 stages with very intense sampling

All machines storing data, single able to process it

Key here: data aggregation, filtering, anomaly

detection, feedback loop for self adjustment

Manufacturing example

Page 14: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

14

All machines connected to data

collector

• Connectivity

• Data processing engine

• Adapters

Manufacturing – connecting machines

Page 15: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

15

Additional input ERP etcData filtering

and aggregation Pattern and trends/

anomalies recognition

Manufacturing – handling data flow

Page 16: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

Limited communication capabilities (satellite)

Thousands of different containers to monitor

„Unstable” work conditions (weather, storm)

(Selected) data to analyze:

• Containers: inside and outside environment

• Ship: tilt/lean, vibration, ballast value

Cargo ship example

Page 17: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

17

• Do we need all these data?

• How much to store? For how long?

• Ways to optimize? (more than tar.gz)

• What is volume/ value relation?

Absolutely!

All!

What is „tar.gz”?

More is more!

No!

What for?

Hmmm…

Less is more!

To be continued

Data flooding the clouds

Page 18: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

18

…true, but most of data will never go beyond Edge

?

Data flooding clouds… really?

Page 19: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

Public

Intelligent edge

Page 20: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

20

A smart machine will first consider which is more worth its while:

to perform the given task or, instead, to figure some way out of it.

Whichever is easier.

And why indeed should it behave otherwise, being truly intelligent?

For true intelligence demands choice, internal freedom

Stanislaw LEM „The Futurological Congress (1971)

Intelligence is a freedom of choice

Page 21: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

Knowledge

Information

21

Data Information Knowledge

Data

Old school

Intelligent Edge

Building knowledge at the Edge

Page 22: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

• Proximity to the source of data

• Lower latency - speedup of decision making time

• Reduced global bandwidth

• Local context, local security

• Ownership of data, privacy protection

22

Why Edge/ Fog computing

Page 23: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

Building knowledge (analytics, patterns,

trends, co-relations, rules)

Taking local decisions

Sharing knowledgewith clouds and with other edges

Evolving (feedback loop, new data, knowledge from

outside)

23

Handling data at the Edge

Page 24: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

Learning / building knowledge

Goal: learn rather than follow instructions

• find patterns

• verify/ filter data

• predict or best-guess

• decide

• get feedback and adjust

Modeling learning: behavior trees, neural networks, genetic algorithms,…

25

http://www.craft.ai/blog/NEST-like/

Page 25: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

26

Resources constraints

Type of problem (optimization,

pattern recognition)

Regression analysis

Adjustment possibility

Derivatives known?

Patterns known?

Amount of input data

Learning time

http://www.craft.ai/blog/NEST-like/

Selecting AI for the Edge

Page 26: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

Public

Wrap up

Page 27: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

© Tieto Corporation

Public

28

Data processing and analysis close to the source

Critical especially when privacy, time or transmission matters

AI key to handle, classify and analyze big flows (flood)

Page 28: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

Public

Q&A

Page 29: Intelligence at the Edge - events.static.linuxfound.org · c Intelligence at the Edge Embracing the Data Flood Andrzej Wieczorek IoT, Connectivity & Traffic, Tieto andrzej.wieczorek@tieto.com

Public

Thank you

Andrzej Wieczorek

IoT, Connectivity & Traffic, Tieto

[email protected]