41
3DS.COM/EXALEAD© Dassault Systèmes | Confidential Information | 2/24/2013 | ref.: 3DS_Document_2012 1 3DS.COM © Dassault Systèmes | Confidential Information | 2/24/2013 | ref.: 3DS_Document_2012 Exalead & Big Data It‟s All About Usage! Lars Nordengren Dassault Systemes / Exalead Bo M. Andersen IdéPro / Exalead VALUE

Exalead & Big Data - SESAM World - Viden gennem netværk€¦ ·  · 2015-04-29Sub-second responsiveness and zero-training usage ... Summer 2011 Go live: December ... Exalead Big

  • Upload
    lykien

  • View
    214

  • Download
    1

Embed Size (px)

Citation preview

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

1

3DS

.CO

M ©

Das

saul

t S

ystè

mes

| C

onfid

entia

l In

form

atio

n | 2

/24/

2013

| r

ef.:

3D

S_D

ocum

ent_

2012

Exalead & Big Data

It‟s All About Usage!

Lars Nordengren Dassault Systemes / Exalead

Bo M. Andersen IdéPro / Exalead

VALUE

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

2

1

What is „Big Data‟? 2

Where‟s the Value? 3

What‟s Search Got to Do With It? 4

Exalead Big Data Case Studies 5

Dassault Systèmes & Exalead

On the menu

6 Why Exalead CloudView?

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

3

1

What is „Big Data‟? 2

Where‟s the Value? 3

What‟s Search Got to Do With It? 4

Exalead Big Data Case Studies 5

Dassault Systèmes & Exalead

On the menu

6 Why Exalead CloudView?

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

4

About Dassault Systèmes

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

5

3DEXPERIENCE Platform

Social/Collaborative

ENOVIA, 3DSWYM

Information Intelligence

EXALEAD, NETVIBES 3D Modeling

CATIA, GEOVIA,

SOLIDWORKS

Content & Simulation

3DVIA, DELMIA, SIMULIA

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

6

EXALEAD delivers

Big Data discovery applications that

accelerate innovation

EXALEAD‟s Mission

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

7

Search as an end user

application

Every employee must be able to

access relevant data

Search is the data access

infrastructure, content

distribution platform,

innovation driver and main

differentiator of web

businesses

Web -driven innovation allows

powerful new Search-based

applications combining

structured & unstructured data

EXALEAD

Founded in 2000 by Search Pioneers, HQ: Paris

Clients: + 350, Staff: 180, 41% in R&D

Uniquely engineered for dual Web/Enterprise use

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

8

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

9

1

What is ‘Big Data’? 2

Where‟s the Value? 3

What‟s Search Got to Do With It? 4

Exalead Big Data Case Studies 5

Dassault Systèmes & Exalead

On the menu

6 Why Exalead CloudView?

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

10

Is it new?

Really large data collections have been around a long time, as have:

Grid computing

Super computers

High-end datawarehouses

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

11

+40%

year

1 petabyte/

15 sec.

What is new? Rate of increase!

2015

8 zettabytes 8 trillion GBs

1 PB/sec

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

12

1

What is „Big Data‟? 2

Where’s the Value? 3

What‟s Search Got to Do With It? 4

Exalead Big Data Case Studies 5

Dassault Systèmes & Exalead

On the menu

6 Why Exalead CloudView?

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

13

Value is in Usage

Big Data Value Proposition

Use new & evolving technologies to drive innovation & productivity

by revealing the hidden information intelligence in data that is

voluminous, variable or fast-moving to exploit with conventional technology

Like Cloud before it, heavy hype, but fundamental shift

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

14

1

What is „Big Data‟? 2

Where‟s the Value? 3

What’s Search Got to Do With It? 4

Exalead Big Data Case Studies 5

Dassault Systèmes & Exalead

On the menu

6 Why Exalead CloudView?

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

15

Search-Based Applications Business applications built on a search infrastructure rather than RDBMS

COLLECT (Exalead Connectivity)

TRANSFORM (Semantic Factory)

MANAGE (CloudView Index)

INTERACT (Mash-Up Builder)

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

16

Where does search fit in Big Data world?

? ?

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

17

Search is Pivotal Driving force behind Big Data

2008 Seminal «Big Data Study Computing Group»

Top Scientists from Industry, Academia & Government

“Advances in sensor, networking, computing, and storage technologies have made it possible to

collect and store very large (beyond one terabyte) data sets capturing scientific, medical, business,

and worldwide web information.…How can the capability for computing over large data sets be

provided in a way that is cost effective, reliable, and generally usable? Toward this end, we draw

inspiration from the computing systems that have been developed at search engine companies...”

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

18

Search is Pivotal Driving force behind Big Data

What inspired «Big Data Study Computing Group»?

• Scaleable, distributed architecture w/commodity hardware

• Flexible data model

• Pivotal technologies: machine learning, auto-classification & clustering, text mining,

sentiment analysis, inverted indexing, pattern recognition, relationship-mapping, natural

language processing, data fusion, probabilistic computing…

3DS ahead of HP, Oracle & IBM in recognizing Big Data value of search/SBA!

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

19

"What do I need to get value from Big Data?”

PhD “data scientists” Unfamiliar technologies

with funny names A multimillion-dollar

Big Data appliance

Oozie

Mahout

Flume

Pig

Jaql

Whirr

Chukwa

Hadoop

PATIENCE: 3 years, 5 years, a decade….

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

20

Big Data Value Leader: Exalead SBAs deliver Big Data value to ordinary

users in just weeks, using existing systems and staff, with an ROI in 2-6 months

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

21

Search Delivers High Value, Fast

Faceted natural language search & navigation

Data fusion (semantic aggregation)

Web mining

Sentiment analysis

Content recommendation

Multimedia access

Exploratory analytics for business users

Operational reporting & analytics

Search-based business applications!!!

Capture, Store, Process, Analyze, Use Big Data

Both complement

& alternative to

NoSQL & SQL

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

22

1

What is „Big Data‟? 2

Where‟s the Value? 3

What‟s Search Got to Do With It? 4

Exalead Big Data Case Studies 5

Dassault Systèmes & Exalead

On the menu

6 Why Exalead CloudView?

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

23

Machine Data: Production/Consumption Real-Time Operational Reporting

Smart meters – consumer meters for a utility Wind power production regulation – equipment readings

Smart meters (manage production, consumption)

Logistics (detect/react exceptions, optimize flows)

eCommerce (recommendation engines)

GPS (location-based marketing)

Healthcare (ICU/ home monitoring)

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

24

Structured Enterprise Content Full-text, semantic search; SQL-free global reporting and analytics

Gefco: track & trace for millions of vehicles

Real-time, consolidated reporting

Non-specialist DB access

Asset sharing and re-use

Research (QoS, compliance, etc.)

Hypermarket: exploratory analytics on fusion of cash

register receipts (Teradata DW) & loyalty program data

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

25

Data Aggregation/Fusion Integration of structured, unstructured, Web content

• Database enrichment

• 360-degree views

• Micro-segmentation

• Content recommendation

Large pharma: 360° decision intelligence – SAP, 2 CRM,

Lotus, Twitter & other social media

Voyages-SNCF: Real-time mash-up databases,

Web UGC, editorial content, maps, etc.

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

26

Data Aggregation/Fusion Agile Customer Service for 217 Million Subscribers

360° View of All Relevant Customer Service Info One stop access to all relevant sources:

CRM

Provisioning

Network monitoring

Contracts

Interventions

Easy monitoring of KPIs and service delivery

Sub-second responsiveness and zero-training usage

Business Advantages Increased revenue: higher customer satisfaction,

reduced customer churn

Reduced costs: Less training, higher productivity,

shorter calls, reduced staff churn

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

27

Data Fusion: Exalead ii for Frontlines Usability: Simple interface & interaction, unified data access

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

28

Dashboards

transactional &

machine data

Map-based

navigation

Web-style natural

language search

Mashup RDBMS, Machine, Unstructured

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

29

Global KPIs

Dashboards

call log data

Mashup RDBMS, Machine, Unstructured

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

30

Operational Business Intelligence for Letter Mail Processing

Machine Data for Logistics

Mail sorting equipment

(apps, machines, platforms)

OCR & video-coding equipment

Datawarehouses/biz apps for

high-level data ontology

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

31

Capture: 60 million letters, 300 million events daily (3500 events/second avg)

Process: 9TB index against 90TB of raw data (1.6 PB annually)

Store: Sliding 3 weeks data (6-7 billion events); images one week

Access: Natural language, full-text, faceted search

Analyze: Dashboards w/ad hoc drilling

Innovate: New services

Real-time operational business intelligence

Machine Data for Logistics

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

32

Machine Data for Logistics “Impossible to do with any other technology”

Existing data

In-house talent plus limited consulting

8 commodity servers 1 connectors

2 Push API

4 Index

1 Search API

Proof of concept iterations: Nov „10-May „11

Prod. dev: Summer 2011

Go live: December 2011

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

33

Web Mining Market Intelligence – quantitative analytics from unstructured content

Real-time & historic real estate market analytics from online ads– Akerys

Real-time dashboards

Trend detection

Historical analysis

Location-based analysis

Resell markets

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

34

Multimedia - Video Search/explore/analyze the content INSIDE video

• Law enforcement

• Government

• Media

• Education

• Preservation

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

35

Multimedia - Images Content-Based Image Recognition (CBIR)

• Point-and-know

• Research

• Sales

• Travel & Entertainment

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

36

1

What is „Big Data‟? 2

Where‟s the Value? 3

What‟s Search Got to Do With It? 4

Exalead Big Data Case Studies 5

Dassault Systèmes & Exalead

On the menu

6 Why Exalead CloudView?

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

37

Performance Extreme performance & massive linear scaling (at a low hardware cost!)

Universal data connectivity with low latency indexing

Secure enforcement of rights at infrastructure level

Agility Non-intrusive to deploy and operate

Semantic factory & Mash-up Builder for easy data fusion & rapid app development

Multitude of Big Data uses in one platform

Usability Zero-training usage for information retrieval or analytics

Mature, packaged product accessible to existing staff

Rapid deployment – app in weeks, POC in days

Exalead Big Data Advantages

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

38

Takeaway

For any user to search, navigate & analyze Big Data―whether direct

from original Big Data sources or from specialized Big Data systems

For IT to rapidly deploy process-driven business applications enriched

with information intelligence from Big Data

For 10 years, Exalead has offered a safe, secure, easy and cost-effective way:

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

39

Proof of Concept Success Criteria

POC • Proof of Concept

• Exalead drives the

POC

• Extract of data

• Limited Scenarios

• Proof point – not

production

Functional Workshop

Technical

Session

Value Proposal

Sharing Experience

Presentation

Restitution

Business Development Proof of Concept

POC Definition

Define priorities

Agreement

Value Proposal Customer

Adoption

Value proposal

Solution Proposal

User Interface

Indexation

Knowledge Transfer / Training

Data Collection

5-15 Days 1-2 Weeks 1 Month 1-2 Weeks

Scenarios (3-4)

Business Meeting

Functional Workshop

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

40

More info: SBA book, Big Data guide, Website (Solutions)

+

Lars Nordengren +46 736 20 5832

Bo M. Andersen +45 2944 7195

3DS

.CO

M/E

XA

LE

AD

© D

assa

ult

Sys

tèm

es |

Con

fiden

tial

Info

rmat

ion

| 2/2

4/20

13 |

ref

.: 3

DS

_Doc

umen

t_2

012

41