24
Understanding the Need for Real-Time Insight regardless of your industry Muzaffer Yöntem [email protected]

Real Time Insight with CEP

Embed Size (px)

DESCRIPTION

Sybase Event Streaming Processing ile sektörünüz ne olursa olsun, gerçek zamanlı aksiyona dayali işlemler yapabilirsiniz.

Citation preview

Page 1: Real Time Insight  with CEP

Understanding the Need

for Real-Time Insight

regardless of your industry

Muzaffer Yöntem [email protected]

Page 2: Real Time Insight  with CEP

© SAP 2011 / Page 1

Our world is simply too busy –

too many things happen too fast.

You need to be able to analyse,

understand and react to change.

Page 3: Real Time Insight  with CEP

© 2011 SAP AG. All rights reserved. 2

How do you make smart business decisions in real-time?

Sales Finance Operations Business

Partners

How do you track

performance of key

business

processes?

Are you able to

identify trends,

forecast events,

and adapt quickly?

How do you find

out when things go

wrong?

Can you detect

and respond

rapidly to threats

and opportunities?

Page 4: Real Time Insight  with CEP

© 2011 SAP AG. All rights reserved. 3

Evolution of Business Intelligence A Paradigm Shift

Business

focus

Primary users

Timeframe

Use model

Data

Source: Intelligence Solutions Inc.

Operational BI

Manage and optimize daily business

operations

LOB managers, front-line employees,

operational systems

Intra-day

Event-driven, Event processing

Real-time, more data sources,

greater volume ,low-latency &

streams, historical data

Strategic BI

Long-term organizational goals

Executives, analysts

Months to years

Rely on query/response

Historical metrics,

fewer sources ,ETL

Page 5: Real Time Insight  with CEP

© 2011 SAP AG. All rights reserved. 4

Information Management Landscape Integration, Federation, Operational BI

Historical

Event Initiated User Initiated

Real Time

Data Federation

Data Integration (ETL based)

Operational Business

Intelligence /

New Market

Segment

‘Business questions are send to data

and not data to business questions’

Page 6: Real Time Insight  with CEP

© 2011 SAP AG. All rights reserved. 5

Pattern Based Strategy Framework by Gartner

Page 7: Real Time Insight  with CEP

© 2011 SAP AG. All rights reserved. 6

Two approaches to CEP

Rules Continuous

Queries

Page 8: Real Time Insight  with CEP

© 2011 SAP AG. All rights reserved. 7

Complex Event Processing

Target Industries & Use Cases

Financial

Capital markets

Banking: fraud prevention

360 Degree Customer Touch

Telecommunictions

Operations monitoring

Mediation

Utilities

Smart grid applications

Demand management

Transportation

Location-based monitoring

Customer satisfaction / loyalty

Social Media Analysis

-Real time customer Voice

Retail / consumer product goods

Real-time click stream analysis

Customer sentiment analysis

Supply chain management

Hospitality / Service

- On-line gaming

- Customer loyalty

Healthcare

Healthcare (e-care, asset tracking)

Public Sector

Situational awareness for public safety

Homeland security

Page 9: Real Time Insight  with CEP

© 2011 SAP AG. All rights reserved. 8

Faster Time To Value

React Quicker, Create Better Value

Action Taken

Time

Value

Latency

Event Happens

Data Stored Action Value

Page 10: Real Time Insight  with CEP

© 2011 SAP AG. All rights reserved. 9

The Event-Driven Business

SOA-2: Event-Driven Service Oriented Architecture

Monitor all internal and external business conditions in real time

Display conditions at multiple levels of the organization, with integrated views

Assess and display key performance indicators as conditions change

Monitor

Analyze

Access and analyze real-time information (Data Driven)

Analyze simple and complex key performance indicators (KPIs)

Access and analyze historical information

Identify new KPIs and business strategies

Act

Proactively alert systems, people, and devices

Automate actions when key conditions occur and adjust actions on the fly

Simulate, analyze and tune automated action based on actual behavior

Allow end users to guide automated action & audit all activity

Page 11: Real Time Insight  with CEP

What is Complex Event

Processing

Page 12: Real Time Insight  with CEP

© 2011 SAP AG. All rights reserved. 11

What Are Events?

An event is just something happening

A change of state

Customer call, bank debit, aircraft movement

Observation of that change

CRM record of call, transaction success

IT message

JMS message, Web Service or DB record

Just data with some key characteristics

Time sensitivity

High volume

Distributed sources

Page 13: Real Time Insight  with CEP

© 2011 SAP AG. All rights reserved. 12

Simple Events Anything Can Happen

Plane

Landing

Lightning

Strike

Barcode

Scanned

Temperature

Reading

Transaction Created

İn CRM or core

business apps

Twits

Facebook

comments, enteries

Clickstream

data

Page 14: Real Time Insight  with CEP

© 2011 SAP AG. All rights reserved. 13

Example of Complex Event Processing

13

Traditional BI: “How many

Fraudulent credit card transactions

occurred last week in Istanbul?”

1 2 3 4 5 6 7 8 9

time

Complex Event Processing: “when three credit card

authorizations for the same card occur in any five seconds

window, deny the requests and check for fraud.”

Page 15: Real Time Insight  with CEP

Introducing

Sybase Event Stream

Processor

Page 16: Real Time Insight  with CEP

© 2011 SAP AG. All rights reserved. 16

Deliver Continuous Insight About Changing Events

Sybase Event Stream Processor 5.0

•Unlimited number of input streams

•Input events in native formats

•Incoming data is processed as it arrives, according

to the business logic defined using high level

authoring tools

•Stream output to apps, dashboards

•Range of built-in adapters for out-of-the-box

connectivity

•Java, C++ and .NET API’s for custom integration

?

INPUT

STREAMS

Market

Events

Transactions

Process

Events

Dashboards

Applications

Studio

(Authoring)

Reference

Data

ESP

Sybase IQ

Message

Bus

Page 17: Real Time Insight  with CEP

© 2011 SAP AG. All rights reserved. 17

Key Concepts

Input Streams Events arrive on input streams

Derived Streams,

Windows Apply continuous query

operators to one or more

input streams to produce a

new stream

Database Analogy • Streams are like tables

• Events are rows in the table

• Fields in an event message are

columns in the table

Windows can Have State • Retention rules define how many or how

long events are kept

• Opcodes in events can indicate

insert/update/delete and can be

automatically applied to the window

Page 18: Real Time Insight  with CEP

© SAP 2011 / Page 18

ESP Studio: Both visual and textual authoring

• ANALYST-LEVEL SKILLS (EXCEL, VBA)

• EASY TO UNDERSTAND COMPLEX MODELS

• NO NEED TO LEARN LANGUAGE SYNTAX

• RAPID PROGRAMMING

• EASY TO USE LANGUAGE (CCL)

• MODULAR, PROJECT BASED APPROACH

Visual Dataflow Authoring Language-based Authoring

ESP Studio supports both Visual and Textual authoring

• Visual diagram produces CCL (code-behind approach)

• User can switch back and forth between diagram and language

• Eclipse-based

Page 19: Real Time Insight  with CEP

© SAP 2011 / Page 19

Organisational Fit

Within your landscape

Business Users

Process Control, Risk, Analytics

Business Applications

Operational Dashboards, Alerts, E-Mail

Sybase Event Streaming

Thin layer on top of existing infrastructure

Logical Data Sources

Database, Web Service, SAP Sources

Physical World

Sensors, Scanners, Equipment, RFID

Works with all of your existing

business applications

Page 20: Real Time Insight  with CEP

© SAP 2011 / Page 20

High-Level Architecture

Dashboard

BI PLATFORM

Business User

Alerts

Event

Sources

Business Event Streams

Event SL

CEP and Event Network

Eve

nt

Str

ea

min

g

BIP

LA

TF

OR

M

Page 21: Real Time Insight  with CEP

© 2011 SAP AG. All rights reserved. 21

ESP Continuous Queries

Event-Driven vs. On-Demand

Traditional Queries are “On-Demand” – you run the query when you want

to know something

With ESP you define the queries before you have the data. Incoming event

data flows through the queries in real-time

Instead of getting the query results when you think to ask for them, you get

them when you need to know

Page 22: Real Time Insight  with CEP

© 2011 SAP AG. All rights reserved. 22

Source: STAC Research Sep 08 – conducted against Aleri 3.1; 5.0 performance is

similar

The only CEP vendor to publish STAC benchmarks

High Performance

STAC Certified measurement of throughput and latency

• Linear scaling with addition of more cores:

180,000 messages/sec on 16 cores

300,000 messages/sec on 24 cores

• Consistent/predicable low latency.

Only minor increase in latency from 20,000 to 300,000 messages/sec:

Mean: 1.296 - 1.568 ms

Medium: 1.177 - 1.502 ms

Std Dev: 0.567 - 1.104 ms

Min: 0.091 – 0.115 ms

99th percentile: 2.479 – 3.165 ms

Page 24: Real Time Insight  with CEP

Thank You!