34
Exciting New Areas for Rules Paul Vincent, TIBCO Software © Copyright 2000-2010 TIBCO Software Inc. Paul Vincent, TIBCO Software

Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Embed Size (px)

Citation preview

Page 1: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Exciting New Areas for Rules

Paul Vincent, TIBCO Software

© Copyright 2000-2010 TIBCO Software Inc.

Paul Vincent, TIBCO Software

Page 2: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Rules vs “The Semantic Web”

Declarative Behaviors

Models Languages

Logic

© Copyright 2000-2010 TIBCO Software Inc.

Production Rules

Queries etc

Event Rules

Inference Rules

Processes etc

Decisions

Page 3: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Current Practices

Declarative Behaviors

Models Languages

Logic

Data

Ontologies

© Copyright 2000-2010 TIBCO Software Inc.

Production Rules

Queries etc

Event Rules

Inference Rules

Processes etc

DecisionsActivity/”Process”

StateEvent Rules

Production /

Reaction Rules

Page 4: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Interesting Area #1

Declarative Behaviors

Models Languages

Logic

© Copyright 2000-2010 TIBCO Software Inc.

Production Rules

Queries etc

Event Rules

Inference Rules

Processes etc

Decisions

Complex Event

Processing

Page 5: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

CEP-driven Business Processes

eventsEvent Transport

& Distribution

© Copyright 2000-2010 TIBCO Software Inc.

Pattern

Detection

Event & State store

Decisions Reactions

Page 6: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Complex Event Processing

Roles:

Sense and Respond

© Copyright 2000-2010 TIBCO Software Inc.6

Sense and Respond

Track and Trace

Situational Awareness

Page 7: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Generalised Role for Event Processing

complex events

Asynchronous

Events

Continuous &

parallel event

pattern detection

simple events

Declarative

processing

© Copyright 2000-2010 TIBCO Software Inc.

BPM:

business

process

SOA:

IT

services

CEP: complex

event

processing

State store

Multiple event types

/ channels

Orchestrated /

procedural processing

Page 8: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Event Sources

eventsPublish-subscribe /

queue-based:

JMS

-TIBCO EMS -

event

channels

© Copyright 2000-2010 TIBCO Software Inc.

Others

TCP-IP

SOAP over

HTTP

RVPattern

Detection

Event & State store

-TIBCO EMS -

IBM MQ etc

Decisions Reactions

Page 9: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Event Pattern Detection and

Processing

eventsEvent Transport

& Distribution

© Copyright 2000-2010 TIBCO Software Inc.

Pattern

Detection

Event & State store

Decisions Reactions

State

Transitions

Continuous

Queries

Pattern RegEx

Event Rules

Page 10: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Event Pattern State Management, FT,

DR

eventsEvent Transport

& Distribution

© Copyright 2000-2010 TIBCO Software Inc.

Pattern

Detection

In-memory

Decisions Reactions

Distributed Cache

DBMS

Page 11: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Decisions and Rules against Event

Patterns

eventsEvent Transport

& DistributionManaged

Decision

Models

© Copyright 2000-2010 TIBCO Software Inc.

Pattern

Detection

Event & State store

Decisions Reactions

Event Rules

Inference Rules

Models

Page 12: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Decisions and Rules against Event

Patterns

eventsEvent Transport

& Distribution

Services

© Copyright 2000-2010 TIBCO Software Inc.

Pattern

Detection

Event & State store

Decisions Reactions

Fact Updates

New Events

Processes

Services

Page 13: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

© Copyright 2000-2010 TIBCO Software Inc.

Operational Intelligence

in Retail Banking

Page 14: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

The Retail Challenge

Small Windows of Opportunity for Selling SuccessfullyP

rop

en

sity

to

Bu

y

Highest Chance to Sell

SuccessfullyThe Longer The Delay in

Selling, The Lesser the

Chance to Sell Successfully

The Challenges

© Copyright 2000-2010 TIBCO Software Inc.

Time Between Desire to Buy and Sales Call

Pro

pe

nsi

ty t

o B

uy

Propensity to Buy

The ChallengesTo Identify the Right Product(s) to Sell at the

Right Moment to the Right Customer(s)

Page 15: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Po

ten

tia

l fo

r In

tell

ige

nt

Co

nve

rsa

tio

n

Aggregated

Product Holdings, &

BalancesChanges in holdings,

Balance triggers,

Bureau data

Customer

Provided Data Renewal dates,

Financial priorities,

other holdingsProduct

Holdings &

Balances:Open & closed,

last x balancesProduct Usage

& events

Futu

re F

ocu

s

Non-core personal

Recognition of Customer Contact/Transaction Events as Important Assets to Effective Campaign

Execution and Management

Touchpoint

EventsATM/ AVR Transactions,

Web usage

Need: Event-Driven Marketing Rules

© Copyright 2000-2010 TIBCO Software Inc.

Po

ten

tia

l fo

r In

tell

ige

nt

Co

nve

rsa

tio

n

Part of Application

Ongoing usage

Aggregation

Customer Data capture

Contact data:Title, forenames, surname, premise #,

address, postcode,DoB, e.mail address,

Preferred name, Correspondence address,

Telephone # (home, work, mobile), GPP

markers (for e.mail,

telephone and post).

Core personalGender, marital status,

# dependants,

employment status,

occupational status,

residential status

Tax number

& eventsTransactions,

Transaction types,

time since last

Contact histories:Contact events,

Credit Events,

campaign codes Hyg

ien

e

Customer

Satisfaction Levels and issues

*Data we capture as part of our daily business

Breadth of Customer Understanding

Non-core personal

details needs to be

managed by either

the individual

customer contact or

back end admin

systems/ processes.

Page 16: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Selling + Offering the Right Products + Services

at the Right Time with Real-Time Response

Credit Card Purchase of Airline Ticket

at 1230pm Today via Agent/Airlines

Up sell Travel Insurance via Call Centre at 1pm Same

Day

Example Real-time Rules

© Copyright 2000-2010 TIBCO Software Inc.

Change of Home Address at Call Centre Up sell New Home Insurance/Personal Loans at Call

Centre at the Same Time

IPO Subscription of Certain Amount Up sell to Turn the Unallocated Amt to Fix Deposit if,

Say, More than > S$200K

Event-driven, declarative, business rules approach

used in conjunction with customer knowledge

and driving Business Processes

Page 17: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

#Campaign and Offers pa 500 Campaigns + 4 M Offers

#Target Customers >4M

Transaction Volume >240 Msgs/Sec

Revenue Growth Campaign Performance

1. Campaign 1: 235% Over Campaign Revenue Target

Real Rule ROI

© Copyright 2000-2010 TIBCO Software Inc.

235% Over Campaign Revenue Target

2. Campaign 2:160% Over Campaign Revenue Target

3. Campaign 3270% Over on Additional Spending Target

4. Campaign 4250% Over Campaign Revenue Target

Time to Market per Marketing Campaign

Concept to Execution:

Before: 3 – 6 Months

After: 7 – 8 Days

Page 18: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Process Awareness in Shipping

© Copyright 2000-2010 TIBCO Software Inc.

Page 19: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Situation Awareness of Business Assets

Shipment container track and trace:

Monitoring shipment milestones and invoking

appropriate processes

© Copyright 2000-2010 TIBCO Software Inc.

54 million active milestones for

shipments in-situ at any one time

Page 20: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Original Business Solution

1. Custom J2EE application

Project Metric

Analysts + Developers 8

Elapsed Time 8 months

© Copyright 2000-2010 TIBCO Software Inc.

Elapsed Time 8 months

Implementation 100 milestones

Productivity 64 person mths per 100

milestones

Page 21: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

De facto Business Solution = BPM +

SOA2. BPM + SOA

Project Metric

Analysts + Developers 3

+ unknown # vendor

© Copyright 2000-2010 TIBCO Software Inc.

+ unknown # vendor

consultants

Elapsed Time 3 months

Implementation 3 milestones

Productivity 400 person mths per 100

milestones

Page 22: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Current Solution = CEP

3. Event-driven rules

Project Metric

Analysts + Developers 3 + 1 vendor consultant

Elapsed Time 7 months

© Copyright 2000-2010 TIBCO Software Inc.

Elapsed Time 7 months

Implementation 100 milestones

Productivity 28 person mths per 100

milestones

Page 23: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Comparison of Approaches

Approach Cost Cost vs Java

Java 64 1x

BPM for events 400 6x

Event-driven rules 28 overall 0.5x

Event-driven rules 12 best case 0.2x

© Copyright 2000-2010 TIBCO Software Inc.

Event-driven, declarative, business rules approach

used in conjunction with, driving,

Business Processes

Event-driven rules 12 best case 0.2x

Page 24: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Shipping milestones covered

100+

Number of shipments in process

8K

Average shipment lifecycle / containers per shipment

100 Days

2 containers per shipment

Real Rule ROI

© Copyright 2000-2010 TIBCO Software Inc.

shipment2 containers per shipment

Average milestones achieved per container / events processed

64 milestones

60 business events per sec

Solution results 1 - Business agility: can now add new milestones without IT in less time

2 – Business IT agility: declarative model makes updates easier

3 – Solution is high performance and scales to business

Page 25: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

© Copyright 2000-2010 TIBCO Software Inc.

RFID-BASED MANUFACTURING

EFFICIENCY

Page 26: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Manufacturing is Labor Intense

100% testing?

Test results data vs Error

lifecycle

© Copyright 2000-2010 TIBCO Software Inc.

testing?

Manual, expensive

tests

Page 27: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Not all process steps are necessary…

• Reliability depends on known event-

based conditions

• Monitoring these events can give good

information on the likelihood of a need

for a test

• Example: after a restart production

station A is

© Copyright 2000-2010 TIBCO Software Inc.

station A is

75% reliable for first 4 uses

100% reliable for the next 11 days

80% reliable thereafter

Event-driven, declarative, business rules approach

used in conjunction with production process

analytics and knowledge

Page 28: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Manufacturing tasks carried out per day

24K

Number of process steps Several 100s

Deployment Today: France2010-2011: Worldwide rollout

Solution results 30% reduction in manual test costs

Real Rule ROI

© Copyright 2000-2010 TIBCO Software Inc.

Solution results 30% reduction in manual test costs

“Significant reduction” in overall manufacturing costs

Page 29: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Event

Future trends in business processing

Decision Action

© Copyright 2000-2010 TIBCO Software Inc.

Adaptive Case Management

BPMS

BRMS

Events

Services

Page 30: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Example: Complex Fulfillment

TIBCO Active Fulfillment TIBCO Active Catalog

Fulfillment events

+ exception events

© Copyright 2000-2010 TIBCO Software Inc.

BPM Platform: workflow processes

CEP Platform: rules, states, goals

plan-based provisioning MDM / Content

Page 31: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Interesting Area #2

Declarative Behaviors

Models Languages

Logic

Web-based /

Cloud-based

Knowledge

Modelling

© Copyright 2000-2010 TIBCO Software Inc.

Production Rules

Queries etc

Event Rules

Inference Rules

Processes etc

Decisions

Modelling

Page 32: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Interesting Area #3

Declarative Behaviors

Models Languages

Logic

Machine Learning of

Classifications and

Ontologies

© Copyright 2000-2010 TIBCO Software Inc.

Production Rules

Queries etc

Event Rules

Inference Rules

Processes etc

Decisions

Page 33: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Lots of Potential Synergies!

Declarative Behaviors

Models Languages

Logic

Machine Learning of

Classifications and

Ontologies

Web-based /

Cloud-based

Knowledge

Modelling

© Copyright 2000-2010 TIBCO Software Inc.

Production Rules

Queries etc

Event Rules

Inference Rules

Processes etc

Decisions

Complex Event

Processing

Modelling

Page 34: Exciting New Areas for Rules Paul Vincent, TIBCO Softwarefiles.meetup.com/987383/RuleML2010-TIBCO-WebRuleResearchMeets... · Potential for Intelligent Conversation Aggregated Product

Future for Semantic Web?

• Distributed knowledge and information

being commercialised as Data Grids, Compute

Grids, Cloud Computing

• Universal models and rules, standardisation

© Copyright 2000-2010 TIBCO Software Inc.

• Universal models and rules, standardisation

being commercialised as event pattern

languages (EMP?), production rules

(DMN/PRR/RIF), processes (BPMN), etc

• Next generation research IT being used (RDF,

OWL, SPARQL etc) in complex use cases