Progress Real Time Progress Real Time Products OverviewProducts Overview

Pat Bonser

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation2 Progress Real Time Products

Progress Real Time Products

The Progress Real Time Division Event Stream Processing (ESP) Progress® Event Stream Processing Progress Event Engine™ Progress RFID™ Progress ObjectStore® Enterprise Progress ObjectStore PSE Pro

Agenda

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation3 Progress Real Time Products

Progress Real Time Division

The The Progress Real Time Division is a global provider of products that enable the real-time enterprise. We deliver technologies that monitor and analyze real-time event stream data and accelerate the performance of existing applications. Our leading object database helps companies manage complex data, and our data caching and replication products support occasionally connected users that require real-time access to enterprise applications.

Real World. Real Time.

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation4 Progress Real Time Products

What’s "Real Time Enterprise” ?

"The Real Time Enterprise monitors, captures and analyzes root-cause and overt events that are critical to its success the instant those events occur, to identify new opportunities, avoid mishaps and minimize delays in core business processes. The RTE will then exploit that information to progressively remove delays in the management and execution of its critical business processes."

K. McGee, Gartner Inc., 25 Mar 04

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation5 Progress Real Time Products

Progress Real Time Products

The Progress Real Time Division Event Stream Processing (ESP) Progress Event Stream Processing Progress Event Engine Progress RFID Progress ObjectStore Enterprise Progress ObjectStore PSE Pro

Agenda

© 2005 Progress Software Corporation6 Progress Real Time Products

But, But,

What is an Event? What is an Event?

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation7 Progress Real Time Products

What is an Event?

Chunk of data whose arrival means something has happened– May or may not be significant

Characteristics– Relatively “small”, regular structure– Often multiple sources– Receiver does not need to reply to sender– High arrival rates (usually)

Rapid response important– Detect, determine threat or opportunity– Act while decision still matters

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation8 Progress Real Time Products

IF WMT price moves > 2% 15-DAY WMT-VWAP

FOLLOWED-BY

S&P500 moves > 0.5%

AND

TGT price moves < 2%

WITHIN 30 seconds

ACTION SELL WMT

30 seconds

Event Processing Example

WMT

time

TGT

S&P500

!!

!SELL WMT

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation9 Progress Real Time Products

Can Traditional Data Management Techniques Be Used?

Store events in RDBMS, use SQL queries

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation10 Progress Real Time Products

Can Traditional Data Management Techniques Be Used?

events database

query

query

query

query

query

query

query

query

query

query

query

query

query

query

query

event queries

Store events in RDBMS, use SQL queries

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation11 Progress Real Time Products

Can Traditional Data Management Techniques Be Used?

events database

query

query

query

query

query

query

query

query

query

query

query

query

query

query

query

event queries

3,000,000per minute

terabytes

1,200 traders1,000 patterns of interest

Store events in RDBMS, use SQL queries

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation12 Progress Real Time Products

Can Traditional Data Management Techniques Be Used?

events database

query

query

query

query

query

query

query

query

query

query

query

query

query

query

query

event queries

3,000,000per minute

terabytes

1,200 traders1,000 patterns of interest

Store events in RDBMS, use SQL queries

This will NOT work !

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation13 Progress Real Time Products

What Can We Do ?

Don’t store the events first– Keep them in memory as they arrive, until no

longer needed Bring the events to the queries

– Be clever about which events go to which queries

Process queries continuously– Long running, state in memory

Do it very fast!

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation14 Progress Real Time Products

That’s Event Stream Processing

“To continuously analyze, evaluate, and take action on streaming event data in real time”

Definition

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation15 Progress Real Time Products

Progress Real Time Products

The Progress Real Time Division Event Stream Processing (ESP) Progress Event Stream Processing Progress Event Engine Progress RFID Progress ObjectStore Enterprise Progress ObjectStore PSE Pro

Agenda

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation16 Progress Real Time Products

Progress Event Processing System

Raw,streaming

events

Businessapplications

Event distribution,analysis

and storage

Progress Apama Event Modeler

Progress Apama Event Manager

Enterprise Middleware

ExistingEnterpriseApplications

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation17 Progress Real Time Products

High-Level View

Event Manager

Integration Adapter Framework

Integration Adapter Framework

Event Modeler

Auto Generated Dashboards

Scenario Manager

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation18 Progress Real Time Products

The Progress ESP Stack

Adapter

ObjectStore Event DB

EdgeXtend ™

Managem

ent

Development Tools

Visualization

Processing

Integration

Data management

Sonic™

Progress Apama Event Manager

Progress Apama Dashboard Generation

Progress Apama Event Modeler

Progress Apama Event Processing Language

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation19 Progress Real Time Products

Progress Real Time Products

The Progress Real Time Division Event Stream Processing (ESP) Progress Event Stream Processing Progress Event Engine

– Data Management Software for Events Progress RFID Progress ObjectStore Enterprise Progress ObjectStore PSE Pro

Agenda

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation20 Progress Real Time Products

Progress Event Engine

3. Query

query

client client client

Event Cache

Service

1. CollectEvent Data

Feed store

Convert external events to PSEE events

2. OrganizeStructures data for fast retrieval

sort/mergePersistent Storage

disk disk

disk disk

Data Flow

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation21 Progress Real Time Products

Progress Event Engine

Collection Engine– Store tens of thousands events per second– 20 TB+ database size– Index data is ~1% of database size

Query Engine– High Performance– Pipelined Architecture– Extensible Functionality

Simultaneous Query and Collection– Writes do not block reads!

Why PSEE? High Performance, Scalable

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation22 Progress Real Time Products

Progress Real Time Products

The Progress Real Time Division Event Stream Processing (ESP) Progress Event Stream Processing Progress Event Engine Progress RFID

– Software for Acquiring and Managing RFID Data Progress ObjectStore Enterprise Progress ObjectStore PSE Pro

Agenda

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation23 Progress Real Time Products

Architecture for RFID Event Capture

RFID Event Layer

Readers

ALE

Sensors

Event Repository

Progress RFID

WebServices / Sonic

RFID Application Layer

OpenEdge RFID Library

OpenEdge Application

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation24 Progress Real Time Products

RFID Event Flow

Middlew

are(A

LE)

RFIDReader

RFID Events

RFID Events

Query

Event HistoryQueryRFID Reader

Event History(RFID-A)

OpenEdge Application

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation25 Progress Real Time Products

Progress Real Time Products

The Progress Real Time Division Event Stream Processing (ESP) Progress Event Stream Processing Progress Event Engine Progress RFID Progress ObjectStore Enterprise

– Software for Managing Stored Objects Progress ObjectStore PSE Pro

Agenda

© 2005 Progress Software Corporation Progress Real Time Products

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

But, But,

What is an Object? What is an Object?

26

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation27 Progress Real Time Products

What is an Object ?

Data– Some number of data members– Owned by an object instance– Each instance has own data members

Code– Methods (small programs) that operate on the data– Associated with a set of objects of the same type

(class)– One copy of the code

A way to encapsulate information and its behaviour

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation28 Progress Real Time Products

Object Data Management System (ODBMS)

Progress ObjectStore Enterprise

Proven technology for reliable, high-performance data management and caching support for your C++, Java, and .Net applications

Benefits– Flexible Programming Model

Lets data flow seamlessly between memory and database

– Distributed Transactional Caching Maintains data in-memory across all instances,

guaranteeing data consistency

– Enterprise Database Services Including clustering, online backup,

replication, high availability and more

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation29 Progress Real Time Products

The ObjectStore Data Model

Cache-Forward™ Architecture

ObjectStoreServer

ObjectStoreServer

ClientsApplication/Web Servers

Memory mapped cache

Memory mapped cache

Memory mapped cache

CFA moves cached data forward to the client

Changes in one cache propagated to the other

Cache deletions propagated to other caches

Referential integrity maintained automatically

CFA moves cached data forward to the client

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation30 Progress Real Time Products

Cache-Forward™ Architecture

ObjectStoreServer

ObjectStoreServer

ClientsApplication/Web Servers

Memory mapped cache

Memory mapped cache

Memory mapped cache

CFA moves cached data forward to the client

Changes in one cache propagated to the other

Cache deletions propagated to other caches

Referential integrity maintained automatically

OrdnanceSurvey,UK

This revolutionary database digitally references not just every building & field, but detail as fine as railway signal lights & free-standing letter boxes.

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation32 Progress Real Time Products

Used & new from $16.00

Marketplace

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation34 Progress Real Time Products

Progress Real Time Products

The Progress Real Time Division Event Stream Processing (ESP) Progress Apama Progress Event Engine Progress RFID Accelerator Progress ObjectStore Enterprise Progress ObjectStore PSE Pro

– Embedded Software for Managing Stored Objects

Agenda

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation35 Progress Real Time Products

Embedded Object Persistence

Progress ObjectStore PSE Pro

Small-footprint version of ObjectStore ODBMS Perfect for single-user applications and

embedded devices Benefits

– Applications can scale from PSE Pro to ObjectStore using the same API’s

– Low memory requirement and good performance

– Transactional storage for reliability

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation36 Progress Real Time Products

Comes in Two Flavors

PSE Pro C++

PSE Pro JavaIn-memory objects

PSE Pro Library

Stored Objects

Process

Application

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation37 Progress Real Time Products

PSE Pro Example Uses…

Embedded in– Sun’s Jini/Java Spaces

– Intel CAD applications

– Medical Devices

– Copiers

– Fathom

– SonicMQ

– etc.

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation38 Progress Real Time Products

Progress Real Time Products

Use Progress Event Stream Processing and Progress Event Engine for ESP

Use Progress RFID and OpenEdge RFID Library for capturing RFID events– Includes ObjectStore database

Use Progress ObjectStore PSE Pro Java on small devices that communicate with OpenEdge applications

In Summary

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation39 Progress Real Time Products

Questions?

www.progress.com/realtime

The Progress Real Time Division Event Stream Processing (ESP) Progress Apama Progress Event Engine Progress RFID Accelerator Progress ObjectStore Enterprise Progress ObjectStore PSE Pro

Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

© 2005 Progress Software Corporation40 Progress Real Time Products

Additional Information

INNOV 13:Introduction to Event Stream Processing and Apama

INNOV 10:Progress Event Engine Overview

INNOV 06:RFID Enabling Your OpenEdge Application

INNOV 08:Integrating RFID Technology with Progress-based Solutions

www.progress.com/exchange/2005/technical_sessions