20
CONNECT. TRANSFORM. AUTOMATE. FME Server Meets the Challenge of Real-Time

FME Server Meets the Challenge of Real-time

Embed Size (px)

DESCRIPTION

See more FME World Tour 2014 presentations at www.safe.com/recap2014

Citation preview

Page 1: FME Server Meets the Challenge of Real-time

CONNECT. TRANSFORM. AUTOMATE.

FME Server Meets the Challenge of Real-Time

Page 2: FME Server Meets the Challenge of Real-time

What Generates Real-Time Data?

Page 3: FME Server Meets the Challenge of Real-time

Challenges of Real-Time Data

Data Volume

Amount of data to be

processed

Page 4: FME Server Meets the Challenge of Real-time

Challenges of Real-Time Data

Data Velocity

Rate at which

Data isproduced

Page 5: FME Server Meets the Challenge of Real-time

What is Real-Time Data?

Data is delivered for processing as it is collected.

2 Classifications

On-Demand Real-TimeComplex Event ProcessingLow Data Velocity, Low-Mid Data Volume

Notification Based Technology

Continuous Real-TimeContinuous stream of dataHigh Data Velocity, Low-High Data Volume

Dedicated Engine Technology

Page 6: FME Server Meets the Challenge of Real-time

What is Real-time Analytics?

Dec

isio

ns

=+

Page 7: FME Server Meets the Challenge of Real-time

Event Based Real-Time(Publishers/Triggers)

Amazon SQS

Java Messaging

Service(JMS)

UDPAmazon SNSWeb Sockets

EmailREST APIscheduler

Directory Watcher

TO

PIC

Notification Based Technology

Page 8: FME Server Meets the Challenge of Real-time

Event Based Real-Time (Publishers/Triggers)

Amazon SQS

Amazon SNSWeb Sockets Email

REST API

scheduler

Directory Watcher

Java Messaging

Service(JMS)

UDP

Page 9: FME Server Meets the Challenge of Real-time

Event Based Real-Time(Actions/Subscribers)

TO

PIC

Amazon SNS

Amazon SQS

Amazon S3

EmailFTP

Java Messaging

Service(JMS)REST APIWeb Sockets

Page 10: FME Server Meets the Challenge of Real-time

Event Based Real-Time(Actions/Subscribers)

Amazon SNS

Amazon SQS

Amazon S3

Email

FTPJava

MessagingService(JMS)

REST API

Web Sockets

Page 12: FME Server Meets the Challenge of Real-time

Fighting Australian Bushfires with FME Cloud

1. Mobile App sends location to FME Server via REST API

2. FME Server performs slope and vegetation analysis

3. FME Server sends information to Mobile App

Page 14: FME Server Meets the Challenge of Real-time

Stream Based Real-Time(High Velocity Data)

EngineData

Stream

Web SocketTCP/IP

TweetStreamerJMS

AmazonSQS

Engine

Engine

Engine dedicated to processing data stream

Engine for other servertasks

Engine for other servertasks

FME Server Engines

Dedicated Engine

Technology

Page 16: FME Server Meets the Challenge of Real-time

Success Story – Pelmorex(The Weather Network)

8,000 lightning strikes/minute

Data Stream

TCP/IP

Rules determine when to generate

notifications

Google Earth

Update every20-30 seconds

Java Messaging

Service(JMS)

Engine

Page 18: FME Server Meets the Challenge of Real-time

Stream Based Real-Time

Demo

Page 19: FME Server Meets the Challenge of Real-time

Summary

2 Classifications of Real-Time data defined by:

Data Volume

Data Velocity

FME Server technology meets the needs of both

On-Demand Real-TimeComplex Event Processing

Continuous Real-Timehigh velocity data stream

Page 20: FME Server Meets the Challenge of Real-time

Thank You!

Questions?

For more information: [email protected] www.safe.com