23
Real Time Data and FME FME Server is Automation! I like how he thinks! I like to set it and forget it!!

Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

  • Upload
    dokiet

  • View
    221

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Real Time Data and FME

FME Server is Automation!

I like how he thinks!

I like to set it and

forget it!!

Page 2: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Two Types of Real-Time Data

Event Based or Notification Based

Independent discrete events that occur

at a rate of:

< 1 message / second

Continuous Data Stream

High Velocity Data Stream of > 1

message / second.

Page 3: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Real Time #1:

Notifications

Page 4: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Real Time #1 - NotificationsNotifications all follow the same pattern:

Somethinghappens

FME Workspace is run

Output isdelivered

Page 5: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Notification Service Terms

SubscriberWorkspacePublisher

T T

Topics

Page 6: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Email based Automation

Email triggers

FME to process

email contents.

Page 7: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Notification ServiceEmail -> Validate DWG -> Email

Publisher

Email

Workspace

Validate

DWG

Subscriber

Page 8: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Notification ServiceEmail -> Validate DWG -> Email

Publisher

Email

Workspace

Validate

DWG

Subscriber

DEMO

Page 9: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Webhook based Automation

Page 10: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Workspace Subscriber

T

Webhook call

to topic

Notification ServiceWebHook -> Run Workspace-> Deliver

T

Page 11: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Schedule Based

Automation

Page 12: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Workspace Subscriber

T

Scheduler

Notification ServiceSchedule -> Run Workspace -> Deliver

Page 13: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Data Driven Automation

Page 14: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Workspace Subscriber

T

Data Arrives

Notification ServiceData Driven Automation

T

Local or UNC

Page 15: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

From NetworkTo Cloud…

Page 16: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

D

Workspace Subscriber

T

Data Arrives

Notification ServiceData Driven Automation

T

FTP or Amazon S3 or … (others coming)

Page 17: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Workspace Subscriber

T

Data Arrives

Notification ServiceData Driven Automation

T

FTP or Amazon S3 or … (others coming)

DEMO

Page 18: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Real Time #2

Data Streams

Page 19: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

FME Engine(s) directly

connected to data stream.

Page 20: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Engines connected to Streams

FME

FME Server Core

JMS Stream WebSocket Stream

Connected and dedicatedto stream

Connected and dedicatedto stream

Engine

Engine

Engine

Engine

Engine Engine

Page 21: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Supported Direct Connections

Web Sockets

Java Message Service (JMS)

Amazon Simple Queue Service (SQS)

Amazon Simple Notification Service (SNS)

TCP/IP

Page 22: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

JMS / Websocket Demo

Page 23: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message

Thank You!www.safe.com

[email protected]