Upload
desiree-pfister
View
202
Download
2
Embed Size (px)
Citation preview
BASEL BERN BRUGG DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. GENEVA HAMBURG COPENHAGEN LAUSANNE MUNICH STUTTGART VIENNA ZURICH
Internet of Things (IoT) Are traditional architectures good enough?
Guido Schmutz
Guido Schmutz
Working for Trivadis for more than 18 yearsOracle ACE Director for Fusion Middleware and SOACo-Author of different booksConsultant, Trainer Software Architect for Java, Oracle, SOA and Big Data / Fast DataMember of Trivadis Architecture BoardTechnology Manager @ Trivadis
More than 25 years of software development experience
Contact: [email protected]: http://guidoschmutz.wordpress.comTwitter: gschmutz
Unser Unternehmen.
Trivadis ist führend bei der IT-Beratung, der Systemintegration, dem Solution Engineering und der Erbringung von IT-Services mit Fokussierung auf - und -Technologien in der Schweiz, Deutschland, Österreich und Dänemark. Trivadis erbringt ihre Leistungen aus den strategischen Geschäftsfeldern:
Trivadis Services übernimmt den korrespondierenden Betrieb Ihrer IT Systeme.
B E T R I E B
KOPENHAGEN
MÜNCHEN
LAUSANNEBERN
ZÜRICHBRUGG
GENF
HAMBURG
DÜSSELDORF
FRANKFURT
STUTTGART
FREIBURG
BASEL
WIEN
Mit über 600 IT- und Fachexperten bei Ihnen vor Ort.
14 Trivadis Niederlassungen mitüber 600 Mitarbeitenden.
Über 200 Service Level Agreements.
Mehr als 4'000 Trainingsteilnehmer.
Forschungs- und Entwicklungsbudget: CHF 5.0 Mio.
Finanziell unabhängig undnachhaltig profitabel.
Erfahrung aus mehr als 1'900 Projekten pro Jahr bei über 800 Kunden.
Agenda
1. Introduction
2. Are Traditional Solution architectures good enough?3. IoT Architecture & Components
4. IoT Platforms
5. Summary
Introduction
Internet of Things Wave
Internet of Things (IoT): Enabling communication between devices, people & processes to exchange useful information & knowledge that create value for humans
Term was first proposed by Kevin Ashton in 1999
The concept of IoT first became popular at the Auto-ID center and MIT
IoT can also be named M2M
Reasons why IoT opportunity is occurring now ?
Affordable hardware
• Costs of actuators & sensors have been cut in half over last 10 years
Smaller, but more powerful hardware
• Form factors of hardware have shrunk to millimeter or even nanometer levels
Ubiquitous & cheap mobility
• Cost for mobile devices, bandwidth and data processing has declined as much as 97% over last 10 years
Availability of supporting tools
• Big data tools & cloud based infrastructure have become widely available and fairly sophisticated
Mass market awareness
• IoT has surpassed a critical tipping point• Vision of a connected world has reached such a
followership that companies have initiated IoTdevelopments
• Commitment is irreversible
IoT Solution Types
AdaptedfromGartner
AnalyticsApplicationUserInterface
Enterprise/On-Premise
Cloud-based
Gateway
Thing
Thing-centric Gateway-centric Smartphone-centric Cloud-centric Enterprise-centric
Sensor Data
IoT Solution Types
Thing-centric
q Things are smart on their own
q store most of their data on-board
q Things are self-sufficient and communicate to the Internet only for centralized coordination
Gateway-centric
q gateway houses the application logic, stores data and communicates with the Internet for the things that are connected to it
q Things don’t have to be as smart, because the gateway provides these resources
IoT Solution Types
Smartphone-centric
q The smartphone (or any mobile device) houses the application logic, stores data and communicates with the Internet for the things that are connected to it
q Things don’t have to be as smart, because the smartphone provides these resources
Cloud-centric
q The cloud will act as the central connection hub, power analytics and provision data storage
q Things don’t have to be as smart, because the cloud will provide these resources
Enterprise-centric
q Things are behind a firewall and are geographically co-located
q There is little need to extend out to the external Internet
Are Traditional Solution architectures good enough?
A little story of a “real-life” customer situation
Traditional system interact with its clients and does its workImplemented using legacy technologies (i.e. PL/SQL)
New requirement:• Offer notification service to notify
customer when goods are shipped• Subscription and inform over different
channels• Existing technology doesn’t fit
delivery
LogisticSystem
Oracle
Mobile Apps
Sensor ship
sort
16
Rich(Web)Client Apps
DB
schedule
Logic(PL/SQL)
delivery
A little story of a “real-life” customer situation
Events are “owned” by traditional application (as well as the channels they are transported over)
Implement notification as a new Java-based application/system
But we need the events ! => so let’s integrate
delivery
LogisticSystem
Oracle
Mobile Apps
Sensor ship
sort
17
Rich(Web)Client Apps
DB
schedule
Notification
Logic(PL/SQL)
Logic(Java)delivery
SMS
…
A little story of a “real-life” customer situation
integrate in order to get the information! Oracle Service Bus was already there
Rule Engine implemented in Java and invoked from OSB message flowNotification system informed via queueHigher Latency introduced (good enough in this case)
delivery
LogisticSystem
OracleOracle
ServiceBus
Mobile Apps
Sensor AQship
sort
18
Rich(Web)Client Apps
DB
schedule
Filter
Notification
Logic(PL/SQL)
JMS
RuleEngine(Java)
Logic(Java)delivery
shipdelivery
delivery true SMS
…
A little story of a “real-life” customer situation
Treat events as first-class citizens
Events belong to the “enterprise” and not an individual system => Catalog of Events similar to Catalog of Services/APIs !!
Event (stream) processing can be introduced and by that latency reduced!
delivery
LogisticSystem
OracleOracle
ServiceBus
Mobile Apps
Sensor AQship
sort
19
Rich(Web)Client Apps
DB
schedule
Filter
Notification
Logic(PL/SQL)
JMS
RuleEngine(Java)
Logic(Java)delivery
shipdelivery
delivery true SMS
…
Treat Events as Events and make them globally available
delivery
LogisticSystem
Oracle
OracleServiceBus
Mobile Apps
Sensorship
sort
20
Rich(Web)Client Apps
DB
schedule
Filter
Notification
Logic(PL/SQL)
JMS
RuleEngine(Java)
Logic(Java)
delivery
ship
delivery true SMS
…
EventBus/Hub
Stream/EventProcessing
IoT Architecture
Key Challenges for building an IoT application
Connect: How to collect data from intelligent devices?
• Abstract complexity associated with device connectivity• Standardize integration of devices with enterprise
Analyze: How to analyze IoT data?
• Reduce noise and detect business event at real-time• Enable historical big-data analysis
Integrate: How to integrate IoT data & events with enterprise infrastructure?
• Make enterprise processes IoT friendly• Allow enterprise & mobile applications to control devices
Distribute runtime portion of IoT Analytics to the edge
Some IoT Analytics applications need to be distributed, so that processing can take place in devices, gateways, smart routers, servers at the site where sensor data is generated
Three main reasons:
• The factory, vehicle, home or other edge location needs to stay in operation, even when the corporate data center or cloud is down or not reachable
• Wide-are communication is generally to slow
• Transmitting all sensor data to corporate or cloud data center may be impractical or impossible if the volume of data is high or if reliable, high-bandwidth networks are unavailable
Data and IoT
Several types of data play a role in an IoT deployment:• Continuous environmental and positional data
• Multidimensional time series data
• Descriptive data (metadata) about objects, systems and processes
• Historical data
• Analytical models
• Radio frequency identification (RFID) data
Assess the variety of data used in your IoT architecture to refine your datastore requirements => NoSQL
Understand the unique optimizations for time series data and analysis => NoSQL
EnterpriseService
Bus(E
SB)
EnterpriseApplications
WS
External CloudServiceProviders
BPMandSOAPlatform
Event
BusinessLogic/Rules
Business IntelligenceIoT Device
Services
WS
Event
Processes
Gateway
IoT SmartDevice
Viszualization
Analytics
DB
1) IoT with Simple Event Processing
APIG
atew
ay
=oneway=request/response
25
Mobile Apps
DB
Rich(Web)Client Apps
DB
EnterpriseService
Bus(E
SB)
EnterpriseApplications
WS
External CloudServiceProviders
BPMandSOAPlatform
Event
BusinessLogic/Rules
Business IntelligenceIoT Device
Services
WS
Event
Processes
Gateway
IoT SmartDevice
Viszualization
Analytics
DB
1) IoT with Simple Event Processing – Oracle
APIG
atew
ay
=oneway=request/response
26
Mobile Apps
DB
Rich(Web)Client Apps
DB
Seriv
ceBu
s
APIG
atew
ay
StreamExplorer
Business ActivityMonitoring
SOASuiteBPMSuite
EnterpriseService
Bus(E
SB)
StreamProcessingInfrastructure
EnterpriseApplications
WS
External CloudServiceProviders
BPMandSOAPlatform
Event
BusinessLogic/Rules
Business IntelligenceIoT Device
EnterpriseEventBus(Ingress)
Enterprise
EventBus
Services
WS
Event
Processes
Gateway
ESP/CEP
ESP/CEP
IoT SmartDevice
Viszualization
Analytics
DB
DB
DB
2) IoT with Stream/Event Processing
APIG
atew
ay
27
Mobile Apps
DB
Rich(Web)Client Apps
DB
Social MediaStreams
=oneway=request/response
EnterpriseService
Bus(E
SB)
StreamProcessingInfrastructure
EnterpriseApplications
WS
External CloudServiceProviders
BPMandSOAPlatform
Event
BusinessLogic/Rules
Business IntelligenceIoT Device
EnterpriseEventBus(Ingress)
Enterprise
EventBus
Services
WS
Event
Processes
Gateway
ESP/CEP
ESP/CEP
IoT SmartDevice
Viszualization
Analytics
DB
DB
DB
2) IoT with Stream/Event Processing – “Open Source”
APIG
atew
ay
28
Mobile Apps
DB
Rich(Web)Client Apps
DB
Social MediaStreams
=oneway=request/response
EnterpriseService
Bus(E
SB)
StreamProcessingInfrastructure
EnterpriseApplications
WS
External CloudServiceProviders
BPMandSOAPlatform
Event
BusinessLogic/Rules
Business IntelligenceIoT Device
EnterpriseEventBus(Ingress)
Enterprise
EventBus
Services
WS
Event
Processes
Gateway
ESP/CEP
ESP/CEP
IoT SmartDevice
Viszualization
Analytics
DB
DB
DB
2) IoT with Stream/Event Processing - Oracle
APIG
atew
ay
29
Mobile Apps
DB
Rich(Web)Client Apps
DB
Social MediaStreams
=oneway=request/response
OracleEventProcessingForEmbedded
OracleEventProcessingForEmbedded
Seriv
ceBu
s
OracleEventProcessingStreamExplorer
OracleNoSQLStreamExplorer
Business ActivityMonitoringSe
rivce
Bus
APIG
atew
ay
Coherence
SOASuiteBPMSuite
EnterpriseService
Bus(E
SB)
3) IoT with Big Data Analytics
EnterpriseApplications
WS
External CloudServiceProviders
BPMandSOAPlatform
Event
BusinessLogic/Rules
Business IntelligenceIoT Device
EnterpriseEventBus(Ingress)
Enterprise
EventBus
Services
WS
Event
Processes
Gateway
ESP/CEP
Hadoop BigDataInfrastructureHDFS
BatchProcessing
IoT SmartDevice
Viszualization
Analytics
DBDB
APIG
atew
ay
30
Mobile Apps
DB
Rich(Web)Client Apps
DB
Social MediaStreams
=oneway=request/response
EnterpriseService
Bus(E
SB)
EnterpriseApplications
WS
External CloudServiceProviders
BPMandSOAPlatform
Event
BusinessLogic/Rules
Business IntelligenceIoT Device
EnterpriseEventBus(Ingress)
Enterprise
EventBus
Services
WS
Event
Processes
Gateway
ESP/CEP
Hadoop BigDataInfrastructureHDFS
BatchProcessing
IoT SmartDevice
Viszualization
Analytics
DBDB
APIG
atew
ay
31
Mobile Apps
DB
Rich(Web)Client Apps
DB
Social MediaStreams
=oneway=request/response
3) IoT with Big Data Analytics – “Open Source”
EnterpriseService
Bus(E
SB)
3) IoT with Big Data Analytics - Oracle
EnterpriseApplications
WS
External CloudServiceProviders
BPMandSOAPlatform
Event
BusinessLogic/Rules
Business IntelligenceIoT Device
EnterpriseEventBus(Ingress)
Enterprise
EventBus
Services
WS
Event
Processes
Gateway
ESP/CEP
Hadoop BigDataInfrastructureHDFS
BatchProcessing
IoT SmartDevice
Viszualization
Analytics
DBDB
APIG
atew
ay
32
Mobile Apps
DB
Rich(Web)Client Apps
DB
Social MediaStreams
=oneway=request/response
OracleEventProcessingForEmbedded
OracleEventProcessingForEmbedded
Seriv
ceBu
s
OracleBigData Appliance
OracleNoSQL
StreamExplorer
Business ActivityMonitoring
OracleDataIntegrator
APIG
atew
ay SOASuiteBPMSuite
EnterpriseService
Bus(E
SB)
StreamProcessingInfrastructure
EnterpriseApplications
WS
External CloudServiceProviders
BPMandSOAPlatform
Event
BusinessLogic/Rules
Business IntelligenceIoT Device
EnterpriseEventBus(Ingress)
Enterprise
EventBus
Services
WS
Event
Processes
Gateway
ESP/CEP
Hadoop BigDataInfrastructureHDFS
ESP/CEP
BatchProcessing
IoT SmartDevice
Viszualization
Analytics
DB
DB
DB
DB
4) IoT with “Lambda” Architecture
APIG
atew
ay
33
Mobile Apps
DB
Rich(Web)Client Apps
DB
Social MediaStreams
=oneway=request/response
EnterpriseService
Bus(E
SB)
StreamProcessingInfrastructure
EnterpriseApplications
WS
External CloudServiceProviders
BPMandSOAPlatform
Event
BusinessLogic/Rules
Business IntelligenceIoT Device
EnterpriseEventBus(Ingress)
Enterprise
EventBus
Services
WS
Event
Processes
Gateway
ESP/CEP
Hadoop BigDataInfrastructureHDFS
ESP/CEP
Replay toreprocess
IoT SmartDevice
Viszualization
Analytics
DB
DB
DB
5) IoT with “Kappa” Architecture
APIG
atew
ay
34
Mobile Apps
DB
Rich(Web)Client Apps
DB
Social MediaStreams
=oneway=request/response
EnterpriseService
Bus(E
SB)
StreamProcessingInfrastructure
EnterpriseApplications
WS
External CloudServiceProviders
BPMandSOAPlatform
Event
BusinessLogic/Rules
Business IntelligenceIoT Device
EnterpriseEventBus(Ingress)
Enterprise
EventBus
Services
WS
Event
Processes
Gateway
ESP/CEP
Hadoop BigDataInfrastructureHDFS
ESP/CEP
BatchProcessing
IoT SmartDevice
Viszualization
Analytics
DB
DB
DB
DB
6) IoT with Big Data Advanced Analytics
APIG
atew
ay
35
Mobile Apps
DB
Rich(Web)Client Apps
DB
Social MediaStreams
=oneway=request/response
EnterpriseService
Bus(E
SB)
StreamProcessingInfrastructure
IoT Reference Architecture
EnterpriseApplications
WS
External CloudServiceProviders
BPMandSOAPlatform
Event
BusinessLogic/Rules
Business IntelligenceIoT Device
36
Mobile Apps
DB
Rich(Web)Client Apps
DB
Social MediaStreams En
terpriseEventBus(Ingress)
Enterprise
EventBus
Services
WS
Event
Processes
Gateway
ESP/CEP
Hadoop BigDataInfrastructureHDFS
ESP/CEP
BatchProcessing
IoT SmartDevice
Viszualization
Analytics
DB
DB
DB
DB
APIG
atew
ay
=oneway=request/response
EnterpriseService
Bus(E
SB)
StreamProcessingInfrastructure
EnterpriseApplications
WS
External CloudServiceProviders
BPMandSOAPlatform
Event
BusinessLogic/Rules
Business IntelligenceIoT Device
37
Mobile Apps
DB
Rich(Web)Client Apps
DB
Social MediaStreams En
terpriseEventBus(Ingress)
Enterprise
EventBus
Services
WS
Event
Processes
Gateway
ESP/CEP
Hadoop BigDataInfrastructureHDFS
ESP/CEP
BatchProcessing
IoT SmartDevice
Viszualization
Analytics
DB
DB
DB
DB
APIG
atew
ay
Internet of Things - Sind traditionelle Architekturen gut genug?
=oneway=request/response
IoT Reference Architecture – Open Source Platform
EnterpriseService
Bus(E
SB)
StreamProcessingInfrastructure
EnterpriseApplications
WS
External CloudServiceProviders
BPMandSOAPlatform
Event
BusinessLogic/Rules
Business IntelligenceIoT Device
38
Mobile Apps
DB
Rich(Web)Client Apps
DB
Social MediaStreams En
terpriseEventBus(Ingress)
Enterprise
EventBus
Services
WS
Event
Processes
Gateway
ESP/CEP
Hadoop BigDataInfrastructureHDFS
ESP/CEP
BatchProcessing
IoT SmartDevice
Viszualization
Analytics
DB
DB
DB
DB
APIG
atew
ay
IoT Reference Architecture – Oracle Platform
Internet of Things - Sind traditionelle Architekturen gut genug?
=oneway=request/response
OracleEventProcessingForEmbedded
OracleEventProcessingForEmbedded
Seriv
ceBu
s
OracleEventProcessingStreamExplorer
OracleBigData Appliance
OracleNoSQL
OracleNoSQL
StreamExplorer
Business ActivityMonitoring
OracleDataIntegrator
Seriv
ceBu
sAP
IGatew
ay
Coherence
SOASuiteBPMSuite
IoT Platform
IoT Platforms: backbone to manage IoT business cases
Mayor building blocks of an IoT Platform
OracleInternetofThingsCloudService
IoTCloudService
DeviceVirtualization
High SpeedMessaging
EndpointManagement
Connect
Abstractcomplexityassociatedwithdeviceconnectivity
Standardize integrationofdeviceswithenterprise
AnalyzeReducenoiseanddetectbusiness
eventsatreal-timeEnablehistoricalbig-dataanalysis
IntegrateMakeenterpriseprocessesIoT
friendlyAllowenterprise&mobile
applications tocontroldevices
Integration CloudService
BI&Big DataCloudService
OracleCloudServices
MobileCloudService
3rd partyapps
IndustryVertical Apps
Enterprise AppsCloudorOnPremise
Manufacturing
Transportation
ServiceMgmt
AssetMgmt
EnterpriseConnectivity
RESTAPIs
Control
StreamProcessing
EventStore
DataEnrichment
Summary
Summary
Treat events as events! Infrastructures for handling lots of events are available!
IoT tends to make Big Data / Fast Data infrastructures necessary
Know your use case/requirements to choose the right architecture!Can my existing backend landscape handle the new IoT load?
Do I have to handle huge amount of events in “real-time”?
Do I need to filter/aggregate data before invoking existing backend systems?
Do I want to do Advanced Analytics (predictive analytics) where historical information is necessary?
What is the network bandwidth between device/gateway and cloud/backend?
Centralized or Decentralized IoT solution?
Trivadis anderDOAG2015
Ebene3- gleichnebenderRolltreppe
WirfreuenunsaufIhrenBesuch.
DennmitTrivadis gewinnenSieimmer.
Guido SchmutzTechnology Manager