36
Simon Speth, Johannes Landgraf Technical University of Munich Department of Informatics Chair for Robotics, Artificial Intelligence and Real - time Systems Garching, 01.February.2019 Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

Simon Speth, Johannes Landgraf

Technical University of Munich

Department of Informatics

Chair for Robotics, Artificial Intelligence and Real - time Systems

Garching, 01.February.2019

Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Page 2: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

Outline

Implementation5

Guarantee of Safety and Performance4

Design of an Automotive Architecture3

Service Oriented Architecture2

Motivation1

Conclusion and Outlook6

Page 3: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

3Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

100 +

62

50

50

16

15

7

Modern car

Facebook

Windows Vista

Large HadronCollider

Linux Kernel 3.6

Android

Boeing 787

Software Size (Million Lines of Code)

Page 4: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

4Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

S80

XC90

V40

S80

V60 PHEV

XC90

0

20

40

60

80

100

120

1996 1998 2000 2002 2004 2006 2008 2010 2012 2014 2016

Nu

mb

er

of

EC

Us

ECU Count Evolution at Volvo

Page 5: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

Outline

Implementation5

Guarantee of Safety and Performance4

Design of an Automotive Architecture3

Service Oriented Architecture2

Introduction and Motivation1

Conclusion and Outlook6

Page 6: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

6Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Evolution of SOA

Page 7: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

7Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

What is SOA ?

▪ Architectural pattern in computer software design

▪ Enables application functionality to be provided as a set of services

▪ Allows creation of applications that make use of software services

▪ Couples services loosely by using standards-based interfaces

Page 8: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

8Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

SOA Key Principles Loose Coupling

Abstraction

Reusability

AutonomyStatelessness

Discoverability

Composability

Key Principles

Page 9: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

9Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Service Contract

▪ Service Contract

▪ Documents expressing meta information

▪ Technical interface of service

▪ Service Level Agreement (SLA) specifies quality-of-

service features

ServiceConsumer

Page 10: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

10Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Service-oriented analysis and design phase

Service-oriented analysisService implementation

designService logic design

Technology-agnostic Technology-specific

▪ Identify service candidates ▪ Specification of service API

▪ Specification of service level

agreements (SLA)

▪ Identify service composition

candidates

Page 11: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

11Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Service properties Granularity

(basic – composite)

Weight

(heavy – light)

Runtime service binding

(dynamic – static)

Scope

(powertrain etc.)

Communication pattern

(synch – asyn)

Runtime environment

(onboard – offboard)

Properties

Page 12: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

Outline

Implementation5

Guarantee of Safety and Performance4

Design of an Automotive Architecture3

Service Oriented Architecture2

Introduction and Motivation1

Conclusion and Outlook6

Page 13: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

13Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Drawbacks:

• Complex architecture

• Communication over

different Bus Systems

(CAN, LIN)

• Mass ~ 50kg

• No central data

gateway

ECU Based Architecture

Page 14: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

14Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Zone Architecture

Page 15: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

15Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Combining Zone Architecture with SOA

Simpler architecture

▪ Clear interconnection of services

▪ High level of abstraction

▪ Logical composability

▪ Central data fusion place

▪ High bandwidth for computer vision and machine learning tasks

▪ Upgradability of hardware and software (gpu sockets / over the air update)

Page 16: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

▪ Different types of Sensors:

▪ Ultrasound

▪ Lidar (Laser Scanner)

▪ Radar

▪ Camera

▪ Upgradability of sensors:

▪ Camera cheapest

▪ Later expanded with lidar

16Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

SOA enables Hardware Independence

Page 17: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

▪ More structured Online learning

implementation → cheaper

▪ Faster development

▪ Developing new features/algorithms for

customers after car sale

Examples for autonomous car algorithms:

▪ Computer Vision

▪ Sensor fusion

▪ Trajectory planning

17Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Advantages of SOA for AI in cars

▪ Parallelizable

▪ Computational Complex

Page 18: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

Nvidia estimation:

18Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Computer Vision Computational Complexity

Feature Detection / Tracking

30 GFLOPS (30 Hz)

Object Recognition

180 GFLOPS (30 Hz)

3D Scene Interpretation

280 GFLOPS (30 Hz)

Page 19: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

On-car training not yet feasible for safety critical functions:

▪ On-car training:

▪ Danger of malicious learning

▪ Need to install expensive hardware → car cost

▪ Off-car training:

▪ Store produced data

▪ 5G connection for sending training data to server

19Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Online learning in the car or in cloud?

Page 20: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

Outline

Implementation5

Guarantee of Safety and Performance4

Design of an Automotive Architecture3

Service Oriented Architecture2

Introduction and Motivation1

Conclusion and Outlook6

Page 21: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

▪ Safety defined as minimization of

risk and uncertainty

▪ Functional safety of automotive

software addressed by ISO 26262

▪ Automotive Safety Integrity Level

(ASIL)

21Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Functional safety overview

Page 22: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

▪ Data Distribution Service (DDS)

▪ Scalable, distributed, interoperable data sharing

▪ Pub / Sub System

▪ Time-Sensitive Networking (TSN)

▪ Real-time communication over Ethernet

▪ Guarantees of delivery

22Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Middleware crucial for ASIL rating

Page 23: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

23Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Checking time constraints is hard

▪ Services may be deployed on different platform

▪ Bring your own device

▪ Assume the worst case

▪ Enforce static service binding

Service ClientClient Service

-

Dynamic service binding

Static service binding

Page 24: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

24Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Monitor / Actuator services

Actuator

Inputs

Outputs

Shut-

down

Cross-

checks

▪ Actuator designed on low ASIL

▪ Vehicles have short failover missions

▪ Global Scope:

▪ High-ASIL monitor service

▪ Other services run low-ASIL

Monitor

Page 25: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

▪ Accident reconstruction data

▪ Important for legal issues

▪ Safety assurance argument

▪ Valuable training data

▪ Fits in zone architecture

▪ Log DDS

25Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Black Box service

Page 26: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

Outline

Implementation5

Guarantee of Safety and Performance4

Design of an Automotive Architecture3

Service Oriented Architecture2

Introduction and Motivation1

Conclusion and Outlook6

Page 27: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

27Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Autonomous driving platform

Page 28: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

28Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Failover test

▪ Failover test from Kugele et al.▪ Failover time 𝑡𝑡0▪ Response interval 𝑡𝑖▪ Service deployed in cloud 𝑠𝐴

𝐶𝑙𝑜𝑢𝑑

▪ Service deployed locally 𝑠𝐴𝐿𝑜𝑐𝑎𝑙

Page 29: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

29Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Implementation Cloud Service

1. Car sends request to cloud service

over the internet

2. Google Server computes response

3. Car receives response over

internet

Page 30: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

30Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Implementation Local Service

1. Car sends request to local

service over Wi-Fi network

2. Local Tomcat Server computes

response

3. Car receives response over local

network

Page 31: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

31Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Measurements of failover time

Page 32: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

▪ Median Cloud takeover time 859ms

▪ Median Local takeover time 335ms

▪ Both not real time capable

▪ Worst case analysis would clearly lead to crash

▪ Cloud service one order of magnate slower than local service

▪ Cloud service not suited for safety critical failover

32Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Implementation Result

Page 33: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

Outline

Implementation5

Guarantee of Safety and Performance4

Design of an Automotive Architecture3

Service Oriented Architecture2

Introduction and Motivation1

Conclusion and Outlook6

Page 34: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

▪ SOA for hardware independence

▪ SOA improves deployment and development

▪ Cloud services no real time guarantee

▪ High ASIL monitor service for failover initiation

▪ Middleware has to support TSN and DDS

▪ Dynamic binding in safety critical functions not possible

34Simon Speth (TUM), Johannes Landgraf (TUM) | Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications

Conclusion

Page 35: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

[1] https://www.motor1.com/news/65202/bentley-bentayga-wiring-harness-is-weirdly-beautiful/

[2] https://patents.google.com/patent/US7999408B2/en

[3] https://www.audi-mediacenter.com/de/audi-a8-51

[4] https://www.audi-technology-portal.de/en/electrics-electronics/driver-assistant-

systems/adaptive-cruise-control-with-stop-go-function

[5] http://on-demand.gputechconf.com/siggraph/2014/presentation/SG4134-GPUs-

Autonomous-Driving.pdf

[6] Koopman, Philip, Wagner Michael. “Challenges in Autonomous Vehicle Testing and

Validation” 2016 SAE World Congress

[7] Kugele, Stefan, David Hettler, and Sina Shafaei. ”Elastic Service Provision

for Intelligent Vehicle Functions.” 2018 21st International Conference

on Intelligent Transportation Systems (ITSC). IEEE, 2018.

[8] Hiller Martin, “Thoughts on the Future of Automotive Electronic Architecture“, Presentation

Page 36: Service Oriented Architecture (SOA) and the Integration of ...€¦ · Service Oriented Architecture (SOA) and the Integration of Online Learning-based Applications. Outline 5 Implementation

Thank You for Your attention!

Any Questions?