CONFORMANCE TESTING OF ELECTRIC VEHICLE CHARGING COMMUNICATION BASED ON TTCN-3 · PDF file · 2017-10-16ISO 15118 Road vehicles —Vehicle to grid communication interface —Part

CONFORMANCE TESTING OF ELECTRIC VEHICLE CHARGING COMMUNICATION BASED ON TTCN-3

Presented by Sven Gröning

© All rights reserved

Agenda

2

• The new E-Mobility market and it’s challenges

• ISO 15118 Conformance Testing using TTCN-3

• Lessons learned

• Summary & Outlook

© All rights reserved

The new E-Mobility market and it’s challenges

3 © All rights reserved

The new E-Mobility market and it’s challenges


CommunicationCharging-Control

Accounting

Charge-Scheduling

Value Added Services

Alternating Current

CommunicationContacting

Charging-Control

Charge-Scheduling

(Renewable Energy)

Bidirectional Current

InductionPositioning

Direct Current

CommunicationCharging-Control

Accounting

Charge-Scheduling

Value Added Services

Positioning

CommunicationContacting

Charging-Control

Charge-Scheduling

ᴓ Diameter

Gasoline /

Diesel

octane index

Co

mple

xity

Mark

et A

cto

r‘s

Interoperability in scaling E-Mobility Market


… …N x M

Bosch

Test System for

Charging Interface

Bosch

Interoperability in scaling E-Mobility Market


Ham

burg

er

Hochbahn

… …N x M

… …N x M

Bosch… …N x M

… …N x M

Test System for

Charging Interface

Bosch

Ham

burg

er

Hochbahn

ISO 15118 Conformance Testing using TTCN-3

• Requirement Analysis• ISO 15118-2/-3 Standards

Technical Specification of charging communication

• Vendors implement software stacks based on requirements

• Number of technical requirements

ISO 15118-2:2014 ~850 req.

ISO 15118-3:2015 ~230 req.


Testability

Criteria Definition

testable Explicit testing of requirement in ATS.

partially testable

Partially testing of requirement in ATS. Parts cannot be

tested in black-box tests or may only be tested by multiple

test cases.

indirectly testable

Indirect testing of requirement in ATS. Internal processing

of the SUT and can only be tested by analyzing the

subsequent reaction of the SUT.

implicitly testable Implicit testing of requirement by Test Adapter/Codec.

not testable Requirement cannot be tested in black-box tests.

not applicable Requirement is not applicable for use case.

Error Requirement has an error in the underlying standard.


• Requirement Analysis• ISO 15118-2/-3 Standards

Technical Specification of charging communication

• Vendors implement software stacks based on requirements

• Number of technical requirements

ISO 15118-2:2014 ~850 req.

ISO 15118-3:2015 ~230 req.


Testability

Criteria Definition

testable Explicit testing of requirement in ATS

partially testable

Partially testing of requirement in ATS. Parts cannot be

tested in black-box tests or may only be tested by multiple

test cases.

indirectly testable

Indirect testing of requirement in ATS. Internal processing

of the SUT and can only be tested by analyzing the

subsequent reaction of the SUT.

testable (PIXIT)Explicit testing of requirement if a special PIXIT is used.

SUT involve additional configuration settings.

implicitly testable Implicit testing of requirement by Test Adapter/Codec.

not testable Requirement cannot be tested in black-box tests.

not applicable Requirement is not applicable for use case.

out of scope Requirement is out of scope e.g. just a reference.

Error Requirement has an error in the underlying standard.



PWMAnalysis

• IEC 61851-1 PWM Analysis

• IEC 61851-1 Proximity Test

PHY Analysis

• PSD Measurement ISO 15118-3 (Transmission Power)

• Pre-Scaler Check (Frequency Map )

Test Setup

• Protocol Implementation Conformance Statement (PICS)

• Protocol Implementation extra Information for Testing (PIXIT)

Test Execution

• Automated Execution of Test Cases based on selected Control Part

Test Results

• Fault Detection and Verdicts

• Failure Analysis and Test Reports

Certifi-cation

• Certificate Generation based on Test Setup and Test Results

-90

-80

-70

-60

-50

-40

-30

0,0

00

0,6

59

1,3

18

1,9

78

2,6

37

3,2

96

3,9

55

4,6

14

5,2

73

5,9

33

6,5

92

7,2

51

7,9

10

8,5

69

9,2

29

9,8

88

10

,54

7

11

,20

6

11

,86

5

12

,52

4

13

,18

4

13

,84

3

14

,50

2

15

,16

1

15

,82

0

16

,47

9

17

,13

9

17

,79

8

18

,45

7

19

,11

6

19

,77

5

20

,43

5

21

,09

4

21

,75

3

22

,41

2

23

,07

1

23

,73

0

24

,39

0

25

,04

9

25

,70

8

26

,36

7

27

,02

6

27

,68

6

28

,34

5

29

,00

4

29

,66

3

30

,32

2

30

,98

1

31

,64

1

32

,30

0

32

,95

9

33

,61

8

34

,27

7

34

,93

7

35

,59

6

36

,25

5

36

,91

4

dB

m/H

z

HP Limit dBm/Hz

ISO Limit dBm/Hz

U

p

p

e

r

b

a

n

d

1

3

V

L

o

w

e

r

b

a

n

d

1

1

V

U

p

p

e

r

b

a

n

d

1

0

V

L

o

w

e

r

b

a

n

d

8

V

U

p

p

e

r

b

a

n

d

7

V

L

o

w

e

r

b

a

n

d

5

V

U

p

p

e

r

b

a

n

d

4

V

L

o

w

e

r

b

a

n

d

2

V

A B C D

02

46

81

01

21

4

VMax

states

Po

sitiv

e V

olta

ge

[V]

State A: EV Not connected

State B: EV connected, not ready to charge

State C: EV connected, ready to charge

State D: EV connected, ready, ventilation required













Fall

Time

(90%

bis

10%)

Rise

Time

(10%

bis

90%)zur Detektion der Störungen, zum Abschalten des Ladeprozesses und

zur Vermeidung von Verletzungen

Repeat

Tests

Test

Certificate



ISO 15118 Road vehicles — Vehicle to grid communication interface — Part 4: Network and application protocol conformance test, FDIS 2017

ISO 15118 Road vehicles — Vehicle to grid communication interface — Part 5: Physical and data link layer conformance tests, FDIS 2017

Hardware

Adapter

Test System

Test Framework

Runtime Environment

System

under

Test

(SUT)

Test Case

Specification

ISO/IEC 15118-4

Test SuiteTest

Mgmt.

Test Logging

& Reporting

Test Execution

TC

I

Bla

ck B

ox T

ests

TC

I

TC

I

TR

I

TR

I

61851-1 SUT

Adapter

15118-2 SUT

Adapter

TR

I

IEC 61851-1 Annex A

PWM Signaling

ISO/IEC 15118-2

Messaging

15118-3 SUT

Adapter

Test

System

User External

Functions

Security

TCI

Test-PKI

ISO/IEC 15118-4

ISO/IEC 15118-3

PLC over CPL (SLAC) TCI: Test Control Interface

TRI: Test Runtime Interface

PLC: Powerline Communications

CPL: Control Pilot Line

EXI: Efficient XML Interchange

SDP: SECC Discovery Protocol

V2GTP: V2G Transfer Protocol

SLAC: Signal Level Attenuation

Characterization

Platform

Adapter

Codecs

V2GTP

V2G-EXI

SDP

Security

SLAC

TCI

U

p

p

e

r

b

a

n

d

1

3

V

L

o

w

e

r

b

a

n

d

1

1

V

U

p

p

e

r

b

a

n

d

1

0

V

L

o

w

e

r

b

a

n

d

8

V

U

p

p

e

r

b

a

n

d

7

V

L

o

w

e

r

b

a

n

d

5

V

U

p

p

e

r

b

a

n

d

4

V

L

o

w

e

r

b

a

n

d

2

V

A B C D

02

46

81

01

21

4

VMax

states

Po

sitiv

e V

olta

ge

[V]

















Fall

Time

(90%

bis

10%)

Rise

Time

(10%

bis

90%)zur Detektion der Störungen, zum Abschalten des Ladeprozesses und

zur Vermeidung von Verletzungen

-90

-80

-70

-60

-50

-40

-30

0,0

00

0,6

59

1,3

18

1,9

78

2,6

37

3,2

96

3,9

55

4,6

14

5,2

73

5,9

33

6,5

92

7,2

51

7,9

10

8,5

69

9,2

29

9,8

88

10

,54

7

11

,20

6

11

,86

5

12

,52

4

13

,18

4

13

,84

3

14

,50

2

15

,16

1

15

,82

0

16

,47

9

17

,13

9

17

,79

8

18

,45

7

19

,11

6

19

,77

5

20

,43

5

21

,09

4

21

,75

3

22

,41

2

23

,07

1

23

,73

0

24

,39

0

25

,04

9

25

,70

8

26

,36

7

27

,02

6

27

,68

6

28

,34

5

29

,00

4

29

,66

3

30

,32

2

30

,98

1

31

,64

1

32

,30

0

32

,95

9

33

,61

8

34

,27

7

34

,93

7

35

,59

6

36

,25

5

36

,91

4

dB

m/H

z

HP Limit dBm/Hz

ISO Limit dBm/Hz

t[µs]





Test System

Test Execution

system:

System_SECC (TSI)

or System_EVCC (TSI)

System

under

Test

(SUT)

SECC

or

EVCC

mtc:

SECC_Tester

or EVCC_Tester

ptc:

HAL_61851_Listener

TRI

pt_V2G_TCP_TLS_ALM_SECC_Port

or pt_V2G_TCP_TLS_ALM_EVCC_Port

pt_V2G_UDP_SDP_Port

pt_HAL_61851_Port

pt_HAL_61851_Port

pt_HAL_61851_Listener_PortIEC 61851-1

Adapter

pt_

HA

L_

61

85

1_In

tera

l_P

ort

pt_

HA

L_

61

85

1_In

tera

l_P

ort

pt_HAL_61851_Listener_Port

15118-2 SUT

Adapter

pt_V2G_TCP_TLS_ALM_SECC_Port or

pt_V2G_TCP_TLS_ALM_EVCC_Port

IEC 61851-1 Annex A

PWM Signaling

ISO 15118-2

Messaging

pt_V2G_UDP_SDP

_Port

U

p

p

e

r

b

a

n

d

1

3

V

L

o

w

e

r

b

a

n

d

1

1

V

U

p

p

e

r

b

a

n

d

1

0

V

L

o

w

e

r

b

a

n

d

8

V

U

p

p

e

r

b

a

n

d

7

V

L

o

w

e

r

b

a

n

d

5

V

U

p

p

e

r

b

a

n

d

4

V

L

o

w

e

r

b

a

n

d

2

V

A B C D

02

46

81

01

21

4

VMax

states

Po

sitiv

e V

olta

ge

[V]

















Fall

Time

(90%

bis

10%)

Rise

Time

(10% bis

90%)

zur Detektion der

Störungen, zum Abschalten

des Ladeprozesses und zur

Vermeidung von

Verletzungen

-90

-80

-70

-60

-50

-40

-30

0,0

00

0,8

06

1,6

11

2,4

17

3,2

23

4,0

28

4,8

34

5,6

40

6,4

45

7,2

51

8,0

57

8,8

62

9,6

68

10

,47

41

1,2

79

12

,08

51

2,8

91

13

,69

61

4,5

02

15

,30

81

6,1

13

16

,91

91

7,7

25

18

,53

01

9,3

36

20

,14

22

0,9

47

21

,75

32

2,5

59

23

,36

42

4,1

70

24

,97

62

5,7

81

26

,58

72

7,3

93

28

,19

82

9,0

04

29

,81

03

0,6

15

31

,42

13

2,2

27

33

,03

23

3,8

38

34

,64

43

5,4

49

36

,25

53

7,0

61

dB

m/H

z

HP Limit dBm/Hz

ISO Limit dBm/Hz



User Interface(Test Control and Analysis)

PHY Layer Comp.(PLC Connection to SUT Homeplug GreenPhy)

Dig. Oscilloscope(PWM Signal Analysis)

Spectrum Analyzer(PLC Signal Verification)

Signal Generator(Simulation of Interferenceson PHY Layer e.g. PLC)

Test System(Test-Suites and automated Control)

System

under

Test

(SUT)

EV/EVSE

Bla

ck B

ox T

ests

IEC 61851-1 Annex A

Analog PWM Signal Analysis

ISO/IEC 15118-3 / DIN 70121

PLC over Control Pilot Line

ISO/IEC 15118-2 / DIN 70121

Message Exchange

ISO/IEC 15118-3 / DIN 70121

Digital PLC Signal-Analysis & Interference

AC DC

Communication

Unit

Power Flow

ISO 15118 Interoperability Testing using TTCN-3




Hardware

Adapter

Test System

Test Framework

Runtime Environment

System

under

Test

(SUT)

Test Case

Specification

ISO/IEC 15118-4

Test SuiteTest

Mgmt.

Test Logging

& Reporting

Test Execution

TC

I

Bla

ck B

ox T

ests

TC

I

TC

I

TR

I

TR

I

61851-1 SUT

Adapter

15118-2 SUT

Adapter

TR

I

IEC 61851-1 Annex A

PWM Signaling

ISO/IEC 15118-2

Messaging

15118-3 SUT

Adapter

Test

System

User External

Functions

Security

TCI

Test-PKI

ISO/IEC 15118-4

ISO/IEC 15118-3

PLC over CPL (SLAC) TCI: Test Control Interface

TRI: Test Runtime Interface

PLC: Powerline Communications

CPL: Control Pilot Line

EXI: Efficient XML Interchange

SDP: SECC Discovery Protocol

V2GTP: V2G Transfer Protocol

SLAC: Signal Level Attenuation

Characterization

Platform

Adapter

Codecs

V2GTP

V2G-EXI

SDP

Security

SLAC

TCI

Test Case Specification

for Interoperability



Facts about 6th Testing Symposium:

~200 Participants

~85 Companies

17 Nations

~150 Test Sessions

Prototype AC/DC EVs & EVSEs

Interop & Conformance Tests in

2 hour Test Slots

1. Int. ISO 15118

Testival, 11/2014,

@ ANL, Chicago

2. Int. ISO 15118

Testival, 04/2015,

@ JARI, Tokyo

3. Int. ISO 15118

Testival, 11/2015,

@ CNI, Dortmund

4. Int. ISO 15118

Testing Symposium,

04/2016, @ CSE,

San Diego

5. Int. ISO 15118

Testing Symposium,

11/2016, @ KSGI,

Jeju-Do

6. Int. ISO 15118

Testing Symposium,

06/2017, @

VEDECOM, France

Since 5th TS supported by:

Organized by:

Communication

Networks Institute

In close cooperation with:

www.testing-symposium.net

[9][10][11]

7. Int. CCS & ISO 15118 Testing

Symposium, 11/2017, @ CSA

GROUP, Mississauga

http://www.testing-symposium.net/



Since 5th TS supported by:

Organized by:

Communication

Networks Institute

In close cooperation with:

www.testing-symposium.net

[9][10][11]

http://www.testing-symposium.net/

Lessons learned or the

• Harmonize testing in a cross-vendor domain is tough

• Automotive-, Utility- and Communication have it’s own testing evolution

• Signal- and message based testing with real-time requirements

• Synchronization between MTC und PTC stimulus must be timed

• Security testing using TTCN-3

• Fractional Encoding to calculate signatures before sending Msg.

• Managing Test Suites

• ATS is open source and some features are entangled, due to protocol nature

• Aspect Oriented TTCN-3 (AOT3) a code management option?


?

Summary & Outlook


Pass

Talk

EV charging communication brings together cross-domain vendors

The formal description of ISO 15118 test cases in TTCN-3 minimizes ambiguities

Testing concept will also be applied for the 2nd editionand other groups e.g. IEC 63110 expressed interest

verisco GmbH, Startup of TU Dortmund (CNI)Conformance and Interoperability Testing of EV-Charging Solution

http://verisco.de/

http://verisco.de/

Thank you for your attention! Q&A


http://www.sap.com/

http://www.sap.com/

http://www.sap.com/

Sources

[1] Stefan Koelle, Daimler beschleunigt seinen Elektrifizierungs-Fahrplan, (www.electrive.net)

[2] Peter Schwierz, BMW plant Elektro-Umschwung – 12 Stromer bis 2025, (www.electrive.net)

[3] Daniel Bönnighausen, VW startet Elektro-Offensive – 50 Stromer bis 2025, (www.electrive.net)

[4] Daniel Bönnighausen, Post und Ford stellen StreetScooter Work XL vor, (www.electrive.net)

[5] Stefan Koelle, 60 E-Busse in Hamburg bis spätestens 2019, (www.electrive.net)

[6] Marschall Wernecke, Andere Accelerate, Verband der Automobilindustrie e.V. (VDA), Die digitale Revolution im Automobil

[1-6] Fig. Sources: www.electrive.net, www.intellimec.com

[7] ISO 15118 Road vehicles — Vehicle to grid communication interface — Part 4: Network and application protocol conformance test, FDIS 2017

[8] ISO 15118 Road vehicles — Vehicle to grid communication interface — Part 5: Physical and data link layer conformance tests, FDIS 2017

[9] CharIN, ISO/IEC 15118 Testing Symposium took place on Nov. 7th – 9th in Korea., 2016

[10] CharIN, Communication Networks Institute veranstaltet 5. internationales Testing Symposium zur CCS Ladeschnittstelle in Süd-Korea 2016.

[11] CharIN, The ISO/IEC 15118 Testing Symposium in Versailles shows a great momentum in the CCS adoption, 2017

[11] Hänsch, K., Pelzer, A., Komarnicki, P., Gröning, S., Schmutzler, J., Wietfeld, C., ... & Müller, R. (2014, July). An ISO/IEC 15118 conformance testing system architecture. In PES General Meeting| Conference & Exposition, 2014 IEEE (pp. 1-5). IEEE.

[12] S. Gröning, C. Lewandowski, J. Schmutzler, C. Wietfeld, "Interoperability Testing based on TTCN-3 for V2G Communication Interfaces", In International Conference on Connected Vehicles and Expo (ICCVE), IEEE, Beijing, China, December 2012


https://www.electrive.net/2017/09/11/daimler-beschleunigt-seinen-elektrifizierungs-fahrplan/

https://www.electrive.net/2017/09/07/bmw-plant-elektro-umschwung-12-stromer-bis-2025/

https://www.electrive.net/2017/09/11/vw-startet-elektro-offensive-30-stromer-bis-2025/

https://www.electrive.net/2017/08/16/post-und-ford-stellen-e-transporter-streetscooter-work-xl-vor/

https://www.electrive.net/2017/09/04/30-e-busse-in-hamburg-bis-spaetestens-2019/

https://www.vda.de/dam/vda/Medien/DE/Service/Nachwuchsfoerderung/Unterricht/Vernetzung_VDA_Magazin.pdf

http://www.electrive.net/

http://www.intellimec.com/

http://www.charinev.org/news-detail/news/isoiec-15118-testing-symposium-took-place-on-nov-7th-9th-in-korea/

http://www.charinev.org/news-detail/news/communication-networks-institute-veranstaltet-5-internationales-testing-symposium-zur-ccs-ladeschnittstelle-in-sued-korea/

http://www.charinev.org/news-detail/news/great-interest-from-the-ev-community-in-ccs-at-the-isoiec-15118-testing-symposium-in-versailles/

Documents

CONFORMANCE TESTING OF ELECTRIC VEHICLE CHARGING COMMUNICATION BASED ON TTCN-3 · PDF file · 2017-10-16ISO 15118 Road vehicles —Vehicle to grid communication interface —Part