Embed Size (px)
Citation preview
MOdel-based GENeration of Tests for Embedded Systems
#216679 FP7-ICT-2007-1-3.3 Embedded Systems Design
��
Workshop SPIN, 04/06/2009
Model-based generation of tests for
embedded systems: the MOGENTES EU
project
Stefano Marzani, Lorenzo Fantesini
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Background: RE:Lab MBD approach (1)M
Od
el-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 2ME2008, 16/10/2008Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Background: RE:Lab MBD approach (2)M
Od
el-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 3ME2008, 16/10/2008Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� MOGENTES overview
� Model-Based GEneration of TEst-
Cases for dependable Embedded
Systems
� Objective:
♦ automatic generation of test cases to
enhance testing and verification of
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 4ME2008, 16/10/2008
enhance testing and verification of
dependable embedded systems
♦ target applications: trains, agricultural
machines, cars
♦ a common model-based approach
(framework) for test and validation
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
��Budget: 4.436.511 €
Partners:
� Austrian Research Centers Gmbh - ARC
� Swiss Federal Institute of Technology Zurich /
University of Oxford
� Ford GmbH
� Budapest University of Technology and Economics
� Graz University of Technology
MOGENTES ConsortiumM
Od
el-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 5ME2008, 16/10/2008
� Graz University of Technology
� PROLAN
� Prover Technology AB
� SP Technical Research Institute of Sweden
� Thales Rail Signalling Solutions
� RE:Lab
� 05/06/2009
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� MOGENTES overall framework
� Automatic generation of efficient test cases to
verify system safety correctness using formal
methods and fault injection
Constructoir
Destructi
f1(xd, fs nnm)
isOpen()
MOGENTES
– demonstrators
Automotive
on/offroad
Railway
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 6ME2008, 16/10/2008
User Requirements
Safety Requirements
(Standards: 26262, 25199 etc)
Specification
Model
Result
Data
Scenario
Test CasesGeneration
Constructoir
Destructi
isOpen()
Constructoir
Destructi
f1(xd, fs nnm)
isOpen()
Software / System
Test Case Application(unit, system,
SIL, HIL, FI)
MOGENTES – research core
Railway
signalling
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Framework application
� Bucket: off-highway machine
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 7ME2008, 16/10/2008Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Phase 1: user requirements and specs
� Highlight, analyze and validate
system requirements
♦ Classification: requirements are
grouped according to their
characteristics
Management: system
Requirements classification
FunctionalNot
FunctionalDomain
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 8ME2008, 16/10/2008
♦ Management: system
specifications are generated and
translated into product design
guidelines
Requirements management
Definition SpecificationProduct
design
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Phase 1: user requirements and specs
� Functional
♦ System Behaviour
• The system must read the incoming CAN messages
input signals of the control joystick each time a
message is received.
• The ISOBUS joystick must sent a status message at
least every 100 milliseconds
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 9ME2008, 16/10/2008
� Non functional (e.g. ISOBUS requirements)
♦ ECU initialization
• Initialization of an ECU with address claim and no
contention
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Phase 2: model development
� Basing on system specifications, the model (prototype) of the final
system is developed.
♦ Behavioural specifications modelling (Matlab simulink/Stateflow, Visual Studio)
♦ Isobus specifications implementation
♦ User Interface graphics implementation (Altia, PConvert)
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 10ME2008, 16/10/2008
Product design
requirement
Model
(virtual prototype)
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Phase 2: model development (examples)
� System behaviour
modelling (State Flow)
� ISOBUS implementation
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 11ME2008, 16/10/2008Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Phase 2: model development – OverallM
Od
el-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 12ME2008, 16/10/2008
- Control Logic and Algorithms-ISOBUS Protocol and Graphic
Stateflow
Proprietary GraphicDevelopment:Altia Design
Custom Code integration:Simulink S-Functions
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Phase 2: model development – CAN bus
RE:Lab CAN Blocks
RE:Lab CAN
Blocks
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 13ME2008, 16/10/2008
CA
N N
etw
ork
Blocks
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Phase 2: model development
� User Interface graphics implementation
Proprietary
graphics
• Not strictly related to
CAN messages
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 14ME2008, 16/10/2008
ISOBUS
graphics
• Each object pool related
to a CAN message
System behaviour
model and ISOBUS
network
VIRTUAL TERMINAL
TFT
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Phase 2.1: model validation
� At the end of the process, the model becomes the
reference for the validation of the final system
� Before, the model should be validated
Model Checking Technique - Validation of the system logic
Signals from CAN
andModel logic
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 15ME2008, 16/10/2008
System behaviour model and
ISOBUS network
and
Signal Machine
Model logic
output
System specifications
(expected output)
Check
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Phase 2.1: model validation
Validation of the graphics
Signals from CAN
and
Signal Machine
System behaviour model and
Graphic outputs
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 16ME2008, 16/10/2008
System behaviour model and
ISOBUS network
System
specifications
(expected output)
Check
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Phase 3: code generation
� Code generation: from the
validated model to the target
final system
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 17ME2008, 16/10/2008
VT TFT
ECUJoystick
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
��• From CAN blocks, Matlab/Simulink/StateFlow and Altia it is
possible to generate code for specific embedded targets.
Phase 3: code generationM
Od
el-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 18ME2008, 16/10/2008
• Using this target it is possible to generate the C code firmware
for a specific microcontroller and to create directly a project file
ready for compilation with the proprietary toolchain.
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Phase 4: final system validation
Requirements
and specifications
Model
(virtual prototype)
Validation
Test case model (UML): signal
selected for the test case
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 19ME2008, 16/10/2008
Code generation
for the final
system
Final system
(sw and hw)
Validation
comparing
Test Cases results
Signals from CAN
and signal machine
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Phase 4: final system validation
� Inputs to the model and the final system are:
♦ CAN messages, sent using the Vector CANoe tools together with the
generable CAN Blocks inside the Matlab/Simulink model
environment.
♦ Voltage and Current signals, generated by a Signal Machine.
� Outputs
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 20ME2008, 16/10/2008
VS
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Phase 4: final system validation
� Proprietary graphics validation
Model outputs Final system outputs
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 21ME2008, 16/10/2008Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Phase 4: final system validation
� ISOBUS graphics validation
♦ Object Pools test is performed by testing the CAN
frames through the network bus and verifying if the
displayed Object Pool is the correct one with respect to
the Standard ISOBUS (ISO 11783).
Object pool (highlighted graphic element)
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 22ME2008, 16/10/2008
CAN frames
Object pool (highlighted graphic element)
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Final validated systemM
Od
el-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 23ME2008, 16/10/2008Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Conclusions
� MOGENTES: automatic generation of test cases to enhance testing and
verification of dependable embedded systems
� Target RE:Lab application: agricultural machine bucket
� Framework for test and validation
Requirements
and specifications
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 24ME2008, 16/10/2008
Model
(virtual prototype)
Code generation
for the final
system
Final system
(sw and hw)
Test case
validation
Signals from CAN
and
Signal Machine
Workshop SPIN, 04/06/2009
ba
se
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
3.3
Em
be
dd
ed
Syste
ms D
esig
n
�� Contacts
MO
de
l-b
ase
d G
EN
era
tio
n o
f Te
sts
fo
r E
mb
ed
ded
Syste
ms
#2
16
67
9 F
P7
-IC
T-2
00
7-1
-3.3
Em
be
dd
ed
Syste
ms D
esig
n
Slide 25ME2008, 16/10/2008
www.mogentes.eu��Workshop SPIN, 04/06/2009
![Embedded Linux for Thin Clients Next Generation (eLux …support.ts.fujitsu.com/Dokumente/FAQ/124136098-eluxng_en_023[1].pdf · Embedded Linux for Thin Clients Next Generation](https://img.pdfslide.us/doc/110x75/5a6ffb027f8b9abb538b8793/embedded-linux-for-thin-clients-next-generation-elux-supporttsfujitsucomdokumentefaq124136098-eluxngen0231pdfpdf.jpg)
