Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report

V0.1 | 2019-02-11

Software Analytics Automation for Quality Measurement and Customer/Supplier Reporting

Squore KPI Platform

5

During the project development process, customer and supplier both have expectations and commitments related to all objects of the development cycle.

The Customer expects a product compliant to his requirements and standards

The Supplier is committed to deliver a product respecting quality and time constraints

To achieve these goals, Continuous quality monitoring has to be applied during development.

On the supplier side, it ensures that the delivery meets expected quality levels as the project evolves, thus increasing confidence on the final delivery.

On the customer side, it provides visibility on quality objectives trends, thus providing confidence on the acceptance process.

Introduction

6

Handling heterogeneous objects from the project lifecycle

Ensuring industrial standards compliance

Simplifying customer/supplier collaboration

Automating proven KPI generation

Summary

Agenda

7





Summary

Agenda

8

Heterogeneity can be found in a project:

In the project structure

Several object types have to be managed: Requirements, Tests, Issues, Source Code …

Across objects

A Test can have different IDs depending on where it is referenced

From the diversity of tools

Requirements can originate from different tools across the organization

Through time

The data model for Tests results can change because of a tool upgrade

Handling heterogeneous objects from the project lifecycle (1)

9

An industrial project monitoring solution should be able to:

Manage objects types from all tool origins

Propose a reconciled view of all objects, and their links

Assess quality on the project and its components

Assist decision maker by relevant indicators and time-based analysis

Be automated, to ensure Continuous Quality

Such a solution should be implemented:

By the supplier, to check project progress during development

By the customer, to monitor project health and completion

Handling heterogeneous objects from the project lifecycle (2)

10

Squore Solution overview

SQUORE

KPI PLATFORM

SUPPLIER CUSTOMER

Automate conversion of complex engineering data into high level KPIs

Provide a Continuous Quality vision

Assess continuous quality/progress

Comment/collaborate with supplier

11

Handling heterogeneous objects from the project lifecycle with Squore

Co

llect

and

O

rgan

ise

Ass

ess

and

A

nal

yse

Mo

nit

or

and

Sh

are

Project monitoringDecision making

CloningISO25010

ISO26262

HIS MISRA

Standard Compliance

Source Tests Tickets Design

DO178

Complexity

Automated Reports

Role-Based

Action Plan

Milestones/Goals

Simulink

Scade

Jira

Mantis

JUnit

CAST/Cover

. . .

CAST/C++

Self descriptiveness

Test Effectiveness

Aggregated Indicators Standards

Monitoring Features

Trend Analysis

. . .. . .

Others

Excel

SAP

. . .

SQUAN

Data

Business

BI

GitLabJenkins

Cont. Integration

Traceability

Reqs.

REQIf

Excel

. . .

Real-time

CorporateKPI

Automate

CorporateStandards

. . .

Rated, Trended

Structured

Raw

Actionable

12

Squore flexibility: Acquiring Data

External data are gathered by Squoreusing the Data Provider technology

An open API makes writing new Data Providers easy

Squore comes out of the box with tens of Data Providers for several tools

13





Summary

Agenda

14

Ensuring industrial standard compliance (1)

Squore Quality Model turns rawdata into KPI

Example: Squore computes industry proven indicators (MISRA compliance, HIS, Requirement Coverage, Structural Code Coverage…)

15

Ensuring industrial standard compliance (2)

Squore combines data from multiple sourcesIt allows Standard activities assessment

Example: Requirements Completion + ASIL Analysis + Test results ➔Squore detects the list of Compliant components according ASIL

16

Squore flexibility: Tuning the compliance parameters

Squore is aware of multiple standards used in the industry

It is possible to fine-tune the compliance expectations for each standard

Rules from a standard can be excluded, or modified for a specific project, or for all projects from the organization

17





Summary

Agenda

18

Simplifying Customer/Supplier relationship

SQUORE

KPI PLATFORM

SUPPLIER CUSTOMER

Shared vision of quality

"1 click" Report generation

Collaboration/Comment features

19

Squore flexibility: Adapted rating

Squore comes with a full rating model, taking into account objects from the project lifecycle

A powerful rating descriptive method allows Squore power users to define their own metrics, indicators, alerts, and more

20

Squore flexibility: Relevant dashboards

Squore comes with predefined dashboards, for each kind of user role and object to monitor

A fully graphical editor also allows users to create their own dashboards, depending on their needs

21





Summary

Agenda

22

Automating proven KPI generation (1)

Time spent on data

Consolidating Analizing

Time spent on data

Process Improvment

Analizing

Consolidating

How do you go from here … … to here?

Focus on data mining

Have multiple visuals, but no goal

Not relying on a proven method

Focus on data meaning

Manipulate relevant indicators

Be confident in your decision-making

23

Automating proven KPI generation (2)

Source

Tests

Tickets

Reqs.

Squore

Platform

Real-time Dashboards

Reliable Industrial KPIs

Efficient Project monitoring

Synchronize

with project data

Automation

24





Summary

Agenda

26

Squore deployment use case (1)

SUPPLIER: > Product 1 for customer A

> Product 2 for customer B

CUSTOMER B: > Requirement Coverage

SQUORE

KPI PLATFORM

CUSTOMER A: > Code Quality

27

Squore deployment: Cutomer or OEM use case (2)

SQUORE

KPI PLATFORMSUPPLIERS CUSTOMER

28

Automated Static Analysis

Automated Unit Testing

Independent System Testing

Software Stress Testing

Software Failure Mode and Effects Analysis

ECU Software Performance Analysis

Requirements Traceability Matrix

Squore: Overview

29

Squore Analyzer provides quality/complexity metrics

Squore can import SCA results from various tools

Squore can track findings/justifications among software version

Squore can generate a deviation report

Squore: Automated Static Analysis

30

Squore can import Test results from various tools

Squore provides Code Coverage KPI

Squore provides a Test Stability listing (eg, maintained tests)

Squore provides test coverage report

Squore applies a Test Strategy (eg, function to test Vs ASIL)

Squore: Automated Unit Testing

31

Squore can import CANoe and vTestStudio data

Squore provide a Test Effectiveness KPI

KPI are based on any Test types (Functional, Unit Test…)

Possibility to link Requirement and Test outcomes

Squore: Independent Systems Testing

32

Squore provides KPI based on software resources

Possibility to track RAM/ROM, CPU and Stacks

Expected « performance » thresholds can be tuned per project

Squore: ECU Software Performance Analysis

33

Squore can import Requirement from various tools (Doors, Reqtify, Excel…)

Squore tracks requirement’s status and integrity

Squore reconciles links between requirements, tests and tickets

Squore: Requirement Traceability Matrix

35

Recorded Squore Demo Online

36 © 2018. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V0.1 | 2019-02-11

Author:Cyril BenkimounVector Germany

For more information about Vectorand our products please visit

www.vector.com

http://www.vector.com/

Documents

Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report