14
10/14/2014 1 Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries Feasibility Study for Building a Testing Laboratory Organization and activity of a Test Center Environments, procedures and methodologies, management and maintenance of a testing center covering different kind of C&I testing areas Carlo Mogavero (Testing Labs - Tilab – Italy) Summary Scope of the presentation Testing lab presentation Organization of a test center Conclusion

Feasibility Study for Building a Testing Laboratory · PDF fileFeasibility Study for Building a Testing Laboratory ... IP and ATM DSLAM ... Manual and the requirements of national/international

Embed Size (px)

Citation preview

Page 1: Feasibility Study for Building a Testing Laboratory · PDF fileFeasibility Study for Building a Testing Laboratory ... IP and ATM DSLAM ... Manual and the requirements of national/international

10/14/2014

1

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries

Feasibility Study for Building a Testing Laboratory

Organization and activity of a Test Center

Environments, procedures and methodologies, management and

maintenance of a testing center covering different kind of C&I

testing areas

Carlo Mogavero (Testing Labs - Tilab – Italy)

Summary

• Scope of the presentation

• Testing lab presentation

• Organization of a test center

• Conclusion

Page 2: Feasibility Study for Building a Testing Laboratory · PDF fileFeasibility Study for Building a Testing Laboratory ... IP and ATM DSLAM ... Manual and the requirements of national/international

10/14/2014

2

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries

Scope of the presentation

To describe environments, procedures and methodologies to be adopted

to establish, manage and maintain a testing center covering different

kind of conformance and interoperability testing areas.

Best practices are reported in this document covering all relevant

aspects not only related to test campaign activity, but also to all

activities necessary to manage and maintain a large test center

part 1: Organization of a test center as described in the feasibity study -

(Carlo Mogavero)

part 2: Quality aspects and description of the labs and test plant of a test

center – (Robert Farotto)

Testing Labs – TIlab - Telecom Italia

Page 3: Feasibility Study for Building a Testing Laboratory · PDF fileFeasibility Study for Building a Testing Laboratory ... IP and ATM DSLAM ... Manual and the requirements of national/international

10/14/2014

3

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries

Design and Planning of a new service

Go / No Go Go / No Go

New service concept Deployment planStand

aloneTrial

Commercial

launch O&MService

development End to end

Testing Labs & TIlab

Testing Labs

Labs

Napoli

Torino

Location and resources

1067

1071

1077

1083

1087

1090110111031105110911161115

1411

1412

1413

1414

1415

1416

1417

1418

14191420

1421

1422

1427

1428

1429

1430

1431

1432

1433

1434

1435

1436

1438 1439

1440

1441

1442 1443

1444 1445

1446

1448 1447

1449

1450

1444

1437

SALASALASALASALA

APPARATIAPPARATIAPPARATIAPPARATI

VDSL2VDSL2VDSL2VDSL2

M obi le M obi le M obi le M obi le

Access (RNC) Access (RNC) Access (RNC) Access (RNC)

OPBOPBOPBOPB

IM SIM SIM SIM S

OPMOPMOPMOPM

ServiceServiceServiceService ce nter

ce nterce nterce nter

ElementElementElementElement

managermanagermanagermanager

Mobile access (Mobile access (Mobile access (Mobile access ( nodenodenodenode b) b) b) b)

Co re ne two rkCo re ne two rkCo re ne two rkCo re ne two rk

mobilemobilemobilemobile

1067

1071

1077

1083

1087

1090110111031105110911161115

1411

1412

1413

1414

1415

1416

1417

1418

14191420

1421

1422

1427

1428

1429

1430

1431

1432

1433

1434

1435

1436

1438 1439

1440

1441

1442 1443

1444 1445

1446

1448 1447

1449

1450

1444

1437

SALASALASALASALA

APPARATIAPPARATIAPPARATIAPPARATI

VDSL2VDSL2VDSL2VDSL2

M obi le M obi le M obi le M obi le

Access (RNC) Access (RNC) Access (RNC) Access (RNC)

OPBOPBOPBOPB

IM SIM SIM SIM S

OPMOPMOPMOPM

ServiceServiceServiceService ce nter

ce nterce nterce nter

ElementElementElementElement

managermanagermanagermanager

Mobile access (Mobile access (Mobile access (Mobile access ( nodenodenodenode b) b) b) b)

Co re ne two rkCo re ne two rkCo re ne two rkCo re ne two rk

mobilemobilemobilemobile

0457a

C ENTR ALE

TEL EFO NICA

LOCA

LETEC

NICO

12 0

R EI

U S

0472

3

REI

1 20

SALA4

SALA

S

1 20

REI

120

RE I

U

04690469/A

F ILO E STE RNO DIAFR AMMA

0444b 0444c

046

8

RE I

120

0471a

RE I

120

0470

RE GIST RAZIO NI

0464S ALA

0469

REI

1 20

TECN ICO

045812 0

R EI

LOC ALE

0444

0466

REI

120RE I

120

0465

12 0

R EI

0457/0443

0480

LOC

ALE T

ECNICO

120

REI

1 20

REI

120

REI

0481

REI

120

REI1

20

- 5. 50

U REIS 120 0451 04470453

0463b

REI120

0473

REI120

TEST-PLANTCENTRALE

0476REI120 0463c 0463 REI

120

REI

120

120

120SU REI

- 5.60

120REI

SU

REI

U S

REI120 0455

120REIREI

120

0446

043

8

120REI

120REI

0445

REI

120

120

REI

U S

120SREIU REI

120US 120

REI

- 5.60 LOCAL

ET

ECNIC

O

REI 60

REI 60

REI120

REI120

0436

120REI

120REI

0471

FTT B, FTT CFTT B, FTT CFTT B, FTT CFTT B, FTT C

IPTV IPTV IPTV IPTV pl atformpl atformpl atformpl atform

OPBOPBOPBOPB

O PMO PMO PMO PM

ServiceServiceServiceService

nodenodenodenode

T ransportT ransportT ransportT ransport

netw orknetw orknetw orknetw ork

ElementElementElementElement

managermanagermanagermanager

O LO/MVNO O LO/MVNO O LO/MVNO O LO/MVNO

Interconnec tionInterconnec tionInterconnec tionInterconnec tion

0457a

CENTRALETELEFONICA

LOCA

LETEC

NICO

120REI

U S

0472

3

REI120

SALA4

SALA

S

120REI

120REI

U

04690469/A

FILO ESTERNO DIAFRAMMA

0444b 0444c

046

8

REI120

0471a

REI120

0470

REGISTRAZIONI

0464SALA

0469

REI120

TECNICO

0458120REI

LOCALE

0444

0466

REI

120REI120

0465

120REI

0457/0443

0480

LOC

ALE T

ECNICO

120

REI

120REI

120

REI

0481

REI

120

REI1

20

- 5. 50

U REIS 120 0451 04470453

0463b

REI120

0473

REI120

TEST-PLANTCENTRALE

0476REI120 0463c 0463 REI

120

REI

120

120

120SU REI

- 5.60

120REI

SU

REI

U S

REI120 0455

120REIREI

120

0446

043

8

120REI

120REI

0445

REI

120

120

REI

U S

120SREIU REI

120US 120

REI

- 5.60 LOCAL

ET

ECNIC

O

REI 60

REI 60

REI120

REI120

0436

120REI

120REI

0471

FTT B, FTT CFTT B, FTT CFTT B, FTT CFTT B, FTT C

IPTV IPTV IPTV IPTV pl atformpl atformpl atformpl atform

OPBOPBOPBOPB

O PMO PMO PMO PM

ServiceServiceServiceService

nodenodenodenode

T ransportT ransportT ransportT ransport

netw orknetw orknetw orknetw ork

ElementElementElementElement

managermanagermanagermanager

O LO/MVNO O LO/MVNO O LO/MVNO O LO/MVNO

Interconnec tionInterconnec tionInterconnec tionInterconnec tion

Test Plant

Fixed and mobile Test plant

Roma

Mobile and fixed accessTesting AutomationFixed CPE and IPTVCore NetworkEnergy WIFIUser experienceService StabilityMobile and fixed accessTesting AutomationVertical IT solution testing

Mobile VASEMCPANPoweringSafety & protectionElettroacusticSAR

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries

Housing Assets

Test Plant “Via Reiss Romoli”~1000 m²

~100 rack

~200 equipment

Main installed equipment:

BB Access

NGN2 – GPON and VDSL2

IP and ATM DSLAM

Business and residential CPE

SDH and xWDM transport

GbE and IP/MPLS Metro Networks

Layer 2 aggregation

ATM

Edge IP (PE/Access Routers, BRAS)

IP Backbone (Terabit Routers and Gigabit Routers)

TDM/IP Gateways and NGN (CL4 and CL5 nodes)

IPTV Platform

Data Center Networking

Test Plant “Via Borgaro”~2000 m²

~200 rack

~400 equipment

Main installed equipment:LTE, UMTS and GSM Network

Circuit and Packet Mobile Core Network

VAS Platforms (IN, SMSC, MMSC, WAP GW, CMX, …)

IMS Platforms

CL5 node

1067

1071

1077

1083

1087

1090110111031105110911161115

1414

1415

1416

1417

1418

14191420

1421

1422

1427 1429

1431

1432

1433

1435

1436

1438 1439

1440

1441

1442 1443

1444 1445

1446

1448 1447

1449

1450

1444

1437

SALASALASALASALA

APPARATIAPPARATIAPPARATIAPPARATI

VDSL2VDSL2VDSL2VDSL2

Accesso Accesso Accesso Accesso

Mobile (RNC) Mobile (RNC) Mobile (RNC) Mobile (RNC)

OPBOPBOPBOPB

IMSIMSIMSIMS

OPMOPMOPMOPM

Centro serviziCentro serviziCentro serviziCentro servizi ElementElementElementElement

managermanagermanagermanager

Accesso Accesso Accesso Accesso

Mobile (Mobile (Mobile (Mobile (nodenodenodenode b) b) b) b)

Core networkCore networkCore networkCore network

mobilemobilemobilemobile

1067

1071

1077

1083

1087

1090110111031105110911161115

1414

1415

1416

1417

1418

14191420

1421

1422

1427 1429

1431

1432

1433

1435

1436

1438 1439

1440

1441

1442 1443

1444 1445

1446

1448 1447

1449

1450

1444

1437

SALASALASALASALA

APPARATIAPPARATIAPPARATIAPPARATI

VDSL2VDSL2VDSL2VDSL2

Accesso Accesso Accesso Accesso

Mobile (RNC) Mobile (RNC) Mobile (RNC) Mobile (RNC)

OPBOPBOPBOPB

IMSIMSIMSIMS

OPMOPMOPMOPM

Centro serviziCentro serviziCentro serviziCentro servizi ElementElementElementElement

managermanagermanagermanager

Accesso Accesso Accesso Accesso

Mobile (Mobile (Mobile (Mobile (nodenodenodenode b) b) b) b)

Core networkCore networkCore networkCore network

mobilemobilemobilemobile

Mobile Access (Node B)

Mobile Access (RNC)

0457a

CENTRALETELEFONICA

LOCA

LETE

CNIC

O

120

REI

U S

0472

3

REI

120

SALA4

SALA

S

120

REI

120

REI

U

04690469/ A 0444b 0444c

0468

REI

120

0471a

REI

120

0470

REGISTRAZIONI

0464SALA

0469

REI

120

TECNICO

0458120

REI

LOCALE

0444

0466

REI

120

REI

120

0465

120

REI

0457/ 0443

LOCA

LE T

ECNIC

O

120REI

120

REI

60

REI

U S

60

60

REI

REI

120REI

REI

120 RE

I

120 12

0

0463b

REI

120

0473

REI

120

TEST-PLANTCENTRALE

REI

120

120

120S

U REI

- 5.60

120

REI

S

U

REI

U S

REI

120

0455

0446

0438

120

REI

120

REI

0445

REI

120

120

REI

U S

120S

REIU REI

120

U

S120

REI

- 5.60 LOCA

LETE

CNICO

REI

60 REI

60

REI

120

REI

120

0436

0471

FTTB, FTTCFTTB, FTTCFTTB, FTTCFTTB, FTTC

Piattaforma IPTV)Piattaforma IPTV)Piattaforma IPTV)Piattaforma IPTV)

OPMOPMOPMOPM

e service e service e service e service nodenodenodenode

OPBOPBOPBOPB

BackhaulingBackhaulingBackhaulingBackhauling

(GBE,PON)(GBE,PON)(GBE,PON)(GBE,PON)

ServiceServiceServiceService

nodenodenodenode

TrasportoTrasportoTrasportoTrasporto

ElementElementElementElement

managermanagermanagermanager

0457a

CENTRALETELEFONICA

LOCA

LETE

CNIC

O

120

REI

U S

0472

3

REI

120

SALA4

SALA

S

120

REI

120

REI

U

04690469/ A 0444b 0444c

0468

REI

120

0471a

REI

120

0470

REGISTRAZIONI

0464SALA

0469

REI

120

TECNICO

0458120

REI

LOCALE

0444

0466

REI

120

REI

120

0465

120

REI

0457/ 0443

LOCA

LE T

ECNIC

O

120REI

120

REI

60

REI

U S

60

60

REI

REI

120REI

REI

120 RE

I

120 12

0

0463b

REI

120

0473

REI

120

TEST-PLANTCENTRALE

REI

120

120

120S

U REI

- 5.60

120

REI

S

U

REI

U S

REI

120

0455

0446

0438

120

REI

120

REI

0445

REI

120

120

REI

U S

120S

REIU REI

120

U

S120

REI

- 5.60 LOCA

LETE

CNICO

REI

60 REI

60

REI

120

REI

120

0436

0471

FTTB, FTTCFTTB, FTTCFTTB, FTTCFTTB, FTTC

Piattaforma IPTV)Piattaforma IPTV)Piattaforma IPTV)Piattaforma IPTV)

OPMOPMOPMOPM

e service e service e service e service nodenodenodenode

OPBOPBOPBOPB

BackhaulingBackhaulingBackhaulingBackhauling

(GBE,PON)(GBE,PON)(GBE,PON)(GBE,PON)

ServiceServiceServiceService

nodenodenodenode

TrasportoTrasportoTrasportoTrasporto

ElementElementElementElement

managermanagermanagermanager

Multimedia platform &

Page 4: Feasibility Study for Building a Testing Laboratory · PDF fileFeasibility Study for Building a Testing Laboratory ... IP and ATM DSLAM ... Manual and the requirements of national/international

10/14/2014

4

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries

Main Technologies and Measurement EquipmentSome of the technologies installed in our Test Plants:

GPON: Huawei, ZTE, NSN

NGN: Italtel CL4-CL5 Nodes

DSLAM IP and ATM: ALU, NSN, Ericsson, Huawei, ECI

CPE: Pirelli, Telsey, Cisco, and many others

Edge IP: Cisco, Juniper, Nortel, ALU, Huawei, Tellabs

Transport Network (SDH, xWDM): Ericsson, ALU, Huawei,

NSN, Pirelli

Backbone OPB (Terabit Router and Gigabit Router):

Cisco, Juniper

GbE and IP/MPLS Metro: Cisco, Juniper, ALU, ZTE

ATM: Cisco

Gateway: Tellabs, T-VIPS

Mobile Access Network: Ericsson, NSN, Huawei

ENAV: Marconi, Elsag, Juniper, Selex

Mobile Core Network: Ericsson, Huawei

Mobile VAS Platform: Ericsson, HP, Acision, Openwave,

Novarra, Mobixel

IMS Platform: Ericsson, Huawei, NSN

CL5 Node: Italtel

Main measurement equipment

available at our Test Plants:

xDSL line simulators

Spectrum Analyzers

Noise Generators

Arbitrary Wavelength Generators

Traffic and Signaling Generators (Spirent, IXIA,

Agilent, Tektronix, Catapult, Radcom)

Network Generators (i.e. SDH, …)

Protocol Analyzers

Diagnostic Software (e.g. ASCOM Monitor Master)

Application Loading Software (e.g. HP LoadRunner)

Monitoring Software

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries 8

LAP – Laboratorio Accreditato Prove(Accredited Testing Lab)

• LAP is Telecom Italia/Tilab entry point authorized to offer testing services and facilities

on TLC systems to external customers

• has a multi-lab structure, organized in accredited and not accredited labs offering testing

services in different fields of application

• has a management structure coordinating:

• Accreditation processes

• Economical aspects (commercial offers and orders)

• Economical evaluations

• Quality monitoring and customer satisfaction

• Testing work flow

• Design of new accredited test environment

LAP Mission

► to manage labs accordingto standard EN17025

► to design new testingservices/labs to increaseoffer portfolio and quality

► to manage existing labsimproving quality and KH

► to make revenues

Page 5: Feasibility Study for Building a Testing Laboratory · PDF fileFeasibility Study for Building a Testing Laboratory ... IP and ATM DSLAM ... Manual and the requirements of national/international

10/14/2014

5

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries

LAP Current Accreditations (UNI CEI EN ISO/IEC 17025)

Lab Service Accreditation

body

ElectroacusticISDN basic access CPE, PSTN CPE, Access requirements for

PSTN CPE.

Electromagnetic

Compatibility

System and Equipment for Radiocommunication

Terminal for TLC

System and Equipment for TLC public network

Safety Protection &

Mechanical (PSM)

TLC terminal protection

TLC terminal electrical safety

Radiocommunication equipment Electrical Safety

Metrology

Intrumentation calibration for the following standards:

current, voltage, resistance in c.c. in a.c., frequency, optical

power, fiber attenuation, wavelengh

Powering (PSM)Powering testing of TLC equipment in off mode and stand

by conditions (IEC standard)

Value Added ServicesTesting Value Added Services (VAS) for mobile terminals

(standard CASP)

SAR dosimetry Specific Absorption Rate (SAR) d

Personal Area

NetworkFunctional testing of Zig Bee protocol

9

• Organization of a test center

The value of testing

Service portfolio

The testing phases

Resource management and organization

Periodical reporting

Investment & cost estimation

Support systems

Bugs tracking

Investment priorities

Test campaign management

Testing process

Intrumentation maintenance & management

Market surveillance and incoming quality

Cost evaluation

Key best practises

Conclusion

Page 6: Feasibility Study for Building a Testing Laboratory · PDF fileFeasibility Study for Building a Testing Laboratory ... IP and ATM DSLAM ... Manual and the requirements of national/international

10/14/2014

6

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries

The value of testing

The most straightforward way to estimate the value of testing is represented by the calculation of losses avoided (in terms of money, time and human life) thanks to the preventive performance of testing activities.

Advantages:

• Acquire knowledge (configuration, system, processes)

• Integrated vision (complete chain)• Risk analysis• Availability of test environment• Organized documentation description

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries

Service portfolio of a test centerConformance testing

to a standard (international, national or provided by the customer) –

accredited or not

Credibility test for quality evaluation of a product – pre-assessment

Procurement for the Operator

to support the internal procurement process

Testing park

locations and test plant usage to perform test event with or without TI

internal resources support

Co-making and consultancy

Cooperation in developing new products

Joint Testing (outsourcing - insourcing)

Sharing with vendor test activity

Calibration and instrumentation management

Instrumentation calibration of electrical and optical quantities.

Page 7: Feasibility Study for Building a Testing Laboratory · PDF fileFeasibility Study for Building a Testing Laboratory ... IP and ATM DSLAM ... Manual and the requirements of national/international

10/14/2014

7

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries

A Testing phase for each Service Development step

The service development steps are paired with corresponding testing phases, in order to ensure a

smooth development process and to prevent malfunctions on the launched services

Service Usability

Verification

Service Requirements

Definition

CredibilityTests

RFI andRFQ process

Lab Tests in stand-alone

configuration

Network Solution

Development

E2E Lab Tests

Network Integration

Friendly Users Trial

Solution Tuning

Tests in field

Pre-Deployment

Tests by Trouble-shooting

ServiceLaunch

Service DevelopmentService DevelopmentService DevelopmentService Development

TestingTestingTestingTesting

Go / No Go Go / No Go Go / No Go

13

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries

Resource management and organization

14

A conformance testing center should be independent of anycompanies, so it guarantees its impartiality as a third-partyprovider of conformance testing services.

Page 8: Feasibility Study for Building a Testing Laboratory · PDF fileFeasibility Study for Building a Testing Laboratory ... IP and ATM DSLAM ... Manual and the requirements of national/international

10/14/2014

8

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries

The most significant management & technical

roles

15

General Manager (GM)The General Manager has the overall responsibility test center’s development. Technical Manager (TM)The Technical Manager is responsible to General Manager for the overall technical activities of the laboratory in accordance with the standards and procedures indicated in this Quality Manual and the requirements of national/international accreditation bodies. Testing Area Responsible (TAR)Testing Area Responsible is responsible to the Technical Manager for coordinating and supervising the testing activities performed by the personnel in his or her area in compliance with the requirements indicated in this Quality Manual.Testing Specialist (TS) – test campaign responsibleTesting Specialist is responsible to the Testing Area Responsible for the implementation of related conformance assessment in compliance with the requirements indicated in the Quality Manual.Test campaign operator (TCO)The test campaign operator is responsible of executing the test campaignLaboratory Technical Experts (LTE)This expert can be external to the laboratory and, in complex organization is not usually involved in the testing activity but can be part of the innovation or engineering departmentQuality Manager (QM)The Quality Manager is responsible for establishing and verifying the adequacy of the Quality System described in the Quality Manual, ensuring that the requirements of the ISO/IEC 17025 are met on a day-to-day basis, and advising the Technical Manager and General Manager accordingly.

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries

Periodical reporting

16

A good procedure to be adopted in order to manage in an efficient way the testing center is to held a periodical reporting session between the TM and the TAR to verify the status of the different activities. The QM can summarize the result of the weekly reporting session in a status report document. The status report document must be organized in order to keep track of:

• Status of each test campaign• Salary policy • Main fault identified during the test with gravity status• Top issue of the week to be shared with other engineering department• Critical point to be solved concerning the test center management• Liaison with other bodies or company entities and departments

Page 9: Feasibility Study for Building a Testing Laboratory · PDF fileFeasibility Study for Building a Testing Laboratory ... IP and ATM DSLAM ... Manual and the requirements of national/international

10/14/2014

9

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries 17

The availability of proper assets is a topic of paramount importance for a test center. In particular, the areas of competence and the technological evolution determine the need of acquiring and maintaining the proper test equipment, required for the setup of the desired test benches.

Investment & cost estimation

Key aspects

The most important key aspects to be taken into account are:

• Technological gaps• Evolutionary maintenance• Instrumentation duplication (efficiency

improvement)• Instrumentation management and support

systems (simplification and automation)

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries 18

Investment priorities in relation to investment areasInvestment priorities in relation to investment areasInvestment priorities in relation to investment areasInvestment priorities in relation to investment areas

When a test center consider to acquire new instruments, it should keep into account not only the initial cost, but the Total Cost of Ownership (TCO).

CAPEX: investments related new asset

OPEX: Instrumentation maintenance

Page 10: Feasibility Study for Building a Testing Laboratory · PDF fileFeasibility Study for Building a Testing Laboratory ... IP and ATM DSLAM ... Manual and the requirements of national/international

10/14/2014

10

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries

Support systems for testing

• COMMON REPOSITORY for all the information related to the project (Test List, Bugtracking, Release management)

• Accessible to ALL the people involved in the project (operator and vendors)

• Information updated in REAL TIME (test execution, anomalies management)

• Creates AUTOMATICALLY test execution reports (status of the tests…), bug reports and bug notification e-mails

• Archives information so it can be accessible also in the future.

19

TEST PLAN

•Definition of Test Campaigns

•Definition of HW/SW Versions

•Assignment to Test Groups

•Assigmment to Labs

•Selection of Test Lists

•Monitoring of Execution and Bug Solving

TEST TRACK

• Creation and Management of

•Test Areas

•Test Lists

•Test Cases

REPORTING

•Anomalies Detailed Reports and Summarisation

•Final Test Report

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries

Hierarchical Organisation of Test Tracks

20

Product Service

Test Area Test Area Test Area Test Area

Test List Test List Test List

Test Area

Test Case

Test Case

Test Case

Test Case

Test Case

Test Case

Test Case

Test Case

Test Case

Test Case

Page 11: Feasibility Study for Building a Testing Laboratory · PDF fileFeasibility Study for Building a Testing Laboratory ... IP and ATM DSLAM ... Manual and the requirements of national/international

10/14/2014

11

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries

Bug Severity and Priority management

• SEVERITY: Level of technical non-conformancy of the bug

• PRIORITY: Level of solving priority for the bug. Three levels are defined: A (higher priority), B

(medium priority) and C (lower priority).

21

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries 22

Test campaign management Test campaign management Test campaign management Test campaign management & testing process& testing process& testing process& testing process

The test campaign management is a critical process in any testing center. The efficiency of the process has a direct impact on the cost organization and time to market of tested products. Moreover the correct testing sequence is very important to identify in the correct way the item under test anomalies.

The four step approach is organized in the following sequential phases:Stand alone testing: in this phase the product is evaluated as a single element not connected to the other equipment (test performed in lab)End-to-end testing: in this phase the product is evaluated as a part of a network according to a defined service model (test performed in test plant). The estimation of the real ICT product’s performance might be a part of this phase (the special load equipment is necessary).In field testing: the product is tested in real environment condition (test performed in the field)Service stability evaluation: final evaluation of the end-to-end service performed using real customer (test in field)

Page 12: Feasibility Study for Building a Testing Laboratory · PDF fileFeasibility Study for Building a Testing Laboratory ... IP and ATM DSLAM ... Manual and the requirements of national/international

10/14/2014

12

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries 23

Instrumentation maintenance and managementInstrumentation maintenance and managementInstrumentation maintenance and managementInstrumentation maintenance and managementThe maintenance and management of the quality and metrological characteristics of a test center instrumentation, for the correct testing process execution and for the support to quality system for certification (ISO 9001:2000 and ISO/IEC 17025), are usually granted by two kinds of labs: the calibration lab and the instrumentation and management lab.These labs, in order to provide a correct instrumentation management service, must operate according to the well know metrological chain described below representing the correct use of reference and working standards used by the different labs operating on instrumentation at different levels

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries 24

Market surveillance and incoming quality monitoringMarket surveillance and incoming quality monitoringMarket surveillance and incoming quality monitoringMarket surveillance and incoming quality monitoring

Tender Contract delivery Incoming quality

monitoring Billing Feedback from the field

Vendor list

Vendor Rating

Vendorclassification

New product

• Sub test list

• Periodical control

• Feed back from test

phase

Page 13: Feasibility Study for Building a Testing Laboratory · PDF fileFeasibility Study for Building a Testing Laboratory ... IP and ATM DSLAM ... Manual and the requirements of national/international

10/14/2014

13

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries 25

Other important best Other important best Other important best Other important best practisespractisespractisespractises

• Design of air conditioning /

free cooling

• Low power lights

• Renewable sources

• Safety aspects

• Security and access control

• Instrumentation remote

control

• Automation of test suites

• Use of control rooms

• Tele-working

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries

Lab and test plant cost estimation

26262626

lablablablab activityactivityactivityactivity mmmm2222

LocationLocationLocationLocation

RentRentRentRent

KKKK€€€€/year/year/year/year

UtilityUtilityUtilityUtility

KKKK€€€€/year/year/year/year

Instrument. Instrument. Instrument. Instrument.

AssetAssetAssetAsset

KKKK€€€€

PersonnePersonnePersonnePersonne

Number of peopleNumber of peopleNumber of peopleNumber of people

####

Instrument.Instrument.Instrument.Instrument.

Opex Opex Opex Opex

KKKK€€€€/year/year/year/year

SARSARSARSAR Specific Absorption Rate lab 150 19 28 800 4 25

USXUSXUSXUSX User experience lab 130 17 24 100 6 0

BBABBABBABBA Broadband access lab 300 39 56 1.400 7 5

VASVASVASVAS Mobile value added services lab 40 5 7 0 3 0

EPSEPSEPSEPS Electrical safety & protection lab 80 10 15 1.200 4 25

ELAELAELAELA Electroacoustic lab 250 32 46 800 4 5

EMCEMCEMCEMC Electromagnetic compatibility lab 300 39 56 1.600 5 5

RSLRSLRSLRSL Radio & Signalling lab 250 32 46 2.000 12 10

PWRPWRPWRPWR Powering consumption lab 80 10 15 200 2 5

QMLQMLQMLQML Quality of material lab 250 32 46 1.300 6 15

WIFWIFWIFWIF Personal area network lab 170 22 31 500 5 5

TPFTPFTPFTPF Fixed Test plant 900 117 167 3.000 33 120

TPMTPMTPMTPM Mobile Test plant 2500 324 463 3.000 55 300

managemanagemanagemanage

mentmentmentment10

cross cross cross cross

activities activities activities activities

(*)(*)(*)(*)

24

TOTALTOTALTOTALTOTAL 5.400 700 1.000 15.900 180 520

(*) Cross activities: Project office, ICT management, Quality, Secretariat

Page 14: Feasibility Study for Building a Testing Laboratory · PDF fileFeasibility Study for Building a Testing Laboratory ... IP and ATM DSLAM ... Manual and the requirements of national/international

10/14/2014

14

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries 27

CCCConclusiononclusiononclusiononclusion

The 7 pillar for a correct test center management:

• Correct definition of a service portfolio• Accurate definition of testing phases• Resource management and

organization• Investment & cost estimation – identify

priorities• Support systems & bugs tracking• Test campaign management & testing

process management• Market surveillance and incoming

quality monitoring

Livingstone (Zambia), 13-15 October 2014 - Workshop for SADC countries 28