ITU Forum on Conformance & Interoperability

For the Arab & African Regions, 5-7 November 2012 Tunisia

AlaaAlDin (Aladdin) Al-Radhi ICT / Telecom / Internet: Strategist & Consultant alradhi2000@yahoo.ca , alaalradhi@gmail.com

6 November 2012 1

Session 5: Building

Test Labs

S5-5: Testing Laboratory Experience in the ARB

Region

Agenda

Quick C & I Background

Arab Cases & Practices

Arab Conclusions & Recommendations

Annex:

ITU Reference Works

1

2

3

4

6 November 2012 2

Quick Wrap -Up Recall

Main Talk

Agenda

Quick C & I Background 1

6 November 2012 3

6 November 2012 4

• The processes used to demonstrate that a product (tangible) or a service or a management system or body meets specified requirements.

• These requirements are developed by the International Organization for Standardization (ISO) & the International Electrotechnical Commission (IEC). The processes that need to be followed to be able to demonstrate that they meet the requirements are also developed by ISO/IEC.

• The ISO committee on Conformity Assessment (CASCO), develops standards & guides for conformity assessment and these documents are referred to the CASCO toolbox

www.iso.org/iso/casco_toolbox

Conformity Assessments & Conformance Testing

Quick C & I Background 1

6 November 2012 5

Quick C & I Background 1

www.iso.org/iso/casco_toolbox

• ISO/IEC 17000:2004 : Conformity assessment –Vocabulary and general principles

• ISO/IEC 17011:2004 : Conformity assessment – General requirements for accreditation bodies accrediting conformity assessment bodies

• ISO/IEC 17020:1998: General criteria for the operation of various types of bodies performing inspection

• ISO/IEC 17021:2011: Conformity assessment – Requirements for bodies providing audit and certification of management systems

• ISO/IEC 17024:2003: Conformity assessment – General requirements for bodies operating certification of persons

• ISO/IEC 17025:2005/Cor 1:2006: General requirements for the competence of testing and calibration laboratories

• ISO/IEC 17030:2003: Conformity assessment – General requirements for third-party marks of conformity

CASCO toolbox standards & guides for telecommunication sector 1 / 2

6 November 2012 6

Quick C & I Background 1

www.iso.org/iso/casco_toolbox

• ISO/IEC 17040:2005: Conformity assessment – General requirements for peer assessment of conformity assessment bodies and accreditation

• ISO/IEC 17043:2009: Conformity assessment – General requirements for proficiency testing

• ISO/IEC 17050:2004: Conformity assessment – Supplier’s declaration of conformity

• ISO/IEC Guide 65:1996: General requirements for bodies operating product certification systems

• ISO/IEC Guide 67:2004: Conformity assessment – Fundamentals of product certification

• ISO/IEC Guide 68:2002: Arrangements for the recognition and acceptance of conformity assessment results

CASCO toolbox standards & guides for telecommunication sector 2 / 2

6 November 2012 7

Interoperability Testing Quick C & I Background 1

• Network capabilities for support of services including number format, identification, authentication;

• Network architecture and functional requirements of network elements;

• Access network and terminal types; • Scenarios for service assignment; • Traffic flow characteristics; • Protocol and interface types; • Interworking with non-NGN networks; • Interworking with other services

Operator Side

Customer Side

6 November 2012 8

The ECO System

Source: Dr. Roman Kužnar, Sintesio, (Matej Žontar, SIQ) ITU CIS/EU CIT Forum

Regulator

Vendor

Consumer Operator/

Service Provider

Service Delivery

Performance, Conformance,

Interoperability

Equipment Type Approval

Iterop

SDO SDO SDO

6 November 2012 9

Technologies Testing Focus Quick C & I Background 1

• NGN Architecture & Services • Fixed-Mobile Convergence • Mobile Multimedia Broadcast/Multicast • Optical Networks • Multimedia and IPTV • QoS, • Security and Identity Management • Emergency Communications • Smart Grid • Cloud Computing • IPv6 • …etc

6 November 2012 10

Quick C & I Background 1

• NGN Architecture & Services

• Fixed-Mobile Convergence

• Optical Networks • Broadband Cable • Multimedia, IPTV • ISDN • QoS • Security

ITU-T test Specifications : Conformity Database

Project & Recommendations

www.arib.or.jp

Alliance for Telecomm Industry Solutions

www.atis.org

Telecomm Industry Association www.tiaonline.org/

European Telecomm Standards Institute

www.etsi.org

OMA (Open Mobile Alliance) www.openmobilealliance.org

IETF (Internet Engineering Task Force) www.ietf.org

Testing Specifications: Who is Who

6 November 2012 11

Test Centers Quick C & I Background 1

Conformance testing of equipment to meet specific standards & specifications as specified by vendors, SPs, & network operators.

Interoperability testing of equipment on networks.

Testing & evaluation of equipment which employs new technologies before deployment in networks

Purpose

Types

1. Private: Belong to OEMs & Testing laboratories

2. International / Regional: Tests equipment to meet Standards (ISO) & ITU Recommendations. e.g.

• ETSI Plugtests • ZNIIS: Russian Central

Scientific Research Institute

• University of Hampshire IOL (Interoperability Lab)

www.etsi.org/Website/OurServices/Plugtests/home.aspx

www.zniis.ru

www.iol.unh.edu

6 November 2012 12

MRA: Mutual Recognition Agreements / Arrangements

Quick C & I Background 1

• Help avoid the cost of duplicative testing: Once in the exporting country & again in the importing country

• Test once, Use any where! Will reduce testing costs

6 November 2012 13

Accreditation Bodies Quick C & I Background 1

• To develop a global network of accredited testing Labs

• Has 3 Regional Cooperation Bodies & MRAs:

1. Asia Pacific Lab Accreditation Cooperation (APLAC)

2. EU co-operation for Accreditation (EA)

3. Inter-American Accreditation Cooperation (IAAC)

International Laboratory Accreditation Cooperation

(ILAC) www.ilac.org

www.aplac.org

www.european-accreditation.org

www.iaac.org.mx

International Accreditation Forum (IAF) www.iaf.nu

• To establish Multilateral Recognition Arrangements (MLA), between its members.

• Has 3 regional groups: 1. The EU co-operation for

Accreditation (EA) 2. The Pacific Accreditation

Cooperation (PAC) 3. The Inter-American

Accreditation Cooperation (IAAC).

Agenda

Arab Cases & Practices 2

6 November 2012 14

6 November 2012 15

Arab Cases & Practices

2

www.tra.gov.eg/english/main.asp?

NTRA Egypt

Standards Organization

Telecom / Radio ITU, ETSI, ASA, FCC

EMC / EMI CENELEC, IEC, ASA

Safety / Health CENELEC, IEC, ASA, UL, FCC

Compliance with International Standards

6 November 2012 16

www.tra.gov.eg/english/main.asp?

NTRA Egypt

• Light Regime: Declaration of Conformity certificate “DoC” or “FCC ID”, (USA, Canada, EU, Japan, South Korea, Australia),

• Tight Regime: Test reports from accredited international test labs over the 5 continents, (Other countries not including China),

• Special Regime: Verification of Conformity certificate (VoC) & Pre-shipment verification from NTRA accredited labs in China,

Source: dr. Roman Kužnar, Sintesio, (Matej Žontar, SIQ) ITU CIS/EU CIT Forum

Arab Cases & Practices 2

6 November 2012 17

Arab Cases & Practices

2

www.tra.gov.eg/english/main.asp?

NTRA Egypt

NTRA Accredited Test Labs in China

1. China Telecommunication Technology Labs www.chinattl.com

2. Intertek China www.intertek.com 3. SGS-CSTC Standards Technical Services Co., Ltd.

www.sgs.com 4. Bureau Veritas ADT

www.cn.bureauveritas.com 5. TÜV Rheinland Group Greater China

www.chn.tuv.com

6 November 2012 18

Arab Cases & Practices

2 NTRA Egypt

Wireless TE Test Set (3 MHz to 6 GHZ) Signalling test

Mobile GSM 2G/3G,CDMA 2000 FWT, Cordless Phones

.9/2.4/5.8 GHz, HF/VHF/UHF Transceivers);

1.88-1.9Ghz phones;

Analogue wired phones;

EMC Test system (Immunity/Emission, Semi-anechoic

chamber) (RFP – Jan 2012);

NTRA ICT TE Test Lab

Source: dr. Roman Kužnar, Sintesio, (Matej Žontar, SIQ) ITU CIS/EU CIT Forum

6 November 2012 19

Arab Cases & Practices

2 NTRA Egypt Central DB solution

Source: dr. Roman Kužnar, Sintesio, (Matej Žontar, SIQ) ITU CIS/EU CIT Forum

NTRA ‘Master’ EIR

“NTRA database”

GSMA Global Database

(GSMA Agreement)

MSC MSC

Vodafone network Etisalat network MobiNil network

Vodafone

‘Slave’ EIR

Etisalat

‘Slave’ EIR

MobiNil

‘Slave’ EIR

Develop National

Black list

Management of all

EIR data

Check IMEI requests with Black, White responses

Developed

International

White List

ranges

MSC

SS7 SS7 SS7

Network LVL

Operation /

Authentication

System LVL

Lists &

configuration

data Master/Slave relationship (download-reporting)

6 November 2012 20

Arab Cases & Practices

2

• ADSL (Asymmetric Digital Subscriber Line)

• Cable Modems • FAX Machine • GSM (Global System for Mobiles) and

3G Handsets • Hybrid Systems (Large Key System) • Key Telephone Systems • Leased Line Backup & ISDN Audio

Conferencing • Modems • PABX (Private Automatic Branch

Exchange)

www.uaelab.ae/Products/Products.htm

UAE Telecom Lab

In order to obtain the Type Approval and Site Approval Application

Documents, you need to contact UAE

Telecommunications Regulatory Authority

(TRA) www.tra.ae

6 November 2012 21

Arab Cases & Practices

2

www.uaelab.ae/Products/Products.htm

In order to obtain the Type Approval and Site Approval Application

Documents, you need to contact UAE

Telecommunications Regulatory Authority

(TRA) www.tra.ae

UAE Telecom Lab

• Pagers

• POS (Point of Sale Terminals)

• Telephones

• Telex Machine

• Terminal Adapter & Network

Terminal

• VCS (Video Conferencing

Systems)

• WLAN (Wireless Local Area

Network)

6 November 2012 22

Arab Cases & Practices

2 CERT Tunisia

www.cert.nat.tn/?cont_id=00168&lang=EN

Public Networks

• Switching and data processing systems: Switching systems (AXE, EWSD, OCB ,HC3,C&C08, etc.) Data switching systems (X25, ATM, FR,…) Mobile networks (UMTS, GSM, GPRS) ISDN (Integrated Services Digital Network ) IN (Intelligent Network) and NGN networks UMTS core network

• Transmission systems: Digital TX systems SDH/PDH on optical fibers & microwaves, Mobile networks GSM/GPRS and TETRA (Radio Sub system) Optical fiber civil work

Technical Acceptance Profile

6 November 2012 23

Arab Cases & Practices

2 CERT Tunisia

www.cert.nat.tn/?cont_id=00168&lang=EN

Public Networks Technical Acceptance Profile

Private Networks • Access Networks: Distribution networks

(copper, optical…) WLL (Wireless Local

Loop ) • Telecommunication

Environment: Power supply and Air

Condition equipments Fire detection and

extinction systems

• Communication Systems: PABXs Call centers LAN Buildings Cabling WAN Sites Interconnection WIFI networks

• Information Systems: Server ATM System security.

6 November 2012 24

Arab Cases & Practices

2

• Middle East and North Africa Certifications: Algeria Bahrain Egypt Jordan Kuwait Lebanon Morocco Oman Qatar Saudi Arabia Tunisia United Arab Emirates (UAE)

• Services Covered: Safety/EMC Certifications, Certificates of Compliance (CoC) Wireless and Telecom Type Approvals

• Partnerships Certificates

Go Global Compliance USA

www.goglobalcompliance.com/services

6 November 2012 25

Arab Cases & Practices

2 CITC, KSA

IPv6 Test Lab

www.ipv6.org.sa/testlab www.citc.gov.sa

Agenda

Arab Conclusions

&

Recommendations

3

6 November 2012 26

Current Arab Region Image

• Reliance on TA (Type Approval) process. • Mostly relay on globally recognized Standards &

accredited Labs. • Some have testing facilities but generally NOT

accredited. • NO interoperability requirements or testing by

regulators towards operators • Counterfeit equipment (mainly China-Made) is a

problem, specially in the mobile sets • Regional Test Labs have difficulties to finance. • Some regulators are reluctant about MRAs because

of revenues reduction i.e. loss of TA fees.

6 November 2012 27

Arab Conclusions & recommendations

3

The Way Forward • Advise ITU of interoperability problems • Regulators to establish market access requirements &

prioritize areas • Regulators to simplify related C & I regulations • Establishment of Accreditation Bodies & MRAs setup • Technical Skills build-up • Establishment of local / regional Test Centers • Network-like test centers (common infrastructures) to

reduce costs & share experiences • Develop an inventory & mapping of available resources • Partnerships with industry, vendors, operators, etc • Local & regional interactive sessions: Challenges, Possible

bi-lateral collaborations, Best practices, Action Steps, International aid, Strategies, etc

6 November 2012 28

Arab Conclusions & recommendations

3

The Way Forward

6 November 2012 29

Arab Conclusions & recommendations

3 Interactive Sessions

Courtesy Use f ITU Forms

Main obstacles ? Strategies / Action Steps ?

International Aid ? Others ?

Pillar 1: Conformity Assessment

Pillar 2: Interoperability

Events

Pillar 3: Capacity Building

Pillar 4: Regional

test centers

WORLDWIDE TEST LABS 1

• USA NIST

http://ts.nist.gov/standards/scopes/programs.htm

http://ts.nist.gov/standards/scopes/ect.htm

• AUSTRALIA

www.austest.com.au/about_us.php

• European

http://start.europadev.com/Home/consultancy-1

• A4Labs

www.at4wireless.com/testing-certification-

services/accreditations.html

• TUNISIA

www.cert.nat.tn

6 November 2012 30

Arab Conclusions & recommendations

3

• MIDDLE EAST www.uaelab.ae/UAELAB/about_UAELAB.htm www.goglobalcompliance.com/ www.ntra.gov.eg/arabic/main.asp www.contractlaboratory.com/labclass/telecommunications.cfm

• RUSSIAN FEDERATION http://zniis.ru/ITTC.html

• CANADA – INDUSTRY CANADA www.ic.gc.ca/eic/site/smt-gst.nsf/eng/home

• AFRICA, CHINA, ASEAN, CIS, LATIN AMERICA TEST LABS (Link to ITU webpage) www.itu.int/dms_pub/itu-

t/oth/06/24/T06240000010009MSWE.doc

6 November 2012 31

WORLDWIDE TEST LABS 2

Arab Conclusions & recommendations

3

Agenda

Annex:

ITU Reference Works

4

6 November 2012 32

Quick Wrap -Up Recall

ITU Conformity & Interoperability Portal

• The ITU Conformity and Interoperability (C&I) Programme

Concepts and Guidance

• ITU Conformity Database

• Interoperability and “ITU Interop Events”

• Capacity Building & Guidelines for establishing test centers

• Vendors, Industry, Testing

• Laboratories

• Standards Developing Organizations & International

Organizations 6 November 2012 33

http://www.itu.int/net/ITU-T/C-I/

Contact on conformity: conformity@itu.int Contact on interoperability: interop@itu.int

6 November 2012 34

Standards Side:

Conformity Assessment

Interoperability Events

Developments Side:

Capacity building

Establishment of test centres in developing countries.

The ITU 4 “Pillars”

The ITU Conformity Database DB

• Informative & voluntary database open both to members & non-members

• Adoption of international ISO/IEC standards & guidelines or self-assessment approach

• On-line entries directly made by Companies

• ITU is not participating in any Testing / Certification activities

6 November 2012 35

http://www.itu.int/net/ITU-T/conformity/cdb.aspx

Populating the ITU-T conformity DB

1. Companies can populate the DB via registering online & Choose among 4 routes: http://www.itu.int/net/itu-t/cdb/secured/Register.aspx

6 November 2012 36 http://www.itu.int/net/ITU-T/conformity/cdb.aspx

Populating the ITU-T conformity DB

2. Companies can populate the DB via registering online & Choose among 4 routes: http://www.itu.int/net/itu-t/cdb/secured/Register.aspx

6 November 2012 37 http://www.itu.int/net/ITU-T/conformity/cdb.aspx

(e.g. DSLAM, modem, ADSL, optical fiber, home networking, WDM, multimedia, IPTV etc.)

2. PRODUCT

2.1 Name of product:

2.2 Enter a Category:

2.3 Comments/Re

marks:

(e.g. main functionalities implemented, etc.)

Populating the ITU-T conformity DB 3. Companies can populate the DB via registering online &

Choose among 4 routes: http://www.itu.int/net/itu-t/cdb/secured/Register.aspx

6 November 2012 38 http://www.itu.int/net/ITU-T/conformity/cdb.aspx

(Insert here edition of Recommendations if different from the one in force at the moment of submission of the form and/or number/series of national/regional standards adopted as equivalent to ITU-T Recommendation(s), e.g. NMR 234/G.992.2; XYZ123/H.264)

3. ITU-T RECOMMENDATION(S) IMPLEMENTED IN THE PRODUCT

3.1 Please select from the list below ITU-T Recommendations that are implemented in your product.

Select Series: Select Number:

3.2 Comments/Remarks:

Populating the ITU-T conformity DB

4. Companies can populate the DB via registering online & Choose among 4 routes: http://www.itu.int/net/itu-t/cdb/secured/Register.aspx

6 November 2012 39 http://www.itu.int/net/ITU-T/conformity/cdb.aspx

Drop Menu to Choose From

Populating the ITU-T conformity DB

5. Companies can populate the DB via registering online & Choose among 4 routes: http://www.itu.int/net/itu-t/cdb/secured/Register.aspx

6 November 2012 40 http://www.itu.int/net/ITU-T/conformity/cdb.aspx

Route 1: Testing performed by a laboratory accredited as per ISO/IEC 17025 (Rec. ITU-T X.290 applies). A Supplier’s Declaration of Conformity (SDoC) prepared according to ISO/IEC 17050 standard has to be submitted to ITU to populate the ITU conformity database;

Route 2: Testing performed according to procedures adopted by a Certification Body accredited as per ISO/IEC Guide 65 (Rec. ITU-T X.290 applies) which issues a Certificate of Conformity. The Certification Body is fully responsible for the certification process that may include tests performed in a non accredited Lab. An SDoC (ISO/IEC 17050) is submitted to ITU to populate the ITU database.

Populating the ITU-T conformity DB

5. Companies can populate the DB via registering online & Choose among 4 routes: http://www.itu.int/net/itu-t/cdb/secured/Register.aspx

6 November 2012 41 http://www.itu.int/net/ITU-T/conformity/cdb.aspx

Route 3: Testing performed in laboratories recognized by an SDO or Forum or Consortium qualified as per Recommendation ITU-T A.5 or by an Organization signatory of an MoU with the ITU. (Rec. ITU-T X.290 applies). A Conformity Statement is issued by the Laboratory and an SDoC is submitted to ITU to populate the ITU database.

Route 4: For ITU members only. Self-assessment procedure directly performed by the vendor. A Conformity Declaration is submitted by the vendor to populate the ITU database. Please note that criteria to populate the database under Route 4 are under review. Should the criteria be changed, entries already posted in the database introduced using Route 4 would be tagged as such and all future entries would be required to comply with the revised criteria.

ITU Approach: ISO/IEC assessment & self-assessment procedures.

6 November 2012 42

Route 3: Laboratories recognized by ITU-T A.5

qualified organizations or MoUs signatories

Route 4: for ITU members only

Route 1: Accredited Testing Laboratories

Route 2: Accredited Certification Bodies

6 November 2012 43

4 routes to populate conformity DB

ITU Conformity Database

Co

nfo

rmit

y A

sse

ssm

ent

&

Ce

rtif

icat

ion

ITU

C&

I se

rvic

es

Supplier’s Declaration of Conformity (SDoC)

(ISO/IEC 17050)

Tests performed in a lab agreed by an

Accredited Certification Body

(ISO/IEC 17065) (Rec. ITU-T X.290)

Route 2

Conformity Certificate issued by the Certification

Body

Route 1

Tests performed by an accredited lab

(ISO/IEC 17025) (Rec. ITU-T X.290)

Recommendation(s) compliant test results

ISO/IEC Assessment Procedures

Route 3

Tests performed in a lab selected by an

ITU-T A.5 agreed SDO/Forum/MoUs (Rec. ITU-T X.290)

Recommendation(s) compliant test results

Route 4

ITU Members Only

Tests performed in any lab

Self-Declaration of Compliance issued

by the Supplier

Self-assessment Procedures

ITU virtual Laboratory for remote tests of equipment, new technologies & services

• Currently being developed in ITU-T : A powerful testing & training tool for regional test centers.

• The objective is to provide remote access to an NGN model network for testing new technology equipment & services

• Benefits:

Reduced test preparation time

Availability & use of expensive test equipment via a remote interface;

Testing Procedures & automation

Reduced testing costs compared with on-site tests

6 November 2012 44

http://www.itu.int/ITU-D/projects/display.asp?ProjectNo=CALL-06

6 November 2012 45

ITU virtual Laboratory Status

• ITU & FSUE ZNIIS Russia start collaboration in the field of Virtual laboratory creation on the basis of the ITU – FSUE ZNIIS International Telecommunication Testing Center ITTC project

• The project currently; – Seeking Funds – Call for Partners

• Interested to have information? Write to : BDTPRJHQ@itu.int Subject Title: Request Information about Project

CALL-06

6 November 2012 46 http://www.itu.int/ITU-D/projects/display.asp?ProjectNo=CALL-06

6 November 2012 47

“Handbook on Testing”, ITU-T, November 2011

www.itu.int/ITU-D/tech/events/2011/CI_Moscow_November11/Presentations/Session2/SeminarCI_20

11_CIS_Presentation_JPieczerak_S2_3.pdf

6 November 2012 48

ITU Guidelines for developing countries on establishing conformity assessments test labs in different regions

May 2012

www.itu.int/ITU-D/tech/ConformanceInteroperability/ConformanceInterop/Guidelines/Test_lab_guidelines_EV8.pdf

• Members to advise the ITU of interoperability problems, their mitigation, & successful procedures that were helpful in the process: http://groups.itu.int/itu-t/StandardsQA.aspx

• Members to establish market access requirements for telecom equipment to avoid interference, and safety of life issues in their marketplace.

• Members to examine their existing legislation and regulations to ensure that they enable participation in MRAs on Conformity

• Assessment and testing with foreign partners

6 November 2012 49

ITU Conclusions & Recommendations

• Members to prioritize areas of concern related to telecommunication products and systems

• Accreditation bodies in member states should become signatories of the ILAC MRA or the IAF MLA.

• Test centers should be established on a regional basis to take advantage of the similar networks in a region with common infrastructures

• Make use of ITU training: http://academy.itu.int • Focus on the Test Centers as a Centre of Excellence CoE • Interoperability testing should utilize the model

network concept under development in ITU-T

6 November 2012 50

ITU Conclusions & Recommendations

6 November 2012 51