1

ETSI Plugtests The interoperability service

@METIS Kick-off Meeting

The acid test: Testing Interoperability

31 March - Patrick GUILLEMIN

ETSI Plugtests Technical Manager

2

The ETSI Resources in testing & interoperability are unique…

TC MTS (Methods for Testing and Specification) Development of methodologies, techniques and languages http://portal.etsi.org

ETSI PTCC (Protocol and Testing Competence Centre) Supports ETSI TBs on the application of formal techniques in

standards on a daily basis Development of test specifications (conformance and interop) http://www.etsi.org/ptcc

ETSI Plugtests Service Validation of standards and prototypes through

interoperability events http://www.etsi.org/plugtests

…and complementary!

3

PlugtestsTM events look like this:

Oh I discovered a BUG !!!!

4

Plugtests Interoperability Test Events?

Classical Conformance and Interoperability tests: IPv6, SIGTRAN, SIP, VoIP, ENUM…DSL, SMS-MMS

Proof of concept and performance evaluation (early phase): RFID, IRAP, Powerline, UWB, NGN

Services interworking: OSA/Parlay API and Web Services, ebXML, XAdES and PKI

Benchmark, Contest, Deployment and Portability: Speech Quality, GRID with N-Queens contest, J2ME…

5

INTEROPERABILTY and CONFORMANCE TESTING TOGETHER

6

ETSI Plugtests Services

“Interop”, “Bake-off”, “Plugtests” – they are all the same

Improve both quality and interoperability

Debug fast all together

Complementary to standardisation

Can be in the early process.

7

ETSI Plugtests Services

It is an ETSI Service : Neutral and Open to all other organizations and standards

57 events in +4 years, ~3000 engineers, ~1000 Companies and very good rate of usefulness

no sales, no marketing, no observer attend the meetings

8

What is Plugtests ?

5 Staff coordinating big events with experts from ETSI

Pragmatic extended interoperability tests

Not a laboratory, no certification

Come & Test is our leitmotiv

Saving time !

9

Philippe Cousin

The Boss

Nathalie Guinet

Maria-Luisa Parlatano Patrick Guillemin

*new*

Maya Ayache

10

Plugtests Set up?

Participants – Implementations – standards or specifications – and Experts

Test case and Test bed at ETSI ?

Scheduling – Test Plan

Rules of engagements

11

18 Plugtests Events in 2004

OSA/Parlay #2 SiPit #14 1st ENUM Workshop SQTE #3 PKI & XAdES#2 ebXML UWB SIGTRAN #4 DSL #3 SQTE #4

IPv6 #5 GRID Universidad de Chile F-MMS & F-SMS J2ME Powerline #2 Smart Card NGN VoIP CPqD Brazil 2nd ENUM Workshop

12

Open Source Products & Standards and ETSI Plugtests - 1

With IETF VoIP : SIP, SIGTRAN using ETSI TCCN Test Suites ENUM ITU-T, RIPE-NCC and ETSI

IPv6 using ETSI TCCN Test Suites MIP6 http://mip6.plugtests.org , FreeBSD, MySQL,

Apache, IRC, PHP design PKI

13

Open Source Products & Standards and ETSI Plugtests - 2

With W3C and ObjectWeb XAdES with ETSI TC ESI GRID (ProActive Java Open Source Middleware), EGEE,

CoreGRID, GridCoord (N Queens Contest)

OASIS, UN/CEFACT and CEN/ISSS ebXML with Open Source Test Service (KorBIT)

14

In 2005, 22 Plugtests Events1/2

WLAN IRAP (TISPAN) 7-11 February (3GSM) RFID (ERM TG34) 7-11 March OSA/PARLAY-X (TISPAN + 3GPP) and Web Serv. 14-18 March

with IPT Brazil

NGN@HOME Workshop (TISPAN NGN) 6 April Open Source Middleware for Mobility Workshop (ObjectWeb,

INRIA) 7 April STQ Mobile (STQ) 18-22 April ENUM (TISPAN/WG4) 30-May 3-June F-SMS-MMS (AT, DECT, TISPAN + 3GPP) 27-June 1-July 4th DSL (AT, TM) Lannion 27-June 1-July IP Monitoring Workshop with IPFIX Plugtests IETF#63 Paris SIGTRAN (TISPAN NGN + MTS/PTCC) 12-16 September

15

22 Plugtests Events 2/2

Speech Quality Test Event (STQ) 12-16 September OSA/PARLAY API (TISPAN) 26-30 September GRID (ObjectWeb, INRIA, EGEE and other IST EC

Projects) 10-14 October IPv6 (MTS + 3GPP) 17-21 October Mobile Applications (3GPP) 7-10 November STQ Taiwan (STQ) WiMAX (BRAN) 14-18 November Smart Card (SCP + 3GPP) 14-18 November Powerline (PLT) 21-25 November Lawful Interception (LI) 28 November – 2 December Human Factors (HF) 5-9 December

Open Source Plugtests (ObjectWeb) scheduled in Spring 2006

16

Thank You !

17

ETSI European Telecommunications Standards Institute

ISDN integrated services digital networkGSM Global System for Mobile Communications

(cellular phone technology)UMTS Universal Mobile Telecommunications

SystemDECT Digital European Cordless

Telecommunication systemTETRA TErrestrial TRunked RAdioSAT COM Satellite CommunicationsDVB Digital Video Broadcasting NGN Next Generation NetworksVoIP Voice Over IP (Internet Protocols)BRAN Broadband Radio Access Networks Powerline, PLC Powerline Communications :

The transmission of information using the existing power

IP Cablecom : Internet Protocol Cable Communications

SDO Standards Development OrganizationsOSA Open Service Architecture,Open Service

AccessSIPIT SIP Interoperability testsSIP Session Initiation ProtocolENUM E.164 Number MappingSQTE Speech Quality Test EventPKI Public Key InfrastructureXAdES XML Advanced Electronic Signatures

ebXML Electronic Business XML (eXtensible Markup

UWB Ultra-Wide BandSIGTRAN Signaling Transport DSL Digital Subscriber Line IPv6 Internet Protocol version 6 (current version

is version 4)MIP6 Mobile IPv6GRID Computer Grid (like power grid)SMS Short Message Service MMS Multimedia Message Service J2ME Java 2 Micro Edition IETF The Internet Engineering Task ForceTTCN The Testing and Test Control Notation

(Tree and Tabular Combined Notation)W3C World Wide Web ConsortiumTC ESI Technical Committee Electronic

Signatures and InfrastructuresOASIS Organization for the Advancement of

Structured Information StandardsCEN/ISSS Information Society Standardization

System (European Committee for Standardisation)

WLAN Wireless LAN WIMAX Worldwide Interoperability for Microwave

Access HF Human Factors