Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
MAKING HETEROGENEOUS ELEMENTS
INTEROPERATE
ANTHONY WILES
ETSI CENTRE FOR TESTING AND INTEROPERABILITY (CTI)ETSI CLOUD WORKSHOP 28 - 29 SEPT 2011
My starting point is
• In a global market interoperability is essential
• Standardisation enables interoperability
About This Presentation
The ETSI approach to achieving interoperability:
• Standards validation and testing
About Interoperability Events
A few words on conformance and interoperability
Conclusions
2 Standards in the Cloud: a transatlantic mindshare
Definition of Interoperability
No single definition of Interoperability, two examples
1) The ability of two or more systems or components to exchange and use information
2) Interoperability is a property of a product or system, whose interfaces are completely understood, to work with other products or systems, are completely understood, to work with other products or systems, present or future, without any restricted access or implementation [Wiki]
3 Standards in the Cloud: a transatlantic mindshare
ICT Technologies are Built on Multiple
Standards
ITU
ETSI
IEEE
IETF
Fora
ICT technologies are often specified by ‘islands of standards’
• From (many) different standardisation bodies or organisations
• Different approaches in terms of specification
Converged into a single product (Smartphone)
Interconnection of many hetererogenous components (LBS, IMS, Cloud)
• Maybe using standards beyond their original purpose or where end-to-end interoperability
may never been considered
Results in potentially non-interoperable standards and/or products
4 Standards in the Cloud: a transatlantic mindshare
ETSI Approach –
Validation and Testing
Products mature from prototypes to commercial products
Time
Certification
(not done by ETSI)
Development of Base Standards
Validation through Interoperability Events
5 Standards in the Cloud: a transatlantic mindshare
Products mature from prototypes to commercial products
Conformance Testing
Development of Test Specs (Conformance & Interop)
Validation Through Interoperability
Events
Single physical location or several interconnected locations during a fixed
period (e.g., 5 days)
• At ETSI, test lab, hotel etc.
• Test infrastructure is put into place just for each event
• Events can be (fully) remote but still fixed duration
Dedicated location
• Permanent (or semi-permanent) testbed
• Can be fixed duration events
• Can be long-term activity
In both cases ETSI Plugtests offer full organisational and technical support
Standards in the Cloud: a transatlantic mindshare6
Typical Plugtests Events
IMS
Bluetooth
IPv6
B2B (Business-to-Business)
SIPiT
J2ME – Mobile Apps
In operation since 1999
Over 160 events so far
For many diverse technologies
IPv6
Triple Play over xDSL
SIM/Handset
WLAN IRAP
RFID
STQ (Speech Quality)
WiMAX
SIGTRAN
Femtocell
OSA/ParlayX
SMS / MMS
7 Standards in the Cloud: a transatlantic mindshare
J2ME – Mobile Apps
HDMI
VoIP for Air Traffic Management (3 EUROCAE events)
Electronic Signature (XadES, CadES)
Lawful Interception
Optical Fibre (GPON)
Power Line (PLT)
Intelligent Transport Systems (ITS – C2C)
Fixed Mobile Convergence (FMCA)
GRID (Cloud)
ENUM
Plugtests™ can look like this…
Standards in the Cloud: a transatlantic mindshare8
… or this (Car2Car Interop)
9 Standards in the Cloud: a transatlantic mindshare
Enabling Remote Events - Hub for
Interoperability and Validation at ETSI
Standards in the Cloud: a transatlantic mindshare10
Validation of Standards by
Interoperability Events
Community
ProductsStandards
Standards in the Cloud: a transatlantic mindshare11
ProductsStandards
Identified
IOP Issues
Tests
Interop Event
Evaluation of Standards Solutions by
Interoperability Events
Community
StandardsTrial
Alternative
Standards in the Cloud: a transatlantic mindshare12
Interop Events,
StandardsTrial
Solutions
Alternative
Standards
Solutions
Evaluated
Solutions
Scenarios
Resolution of Specific IOP Problems
by Interoperability Events
Community
Standards
Community
Identifies
IOP Issues
Standards in the Cloud: a transatlantic mindshare13
Trial
Solutions
IOP Issues
Evaluated
SolutionsInterop Events,
Scenarios
Evaluation of Co-existence Issues
Community
1 2
1 2
1 2
Standards in the Cloud: a transatlantic mindshare14
ProductsStandards
Identified
coexistence
Issues
Tests
1 2 1 2
Interop Event
ETSI Test Specifications for
Conformance
ETSI Develops conformance test specifications for
many of its mainstream standards
For use by members in their proprietary development
processes
Certification schemes, for example• Developing standardised conformance test specifications for GSM and 3G
(UMTS/LTE) for over 15 years
• Follow strict methodology (based on TTCN-3)
• Average budget 1M€ per year
• 3GPP RAN#5 delivers these tests to GCF (Global Certification Forum)
• All tests validated (executed) on up to 5 platforms against real equipment before
approval and publication
Standards in the Cloud: a transatlantic mindshare15
Conformance Testing and IOP Testing are
Complementary
As you move up a system stack the emphasis should change
from conformance to interoperability testing
Lower layer protocols
• Emphasis on conformance testing
Middleware, enablers, infrastructure
16
Middleware, enablers, infrastructure
• Combination of conformance and
interoperability testing
Services, applications
• Emphasis on interoperability testing
Conformance testing should be a pre-requisite to
interoperability testing
Standards in the Cloud: a transatlantic mindshare
Interop and the Cloud
Another definition of interoperability:
- Being able to accomplish end-user applications using different types of
computer systems, operating systems, and application software,
interconnected by different types of local and wide area networks (James A.
O'Brien and George M. Marakas)
Standards in the Cloud: a transatlantic mindshare17
Combining IOT with Conformance
Checking
18 Standards in the Cloud: a transatlantic mindshare
Conclusions
Interoperability is a major factor in driving ICT
standardisation
Validated standards(Plugtests) help ensure
interoperable standardsinteroperable standards
Testing helps ensure interoperable products
Standardised test specs and interoperability events
should be an integral part of standards development
• Requires planning and support
Works for Cloud too!
Standards in the Cloud: a transatlantic mindshare19
Contacts
Email: [email protected]
Web: www.etsi.org/plugtests
Standards in the Cloud: a transatlantic mindshare20
ETSI Approach – Three Best Practices
Technical Bodies
3GPP
AERO
ATTM
BRAN
CLOUD
DECT
eHEALTH
SPECIFICATION
Validation of standards as an active
Application of best practice
specification methods, techniques
and tools.(Subject of another presentation!)
eHEALTH
ERM
ESI
HF
INT
ITS
LI
MTS
PLT
SCP
STQ
TETRA
TISPAN …
Standards in the Cloud: a transatlantic mindshare22
VALIDATION
TESTING
Validation of standards as an active
part of the development process.
Mainly through interoperability
events.
Development of standardised test
specifications for key technologies.
Series of IOP Events
Maturity of the Standard
Stable and interoperable
Number of Events
Event 1 Event 2 Event nn...........
23 Standards in the Cloud: a transatlantic mindshare
Early draft
Scope of Interoperability Testing
Interoperability
Scope of
Interoperability
Testing
Standards in the Cloud: a transatlantic mindshare24
Interoperable
products may still
not conform!
Performance addressed
to some degree –
depends on the
complexity of the test
scenarios
Cannot explicitly cause
error conditions so
robustness addressed to
a limited degree and in a
less controlled manner
Scope of Conformance Testing
Conformance
to
Requirements
Scope of
Conformance
Testing
Standards in the Cloud: a transatlantic mindshare25
Requirements
Conformant
products may still
not interoperate!
Performance not usually
addressed – requirements
not standardised and
testing is done under
ideal conditions
Can simulate error
conditions – but only
standardised robustness
requirements addressed