ETSI NFV Plugtest Overview

NFV PLUGTESTS

Silvia Almagia

ETSI CTI

© ETSI 2015. All rights reserved

OSM-MR#1, Madrid

June 2016

ETSI Plugtests

© ETSI 2015. All rights reserved

Plugtests are interoperability testing events organised and run by ETSI to support its Technical Bodies• Run in parallel with specification work

• Most often part of a series

Main focus on validating the interoperability among different implementations over standardized reference points

Run consistent testing across different combinations of implementations

Compile statistic results and provide consistent feedback to the TB

Participation is free and open to any organisation providing a Function Under Test (FUT)

7

NFV Plugtest

ETSI is organising a first NFV Plugtest• Hosted by 5Tonic in Madrid, Spain

• 23 January – 3 February 2017

• Preceded by a remote integration phase

Goal: Validate ETSI NFV Release 2 capabilities and Information Model in a number of NFV end to end configurations with components from different providers.

NFV capabilities in scope include: • VNF Package, SW Image and NSD Management,

• VNF & NS Life Cycle Management,

• VNF & NS Fault & Performance Management.

© ETSI 2015. All rights reserved

Functions Under Test

© ETSI 2015. All rights reserved

NFV components (FUTs) in scope include:

• VNFs

• MANO (VNFM & NFVO)

• NFVi & VIM

VNFs

MANO

NFVI & VIM

* Note: FUTs can be provided by a group of companies / partners (i.e. comp1, comp2 and comp3 team up and bring a pre-integrated NFVi & VIM)

Supporting Open Source Projects

Open Source Projects supporting the NFV Plugtest:• Review and provide feedback to the Test Plan

• Provide and support (at least) one FUT

© ETSI 2015. All rights reserved

Test Plan

Test Plan development lead by ETSI

Based on ETSI NFV Rel’2 Capabilities

Following NFV IOP Methodology (TST002)

With input from

• ETSI NFV (TST)

• Plugtest participants,

• supporting Open Source projects

Applicable to any implementation in scope

• So vendors and Open Source projects can derive their own detailed test plan (map configuration / stimulus / check steps to their implementation specifics)

Will be run and validated during Plugtest

• Over a number of combinations of implementations

And submitted to ETSI NFV as possible input for NFV IOP Test Specification

© ETSI 2015. All rights reserved

Test Plan Reference documents

Information Model

IFA015 - NFV Information Model Report (**)

• NFV Information Model overview

IFA014 – Network Service Templates Specification (**)

• NSD Templates

IFA011 – Network Service Templates Specification (**)

• VNF Packaging

Capabilities

IFA010 – MANO Functional requirements specification (*)

• MANO Requirements overview

IFA012/IFA013 – Os-Ma-Nfvo ref point Spec - svc mgmt & info model (**)

• MANO NBI

IFA008 – Ve-Vnfm ref point Spec (**)

• Interface to VNF/EM

IFA005/006 – Or-Vi/Vi-Vnfm reference points Spec (*)

• VIM NBI

Test Methodology

TST002 – NFV IOP Methodology (**)

• IOP Test Framework and summary of capabilities

TST007 – VNFM/VIM IOP Guidelines (TBC)

• Very early stage, change of scope under discussion

© ETSI 2015. All rights reserved

(*) Published http://www.etsi.org/deliver/etsi_gs/NFV-IFA/001_099/

(**) Latest draft in https://docbox.etsi.org/ISG/NFV/Open/Drafts/

PlugtestIntegration

Timeline

Registration (July to September)• Co-participants

• FUT

• NDA (test results)

Preparation: (Sept-Oct)• Test Plan development & practical arrangements – lead by ETSI

• Regular conf-calls, details captured in Plugtest WIKI

Remote integration & pre-testing (Nov-Dec)• Through HIVE

• Regular conf-calls, IRC sessions, …

F2f Plugtest• 1st Week (23-27 Jan) – Local Infrastructure Deployment

• 2nd Week (30 Jan – 3 Feb) – Test Sessions

© ETSI 2015. All rights reserved

PreparationRegistration

23 Jan – 3 Feb 2017

Sept Oct Nov Dec Jan Feb

Xmas

Remote Integration

© ETSI 2015. All rights reserved

Remote Integration Sessions

© ETSI 2015. All rights reserved

MANO to VIM VNF to MANO

Plugtest Setup

© ETSI 2015. All rights reserved

During Plugtest

Week 1 – Local infrastructure deployment in host’s lab

• Finalise / re-run pre-testing among local and remote implementations

Week 2 – Interoperability Test Sessions

• Min 1 engineer on-site per FUT (even if FUT remote)

• Test Session Schedule generated automatically (fair and balanced)

• TRT allows to record test results and provide a real-time statistical view

• Per test case, test group, configuration, …

• Detailed results remain private to individual participating organisations

• Daily wrap up meetings :

• To discuss issues, workarounds, feedback, .. on specs and test plan

• Any outstanding topic is documented in the Plugtest Report

© ETSI 2015. All rights reserved

What it looks like

© ETSI 2015. All rights reserved

Test Session Scheduler

© ETSI 2015. All rights reserved

Test Sessions IRC channels

© ETSI 2015. All rights reserved

Test Reporting Tool

© ETSI 2015. All rights reserved

After Plugtest

Final Plugtest Test Plan submitted to ISG NFV (TST)

• As potential input to NFV Interoperability Test Specification

Plugtest Report is finalised, agreed with participants and submitted to ISG NFV:

• List of participants and implementations (FUTs)

• Test Infrastructure

• Integration and pre-testing

• Test Results (aggregated data)

• Per SUT config

• Per Test group

• Per Test case

• Feedback

• On NFV specifications (IFA, TST, …)

• On general IOP issues

• Conclusions and Recommendations

© ETSI 2015. All rights reserved

Contact Details:

Silvia Almagia

silvia.almagia@etsi.org

Centre for Testing and Interoperability

ETSI

Thank you!

© ETSI 2015. All rights reserved18

Backup Slides

First NFV Plugtest

Functions Under Test (FUT)

© ETSI 2015. All rights reserved

Functions Under Test – VNF

Exposing VNF (& NS) Descriptors • And associated requirements: resources, VNFC interconnection,

configuration methods, …

Supporting integration w/ MANO

© ETSI 2015. All rights reserved

Functions Under Test – MANO

Pre-integrated VNFM & NFVO

Exposing data model (templates) to support the test plan (in line w/ NFV IM)

Supporting integration w/ VIM NBIs & VNFs

© ETSI 2015. All rights reserved

Functions Under Test – NFVi&VIM

Pre-integrated VIM & NFVI

If to be deployed locally, Max: 1 rack

Minimum of 3 NFV nodes:

• Pre-configured computing nodes (to be used with the pre-integrated VIM)

• Data plane switches

VIM running in a VM or small sever

• Exposing required NBIs to support the test plan

• Supporting integration w/ MANO

© ETSI 2015. All rights reserved