3
NSN case study Nokia Solutions and Networks cFRAME At NSN, multiple wireless communication product testing teams must verify their systems-under-test against a selected set of KPIs in the shortest time possible and without inhibiting each other with resource locks while ensuring low test-retest variability. For this, they need a tool capable of managing complete lab equipped with remote RF channel emulation devices (faders, attenuators, RF analyzers), core and supporting network elements, data simulation (IPERF), traffic analysis (SmartBits), radio access nodes (NB, BTS, RNC), and user endpoints. Test output needs to be preserved in the form suitable for external processing. The complete solution must be lightweight in terms of integration costs while keeping total cost of ownership down. End-to-end network testing automation solution specifically designed with GSM, GPRS, CDMA, UMTS, WiFi, WiMax, and LTE networks in mind, which simplifies test bench control and automates test case execution. After deploying cFRAME, engineers can organize remote test objects into arbitrary collaborating groups responsible for unattended automatic execution of user-defined test scenarios under supervision of the master agent. Generated test output is automatically collected, normalized, and uploaded to a predefined place where it can be picked up by a preferred analysis tool. CLIENT PRODUCT CHALLENGE RESULT DL_UDP_TEST1 DL_TCP_TEST2 DL_UDP_TEST3 DL_TCP_TEST4 UL_UDP_TEST3 UL_TCP_TEST4 Throughput Testing Automation Example Throughput testing is intrinsically labor-intensive, hence perfect candidate for automation. In the above example 4 tests were used to automatically emulate full spectrum of channel conditions for data download/upload over TCP and UDP and produced 6 performance measurements indicative of maximum sustained and peak measured throughput. 504 12 12 34 24 15 Throughput Attach HARQ Latency Sensitivity UL Power RPT Test Cases automated cases non automated cases Total: 601 Automated: 83% Mbit/s 70 52.5 35 17.5 0 20 30 40 50 100 150 dB

Rubedo Case Study 2014-04-22 NSN (perziurai)

  • Upload
    lydang

  • View
    216

  • Download
    0

Embed Size (px)

Citation preview

NSN case study

Nokia Solutions and Networks

cFRAME

At NSN, multiple wireless communication product testing teams must verify theirsystems-under-test against a selected set of KPIs in the shortest time possible andwithout inhibiting each other with resource locks while ensuring low test-retest variability.

For this, they need a tool capable of managing complete lab equipped with remoteRF channel emulation devices (faders, attenuators, RF analyzers), core and supportingnetwork elements, data simulation (IPERF), tra�c analysis (SmartBits), radio accessnodes (NB, BTS, RNC), and user endpoints. Test output needs to be preserved inthe form suitable for external processing. The complete solution must be lightweightin terms of integration costs while keeping total cost of ownership down.

End-to-end network testing automation solution specifically designed with GSM, GPRS,CDMA, UMTS, WiFi, WiMax, and LTE networks in mind, which simplifies test bench controland automates test case execution.

After deploying cFRAME, engineers can organize remote test objects into arbitrarycollaborating groups responsible for unattended automatic execution of user-defined testscenarios under supervision of the master agent. Generated test output is automaticallycollected, normalized, and uploaded to a predefined place where it can be picked up bya preferred analysis tool.

CLIENT

PRODUCT

CHALLENGE

RESULT

DL_UDP_TEST1DL_TCP_TEST2

DL_UDP_TEST3DL_TCP_TEST4

UL_UDP_TEST3UL_TCP_TEST4

Throughput Testing Automation Example

Throughput testing is intrinsically labor-intensive, hence perfect candidate for automation. In the above example4 tests were used to automatically emulate full spectrum of channel conditions for data download/upload overTCP and UDP and produced 6 performance measurements indicative of maximum sustained and peak measuredthroughput.

504

12

12 34 24

15

Throughput

AttachHARQLatency

SensitivityUL Power

RPT Test Cases• automated cases• non automated cases

Total: 601Automated: 83%

Mbit/s70

52.5

35

17.5

020 30 40 50 100 150 dB

NSN case study

Conventional approachA typical E2E test bed consists of multiplenetwork and supporting elements whichare individually controlled.

cFRAME approachcFRAME acts as the universal remote controlfor most RF channel emulation devices, tra�canalysis tools, etc.

Conventional approachTest planning and controlled executionrequires considerable shared resources.

cFRAME approachcFRAME allows defining ad-hoc subnetswith required network nodes & resourcesand running custom test scripts.

Conventional approachSignificant e�ort required to collect andorganize test output data generated by di�erent tools.

cFRAME approachcFRAME can collect, organize, and uploadtest output data to the specified FTP addressfor subsequent o�ine analysis.

Test Planning and Automated Execution

Test Output Management

E2E Test Bed Control

Ease of Use• No more terminal windows overhead• No more manual input to remote user applications• No more manual scheduling of user applications• No server administration to join new nodes

to the map

• Low test-retest variability (repeatablemeasurements)

• Reduced HW/SW tools cost due to better reuse• Reduced labor cost due to less running time

Key benefits

Quality and Cycle-time

Contact UsRUBEDO SISTEMOSJovarų g. 2, 47193 Kaunas, Lithuania / +370 686 34807 / [email protected] / www.rubedos.comLINAS VAITULEVICIUS / Sales Representative+370 37 220 280 / [email protected]

TESTIMONIAL

NSN case study

“cFRAME took our LTE E2E throughput testing automation to a newlevel. We breezed through building a communication map of cFRAMEagents which allowed multiple users to monitor lab equipment poolstatus in real-time time, making dedicated test bench reservationintuitive and overlap free. Great feature!

Another cool feature – the Toolbox – allowed us to develop test scriptsindependently from specific test bench configuration, ending up withhuge time and resource savings. We called it ‘100% test scripttransparency!’

Choice of C# as a scripting language is well-thought, too, because itpromotes reuse of existing 3rd party software tools. As a result, over80% of RF performance TPUT test cases were automated in about3 months’ time.

We are looking forward to cFRAME extensions towards supportof passive agents, hands-free updates, and auto-generation of testscripts. Rubedo Sistemos provides us with the dedicated customersupport and is willing to tailor new cFRAME features in line with ourpriorities and time lines.”

Thank You!

KĘSTUTIS JASINEVIČIUSLead Engineer, RF Performance & AutomationNokia Solutions and Networks / MBB SC

x