XCAL Mobile Sales_Russia_ PPT v1 3

www.accuver.com

Smartphone-based QoS Measurements in 3g – 4g Networks Draft

Contents

Who are we and our vision Accuver at a glance & Who we work with Main PPT for XCAL Mobile

A

B

C

2

Accuver at a glance

Revenues 2011 – US$ 31.9m; Post Tax Net Profit US$ 3.m

• Over x35 chipset partnerships • Multi-vendor client base • Work with all major operators in the USA

(North and South), EMEA and Asia Pacfic

Strategic Partners

Operations

• 100 clients in 85 countries • > 15,000 licenses delivered

LTE – Early Lead • We work with all leading vendors and

new LTE networks • We have an early lead in chipset-

support for UU and service testing • We have and e2e test solutions that are

widely adopted

RoW • Over 85 clients in 4 years (vendors &

carriers) • WiMax – dominant supplier • LTE – broadest air interface solutions

available in the market today • Recent tactical wins – Softbank, NSN,

Nielsen, Hutchison etc.

Resources

• Total 350 - 176 fulltime employees − 75 – Product Development & R&D − 90 - Engineering Services − 11 - Administration

• 174 – contractors and ‘flex employees

Established April 1995

Capital HK$16.6m (US$2.14m)

HQ Hong Kong

Management Chairman J.T. Chung (‘JT’)

CEO Myunsgup Kim

3

Our geographic reach covers all major geographies

x5 Accuver office x15 VARs

4

How we compete

Competitive Advantage

Innovation & Reach • Ownership of e2e value chain • Alliances that fuel innovation

(vendors, OEMs, networks) • First to market for key solutions

e.g. UU analytics

Cost structure • Lower overheads our European

peers • Strong TCO proposition • Efficient processes + experience • Cutting edge architecture –

faster development cycles Products

• Core competence in

‘productisation’ and automation

• Improved work flow and reduced costs

Custom Build • Custom development • Value added services • Rapid technology cycles

1

3

2

4

5

6

We work with all leading 4G players in over 45 countries

Key Customer Segments

1 Network operators 2 Infrastructure vendors

3 Chipset / OEMs 4 RF Services

http://www.francetelecom.com/en/

7

Structure

Market context

• OS market dynamics

• LTE device landscape

• User requirements

What have we got?

Why is it unique – KPI framework & key differentiators

How is it used?

Devices supported

Roadmap

A

B

C

D

E

F

8

Smartphones

9

High end devices significantly multiply traffic

10

LTE device landscape – 269+ UEs launched to date from 57 manufacturers

12%

7%

4%

1%

0%

18%

38%

21%

142

52 50

65

43 51

36 36

5

Source: Status of the LTE Ecosystem Report – GSA, Jan 2012

269 Products; 57 manfs No. Devices (FDD) No. Devices (TDD)

Modules

Tablets

Laptops

PC cards

Smartphones

Routers

Dongles

700 MHz

800 MHz

1800 MHz

2600 MHz

800, 1800, 2600 MHz

AWS 2600 MHz Band 38

2300MHz, Band 40

2600 MHz Band 41

• 80/20 rule applies • 36% increase in LTE devices in last

3 months • LTE smartphones – x6 increase • LTE tablets – iPad +

Femto

11 Source: Status of the LTE Ecosystem Report – GSA, Jan 2012

The impact of smartphones in the network

Leverage Real-Time Device, Service, Experience, and Network Analytics to

Transform your Customer Service Strategy

The past year has seen the intersection between Customer Experience

Management, customer service and real-time analytics.

In addition, a vast quantity of network and service management data continues to

be under-utilised. This presentation will discuss:

• How to drive down customer support costs by leveraging experience analytics

captured on the device

• How to empower better CEM through an integrated dashboard with a unified view

into network, service and device status, service usage data, location information

and vendor statistics

12

6

success factors

Smartphone-based User-perceived QoS Tool …

Supports all

major OS

(Android &

iPhone)

Support of end-

user KPIs

Support of

3GPP and WiFi

Perform

measurement as

‘network adapter

device’

Benchmarking-

ready

Support of multi-

RAB call scenarios

1 2

3 4

5 6

User requirements

13

Smartphone Services • Web-

surfing • Youtube • Video • File UL/DL • Email • Etc.

Network – level • Whole network • Per region • Per network

element/Cell • Per ran vendor • Per chipset? • Etc.

Device - level • Best selling

smartphone devices

• Device class • Device type • Device group • Etc.

Technology- • 2G • 3G • LTE – FDD,

TDD • WiMax

Customer • All

customers • By segemnt • By tarrif • Etc.

Flexible user-cases

14

Our tools portfolio

• eNB verification & stability testing

• Handset protocol verification

• Real world data rates • Chipset stability • Etc.

• Drive test • Peak data rates • Radio latency • MIMO gains • Multi-user scheduling • Connection set-up times • QoS, IOT • VoIP • Handover behaviour and

performance

• Radio latency • E2E latency • Initial detailed assessment

of RAN integration challenges

• E2E system performance

Lab Tests Multi-user E2E Multi-Cell Live Air

Our tools portfolio

15

Application server

EPC eNB

XCAL

E2ES: E2E Network Analysis MTS XCAL-MO XCAP / Vuze XCAL / Auto XCAL-Mobile

SGi S1 UU

• LTE Network Protocol Analyser • S1, Sgi, X2 links • U-Plane and C-Plane analysis • Protocol conformance verification

• Competitive network benchmarking

• x5–20 LTE UEs

• Capacity & load testing

• Extensible platform • x50 LTE UEs

• Stand alone & enterprise-wide post-processing

• Root-cause analysis

• Reporting

• UE-trace • L1-L3, NAS,

Application layer • VoIP • KPI analysis • Voice & video

quality

• Smartphone-based UE trace

• L1-L3, NAS, Application layer

• KPI analysis • Indoor & outdoor

16

Smartphone – Need to quantify the congestion caused by Signaling & User traffic from smartphones

Automated testing – Need to test a large number of devices, service types and radio technologies to verify network performance

Test latest devices – Need to test devices being used by subscribers on your network

Benchmarking – Need to compare network and device performance across different radio technologies and service types

Effective report generation - Need to analyse and report on the large volume of drive test data captured

1

2

3

4

5

Our Understanding of Operator Challenges

17

Our Solutions

Drive Test & Post processing Tool

1 Smartphone Hand held 2 Benchmarking 3 Enterprise Solutions 4

XCAL/XCAP. • Largest number of chipsets and devices supported.

• Captures KPI, RF measurements and Protocol logs

• Advanced feature testing include CSFB and VoLTE

XCAL-Mobile • Calibrate the

performance of network services (Voice, FTP, HTTP, Multi-RAB, Web browse, facebook and YouTube).

• QoS and QoE testing on devices used in your network

XCAL-P8E, XCAL-MO • Flexible benchmarking

platforms, which support testing with 8 and 20 devices in parallel.

XCAL-MTS • Load and Stress test network

within Lab environment using 100s of devices, which are deployed in your network.

XCAL-Auto • Remote control and automation of network testing.

XCAP-Vuze • Nationwide/Worldwide database report engine utilising web interface.

• AEGIS • End-to-End network test probe.

Key Features :

Standalone measurement solution with no PC nor separate GPS receiver required

Radio parameters displayed in real time and logged in the phone internal memory.

The log files can be transferred either through the USB mass memory mode or uploaded to the FTP server through wireless (or WiFi) interface.

Auto call script feature Indoor measurement feature Band lock/Technology lock supported (not with iOS) Real time RRC L3 message decoding(not with iOS) Wireshark format packet capturing (Only Android)

XCAL-Mobile

XCAL-Mobile is a,

18

Smartphone based measurement solution Runs on Android, iOS and Symbian platforms Supports GSM/GPRS/EDGE/WCDMA/HSDPA/HSUPA/HSPA+/DC-HSDPA/LTE and WiFi measurements

XCAL-Mobile

Information provided by XCAL-Mobile

19

Radio metrics for virtually all wireless technologies Service Quality indicators : application throughput, Round trip time, Youtube buffer status, etc. Layer 3 RRC signalling message TCP/IP packet capturing using Wireshark like capturing machine

XCAL-Mobile

Use cases

20

KPI measurements using auto call scripts of FTP download/upload, HTTP web browsing, HTTP download, HTTP upload, Email, SMS, Voice, Youtube, WiFi, Ping, Multi call and Multi RAB.

Outdoor measurement while displaying locations on the map – Google map engine embedded Indoor measurement while the radio parameters displaying on the indoor map image

21

XCAL

GPS

Technology UE Chipset supported

LTE

• Samsung (FDD/TDD)

• Qualcomm (FDD/TDD)

• Sequans (TDD)

• Altair (FDD/TDD)

• LG (FDD)

• GCT (FDD)

• Docomo (FDD)

• HiSilicon (FDD/TDD),

GSM

WCMA

HSPA

• Qualcomm

• Nokia

• Infenion

• Icera

• Datang

CDMA2000

EVDO • Qualcomm

WiMAX • Beceem, Samsung

• GCT, Sequans, Intel

Scanner PCTEL, DRT,

Anritsu, R&S

XCAP

XCAL is a typical Drive Test SW

solution which interfaces with test

terminals, GPS and Scanner. XCAL’s

differentiator from other solutions are,

• Various UE chipset support ON TIME

• Stable and easy to use

• Customisation to each customer’s

needs in the field.

XCAP is a typical post

processing & analysis SW

solution which enables the user

to perform field optimisation.

• Automatic report generating

• Easy to operate

XCAL & XCAP

22

Benchmarking Solution

XCAL XCAL-P8E XCAL-MO XCAL-MTS

Usage Field & Lab Field & Lab Field & Lab Lab

Number of Phone 4 8 20

40 (scalable)

Technology supported

GSM/WCDMA/HSPA/

WiMAX/LTE/EVDO

GSM/WCDMA/HSPA/ WiMAX/LTE/EVDO



Dimension (mm) Laptop 280 x 36 x 222, 1.85Kg

257x147x363, 7.5Kg

565 x 250 x 600, 23.5kg

Power supply Laptop 20V DC, 100W (max)

48V DC, 500W (Max)

110-240 VAC, 1400W (max)

Special Feature • Smartphone Voice MOS (PESQ and POLQA) measurement • Video Quality measurement • Battery Test

• Benchmark service types, devices and radio technology performance across competing operators.

• Perform network Load and Stress Testing with scalable solutions

23

XCAL-Auto

Server

Smartphones

Mobile network

Administrator

Reports RF

parameters and

Status in real time

Sends Auto call

scripts and

commands

XCAL-Auto Solution

XCAL-Auto is a,

Automated and Remote field measurement system operated via Web interface Android Smartphone is used as remote measurement device

Smartphone Testing

XCAP – Post Processing

ANALYSIS

REPORTING

DATA

Configuration Benefits

• Technology independent and first to market for new technologies

• Provide detailed reports on service-specific and overall network performance

• Benchmark radio and application level metrics

• Build and present KPI reports across the enterprise

• Analyse trends and perform complex statistical analysis

• Robust data management system for managing and mining massive volumes of data quickly and easily

24

XCAP-Vuze – Enterprise-class, server-based post-processing

LOCAL SERVER CENTRAL SERVER

DATA

WEB SERVER USER PC

LOCAL INTRA NETWORKCENTRE

SCANNER

OWNNETWORK

COMPETITIVEVENDOR

NETWORK

GPS

ANALYSIS

Configuration Benefits

• Delivers a common view of network performance across the enterprise (marketing, customer service, operations, maintenance and radio access network etc.)

• Shares data among engineers easily, as a large quantity of measurement data is uploaded into one central server

• Consistent and accurate reporting of asset performance

• Manages area-specific data logically and efficiently (by team, cluster, region or country-wide)

• Powerful trending analysis - by network type (2g, 3g, LTE) and/or region; binning-based KPI and statistics

25

26

Architecture for XCAP-Vuze.

XCAP-Vuze Enterprise Solution

Setup Time

1. CS Fall Back Analysis Feature for LTE voice service (1/3)

CSFB is a process defined by 3GPP to deliver voice service for the LTE enabled smartphones. CSFB means Circuit Switched Fall Back from LTE to 2G/3G. The typical signalling procedure of CSFB is illustrated below.

XCAP have an one button CSFB performance report.

XCAP New Features

27

Type Coverage Message Name Contents

UL EPS MM LTE Extended service request ServiceType: 0 (mobile originating CS fallback or 1xCS fallback)

UL-CCCH LTE rrcConnectionRequest/Setup/Complete

establishmentCause mo-Data

DL-DCCH LTE rrcConnectionRelease WCDMA SIB1,2,3,45,7,11 in LTE rrcConnRel. for PCI 345, 346

DL BCCH:BCH WCDMA MIB/SIB1/SIB1,3,3,7,11 in 3G WCDMA SIB1,2,3,45,7,11 in 3G coverage

UL CCCH WCDMA rrcConnectionRequest/Setup/Complete

establishmentCause originatingConversationalCall

UL DCCH WCDMA initialDirectTransfer CM SERVICE REQUEST

UL DCCH WCDMA initialDirectTransfer ROUTING AREA UPDATE REQUEST

UL DCCH WCDMA uplinkDirectTransfer SETUP

DL DCCH WCDMA downlinkDirectTransfer CALL PROCEEDING

DL DCCH WCDMA downlinkDirectTransfer GMM INFORMATION

DL/UL DCCH WCDMA downlink/uplinkDirectTransfer ROUTING AREA UPDATE ACCEPT/Complete

DL/UL DCCH WCDMA radioBearerSetup/Complete

DL DCCH WCDMA downlinkDirectTransfer ALERTING

DL DCCH WCDMA signalingConnectionRelease cn-DomainIdentity ps-domain

DL DCCH WCDMA downlinkDirectTransfer CONNECT

The KPI for CSFB XCAP provides CSFB success rates Setup time for CSFB 3G SIBs in LTE indicator Setup time for CSFB in LTE

coverage Setup time for CSFB in

3G/2G coverage


Typical example of CSFB analysis feature in XCAP

XCAP New Features

28


Typical example of CSFB analysis feature in XCAP

XCAP New Features

29

2. RB MAP Analysis Feature

30

XCAP now have Resource Block MAP analysis feature for each LTE UE to analyse the eNB RB scheduler performance. This feature is provided by default

XCAP New Features

VoLTE and VoIP Measurement

31

Thorough performance analysis of VoLTE & VoIP What is possible

• Voice Quality/MOS (PESQ/POLQA)

• SIP protocol based analysis : setup related performance

• RTP/RTCP protocol based analysis : throughput, jitter, delay, packet loss, etc.

• KPI reports – drop, setup failure, etc.

• LTE Metrics, RRC/NAS protocol messages in parallel

LTE

TCP/IP

SIP RTP/RTCP

Codec

TCP/IP

SIP RTP/RTCP

Codec

VoLTE and VoIP Solutions


32

Either SIP client (PC) or Smartphone based VoIP/VoLTE Configuration

• Any Network device can be used, i.e. LTE dongle, 3G Dongle, WiFi, Fixed LAN, etc.

• VoIP (SIP) Client already embedded in XCAL

LTE

LTE dongle

SIP Server

LTE

IMS Server

XCAL

XCAL

With VoIP

Client embedded

Smartphone

With VoLTE

embedded

• Smartphone with VoLTE (or VoIP client) can be used.

• Qualcomm chipset based smartphone only


http://kr.srd.yahoo.com/_ylt=A3ehCpCL6cFOayYAq1W8FfZ6/SIG=13qrec3cg/EXP=1321359883/**http:/www.urbanjunkie.co.uk/shopimages/products/extras/Wifi Gaming Dongle 11g 350.jpg


33

Voice Quality assessment : audio AND packet metrics How it works

• Measure actual voice quality based on audio sample captured through the audio cable

• PESQ/POLQA algorigthm

• Full reference based

• VoIP/VoLTE performance measurement based on packet performance

• Jitter, packet loss, delay analysis based on RTCP protocol analysiis



34

Metrics Available Metrics

• Packet Loss : The number of lost packets.

• RTP Throughput

• Delay : Interval between received RTP packets

• Delta Delay : Average Trend of dynamic change of Delay of RTP Packet

• Jitter Delay : Jitter on Packet Delay

• One Way Delay : Time Delay from Sender part to Receiver Part

• RTP Packet Count : Total Packet count received.

• Round Trip Time : Round Trip Time of sender packet

• R-Factor : An Audio Quality based on VoIP (VoLTE) Packet.

• MOS mapped based on R-Factor : Conversion Value of R-Factor on General PESQ MOS Mapping Table.


Aegis – e2e network performance analysis

Configuration Uses & Benefits

35

Use Aegis to: • Monitor e2e network performance

for LTE network • Perform synchronised analysis of

the air interface, core and IP network e.g. to highlight where data packets were lost and find a reason and solution

• Reduce the cost of managing trouble tickets

• Improve throughput • Localise network problems

geographically Benefits

• Scalable platform, versatile and

flexible • Minimises OPEX • Reduces the need for drive testing

AEGIS is a,

36

eNB MME SGW PGW Internet Mobile

S1-MME S6a HSGW Etc...S10S11 S1-U SgiX2 S6b S13 Gx Sp Rx SGSN

IMSI

TMSI

IP

Real Time

Real time End to End protocol monitoring solution (Uu, X2, S1-MME, S11, S10, S6a + S1-U , S13) Real time data packet performance monitoring solution (S1-U, SGi) Supports LTE EUTRAN and Core network nodes. Also support 3G protocols for LTE to 3G mobility monitoring Post Processing and analysis software included (E2ES analyser) which can load both UE trace log files and EUTRAN/Core

network trace data at the same time.

AEGIS Overview

UE C-plane data

UE U-plane data

S1-MME data

S1-U data

Core network C-Plane data

Core network U-Plane data (user data packets)

AEGIS Components

37

AEGIS Overview

AEGIS Real time Monitoring Client SW Communicates with AEGIS HW to bring trace data using TCP/IP communication.

AEGIS E2ES Analyzer Post processing and analysis SW. It can load UE trace data and EUTRAN/Core network trace data at the same time.

AEGIS Server Connects to the probe tapping device or mirroring port through a switch. Also, provides tracing data to AEGIS Real time Monitoring Client SW connected to it.

MME real time monitor

eNB real time monitor

38

AEGIS- End-To-End Network Test 6

eNB

MME

P-GW PDNeNB

eNB

MMEeNB PCRFHSS EIR

S-GW

AAA

SGSN HSGW

SgiS5/S8

X2S11

S6bS13 GxGxc

Sp

Swx

S1-MME

S1-U

S6aS10

Port Mirroring

LTE EPS or EPC Switch

Line Tapping or

S1-MME X2AP S11 S10 S1-U Sgi etc..(Diameter)

Interface Capture

LTE Packet LTE Core

LTE Call Procedure

Data Service

Processing Packet Trace and Viewer

Call Detail Record

S1_Call_CDR

S11_Call_CDR

S10_Call_CDR

S1-U_Call_CDR

Sgi_Call_CDR

Processing

• Monitor end-to-end network performance for a LTE network.

• Perform synchronised analysis of the air interface, core and IP network e.g. to highlight

where data packets were lost and find a reason and solution.

• Localise network problems geographically.

AEGIS Server and AEGIS Monitoring Client

39

AEGIS Test Configuration

AEGIS Server

AEGIS Monitoring Client Provides user interface

TCP/IP either through Physical link TAP from each node, or from the mirroring port of LTE EPS/ EPC Switch.

AEGIS System Architecture

40

Traffic

Signal Interface Data Interface

Filter Traffic

EPC Diameter Other Network Data

Call Procedure Analysis Data Call Procedure Analysis

Basic Statistic

Raw Data

Data CDR Signal CDR

Distribute DBMS

Monitoring Summary Analysis Summary Statistics Summary

GUI & Management Analyzer

AEGIS System Architecture

2012

Devices

• Iphone 4

• Iphone 4S

• HTC Desire

• HTC Sensation

• HTC Velocity LTE

• Samsung S1

• Samsung S2

• Samsung S2 LTE

Android

• RF Parameters

• Background Operation

• Full RF/L3 parameters

• IP Packet Capture

• Call Types

• Email

• FTP

• HTTP

• Ping

• SMS

• Voice

• Web Browse

• YouTube

• Multi RAB

• Wi-Fi

Android

•MOS (NB POLQA) application

running on device

Windows Mobile 8

• Similar level of implementation

as Android

Blackberry

• Similar level of

implementation as Android

2011/12

Smartphone Product Roadmap 2012

3Q 4Q

Android

•YouTube metrics displayed in

XCAL-Replay and XCAP

• XCAL-Replay re-design

Nokia Symbian

• Replay on the Device

Other

• Battery Test vs Application

Android (Continued)

• Auto-call Test Sequence

• Outdoor Indoor Mapping

• Band Lock

• Radio Technology Lock

• PDP Context Test

• XCAL-Auto support

iPhone

• Basic RF Parameters


• Call Types

• FTP

• Voice

• Web Browse

• Multi RAB

Nokia Symbian


• Full RF/L3 parameters

• Call Types

• Email

• FTP

• SMS

• Voice

• Web Browse

Documents

XCAL Mobile Sales_Russia_ PPT v1 3