43
ITU WORKSHOP ON PERFORMANCE, QOS AND QOE FOR MULTIMEDIA SERVICES ASSESSMENT OF FIXED AND MOBILE BROADBAND QUALITY USING CROWDSOURCING AND EMBEDDED SOLUTIONS VINÍCIUS CARAM 04/09/2018 Istanbul - Turkey

ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

ITU WORKSHOP ON PERFORMANCE, QOS AND QOE FOR MULTIMEDIA SERVICES

ASSESSMENT OF FIXED AND MOBILE BROADBAND QUALITY USING

CROWDSOURCING AND EMBEDDED SOLUTIONS

VINÍCIUS CARAM

04/09/2018

Istanbul - Turkey

Page 2: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

Zettabyte = 1KEB = 1 Sextillion Bytes

1,000,000,000,000,000,000,000 bytes

Page 3: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

WHAT WE WANT?

• QUALITY ASSURANCE

• OPERATOR: DRIVE + PROBE + CDR + COUNTERS +

CROWDSOURCING + ….+ RANKING + USER SURVEYS

• REGULATORY BODY – GOVERNMENT :

MONITORING, SUPERVISION, PUBLICATION, METHODS

• PROVIDER: SOLUTIONS + EQUIPMENTS + REPORTS +

BENCH

• QoS + End-to-End QoS + QoE ( Survey)

Page 4: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

QUALITY

Page 5: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

QoS – QoE – Big Data – Cognitive Algorythm – Prediction Model

RATIONAL

EMOTIONAL

ESSENTIAL

FUNCTIONAL

VOICE

DATA

- SUBJECTIVE ASPECTS: RESEARCH - EXPECTATION - PERCEPTION - EXPERIENCE

- OBJECTIVE ASPECTS: NETWORK - KPI - KQI

- HYBRID MODELS - PREDICTIONS - PROFILE - PRICE - EDUCATION - INCOMING

ALIKE

DISTINCT AT SOME LEVEL

DISTINCT

DISTINCT IN ASPECTS OF PRICE FORMATION

Page 6: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

USERS’S PANEL (WISH LIST)

Page 7: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

PREVIOUS DISCUSSIONS

• INDICATORS CONTROLLED BY GOVERNMENT

• AUTORRELULATION x DISREGULATION

• RESPONSIBLE REGULATION

• REGULATORY QUALITY

• ACTIVITIES DRIVE BY COMPETITION

• QoS X QoE X User surveys

• 5G-M2M-IoT? Cyber-Security

Page 8: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

REGULATORY EVOLUTION I) Resolution nº 272, 9 agosto 2001

• Appropriate signal • Availability • Claims • Attendance

II. Resolution nº 574, 28 outubro 2011 • Objective technical indicators • End-to-End User Terminal Indicators at EAQ • Standardization • Methodology • Uniformity • Enforcement

III. RQUAL (Public Consultation 2017 – 2018 ) • Closer to user experience • Dissemination of measures - multi-players • By municipalities (proposal)

Page 9: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL
Page 10: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

CURRENT MONITORING – ACTION PLAN

Page 11: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

CURRENT MONITORING THE EVOLUTION OF THE ACCESS NETWORK – MOBILE NETWORK

Page 12: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

GIPAQ

Page 13: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

PROBES

Page 14: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

RESULTS PUBLICATION

Page 15: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

RESULTS PUBLICATION

Page 16: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

PERU – FREE RESULTS - 2018 TUTELA X OPENSIGNAL X SPEEDTEST

Page 17: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

Histórico Metodológico

Indicadores: SCM5 e SMP11 Indicadores: SCM4, SCM6,

SCM7, SCM8, SCM9 e SMP10

(1) Erro máximo desejado: diferença entre a média/proporção amostral e a verdadeira

média/ proporção populacional Fonte: EAQ – Plano amostral para SCM e SMP

Revisão Estatística

Page 18: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

SAMPLE - STATISTIC

SAMPLE STAGE 1 STAGE 2

Nível de confiança (Z) 1,645 1,960

Proporção da medida (p) 95% 86,8%

(HISTORICAL)

Erro máximo (e) 6,8997% 7,00%

Distribuição geográfica

da amostra

Distribuição proporcional mandatória na mesorregião

Distribuição proporcional mandatória na mesorregião

Page 19: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

Parâmetros da

Amostragem STAGE 1 STAGE 2

Ponto de corte para

definição de população

infinita por célula

(Prestadora/UF)

540 810

Amostra mínima

(Número mínimo de

coletores contribuindo, pós

regra de descarte)

População infinita: 27 coletores

População finita: Indicadores não são medidos

População infinita: 90 coletores

População finita: Mensurar no mínimo 10% dos clientes (definição arbitrária)

SAMPLE - STATISTIC

Page 20: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

NEW MODEL

• DO NOT NEED VOLUNTEER;

• NO NEED FOR ADDITIONAL EQUIPMENT -

PROBE REDUCES COSTS – MAINTENANCE

• STATISTICAL VALIDITY GREATER PERCEPTION

OF USER EXPERIENCE SINGLE METHODOLOGY

• ADEQUATE RANKING

• OFFICIAL OPENING FOR MISCELLANEOUS

COMPANIES - CERTIFICATION

Page 21: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

NEW MODEL - CHALLENGES

• WHICH COMPANIES MUST BE MEASURED?

• ZERO-RATING

• HOW MANY USERS SHOULD BE MEASURED?

• HOW MANY MEASURES? TIME OF MEASURE?

• WHAT TECHNOLOGIES? DIFFICULT?

Page 22: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

STATUS OF PROJECT

Page 23: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

COLLECTORS VOLUMETRY- FIXED

Page 24: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

COLLECTORS VOLUMETRY- MOBILE

Page 25: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL
Page 26: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

97.144 13.082

2.469.182 2.186.066

828.262

30.436

842.276

5.128.633

ALGAR SERCOMTEL CLARO OI VIVO Porto Nextel TIM

COLETORES CADASTRADOS

108 1

724

85

1059

281 259

1595

ALGAR SERCOMTEL CLARO OI VIVO Porto Nextel TIM

QTD MUNICIPIO IDENTIFICADOS

Page 27: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

266 63 23

24.571

30.027

47.420

6.579

359

ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM

COLETORES CADASTRADOS

33 2 1 135

2337

151 122 2

ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM

QTD MUNICIPIO CADASTRADOS

Page 28: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

APP - STATISTICS

Page 29: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

SPEED TEST - STATISTICS

Page 30: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

FIXED – CPEs NUMBERS

Page 31: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

MOBILE – SMARTPHONE NUMBERS

Page 32: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

STATISTICAL VALIDITY

Page 33: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

STATISTICAL VALIDITY

Page 34: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

NEW MODEL - GIPAQ

Page 35: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

CERTIFICATION - HOMOLOGATION

Page 36: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

PROCEDURE - FLOW

Page 37: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

MINIMUM PARAMETERS FOR CERTIFICATION

Page 38: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

MINIMUM PARAMETERS FOR CERTIFICATION – real results

Page 39: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

PROCEDURE - FLOW

Page 40: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

WEB DASHBOARD https://portaleaq.abrtelecom.com.br/eaq/

Page 41: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

COLLECTORS ESTIMATION- SMP

Page 42: ITU WORKSHOP ON PERFORMANCE, Q S AND QOE FOR … · QoS – QoE – Big Data ... ALGAR CABO TELECOM SERCOMTEL CLARO OI VIVO SKY TIM 33 2 1 135 2337 151 122 2 ALGAR CABO TELECOM SERCOMTEL

MUNICIPALITY RESULTS

USER

COMPETITION

SECTOR