Upload
others
View
0
Download
0
Embed Size (px)
Citation preview
Quality Of Experience (QOE) for next generation video network
By Weerapong Tocharoen
TRINERGY INSTRUMENT CO.,LTD.
What are the industry challenges?
Confidential 2
Human operator doing manual visual inspection. Too many channels/programs. Tradition Quality of Service(QOS) Monitoring provide complex metrics. Not focus on Viewer impact issues.
TRINERGY INSTRUMENT CO.,LTD.
1. measure the frustration/satisfaction level of your TV viewer.
2. Easy to understand score – 0 to 100. 3. The QOE score should derived from:
i. Where the defects? ii. Area size? iii. Frequency?
4. Analyzes not only QOS but also the raw video and audio.
What is Quality of Experience?
3 Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
What is Quality of Service? Transport Metrics IP, RTP, MPEG Transport Statistics IP Arrival Interval, IP Delay Factor, Partial datagrams and Invalid Packets. PCR Jitter Transport Stream Synchronization loss Sync byte error Continuity count error Transport error PCR error PCR repetition error PCR discontinuity indicator error Etc.
TRINERGY INSTRUMENT CO.,LTD.
5
Monitor Viewer Reported Errors – Poor QoE
Top Video Error*
Operators
Macroblocking 89.5% Blackout 88.4% Freeze 84.2% Audio Silence 52.6%
Measure of the likelihood that viewer complains, changes channel, churns Viewers do not bother about QOS problems like bitrate, sync byte, Transport error, etc.
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
Sentry model
6
-ASI model – 4 ASI ports – 852Mbps(MPEG2) - 500Mbps(MPEG4) -IP model – 1 or 3Gbps(MPEG2) - 500Mbps(MPEG4) - 250 TS inputs -Optical model -T2,S2 model
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
7
What Sentry do? 1. Alert video and audio impairments that
affect viewer satisfaction.
2.Maintain and improve video quality and
viewer experience.
3.Constant health check on your contents.
4.Reduce un-necessary field technical
support.
5.Automated program availability.
6.Automated reports and charts. TRINERGY INSTRUMENT CO.,LTD.
8
Local Content
Degradation can occur everywhere!
SDI Splice
Encrypt Modulate
MPTS
Encode/ Transcode
Multiplex
SPTS
Content Acquisition
RF
IP
ASI Trans-
mission
VOD Pumps
VOD Ingest
IP/ASI
? ? ? ? ?
Source to Edge
Cable
Satellite
Terrestrial
IPTV
Source Quality Impairments
Encoding / Transcoding / Multiplexing Impairments
Network / Transmission Impairments
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
9
Local Content
Source to Edge Content Monitoring & Diagnostics
SDI Splice
Encrypt Modulate
IP MPTS
Encode/ Transcode
Multiplex
IP SPTS
Content Acquisition
RF
IP
ASI IP Core
VOD Pumps
VOD Ingest
Incoming VOD Asset QC – Tek Cerify
Monitor for IP&TS Errors –
Sentry-Verify
Monitor multiplex output for Video &
Audio QoE plus problem root cause –
Sentry
Monitor encoding performance for
Video & Audio QoE plus problem root
cause – Sentry
Monitor decoded baseband video –
Tek Waveform Monitors
Validate network element performance – Tek MTS4000 and Sentry RF, IP and
MPEG Monitor and Analysers
Monitor ingested content for Video &
Audio QoE plus problem root cause –
Sentry
IP/ASI
Cable
Satellite
Terrestrial
IPTV
Copyright © 2004-12 Tektronix, Inc.
QAM RF Edge– Sentry-EdgeII
TRINERGY INSTRUMENT CO.,LTD.
10
Simultaneously, All the time, 24x7x365days
Improve and Maintain Service Availability
Round Robin(Non-simultaneous)
Sentry Simultaneous Analysis
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
Sentry Different Layers of Analysis
11 Copyright © 2004-12 Tektronix, Inc.
QOS
TRINERGY INSTRUMENT CO.,LTD.
12
PES layer Deep dive analysis
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
Deeper & wider=accuracy=time/money/space savings
13
Pay attention to technical details: Deep (Sub-Picture layer) content analysis provides more accurate
information than those which only look at the blue shaded area Analyze everything (QOE & QOS) at in real time
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
14
QoE Reason Codes Reflects what the TV viewer experience
Drop in Confidence
Plain/Simple English Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
15 15
Monitor Additional Program Details
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
16 16
Monitor Program Statistics Generate system performance report automatically. save as a template schedule by hourly, daily, week, and monthly
Export the following data across all programs on a Sentry to a CSV file
– Program Availability – Video QoE – Audio QoE – Audio Volume Level – Bit rate – Discontinuities – GOP length – eMOS – Availability – Ad Cue Events – Closed Caption
Benefits: Service Level Agreement deliverables
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
Now we give you - Program Dashboard!
17 Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
18 18
Monitor Audio Monitoring
Subscriber perceived audio volume variations (against mean value and Dialnorm)
Reflects what the subscriber actually hears while watching TV - monitor audio level in weighted dB scale
Audio Silence, Levels, True Peak and Loudness ITU BS.1770
Absolute audio level alert
Mean audio level alert
Threshold based alerts on audio level issues
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
19
Monitor GOP Length Reporting
GOP length statistics (max, min, avg) – Included in Sentry Program Statistics report for compliance validation
(e.g. some STBs may not work appropriately when GOP length exceeds 45)
Copyright © 2004-12 Tektronix, Inc.
TS Header TS payload
TRINERGY INSTRUMENT CO.,LTD.
20
Alert triggered program capture-symptoms viewing
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
21 21
Seen Video error with no transmission error?
21
No Transmission Error
“Every time Sentry alerts, I know there’s a problem I need to solve now!” – Head of Operations, Large Cable Operator
Packet loss? Discontinuity? Syntax error?
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
QOE Errors & Impact Content(PayLoad) Related Issue
Reference Blockiness Missing Video Splice Syntax/Structural Errors
Blockiness – Low Bitrate coding and coarse quantization Video Splice – Result due to missing splice in encoding. Syntax Errors – Encoding/Transcoding negative effects
Transmission Related Issue
Jitter Loss
Jitter – Non uniform packets arrival cause errors Loss – Packet loss severely impacts Video
22 Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
23
Audio & video PID bit rate report
Audio & video QoE report
Audio loudness & Dialnorm report
Discontinuity event report
Transport IP statistics report
Splicing even report
Monitor Time-based troubleshooting
23 Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
Why need Perceptual Video Quality (eMOS)?
So many Encoders out in the market. Which is good? Each has its own proprietary encoding algorithm methods. Some may use inferior chipset in order to lower costs.
24
How to qualify them?
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
MPEG2/H.264 PVQ (eMOS) Example
25
Perceptual Video Quality (PVQ) Degradation Due to Compression Artifacts
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
Benchmark Encoders and Optimize Compression bitrate
26
Highest Bitrate
Lowest Bitrate
Result in Compression Artifacts
Finding the right bitrate/threshold.
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
Thumbnail Wall
Jan 2013 Sentry Release 8.0
TRINERGY INSTRUMENT CO.,LTD.
Confidential 28
Customer Satisfaction & Industry Trends TRINERGY INSTRUMENT CO.,LTD.
29 Confidential 29
No more heaps of hard-to-understand error logs
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
30 Confidential 30
Operations Management Reports & Data Analytics
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
31 31
Program Availability 1. Measure in terms of percentage. 2. Allow user define period of up to 60 days. 3. Allow user to input start and end time/date.
Benefits and use case:
- Use for SLA, Service Level Agreements measurement parameters.
- Compliance metrics - Trending and tracking purposes - Increase productivity and efficiency.
Copyright © 2004-12 Tektronix, Inc.
TRINERGY INSTRUMENT CO.,LTD.
Copyright © 2004-12 Tektronix, Inc. 32
TRINERGY INSTRUMENT CO.,LTD.