View
109
Download
2
Category
Preview:
DESCRIPTION
HEVC
Citation preview
Agenda
• What is HEVC?
• HEVC comparison with AVC
• Benefits and challenges of HEVC
1080i content with HEVC
What is the optimal architecture ?
• HEVC new market opportunities
Extending HD video delivery
• Market timeline
• Envivio’s approach
• VOD demo: 1080p30 at 3.0Mbps
2
1993 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013
MPEG-1 Part 2(Video-CD)
H.262/MPEG-2 Part 2(DVD Video, Blu-ray, Digital Video
Broadcasting, SVCD)
1990
H.261(Visio-conf)
H.263(Visio-conf)
MPEG-4 Part 2(Video on Internet )
H.264/MPEG-4 Part 10(DVD Video, Blu-ray, Digital Video
Broadcasting, SVCD)x 2
H.265/HEVC(DVD Video, Blu-ray, Digital Video
Broadcasting, SVCD)x 2
• High Efficiency Video Codec, aka H.265
• Jointly developed by ISO/IEC MPEG and ITU-T VCEG group (JCT-VC)
• Primary goal: 50% better compression than H.264
• Resolutions up to 8,192 x 4320 (8K)
• 2013, January: ITU-T H.265, ISO/IEC 23008-2
• Royalties pending
• Next Scalable HEVC
HEVC-3D
HEVC | What is it?
3
HEVC comparison with AVC
• Classical hybrid video coding scheme
• Some features from H.264/MPEG-4 AVC
• High level syntax
• Multiple references
• Flexible GOP structure
• Weighted prediction
• Quantization
• Binary arithmetic coding engine
• Many new features
HEVC comparison with AVC
• CU is either inter or intra
• CU divided into PU
• Predefined set of partitions
• Square only in intra
Functionality H.264/MPEG-4 AVC HEVC
Block partitioning Square, symmetric Square, symmetric,
asymmetric
HEVC comparison with AVC
Functionality H.264/MPEG-4 AVC HEVC
Intra prediction 9 modes 35 modes
Intra mode prediction 1 MPM 3 MPMs
17
16
15
14
13
12
11
10
9 8
7 6
5 4
3 2
18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34
0 : Intra_Planar
1 : Intra_DC
HEVC comparison with AVC
7
HEVC AVC
Intra prediction 33 modes
Prediction depending on PU size
8 modes
Motion prediction Based on multiple candidate vectors
Motion merge mode
Improved skip mode
Based on 1 vector
Inter prediction Blocks up to 64x64
Based on DCT interpolation (DCT-IF)
Blocks up to 16x16
Bilinear interpolation
Transform and
quantization
TU from 4x4 to 32x32
Better integer transform
Quantization at CU level depending on CU size
4x4 and 8x8
Entropy coding CABAC only CABAC + CAVLC
Loop filters Deblocking filter
Adaptive loop filter
Sample adaptive offset
Deblocking filter
Interlaced modes Progressive tools only Interlaced and progressive tools
HEVC | Technical Challenges
• No interlaced support as in AVC
• HEVC increases encoding complexity Requires more horsepower (2 to 3 times more)
No encoding chipsets available, SW is the only solution
• Players Hardware: STB chipsets in development not mature yet
Software: Decoders developed for PC, tablets and smartphones
− 720p30 decoding on tablets
8
HEVC | Process 1080i content with HEVC?
• HEVC designed for progressive material encoding • All targeted displays are progressive
• Broadcast world still massively using interlaced video content • Legacy SD contents
• 15 years of 1080i contents (still counting)
• H.264/MPEG-4 AVC
• Picture Adaptive Frame Field (PAFF)
• Macroblock Adaptive Frame Field (MBAFF)
• Concerns about efficiency of HEVC on interlaced material?
• Syntax is available • Field or Frame coding signaling possible through VUI/SEI
− Signaling constrained to Coded Video Sequence (CVS)
− Adaptive Frame/Field switching possible on IDR only using SEI
− SEI message not mandatory for decoder conformance
HEVC | Interlacing in HEVC
HEVC Field Coding
Interlaced source Interlaced encoded frame
Separate fields Interlace
Fields Encoded fields
HEVC Frame Coding
Interlaced source Interlaced encoded frame
Interlaced source Interlaced encoded frame
Separate fields Interlace
Fields Encoded fields
Encoded interlaced frame Interlaced frame
GOP Decision
Field/Frame?
HEVC Frame Coding
HEVC Field Coding
Frame only coding
Field only coding
Sequence adaptive field frame coding (SAFF)
- Reference:
AVC
- Sequences set:
progressive
HEVC frame
~Bit rate savings* (YUV) -34%
HEVC | Interlacing in HEVC
*sources: JCTVC-K0250, JCTVC-K0331
- Reference:
AVC with PAFF+MBAFF
- Sequences set:
interlaced
HEVC frame
HEVC field
HEVC SAFF
~Bit rate savings* (YUV) -3% -29% -33%
- Reference:
AVC with PAFF+MBAFF
- Sequences set:
interlaced
HEVC field
~Bit rate savings* (YUV) -29%
HEVC | Interlacing in HEVC
• HEVC is handling efficiently interlaced video contents
• Field coding is satisfactory
• Additional gain is possible with SAFF, provided − A good frame field switching decision at the encoder
− A decoder compliant with SAFF SEI message
• Creation of the Interlace AhG
• 103th MPEG meeting, January 2013
• No evidence showing additional interlace coding tools are
needed
Files
SDI
ASI
A/V
Extract
Video
Analysis Processing Codecs WrapDASH, HLS,
HDS, HSS…
SPTS over IP
RTP,…
OTT
FilesRC Targets VBV info
StatMux
AllocatorMultiplexer MPTS
Complexities
HEVC | Encoding Architecture
• Requirements
• Implement existing and new codec
• Consider pre-processing depending on use cases − field splitting, de-interlacing, inverse telecine
− Multiple resolutions (Mobile)
• And also appropriate inputs and outputs
HEVC | Encoding Architecture
• Software solution
• Easy reconfiguration
• 1 to N (Mobile)
• 1 to 1 (4k HEVC)
• N to N (Broadcast)
• Easy hardware upgrade • Abstraction to platform (OS)
• Easy software upgrade
• Benefits from HEVC encoding technology performance
progression
OS
SW
… HW …
HEVC | Extending HD video delivery
• New broadcast networks
• Terrestrial (DVB-T2) − 40 Mbps
• Satellite (DVB-S2)
• 30 to 60 % bandwidth increase
• Current demand
• Extension of HDTV channels
• New demand
• 4K/UHD announced
• TV displays starting to be available
• 4K/UHD contents already produced for a few years (TV series)
• HEVC particularly efficient on very high resolutions.
• 51 to 74% reported subjective gains
4K HD SD
HEVC | Extending HD video delivery
• Telecom access network (telco)
• 100Mbps for 4G (from 3Mbps for 3G)
• Demand
• Unicast video delivery − Bandwidth divided by users number
• New generation of mobile terminals − Smartphone and tablets
− Supporting HDTV or even higher resolution
• Expected growth for mobile video in the coming years: 75%
• Telcos are already under pressure
• HEVC allows encoding 720p for small screens at 1 Mbps
HEVC | Target Client Devices
• First targets PCs, tablets and
smartphones Yearly updates
Software decoders
Decoding chipsets will be ready in 2013
• HEVC decoding in consumer
devices
18
0
500
1000
1500
2000
2500
3000
3500
4000
4500
5000
2011 2012 2013 2014 2015 2016
Insta
lled
ba
se
in
mill
ion
s
Smartphones
Tablets
Set Top boxes
Digital TV sets
Devices HEVC decode capable (Source MRG)
HEVC | Market Timeline
19
H1 2013 H2 2013 H1 2014 H2 2014 H1 2015 H2 2015
HEVC encoding
4K VOD
HEVC encoding
4K Live
HEVC encoding
HD 1080p
FIFA World cup
4K broadcast
(Japan)
HEVC standard
validation
First HEVC
Decoders
(1080p)
First HEVC
deployments
for OTT (VOD then Live)
HEVC
Lab trials
First commercial
services in 4K
HEVC | Benefits
• Telcos Same quality at lower bitrate
Increase IPTV eligibility
HD over 4G networks
− Bring HD to nomad viewers
• OTT cut CDN costs in half
• Cable/DTT/DTH Launch 4K services
Higher resolutions within the same bandwidth
20
Envivio’s Advantages
• 4Caster G4 is built to support HEVC Future proof platform
• Early Time To Market Own software codec, designed from ground up
Unlike HW vendor, not dependent on 3rd party encoding chipsets
• HEVC is just a software update Add HEVC support to Envivio installed base
• HEVC work will help enhance H.264 and MPEG-2 performance
21
HEVC | Envivio Split-Screen Demo
22
• HEVC vs. AVC • Use case: same objective video quality
• Source video content: 1080P@30 fps
• Encodings: HEVC @ 3Mbps & AVC @ 6Mbps
• HEVC stream generated with the HM (offline encoding)
YUV
source
HEVC
encoding
HEVC
decoding
HEVC & AVC
Side by side
AVC
encoding
AVC
decoding
YUV
Recommended