Embed Size (px)
Citation preview
© E
SA
/NA
SA
Fraunhofer FOKUS
Institut für Offene Kommunikationssysteme
Interoperable Digital Rights Management in the 5G era International Copyright Technology Conference 2019
Stefan Pham, Fraunhofer FOKUS
Research budget: 2.6 billion euros, of this sum, 2.2
billion euros is generated through contract research
Around 70 percent of the Fraunhofer-Gesellschaft’s
contract research revenue is derived from contracts
with industry and from publicly financed research
projects
Around 30 percent is contributed by the German
federal and state governments in form of base
funding
The Fraunhofer-Gesellschaft
26,600 Employees
72 Institutes and
research units
Month Day, 2019 | Institute Presentation 2019 2
The FOKUS team
© M
ichael Z
ale
wski/ F
raunhofe
r F
OK
US
from
29 countries
including
108 women
around
430 employees
Computer
Sciences,
Electrical
Engineering,
Mathematics,
Engineering, as
well as Humanities
around
160
students and
interns
Month Day, 2019 | Institute Presentation 2019 3
Consulting and research, prototyping and proof-of-
concept implementations, test environments and
project evaluation in these areas:
Video-streaming and interactive 360° video
Digital Rights Management and media
synchronisation
Smart TV, hbbTV, multiscreen
Media tracking and audience measurement
Future Applications and Media – FAME
© M
atth
ias H
eyde/ F
raunhofe
r FO
KU
S
FAME supports the digital transformation of media
businesses and brands regarding content
development, secure transmission and correct
rendering on the consumer‘s side.
Month Day, 2019 | Institute Presentation 2019 4
© 2018 Akamai | Confidential 5
Cricket in India - record 18.6M concurrent streams May 2019
© 2018 Akamai | Confidential 6
What was achieved
• A world record of 18.6 Mil Peak concurrency for a single event.
• 97% of the user accessed the stream over a Mobile device.
• 91% of the user were on cellular network (3G/LTE).
• The stream was made available on 10 different platforms (Desktop, iOS, Android, Chromecast, FireTV, AppleTV, Roku, Android TV, JioLyf Phones, LG WebOS)
• We did 7.5 Tbps+ on IPv6 which is the largest Akamai peak on IPv6.
• Over 25 teams and 70+ people contributed to make this event happen for 6 months
© 3GPP 2019
Media Web Symposium 2019 May 2019 7
5G Core Technologies
Orchestration and Virtualization (NFV) – de-couple logical function from hardware
Slicing – logical end-2-end networks tailored to customer needs
Mobile Edge Computing (MEC) – resources where they are needed (especially for URLLC)
API Exposure – 3rd party access to 5G services
Service Based Architecture (SBA) – stateless, open, flexible
Harmonized Protocols & Access Agnostic – generic solutions with integrated support for fixed networking , 5G satellite access, …
5G Media Streaming
New Media (Virtual Reality, Extended Reality, …)
Specific ‘vertical industry support’: Broadcasting, Mission Critical Communications, Vehicle to Everything, Industrial Automation, Future Railway Mobile Communication System, …
© 3GPP 2019
Media Web Symposium 2019 May 2019 8
Next Steps
3GPP SA4 just approved TS26.501 on 5G Media Streaming architecture • Includes downling and uplink streaming
• Includes similar client decomposition as CTA WAVE and DASH-IF/dash.js
• Includes initial set of collaboration scenarios
3GPP SA4 also approved stage 3 work item to work on detailed requirements and interfaces. Among others, it says
• The work should consider existing work from external specifications and industry organizations such as DASH-IF, MPEG and CTA WAVE as well as input from key industry players on their requirements and usage scenarios for media streaming over 5G.
Expected Completion by end of 2019 with more work in Rel-17
1. AR/VR/360° Mobile Edge
Computing (MEC)
2. Link Prediction
3. Unicast vs. Multicast
5G Use Cases @ FAME
| 28.05.2019 | 5G 9
Measurement of link quality on a pre-defined track
Handover scenarios
Stationary vs. moving clients
Massive mobile scaling (e.g. Cricket 18m viewers)
eMBMS/QUIC for broadcasting media
Unicast traffic shaping QoE/metrics (3GPP
SAND)
AR/VR/360° content manipulation & stitching
High-resolution 360° / VR streaming
Real-time data for AR
Ultra Low latency streaming standards (DASH)
#1 - AR/VR/360° Mobile Edge Computing (MEC)
40Mbit (4k)
40Mbit (4k)
40Mbit (4k)
MEC Rendering
Processing on client
Only playback on clients
360° full equirect video
Default case:
5G optimised case:
metrics
360° full equirect video
| 28.05.2019 | 5G 10
Partners: DT, BASF,
Hyper360
# 2 – 5G Link Prediction
| 28.05.2019 | 5G 11
Mobile media distribution (e.g. high speed train)
Predict the link quality on a train
(based on historical data, cell data)
Handover scenarios
Analysis of neighboring cells
Number of terminals connected to a cell
Optimize media distribution based on this data for
VoD / Live (low-latency)
AR/VR/360° content
Cloud Gaming
Partner: Intel
# 3 – Unicast vs. Multicast
| 28.05.2019 | 5G 12
Content distribution in train stations / large sports
events (stationary, high density)
Addressing the challenge of large numbers of
users accessing content simultaneously
Massive mobile scaling
Maintaining QoE
Optimize overall bitrate/bandwidth allocation
Network / mobile cell (even 5G) is the bottle neck
Take advantage of 5G/SDN network
features:
traffic shaping, e.g. using MPEG SAND
Multicast, e.g. using QUIC
• DASH – Dynamic Adaptive Streaming over HTTP for live and on demand video; MPEG standard
• SAND – Server and network assisted DASH to enable interoperable metrics and client coordination
• HLS – HTTP Live Streaming for live and on demand video by Apple
• CMAF – Common Media Application Format for HLS and DASH
• CENC – Common Encryption for many DRM & delivery channels
• MSE – Media Source Extension to trick-function HTML5 video-objects via JavaScript (control AV media streams)
• EME – Encrypted Media Extension to play back DRM-protected media in standard browsers w/o the use of proprietary plug-ins
• CDM – Content Decryption Module - addition to the browser that provides functionality for one or more Key Systems
• CPIX – Content Protection Information Exchange Format - standardizes the way entities involved in the content creation workflow exchange protection information
• VMAF – Video Multi-Method Assessment Fusion- perceptual video quality assessment algorithm by Netflix
Delivering Media: Tech to understand
• Standard for streaming multimedia over the Internet
• Dynamic Adaptive Streaming over HTTP (DASH) - ISO/IEC 23009
• Part 1: Media presentation description and segment formats
• Part 2: Conformance and reference software
• Part 3: Implementation guidelines
• Part 4: Segment encryption and authentication
• Part 5: Server and network assisted DASH (SAND)
• Part 6: DASH with Server Push and Web Sockets
• Extensions for common DRM-interoperable encryption and encoding (CENC)
• DASH-IF Interoperability Guidelines
• Different profiles: DVB, HbbTV 1.5/2.0, ATSC 3.0 etc.
MPEG-DASH
MPEG-DASH File Format
File Type
('ftyp') Movie Metadata ('moov')
Movie Header ('mvhd')
Track ('trak')
Movie Extends ('mvex')
Movie Extends Header ('mehd')
Track Extends ('trex')
Movie Fragment ('moof')
Movie Fragm. Header (’mfhd’)
Track Fragme
nt (’traf’)
Media Data
('mdat')
ISO base media file format
(ISOBMFF)
Codec-agnostic Init segment Media segment(s)
Draft: IETF RFC 8216, HTTP Live Streaming 2nd Edition
Mainly used for iPhone, iPad, Mac, AppleTV
New Features:
• HEVC support
• CENC (‘cbcs’) and f-MP4 / CMAF support
• FairPlay / offline playback
• IMSC1 subtitles
Apple HTTP Live Streaming (HLS)
• Common encryption means the same video can be decrypted and decoded by devices
using different DRMs (e.g. Microsoft PlayReady, Google Widevine, Apple FairPlay)
• ISO/IEC 23007-1 (3rd edition) – Common encryption in ISO based media file format files
• Protection schemes: ’cenc’, ’cbc1’, ‘cens’, ‘cbcs’
• ‘cens’ and ‘cbcs’ are pattern encryption schemes
• DRM industry is converging towards ‘cbcs’
Common Encryption (CENC)
CENC
Header
Media File
Body
Key Generator
Audio Video Other
Scra
mb
ler
Content Asset
Management
System
Encrypted media data uses the Advanced
Encryption Standard specified by AES using
128-bit keys in Counter mode (AES-CTR) or
Block cipher mode (AES-CBC)
• Efficient distribution in the CDN; „Package once“ promise
• ISOBMFF-based adaptive media packaging format for HLS and DASH
• CMAF Chunks for low latency encode, delivery and playback
• Defines encoding of segmented media for delivery and decoding on device
• Published in 01/2018 as ISO/IEC 23000-19
• Two brands: ‚cmfc‘ and ‚cmf2‘ (CMAF second edition – currently in Draft)
• ‚cmf2‘ is a full superset of ‚cmfc‘
Common Media Application Format (CMAF)
• ISO/IEC 23000-19 does not specify manifest, player or delivery protocol
HLS manifest : M3U8
DASH manifest: MPD
• HLS
• fMP4 (CMAF) stream compatible with macOS v10.12 or later, iOS 10 or later, and tvOS 10 or
later
• DASH
• CMAF is compatible with DASH+ISOBMFF CTA WAVE, DVB-DASH, DASH-IF profiles
Source:
https://developer.apple.com/documentation/avfoundation/media_assets_playback_and_editing/about_the_common_media_application_format_with_http_live_streaming
CMAF + DASH/HLS
CMAF + DRM
With CMAF segments, HLS and DASH manifests will reference the same file format
‘cenc’ will be needed for legacy devices. Updates to PlayReady and Widevine will
enable ‘cbcs’ support for ”true” common encryption
Streaming File Format Encryption DRM
DASH ISOBMFF (CMAF) ‘cenc’ PlayReady PK<4.0,
Widevine
DASH ISOBMFF (CMAF)
‘cbcs’ PlayReady PK>4.0,
>Android N, Chromecast
Streaming File Format Encryption DRM
HLS MPEG2TS Sample-AES (AES-CBC) FairPlay
HLS ISOBMFF (CMAF) ‘cbcs’ FairPlay
Cross-Platform Deployment
Codec Support in Desktop & Mobile Browsers
Browser Platform AVC/H.264 HEVC/H.265 VP9 AV1
Chrome Win 👍 O 👍 (👍)
OSX 👍 O 👍 (👍)
Android 👍 O 👍 O
Firefox Win 👍 O 👍 (👍)
OSX 👍 O 👍 (👍)
Safari >= OSX High Sierra 👍 👍 O O
< OSX High Sierra 👍 O O O
iOS >= 11 👍 👍 O O
iOS < 11 👍 O O O
Edge Win 10 👍 👍 👍 (👍)
Mapping EME robustness levels to security levels
W3C EME Level PlayReady FairPlay Widevine
1 SL2000 N/A SW_SECURE_CRYPTO (L3)
2 SL2000 N/A SW_SECURE_DECODE (L3)
3 SL2000 N/A HW_SECURE_CRYPTO (L2)
4 SL2000 N/A HW_SECURE_DECODE (L1)
5 SL3000 N/A HW_SECURE_ALL (L1)
DRM Support in Web Browsers
Desktop Browser Platform EME/CDM Security Level
Chrome Windows/MacOS/Linux Widevine L3 (software)
Android Widevine L1 (hardware) / L3
Firefox Windows/MacOS/Linux Widevine L3 (software)
Safari > macOS 10.10.3 (Yosemite) Fairplay undefined
< macOS 10.10.3 (Fairplay) -
iOS FairPlay undefined
IE/Edge < Win 7 - -
Win 10 PlayReady SL3000 (depends on chipset)
Codecs & DRM Support on Native Mobile
OS Version DRM Security Level AVC/H.264 HEVC/H.265 VP9 AV1
iOS iOS 11 or
later
Fairplay undefined 👍 👍 O
O
<iOS11 Fairplay undefined 👍 O O O
Android Android 10 Widevine L1-L3 ; depends on
manufacturer
👍
👍
👍 👍
Android
5.0+
Widevine L1-L3 ; depends on
manufacturer
👍 👍
👍
O
Android
4.4+
Widevine L1-L3 ; depends on
manufacturer
👍 O 👍 O
<Android
4.4
- - 👍 O O O
https://developer.samsung.com/tv/develop/specifications/general-specifications
http://webostv.developer.lge.com/discover/specifications/supported-media-formats/
https://developer.amazon.com/docs/fire-tv/device-specifications.html#media-specifications
https://developers.google.com/cast/docs/media
https://exoplayer.dev/drm.html
Codecs & DRM Support on TV
Device Version DRM Security Level AVC/H.264 HEVC/H.265 VP9 AV1
Samsung 2018/2019 Playready,
Widevine
unspecified 👍 👍 👍
O
LG 2018/2019 Playready,
Widevine
unspecified 👍 👍 👍 O
Fire TV 4K 2018 PlayReady,
Widevine
unspecified,
L1/L3 👍 👍 👍 O
Apple TV 4K FairPlay undefined 👍 👍 O O
Chromecast Ultra Playready,
Widevine
SL2000,
L1 👍 👍 👍 O
Android TV * Widevine,
PlayReady
L1,
SL2000 👍 👍 👍 O
Smart TVs often support Type 1 playback besides Type 3
Supported Codecs, DRM and SecurityLevels can vary (depending on TV model and playback type)
27
THANK YOU!
Stefan Pham Senior Project Manager Future Applications and Media
Fraunhofer FOKUS
Berlin, Germany
