Embed Size (px)
Citation preview
MPEG Workshop
Media Tech. R&D Center
Dr. Jongmin Lee (Center Leader)
Next Generation Media Services and Technologies
• The time will soon come when everyone can create, deliver and consume video data everywhere based on 5G network infra
• Mobile video service is now rapidly evolvingMain keyword: 4K/8K UHD, AR/VR, 3-D, N-screen
• Many SKT’s multi-media services are developed / developing based on MPEG technologies and systems HEVC, AVC, MMT, etc.
Media Service Trend
Media Service Trend
Video Traffic
Daily averageT Byte
Global Mobile Live Broadcasting Traffic forecast, Cisco 2016
`16 `17 `18 `19 `20 `21
□ Video Traffic
□ Audio, Web, etc. Traffic
All these devices increase mobile video traffic !
• Mobile video traffic is rapidly increasing
Media Service Trend
*Ref. from STRABASE (2014.12)
4.5
7.5
Cord-cutting ratio in US.
’14
$ Million
1,926 2,587 3069
41495136
6345
7801
South Korea Media Market
$ Billion
179
554
Global Online Media Market
Media Devices (%), *Ref. from StatCounter (2016.10)
’12 ’14
’14
’20
’20’15 ’16 ’17 ’18 ’19
□ Desktop
□ Smart phone / Tablets
’14
• Mobile Media Market Trend
Media Service Trend
Source: Mary Meeker, Internet Trends 2016
SKT’s Media Services
• Fixed IPTV ( ), Mobile IPTV ( ), 360 VR VoD / Live, etc
8K UHD IPTV Trial (`15.10),4K IPTV Commercialization (`14.4)
AdaptiveOksusu VR Streaming Service(`16.10)
UHD Multi-View (`16.9)
Oksusu Mobile IPTVCommercialization (`17.10)
AI Voice Recognizer / Speaker 360 VR Real-time
Streaming
SKT’s Global Working
• Developing the next-generation TV platform for the U.S market• Various MPEG technologies were adopted into ATSC 3.0, especially, HEVC,
DASH, and MMT.
• Highly contributed to the MPEG, MMT standard activity.
• Hybrid media delivery is the core function leads an enhanced UX of media consumption.
• Adopted the various MPEG technologies in SKT’s media services• HEVC, and MMT (including mobile MMT) were integrated in ‘Oksusu’
• Leads the MPEG project with global companies for preparing the 5G media infrastructures.
SK’s Media Integrated Platform and Services for 5G Network
Architecture for SK’s Media Services
• SK’s Media Service Delivery System is configured as ①Create & Casting, ②Encoding & Value Add, ③Delivery & Publish with live and VoD types
Live Player
LiveController
MediaDeliveryIndicator
StreamingOrigin/Edge
CacheOrigin/Edge
UploadController
Storage
Encoding &Meta Mgmt.
MediaProcess
Scheduleer
Cast & Upload
Mgr
Cameras
Media Files
Live Up
Streaming
File Upload File Upload VoD Pull
Live Relay
streaming
Live Relay
Streaming
MediaPlatform
API
Live Streaming
Download &
VoD Streaming
Create & Casting [Source] Encoding & Value Add [Head end] Deliver & Publish [CDN- 서초/일산/분당 IDC]
DVR &
Transcode
FileLive &
Ads. Mux
VoD PlayerControl MessageControl Message
Live 서비스
VoD서비스
Baseband
Signal (EPG)
Live
Services
VoD
Services
T-MIP: SKT – Media Integrated Platform
Orchestrator
Me
dia
P
roce
ssin
g
Infr
a L
aye
r
Me
dia
D
eliv
ery
Infr
a L
aye
r
Media Services
AP
I
La
ye
r
SubscriberMgmt.
Billing &Auth.
Media Service Management API
Media Platform Open API & SDK
vCache vStreamer MLR
Media Deliver Indicator
Infrastructure Abstraction
Media ServiceApp.
Container
Resoure Alloc. App Distributer Multi Commander App Repo.
Media vInfra Management API
Policy
Flo
w M
gr.
Ops.
Tool
Sta
tist
ics
Repository Processor
Open H/W (Head End/IDC/AWS)
HDR/SRStreamSwitch/
Time Shift
360 AR/VR
Live/VoDEncode/Trans.
Smart URLIndicator
BroadcastProgramming
DRM
Analytics
One time URLgenerator
Processing PublisherSecurity & Analysis
ChattingInjector
Ads. Mgmt.& Injector
Device/RegionDetector
Value added
UpScaler
Cast Mgr
Cast URLIndicator
Upload
IPTV
OTT
MCN
Mobile TV
AV Encoder
• Media Service Functional Architecture
T-MIP: SKT – Media Integrated Platform
• Architectural Model for Media Service Entity Attachment
MDL(Media Delivery Layer)
MPL(Media Processing Layer)
MAL(Media API Layer)
MO
L(M
edia
Orc
hest
rato
r La
yer)
Media Services & Applications(B2B services and B2C services)
MP reference point
MD reference point
Media Resources(Fixed/mobile network + Cloud infra[e.g., AWS, Azure)
MR reference point
MA reference point
MIAL(Media Infra Abstraction Layer)
MI reference point
PO
ref
eren
ce
poin
tD
O refe
rence
poin
tIO
ref
eren
ce
poin
tAO
refe
rence
poin
t
SKT-MIP based Solutions
SKT Provides Media Services including resource and technology as Cloud Service
All Functions are provided with Open API / SDK
Interworking
Tech.
Resource
Upload ContentsManagement
Conversion Delivery
Adv.Player Statics
Mass Storage GlobalCDN
Publishing
24-HR Monitoring
Live
Server
360 VR
Open APIweb admin.tool
Doc.SDK
Broadcasting
Chatting
Cloud Service
Contract
- CDN
Purchase/Install Media system
- Storage- Transcoder- Streaming SVR- Media Solution
System Load Balancing
- Media System Interworking - Contents Mgmt.
Development/InstallMedia Services
- Actual Service based on Sample App. Or Web
ServiceOperation
System Monitoring
- 24 Hours
FlexibleOperation
Development/Install Contents Mgmt. System
Sample Service
• OVP-Online Video Platform
SKT-MIP based Solutions
HLS
SKT Live
Streaming
Chunk
(23.ts)
Chunk
(24.ts)
Chunk
(25.ts)
Chunk
(26.ts)
Chunk
(27.ts)
0 10 t20 30 40
Chunklist.m3u8
‘Waiting for up to 30s’
0 t10
Available to Stream
Available to StreamMPU (Media Processing Unit)
- Frame based Transport
Origin
Content
Source
‘Just 2s delay’
• T-Live Streaming
SKT-MIP based Solutions
Unified Elastic Cache
• Optimization for Cache Storage and Processing
High Visual Quality / Low Latency 360 VR
Streaming System
• Live Stitching supporting 4K/60fps
• 360 VR Live Broadcasting and Provide Player
• Adaptive View Port based on User Viewpoint
65% Data Compression with Adaptive View Port Tech. Cache Storage Performance Enhanced (>9 times)
Value PropositionValue Proposition
T Live Streaming
• Ultra Low Latency Guaranteed Mobile Streaming Tech.
• Latency: <3s, Sync: <0.1s, Bandwidth Saving: 10%
Latency decreases for mobile live streaming (15s→3s)
Value Proposition
Chunk #2
SD (2.ts)
4 8 12 16 20
Chunk #1
HD (1.ts)
Chunk #3
HD (3.ts)
Chunk #4
HD (4.ts)
Chunk #5
SD (5.ts)
As Is
To Be
Cloud based Personal Broadcasting Platform
• Individual Participation Possible
• Low Latency Streaming, Chatting, Ads. Insertion
Provide Personal Broadcasting Tech. supporting Low
Latency / High Visual Quality Supporting
User Position Dependent Ads. Insertion
Value Proposition
BroadcastingPlatform
Encoding, DVR, DRM, Schedule, NVoD, CMS…
LiveCasting
MCN Channel
Social Network
TutoringService
MobileIPTV
T-Live Streaming
AdInjection
Publishing Site
Seoul
Busan
SKT-MIP based Solutions
Online Video Platform
• Provide Infra and Solution with PaaS Type for Internet
Broadcasting Services
Interworking with CDN for B2B (VoD, Live) Service
Provides N-screen, Ads. Insertion, Programing, CMS
Value Proposition
Upload Contents Mgmt.Encoding Streaming
Ads.Player
Statics
Publishing Security Recording
UHD Multi-Screen Solution
• Provide one UHD screen with 4 separate FHD screens
• HEVC Tile Syntax Used
High Visual Quality and STB Resource Saving with
HEVC Tile Syntax
Value Proposition
Super Resolution (H/E Adoption)
• Video Up-scaling with AI DNN based Algorithm
• FHD to UHD at H/E with High Performance H/W
Premium 4K IPTV Services Possible for Both VoD/Real-
Time Streaming
Value Proposition
H/E HDRHigh Dynamic Range Conversion
• SDR(Standard Dynamic Range) Contents to HDR
Contents at H/E (Head End) Side
Premium HDR IPTV Services Possible for Both
VoD/Real-Time Streaming
Value Proposition
[non-HDR ] [HDR]
Network Based Media Processing
• NBMP will be the dominant technology for future media service of 5G.
SKT’s 5G Architecture
Media Source
Network-Based Media Processing
w/ 5G infra.
Media PlayerKey function : enhance the media quality using N/W resources
SK’s AR/VR Platform and Services for 5G Network
SKT’s AR / VR Platform
• is Total AR / VR Service Platform
http://developers.sktelecom.com
SKT’s AR / VR Platform
• is Total AR / VR Service Platform
SKT’s AR / VR Platform
• VR Studio. You can create and play VR contents in there
Google I/O 2017 (/w Google Daydream)
SKT’s AR / VR Platform
Game & Entertainment
Education
Marketing & Event
Collaboration
Productivity
Social Service
1. 대상 이미지 촬영 2. 콘텐츠 배치 3. AR 서비스 실행
T real AR 저작 도구 및 AR Browser
tvN Event(‘16.10)
Mobile Symphony Orchestra AR (‘15.10)
Remote ARMedical Service
(‘15.10)
EV Visualizer(‘16.3)
Education AR/VR(‘16.4)
T real AR Game (‘16.6)
AR Mobile Authoring (‘15.1)
T.um Theater(‘15.3)
AR City Demo(‘15.8)
T real TelepresenceRemote Design
(‘17.1)
Remote AssistPrototype (‘16.8)
AR Baseball GamePlay Adventure (’17.3)
T real Adventure(‘15.3)
Google I/O 2015AR Authoring (‘15.1)
Google I/O 2017Daydream VR Studio (’17.1)
T real 3D SystemUnity VR Studio(‘15.1)
• Developed Services Status
SKT’s AR / VR Services
• AR Entertainment for Baseball Game
SKT’s AR / VR Services
• 360 VR Live Trial Services (4K, Real-time)
High
Quality
SKT AR / VR Services
• 360 VR Streaming Services (BMW Driving Center)
Functional Architecture
360 Camera
(T5 Gopro x 6)
Stitching
& Encoding
TLS Streaming
(/w 5G N/W)
Player
(HMD, phone)
SKT AR / VR Services
• 360 VR Streaming Services (Korean Pro Baseball Game)
Strong Immersiveness is obtained via 360 VR Video with Multi-Cameras
Home
Camera
3rd Base
Camera1st Base
Camera
360 Video Transmission
• 360 VR Streaming Services (in Collaboration with Kia Motors@CES2018)
• Real-time Streaming via 5G Submarine Fiber-Optic Cables Between KOR-USA
SKT AR / VR Services
• 360 VR Streaming Services (CES2018)
Conclusion
• SKT is preparing 5G revolution era with innovative service platforms and solutions
• SKT is especially interested in technology for effective multi-media processing and fast delivery
• SKT is also proposing these platforms and solutions to MPEG and hoping these solutions to be popularized soon
• Flexible standardization is required for faster and effective video processing and deliveryVR targeted video compression is being standardized in MPEG
T-MIP and T-Real can be standardized
