Streaming and Broadcasting Services for Mobile Handsets

Mobile Device Developments 2004 Sep 3, 20031

Mobile Device Developments 2004London , UK, September 2-3, 2004

Jukka Helin MediaLab (www.medialab.sonera.fi)

Streaming and Broadcasting Services for Mobile Handsets


• TeliaSonera in brief

• Streaming service forecasts

• Technology

• Mobile video quality today

• Mobile video services

• Mobile video services at TeliaSonera

• Enablers for video services

• Summary

Outline


TeliaSonera in brief

• Merger between Telia and Sonera: Jan 1, 2003

• Leading telecommunications group in the Nordic and Baltic countries

• Largest mobile operator in Sweden and Finland, 2nd

largest in Norway, 3rd largest in Denmark

• Operates under the Sonera brand in Finland and the Telia brand in Sweden

• Headquarters in Stockholm

• Revenues 9.0 billion EUR and 26,694 employees in 2003


1) Owner share x Associated company’s total mobile subscriptions = Proportional. 2) Increased ownership from 57% to 74% in Mar 2003. 3) Increased ownership from 55% to 90% in Dec 2003.

Mobile – Proportional1 number of customers: 20.32 million (Dec 31, 2003)

SwedenSubs: 3,838,000Annual growth: 6%Owner share: 100%

FinlandSubs: 2,428,000Annual growth: -2%Owner share: 100%

NorwaySubs: 1,195,000Annual growth: 10%Owner share: 100%

LithuaniaSubs: 947,000Annual growth: 24%

(103%3)Owner share: 90%

LatviaSubs: 322,000Annual growth: 19%Owner share: 60%

DenmarkSubs: 525,000Annual growth: 13%Owner share: 100%

EstoniaSubs: 234,200Annual growth: 12%Owner share: 49%

GeorgiaSubs: 189,000Annual growth: 54%Owner share: 62%

MoldaviaSubs: 130,200Annual growth: 33%

(73%2)Owner share: 74%

TurkeySubs: 7,087,000Annual growth: 22%Owner share: 37%

AzerbaijanSubs: 346,600Annual growth: 36%Owner share: 38%

KazakhstanSubs: 374,200Annual growth: 60%Owner share: 38%

RussiaSubs: 2,705,000Annual growth: 104%Owner share: 44%


TeliaSonera Finland’s MediaLab

• An R&D unit focusing on mobile and broadband multimedia technologies and service development

• Belongs to TeliaSonera’s Products and Services unit• Main focus areas:

– Mobile and broadband audio/video services– Mobile broadcasting (DVB-H)– Digital rights management– Mobile/broadband gaming services– Content search technologies

• Main partners: RealNetworks, Nokia, Microsoft, Tampere Univ. of Technology, RTT, Tekes

• More info: www.medialab.sonera.fi

Buy rights?




• Technology





• Summary

Outline


Operators’ plans for streaming services

Source: Forrester Research, June 2003.


Source: Nokia, June 2004: Global mobile service revenues.

Other(advertising, transactions,…)

P2Pmessaging

Business data services

Voice

Data and messaging

2003Total EUR 400 billion

2008Total EUR 635 billion

87%

13%

2%11%

71%

5%

11%

Voice

Infotainment

Video- Video MMS- Video conf.- Video mail

Video- Adult entertainment- Sports clips- News clips- Music videos- Live events

Video- Video ads- Promotional content (movie trailers, musicvideos )

Video- Monitoring- Training

Global mobile service revenues 2003-2008


Mobile video service revenues in Western Europe 2003-2007

00.5

11.5

22.5

33.5

4

2003 2004 2005 2006 2007

Videomessaging

Information

Entertainment

Videotelephony

Source: Yankee Group, 2004

Billion EUR




• Technology





• Summary

Outline


Streaming, broadcasting, datacasting,…Broadcasting Point-to-multipoint transmission by wireless means for

general receptionDatacasting Broadcasting data, typically streams or files (filecasting)Streaming Technique for transferring data such that it can be

processed as a steady and continuous streamUnicasting point-to-point streaming (live or on-demand content)Multicasting point-to-multipoint streaming (live content)Webcasting live streaming over InternetDownloading Transferring data such that it cannot be processed until

it has been completety received


On-demand contentLive content

Content repeat

Viewing delay

Delivery method

Protocol/transport

Delivery methods for mobile phones today

Max content length

Content quality

Stored in memory

Downloading

Yes

No

While stored in memory

Viewing starts afterdownload complete

http (TCP)

Phone memory size

Good(limited by download time)

Yes

Streaming

Yes

Must be re-streamed

Few seconds

Yes

RTP (UDP)

Infinite

Limited by the network bandwidth

No

Pre-downloading

Yes

No

Phone memory size

Good(limited by download time)

YesWhile stored

in memoryNone

(when downloaded)

Server Web/FTP server Streaming serverWeb/FTP server

http (TCP)

Off-line viewing No NoYes


Search music bybrowsing

Listen bystreaming

Pay and download

Don’t want to buy

Found?Ok tobuy

• A video service can use many technologies• Example: the world’s 1st mobile music service, DoCoMo M-stage Music

- Music search, streaming (at 32 kbps for samples), download full high-qualitysongs, view CD covers, lyrics etc.

- Uses 64 kbps PHS network- 21 music companies, including Warner Music Japan and music.co.jp Inc.- Monthly charge 200 ¥, 100–350 ¥ /song (1 € ~ 115 ¥)

Streaming with downloading


Demo: pre-downloaded video content


Mobile video components and interoperability

• Basic components for mobile video:

– encoder– server– player

• For interoperability, standard codecs, file formats and protocols must be used

• Both proprietary and 3GPP compliant codecs, file formats and protocols exist

Encoders Players

Servers

ProtocolsFile formats

Cod

ecs

Source: rtsp.org.


Streaming file formats and codecs

Windows Media Audio

Windowd Media Video 8

.wmv, .wmaWinwows Media

MPEG-4 Visuals, Sorenson Video

RealVideo 8

MPEG-4 Visual Simple Profile, H.263

MPEG-4 Visuals, H.264*

Video Codecs

AAC, AMR

RealAudio

AMR, AAC

AAC

Audio Codecs

.mov, .qt

.rm, .ra

.3gp

.mp4

File Extension

QuickTime

RealMedia

3GPP

MPEG-4

File Format

* H.264 codec is known also as MPEG-4 AVC.


MPEG-4 mobile licencing

Permanent*: 90 minutes or more $.025,31 to 89 minutes $.015, 30 minutes or less $.005Temporary**: $.0025 per title

$0.25/unit, annual cap $2.5M

$0.25/unit, annual cap $2.5M

H.264 (MPEG-4 AVC.) Annual initial fee of $15000 for enterprises with revenues above $2M.

$0.25/subscriber or $0.000333/min, first 50000 subscribers free, annual cap $1M

$0.25/unit, first 50000 units free, annual cap $1M

$0.25/unit, first 50000 units free, annual cap $1M

MPEG-4 Visual Mobile Video

Content feeDecoderEncoder

FeesCodec

* Permanent" means the end user can use the content or end-user product for more than 20 decodes and/or morethan 30 days after the first use.

** Temporary" means that the end user can use the content or end-user product for no more than 20 decodes and/or no more than 30 days after the first use.


RTP

IP

Payload formatshttp

Note:Video, audio and speech must be streamed over UDP protocol (TCP or http cannot be used).

Video: ITU-T H2.63 (req.),MPEG-4 simple

visual profile (opt.)

Speech: AMR (req.)

Audio: MPEG-4 AAC-LC (opt.)

UDP UDPTCP

RTSP

Scene description: SMIL 2.0

Presentation descriptionStill images

Bitmap graphics: GIF, JPEGVector graphicsText: XHTML

Presentation Description

Packet Switched Streaming (PSS)3GPP’s first streaming standard (3GPP Rel4, Mar, 2001)


Mobile streaming roadmap (3GPP PSS)

H1/01 H2/01 H1/02 H2/02 H1/03 H2/03 H1/04 H2/04 2005 2006-07

PSS Rel5- device capability exchange

PSS Rel4- basic framework

Partially Rel4 compliant players, encoders and servers

Rel4 players, encoders and servers

Rel5 players, encoders and servers

3GPP specification freeze date

PSS Rel6- end-to-end bitrateadaptation

- new codecs: H.264- DRM


Mobile broadcasting

• Today mobile streaming is a unicasting service -> not suitable for heavy mass communications (broadcasting)

• Two promising technologies exist:• DVB-H (Digital Video Broadcasting, Handheld)

– Specified by ETSI as an extension to DVB-T– DVB-T based single-frequence network, 5-12 mbps– Needs back-channel, e.g. GPRS for interaction– First terminal introduced: Nokia 7700

• MBMS (Multimedia Broadcast/Multicast Service)– to be specified in 3GPP Rel6 (Jan 2005)– Uses existing EDGE/UMTS infrastructure, 64-384 kbps


Mobile broadcasting roadmap

H1/04 H2/04 H1/05 H2/05 H1/06 H2/06 H1/07 H2/07 2008 2009-10

MBMS Rel6- first definitions

DVB-H- ETSI standardization completed

DVB-H pilot phasesCommercial DVB-H capable players and servers

MBMS Rel6 capability in playersand servers, pre-phases

3GPP specification freeze date


Mobile streaming technology providers

Nokia, Siemens, Sony-Ericsson

Sony-Ericsson

Samsung, HTC, Motorola

---Phone vendor partners

Bitrate adaptation, Helix: open source

Bitrate adaptation

Included in Windows server

Darwin: open source

Other

Symbian, PPC Phone Ed.

Smartphone OS, Symbian

Smartphone OS, PPC Phone Ed., Windows Mobile Second Ed.

---Player platforms

RA, AMR, AACAMR, AACWMAAMR, AACStreaming audioRV, MPEG-4, H.263

MPEG-4, H.263

WMVMPEG-4, H.263

Streaming video

PVPlayer

PVAuthor

Unix

PVServer

PacketVideo

RealOne Mobile, Helix DNA client

Mobile Windows Media Player

---Player

Windows Media Encoder

Windows

Windows Media Server

Microsoft

RealProducer

Unix, Windows

RealSystem Mobile

RealNetworks

QT Broadcast, QT Pro

OS X, Unix

QTSS, Darwin

Apple

Encoder

Server platform

Server

Provider


Authoring-On-demand encoding

Optionalstreamingserver/proxy

Liveencoders

Webservers

UDP

Live sources

Generic mobile streaming platform

SMIL,text,

graphics

Streamingplayers

Mobilecore

audiovideo

GGSN

InternetGPRS/EDGE

W-CDMA

httpMobilecore

SGSN

DVB-Haudiovideo

Streaming multicastingserver/proxy

audiovideo

Back-channel

Streaming servers


TeliaSonera’s streaming platform

FOR RELEASE

TeliaSonera Selects RealNetworks’ Helix Mobile Solutions as Platform of Choice to Deliver Multimedia Content to Mobile Subscribers

RealNetworks Powers TeliaSonera Audio and Video Streamingfor GPRS and 3G Networks

London, UK – January 26, 2004 – RealNetworks®, Inc. (NASDAQ: RNWK), the leading creator of digital media services and software, and TeliaSonera (NASDAQ: TLSN), the leading telecommunications group in the Nordic and Baltic regions, today announced that TeliaSonera has selected RealNetworks’ Helix™ mobile platform to power streaming delivery of audio and video content to GPRS and 3G network mobile subscribers in Finland and Sweden.


Sisältö

Ecosystem of mobile (video) services

• Device has any use alone

• Only when all four parts work together, can we have successful services

• The quality of a service is determined by the weakest part in the ecosystem

Verkko

Sovellukset

LaitteetDevices LaitteetNetwork

LaitteetContentLaitteetApplications


Requirements for good streaming handsets

• High-resolution screen, >64K colors• Loadspeaker and stereo audio output for

headphones• Enough processing power for decoding• 3G network interface for ~100 kbps video quality

(later DVB-H and/or MBMS support) • Support for multiple APNs and/or multiple contexts

(for separating streaming and WAP traffic)• Open SDKs to enable depelopment of various

applications and embedding the player• Player support for horizontal/landscape full-

screen viewing modes• Support for standards (3GPP PSS)


Streaming requirements for networks

• EDGE or W-CDMA bearer (GPRS ok for piloting)

• QoS (priorization and/or streaming class) especially in EDGE networks

• Enough capacity (both radio and transmission)• Traffic differentiation support (for billing,

reporting, etc.)• Scalable streaming server/proxy platform• Later: Multicast support (DVB-H and/or

MBMS)




• Technology





• Summary

Outline


Mobile Internet Edge

Series60 testerclient

Core network

GGSN

SGSN/3G-SGSN

Streaming Testerserver

Internet

Future: W-CDMAtester client

GSM BSS

Streaming tester architecture

PC streamingtester client

Log converter

UTRAN

Traffic log


• Usability problems: operators may use separate GPRS access points (APNs) for wap and streaming traffic

• QoS problems on-the-move (cell changes often cause packet loss)

• Future: content adaptation problems between GPRS, EDGE and UMTS networks

Streaming problems today

Cell changeA 23 min trip in a bus at 0-80 km/h using operator X’s network


50 kbps100 kbps

64 / 128 kbps

W-CDMA

50 kbps*

Varies

EDGE

18 kbps (2 time slots)27 kbps (3 time slots)

Typically CS-2

GPRS

Encoding recommendation

Channel coding / bearer

Network

Encoding recommendations

* Initial recommendation.


Demo: video quality




• Technology





• Summary

Outline


Schedule for video services

2003 2004 2005 2006

Investments for GPRS operators

Video MMSVideo clipdownloads Video streaming over

GPRS/EDGE/W-CDMA

Videocalls

No investments needed

Streaming deliveryplatform needed

Currently circuit switched 3G network needed

Video broadcastingover DVB-H/

MBMS

DVB-H/MBMSnetwork needed


• Person-to-person (P2P) video MMS is the easiest business case• No extra servers needed• In TeliaSonera Finland’s network the current MMS size limitation is 100 kB,

which limits the video length to about 15 sec• Some recorders for Symbian/Series 60 phones: Hantro, Philips, Emuzed,

Packetvideo• Possibility to build extra services such as video archives• E.g. TeliaSonera’s video MMS service (in Finland: 0.39 EUR/MMS

regardless of the content)

MMS

(Record) and send

Receive, store and playback

Video MMS

camera phone withvideo recorder software

3GPP compliant video player


• News and weather, movie trailers, cartoons - all non-real time content• Business models are basically the same as with ringing tones and logos• Video service can be accessed via SMS or WAP• Some players: RealOne Mobile, Mobile Windows Media Player,

Packetvideo PVPlayer, Hantro• E.g. TeliaSonera’s Olympic Games highlights service

Download &

playback

Content server

WAP GW / MMS

WAP/SMS

Video clip download

Phone with videoplayer software


• All on-demand content• All live content e.g. traffic cameras or TV broadcasts• Live streaming: currently no multicast support• Needs a network with enough bandwidth and capacity• Some streaming players: RealOne Mobile, Mobile Windows Media Player,

Packetvideo PVPlayer• Existing Internet streaming platforms can be used for piloting streaming

video services over GPRS• E.g. TeliaSonera’s live streaming for CNN International

Streaming server

WAP

Streaming & instant

playback

Video streaming

Phone with streamingvideo player software


• Both persons need special camera phones• Camera points to the same side as the screen: face-to-face call• Camera points to the opposite side of the screen: ”you-see-what-I-see”• Needs a low-latency (circuit-switched) network with quaranteed

bitrate ~64 kbps • Call cannot be switched from 3G GPRS (normal video streaming can

work ok in dual mode networks)• Possibillity to build extra services such as video conferencing• E.g. DoCoMo video call, Hi3G MoVi

Camera phone

Video calls

Circuitswitchednetwork


• All live content, multicasted to users via DVB-H or MBMS network• DVB-H test network available in Helsinki area• TeliaSonera, Nokia, Digita, Elisa, YLE, Nelonen and MTV will start a

pilot at Q1/2005 with 500 consumers• Currently the only announced mobile terminal: Nokia 7700 (uses

RealPlayer for streaming)

Video broadcasting

streamingserver

Back channel

IP datacast & instant playback

DVB-H media phonewith streaming video player software Broadcast channel 1, 2, 3, ...


Finpilot: video broadcasting trial

FOR RELEASE

Q1/2005


DVB-H video content service

Contentprovider

DVB-Hserviceoperator

DVB-Hnetworkoperator

Mobilenetworkoperator

Mobileserviceoperator

broadcast(11 mbps)

back channel(SMS/GPRS)

content streams,files

requests,rights, payments

DRMservice

operator

contentIDs

requests,rights

Streaming and download (proxy) servers

Microbilling

Content service


Demo: video service over DVB-H




• Technology





• Summary

Outline


• The Sonera brand used in Finland and the Telia brand in Sweden

• WAP portals: Sonera Plaza and Telia Go

• Colour screen required for new services

• Mobile content comes from 3rd parties

• In Finland content comes also from the Sonera Plaza Internet portal

Mobile services at TeliaSonera


Mobile video services at TeliaSonera (Aug 2004)

• In Finland:– Video MMS– Video on Sonera Plaza WAP portal: sports, entertainment,

music, ”Ellit” women channel– CNN International live– Toto Radio: daily live audio broadcast from trotting race– Sony StreamMan music audio service (needs subscription)– Sonera mLive hosting service for companies– No content fees for streaming, only data transmission charged

• In Sweden:– Video MMS– News clip download service– Position based wheater forecast by Foreca– Pre and post game interviews from Swedish premier football– Events, e.g. 20 clips daily + live TV from the Olympics (free)– M-USE music audio service– Pay-per-clip with zero-charged traffic

• Most services can be used with Series 60, Series 45 and UIQ devices

• Clips encoded at GPRS/EDGE/UMTS data rates


wap.sonera.net

Video services

Music videos

Play

Music video services at Sonera Plaza

Encoding: 3 fps used for video sharpness.


Video service statistics (Jan-Aug, 2004)

• On-demand entertainment– Content at Sonera Plaza WAP portal– Streams available at GPRS and

EDGE qualities (18 and 50 kbps)– 3 min 46 sec avg view time

• Live news streaming– Content at Sonera Plaza WAP portal– Stream available at GPRS and

EDGE qualities (18 and 50 kbps)– 4 min 9 sec avg view time


Packet fees---Video (streamed)

Packet fees0.66 EUR/searchLocatorPacket fees4.00 - 4.95 EURGames (java & Symbian)Packet fees0 - 20 EURApplications (java & Symbian)

Packet fees---News (Sonera client app.)---------Transmission fee

1.21 EUR0.95 EUR0.39 EURContent fee

Polyphonic ring tonesMono ring tonesMMSService

18.30 EUR/MB (< 100 MB) +1.749 EUR/MB (> 100 MB)

9.99 EUR/MB (< 20 MB) +2.374 EUR/MB (> 20 MB)

5.99 EUR/MBMonthly charge

8.21 EUR

8.21 EUR---Opening

Pro Data

Active DataFun DataPacket fees

Content and packet fees at Sonera Plaza


TeliaSonera Finland’s content revenue sharing model

3rd party content partner sitesConsumers

Open Internet

Sonera PlazaWAP portal

- GPRS traffic fee- Content fees

- ring tones: ~1 EUR- games: 4-7 EUR- Series 60 applications: 0-20 EUR- video streaming: 0 EUR- etc.

New content services:content fee - 20% commission for Sonera

No fee

NOTE:Content charge: currently only transaction basedTransmission charge: 100 MB/month included in the basic subscription fee 18,30 EUR/monthContent provider pays commission for the link on Sonera’s wap menu and micro-billing




• Technology





• Summary

Outline


Enabler: content based billing

Rate 1 zerorate

Rate 2 Content Portal

Streaming server

Service URL

WAP, HTTP

Streaming

wap.sonera.net/helpdeskAny

Rate

Zero rate

Rate 1Any Any Rate 2

charging filter

Intelligent GGSN

Charging Server

Log events

TransactionsData volume events

Billing system

Internet


Content based billing: regulation problem

ContentProvider

ServiceOperator

NetworkOperator End-User

Traffic fee (bits/month) and transaction fees

% transaction fees

% traffic fee(regulated)

In Finland Viestintävirasto regulates the traffic fees. Network Operator must sell the bandwidth (bits) with same price for all Service Operators.Currently, e.g. wap bandwidth must be sold with the same price as streaming bandwidth.


• Protects content owner rights and enables controlled access to content

• Enables P2P superdistribution of content

• Requirements:– Easy to use (buy content using 1 or 2 clicks)– Flexible usage rules (preview, time based, full, etc.)– A single system preferred (DRM standard)

• OMA DRM R1 (for “thin” content) released in Sep 2002

• OMA DRM R2 (for premium content such as music and videos) to be released in H2/2004

Enabler: mobile digital rights management (DRM)

In order to play you need to buy rights. Want to?

This video clip costs 1 EUR. Purchase?




• Technology





• Summary

Outline


Summary

• For GPRS video, use the technology that suits best: streaming, downloading or scheduled downloading

• Video over GPRS is not a business but rather a piloting environment and market maker for 3G services

• W-CDMA enables high-quality streamed audio and music services

• DVB-H and MBMS are promising technologies for mobile broadcasting for 2006-2008

• For video services to succeed good terminals are not enough, we need also networks, applications and content

• TeliaSonera has launched many mobile video services

• Operators offering flexible content enabling services (streaming, DRM, billing, reporting, etc.) to content, application and service providers can accelerate the market

• Video services need enablers like DRM and content based billing


Documents

Streaming and Broadcasting Services for Mobile Handsets