Download pdf - VoD (Arroyo) Overview - cisco.com · © 2006 Cisco Systems, Inc. All rights reserved. 2 JKB Cisco Confidential Arroyo Now Part of Cisco Video & Content Networking BU (VCNBU) • Timeline

1© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential 1© 2006 Cisco Systems, Inc. All rights reserved.VCNBU - jkb Cisco Confidential

VoDVoD (Arroyo) Overview(Arroyo) Overview

Per Jensen, [email protected] Jensen, [email protected] 2006December 2006

2© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential

Arroyo Now Part of Cisco Video & Content Arroyo Now Part of Cisco Video & Content Networking BU (VCNBU)Networking BU (VCNBU)

•• TimelineTimeline–– 2002: Founded2002: Founded

–– 2004: Field trials2004: Field trials

–– 20052005--2006: Production deployments serving 1M streams/month2006: Production deployments serving 1M streams/month

•• Strong customer baseStrong customer base–– 11 deployments at 6 of North American top 10 11 deployments at 6 of North American top 10 MSOMSO’’ss

–– VOD and VOD and nPVRnPVR trials in other top Telco's and trials in other top Telco's and MSOMSO’’ss

•• Impressive networking heritageImpressive networking heritage–– Paul Paul ShererSherer –– CTO (former CTO of 3Com)CTO (former CTO of 3Com)

++ Originated many current Ethernet technologies/standardsOriginated many current Ethernet technologies/standards

–– Drew Major Drew Major –– Chief Scientist (author of Novell Netware)Chief Scientist (author of Novell Netware)++ Pioneered Pioneered ““networking operating systemnetworking operating system”” and and ““many as onemany as one””

++ Now a Cisco FellowNow a Cisco Fellow


Personalized EntertainmentPersonalized EntertainmentBlend of OnBlend of On--Demand and Broadcast Content DeliveryDemand and Broadcast Content Delivery

•• On Demand TV is top selling On Demand TV is top selling MSO service & table stakes for MSO service & table stakes for telco IPTV offeringtelco IPTV offering–– Driven by host of new Driven by host of new

applicationsapplications

–– Comcast delivered 1.5B streams Comcast delivered 1.5B streams in 2005in 2005

•• Broadcast TV becoming more Broadcast TV becoming more ““personalpersonal””–– New New ““BroadcastBroadcast”” applications applications

are driving this furtherare driving this further

•• Puts a host of new demands on Puts a host of new demands on the video platformthe video platform

• Real-time ingest rates

• Massive stream scale

• Flexible content distribution

• High availability

New Video Platform Demands


Typical VOD SystemTypical VOD System

Trans-codersTransTrans--coderscoders

Transport Network

Aggregation Network

Access (HFC/DSL) Network

STBSTB

End-User AppsTime Shifted TV

sVODnVOD(i)VOD


sVODnVOD(i)VOD

System AppsVideo Control

BillingSubscriber Management



Connection/Control System

Connection/Control Connection/Control SystemSystem

Billing Management System

Billing Management Billing Management SystemSystem

EncoderEncoderEncoder Asset Management System

Asset Management Asset Management SystemSystem

VOD (Streaming) VOD (Streaming) ServersServers

VOD VOD ServersServers

PitcherPitcherCatcherCatcher

Asset Distribution Asset Distribution Interface (ADI)Interface (ADI)

Forms of VODForms of VOD•• Subscription VideoSubscription Video--onon--Demand Demand

(SVOD) (SVOD) •• Free VideoFree Video--OnOn--Demand (FVOD) Demand (FVOD) •• HDTVHDTV--onon--Demand (HDVOD) Demand (HDVOD) •• NetworkNetwork--based Personal Video based Personal Video

Recording (Recording (nPVRnPVR) ) •• Public, Educational & Governmental Public, Educational & Governmental

OnOn--Demand (PEGDemand (PEG--OD) OD) •• Distance Learning (Distance Learning (EduVODEduVOD) ) •• EducationEducation--onon--Demand Demand •• Advanced Advertising Advanced Advertising •• Interactive TV (Interactive TV (iTViTV) )


Typical VOD SystemTypical VOD System

TransTrans--coderscoders

Transport Network

Aggregation Network

Access (HFC/DSL) Network

STBSTB


sVODnVOD(i)VOD



Connection/Control Connection/Control SystemSystem

Billing Management Billing Management SystemSystem

EncoderEncoder Asset Management Asset Management SystemSystem

VOD (Streaming) VOD (Streaming) ServersServers

VOD VOD ServersServers

PitcherPitcherCatcherCatcher

Asset Distribution Asset Distribution Interface (ADI)Interface (ADI)

Forms of VODForms of VOD•• Subscription VideoSubscription Video--onon--Demand Demand

(SVOD) (SVOD) •• Free VideoFree Video--OnOn--Demand (FVOD) Demand (FVOD) •• HDTVHDTV--onon--Demand (HDVOD) Demand (HDVOD) •• NetworkNetwork--based Personal Video based Personal Video

Recording (Recording (nPVRnPVR) ) •• Public, Educational & Governmental Public, Educational & Governmental

OnOn--Demand (PEGDemand (PEG--OD) OD) •• Distance Learning (Distance Learning (EduVODEduVOD) ) •• EducationEducation--onon--Demand Demand •• Advanced Advertising Advanced Advertising •• Interactive TV (Interactive TV (iTViTV) )

Arroyo Components


•• ““The network is the platformThe network is the platform””–– InternetInternet--proven approachproven approach

•• Distributed architectureDistributed architecture–– Hierarchical network storageHierarchical network storage

–– Streaming at the network edgeStreaming at the network edge

–– Multi level cacheMulti level cache

•• CCDS ElementsCCDS Elements–– VaultVault

++ Ingest & reliable storage of video (or Ingest & reliable storage of video (or other) assetsother) assets

–– StreamerStreamer

++ ““PersonalizedPersonalized”” video streamingvideo streaming

++ Pulls content from Vault on demand & Pulls content from Vault on demand & caches at network edgecaches at network edge

–– System Manager System Manager

++ Element Management SystemElement Management System

++ Single system manages all of CCDSSingle system manages all of CCDS

>95% cache hit rate!

< 300ms from ingest to

streaming!

CatcherCatcher

System System ManagerManager

StreamersStreamers

VaultsVaults

Set Top Box & EPG Set Top Box & EPG

Cisco Content Delivery System (CCDS)Cisco Content Delivery System (CCDS)Next Generation Application & Media Processing PlatformNext Generation Application & Media Processing Platform


CCDS ProductsCCDS Products

•• Content Delivery Engines (Content Delivery Engines (CDEsCDEs))–– Appliances for Vault and Streamer applicationsAppliances for Vault and Streamer applications

–– 4 types:4 types:

++ 4U SATA, 3U SCSI, 2U SATA, 1U System Manager 4U SATA, 3U SCSI, 2U SATA, 1U System Manager

–– Purchase includes base CDA licensePurchase includes base CDA license

•• Content Delivery Applications (Content Delivery Applications (CDAsCDAs))–– 1 software application per appliance1 software application per appliance

–– 4 types:4 types:

++ Vault, Streaming, SSV (mixture of vault & streaming), Vault, Streaming, SSV (mixture of vault & streaming), ““PlayPlay--OutOut”” application (e.g. application (e.g. for barker channel)for barker channel)

•• License UpgradesLicense Upgrades–– Additional S/D Stream LicensesAdditional S/D Stream Licenses

–– Stream resiliency optionStream resiliency option

–– Vault upgrade, additional hours S/DVault upgrade, additional hours S/D

–– PlayoutPlayout, NVOD, Barker application, NVOD, Barker application


Content Delivery Engine SpecificationsContent Delivery Engine Specifications

•• 4U SATA Appliance4U SATA Appliance–– For Vault & SSVFor Vault & SSV

–– Up to 12 TB of content storageUp to 12 TB of content storage++ ~6000 hours MPEG2~6000 hours MPEG2

–– 16 GB DRAM16 GB DRAM

–– ~1 Gbps simultaneous ingest~1 Gbps simultaneous ingest++ ~200 channels MPEG2~200 channels MPEG2

–– 6 Gbps output6 Gbps output++ Rapid reRapid re--mirrorsmirrors

•• 3U SCSI Appliance3U SCSI Appliance–– For Streamer & For Streamer & PlayoutPlayout

–– 1212--24 Gbps output24 Gbps output++ Up to 6000 streams MPEG2Up to 6000 streams MPEG2

–– 1.7 TB of SCSI cache1.7 TB of SCSI cache

–– 16 GB DRAM16 GB DRAM


Content Delivery Engine SpecificationsContent Delivery Engine Specifications

•• 2U SATA Appliance2U SATA Appliance–– For Vault & SSVFor Vault & SSV

–– Up to 6TB of content storageUp to 6TB of content storage++ ~6000 hours MPEG2~6000 hours MPEG2

–– ~1Gbps simultaneous ingest~1Gbps simultaneous ingest++ ~200 channels MPEG2~200 channels MPEG2

–– 6Gbps output6Gbps output++ Rapid reRapid re--mirrorsmirrors

•• 1U SCSI Appliance1U SCSI Appliance–– For Application System For Application System

ManagerManager

–– 4 GB RAM4 GB RAM

–– 4 x 73GB SCSI drives4 x 73GB SCSI drives

–– AC powerAC power


Vault Content Delivery Application (CDA)Vault Content Delivery Application (CDA)

•• Content can be ingested via an Asset Distribution Interface (ADIContent can be ingested via an Asset Distribution Interface (ADI) that includes asset data or ) that includes asset data or via FTPvia FTP

•• Content ingestion is easy Content ingestion is easy –– each asset only needs to be ingested once and can be ingested each asset only needs to be ingested once and can be ingested at any location in the server groupat any location in the server group

•• Content (video assets) are reliably stored on at least two of thContent (video assets) are reliably stored on at least two of the vault serverse vault servers

•• Configured as an array of servers for reliability & scalabilityConfigured as an array of servers for reliability & scalability

•• Arrays can be coArrays can be co--located or geographically dispersedlocated or geographically dispersed

•• Content distribution processContent distribution process–– The first time a title is requested by a subscriber it is deliveThe first time a title is requested by a subscriber it is delivered from the Vault to the Stream Array red from the Vault to the Stream Array

serving that subscriberserving that subscriber

–– At the same time it is cached so that subsequent viewings by anyAt the same time it is cached so that subsequent viewings by any subscriber serviced by that array subscriber serviced by that array are satisfied locallyare satisfied locally

–– OnDemandOnDemand handles content as a series of short segments, so the only datahandles content as a series of short segments, so the only data moved around the moved around the network are the portions actually viewednetwork are the portions actually viewed

++ Unlike other VOD solutions which waste bandwidth by transmittingUnlike other VOD solutions which waste bandwidth by transmitting entire titles even if the entire titles even if the requesting subscriber ends up only watching part of it requesting subscriber ends up only watching part of it

–– There's no need to predict what titles subscribers will watch moThere's no need to predict what titles subscribers will watch more than others and preemptively push re than others and preemptively push them to the network edgethem to the network edge

•• Trick play modes are created upon ingest Trick play modes are created upon ingest –– this means trick play resource usage is the this means trick play resource usage is the same as normal usage i.e., thousands of users could all hit Fastsame as normal usage i.e., thousands of users could all hit Fast--Forward at the same timeForward at the same time


Stream CDAStream CDA

•• Streamers respond to user requests for VOD streamsStreamers respond to user requests for VOD streams

•• Content is distributed and cached in 8 KB segmentsContent is distributed and cached in 8 KB segments–– Rather than download an entire movie when a user requests a titlRather than download an entire movie when a user requests a title, only the e, only the

segments that are needed are distributed and cachedsegments that are needed are distributed and cached

–– Streamers easily support personalized content e.g., inserting taStreamers easily support personalized content e.g., inserting targeted rgeted advertising, and playing that content out (not) under subscriberadvertising, and playing that content out (not) under subscriber controlcontrol

•• Streamers can be coStreamers can be co--located with Vault Servers or distributed to located with Vault Servers or distributed to remote locationsremote locations

•• Configured as an array of servers for reliability & scalabilityConfigured as an array of servers for reliability & scalability

•• Arrays can be coArrays can be co--located or geographically dispersedlocated or geographically dispersed

•• Load balancing is also automatic; content is replicated and streLoad balancing is also automatic; content is replicated and stream am assignments are determined based on the shared state of the arraassignments are determined based on the shared state of the arrayy


Content Delivery Management SystemContent Delivery Management System

•• The Content Delivery Management The Content Delivery Management System (CDMS) has a GUI interface System (CDMS) has a GUI interface accessible via browseraccessible via browser

•• The CMDS network functions as a The CMDS network functions as a single virtual server that is single virtual server that is extremely easy to manageextremely easy to manage

•• As servers are added they selfAs servers are added they self--configure so that storage and configure so that storage and streaming capacity are streaming capacity are automatically load balanced automatically load balanced ensuring that network resources are ensuring that network resources are always available exactly where they always available exactly where they are neededare needed

•• When a disk is added to a server or When a disk is added to a server or a server is added to the network it a server is added to the network it contributes storage and/or contributes storage and/or streaming resources to the poolstreaming resources to the pool


•• CDMS is designed to be flexible:CDMS is designed to be flexible:–– It is simple enough to manage a It is simple enough to manage a

small deployment,small deployment,

–– while also being sophisticated while also being sophisticated enough to scale to manage a large enough to scale to manage a large complex service provider networkcomplex service provider network

•• CDMS uses a workflowCDMS uses a workflow--based based approach, automating and approach, automating and centralizing the major system centralizing the major system management functions:management functions:

–– ConfigurationConfiguration

–– MonitoringMonitoring

–– TroubleshootingTroubleshooting

–– ReportingReporting

–– MaintenanceMaintenance

Content Delivery Management SystemContent Delivery Management System


Protocol Interfaces Protocol Interfaces –– TWC ExampleTWC Example

Asset Distribution Interface (ADI)Asset Distribution Interface (ADI)Asset Distribution Interface (ADI)ContentContentContent

FTPFTPFTPContentContentContent

VaultsVaultsVaults

StreamersStreamersStreamers

CCCPCCCPCCCP

Ingress formats:MPEG2

Ingress formats:Ingress formats:MPEG2MPEG2

BMSBMSBMSFile Service Interface

CORBAFile Service InterfaceFile Service Interface

CORBACORBA

LSCP (ISA)LSCP (ISA)LSCP (ISA)

MPEG-2 over IP over GigEMPEGMPEG--2 over IP over GigE2 over IP over GigE

MPEG-2 over IP over GigEAsynchronous Serial Interface (ASI)

MPEGMPEG--2 over IP over GigE2 over IP over GigEAsynchronous Serial Interface (ASI)Asynchronous Serial Interface (ASI)

CDMSCDMSCDMS

NMSNMSNMS


33rdrd Party VOD System InterfacesParty VOD System Interfaces

Partner Session Control RT Control

Openstream for SA and Mot environments

ISA CORBA LSCP

TWC ISA Environment, Mot and SA

ISA CORBA LSCP

CCOR nAble for Mot/SA ISA CORBA LSCP

NGOD ISA CORBA RTSP (Mot), LSCP (SA)

CV NPVR SSP 2.3, ISA CORBA LSCP

Myrio TotalManage RTSP RTSP

Shaw NPVR RTSP LSCP

Partner Control Transport

ISA (Openstream) CORBA FTP

nABLE XML FTP

Condo nPVR XML MPEG SPTS

NGOD NGOD A3 (XML) FTP

Myrio VOD XML FTP

Myrio nPVR XML MPEG SPTS

Verimatrix (IPTV CA/DRM) SOAP AnyIn/SambaFS

Manual ingest AIM Tape/DVD/CD

Streaming

Asset Ingest


CCDS Network Load LevelingCCDS Network Load Leveling

•• Services are distributed and loadServices are distributed and load--leveled leveled across the arrayacross the array

–– Multiple servers function as one logical Multiple servers function as one logical arrayarray

–– Services are distributed across the networkServices are distributed across the network

–– Applications can be added without Applications can be added without disruptiondisruption

–– Expand without disruption Expand without disruption –– servers once servers once configured, will broadcast their capabilities configured, will broadcast their capabilities and join the arrayand join the array

•• All functions are loadAll functions are load--leveledleveled–– IngestIngest

–– StorageStorage

–– StreamingStreaming


NonNon--disruptive, Costdisruptive, Cost--effective Scalabilityeffective Scalability

•• Adapt to your needsAdapt to your needs–– Start centralized & evolveStart centralized & evolve

–– Add adjacent markets by simply Add adjacent markets by simply adding a streameradding a streamer

–– Content from a single ingest point is Content from a single ingest point is available throughout the arrayavailable throughout the array

•• System & Bandwidth ScalingSystem & Bandwidth Scaling–– Systems optimized for unmatched Systems optimized for unmatched

performanceperformance

–– Load is distributed throughout an Load is distributed throughout an arrayarray

–– Extensible platform software Extensible platform software architecturearchitecture

•• Distributed streamingDistributed streaming–– Save $25Save $25--200/stream on aggregation 200/stream on aggregation

network bandwidth costsnetwork bandwidth costs

–– Distribute rack space useDistribute rack space use


Content Distribution AlgorithmsContent Distribution Algorithms

•• Minimize total storage cost Minimize total storage cost –– DRAM, SCSI, SATADRAM, SCSI, SATA

•• Minimize Minimize OpExOpEx –– content management, streamer disk content management, streamer disk cachecache

•• Optimize Network Utilization Optimize Network Utilization –– offer more contentoffer more content

VaultStreamer

100%1-5%


CCDS AvailabilityCCDS Availability

•• There is a There is a statefulstateful switchover in the event one of the switchover in the event one of the systems in the array goes out of service which meanssystems in the array goes out of service which means

–– Software upgrades can be performed without disruptionSoftware upgrades can be performed without disruption

–– Trickledown Trickledown –– servers can be gracefully shutdown for servers can be gracefully shutdown for upgrade by having the system stop sending new streams to upgrade by having the system stop sending new streams to that serverthat server

–– ““Stream steeringStream steering”” allows you to move the streams allows you to move the streams manually for a faster (yet still graceful) shutdown of a manually for a faster (yet still graceful) shutdown of a serverserver

•• Content is never lost Content is never lost –– there are duplicate copies in the there are duplicate copies in the array and when a server, disk, etc. is OOS the content it array and when a server, disk, etc. is OOS the content it hosted is replicated elsewhere in the array hosted is replicated elsewhere in the array

•• The level of resiliency for content and services is The level of resiliency for content and services is operator configurable i.e., operator configurable i.e.,

–– You can configure how many (backup) copies of an You can configure how many (backup) copies of an individual piece of content are stored in the arrayindividual piece of content are stored in the array

–– The number of stream and/or vault servers can be The number of stream and/or vault servers can be increased as desired for M:N redundancyincreased as desired for M:N redundancy

•• If a server loses capacity e.g., loses a network interface, If a server loses capacity e.g., loses a network interface, it dynamically informs all other servers in the array to it dynamically informs all other servers in the array to take over the streams it was serving off that interfacetake over the streams it was serving off that interface


Switchover Process for an Active Stream Switchover Process for an Active Stream Following a Streamer SwitchoverFollowing a Streamer Switchover

Streamer.4Setup.back

Streamer.3

Streamer.2Control.back

Streamer.1Control.priSetup.pri

192.168.1.110.1.1.1

10.1.1.11

192.168.1.210.1.1.12

10.1.1.22

192.168.1.310.1.1.23

10.1.1.33

192.168.1.410.1.1.34

10.1.1.45

STB.1GQAM.1 HFC

IP Core

Virtual Control IP10.1.1.101


Virtual Setup IP10.1.1.201

LSCP

eth1eth2

eth13

eth1eth2

eth13

eth1eth2

eth13

eth1eth2

eth13

Stream state information


Switchover Process for an Active Stream Switchover Process for an Active Stream Following a Streamer SwitchoverFollowing a Streamer Switchover

Streamer.4Setup.back

Streamer.3

Streamer.2Control.back

Streamer.1Control.priSetup.pri

192.168.1.110.1.1.1

10.1.1.11

192.168.1.210.1.1.12

10.1.1.22

192.168.1.310.1.1.23

10.1.1.33

192.168.1.410.1.1.34

10.1.1.45

STB.1GQAM.1 HFC

IP Core



Virtual Setup IP10.1.1.201

Content

LSCP

Stream state information

eth1eth2

eth13

eth1eth2

eth13

eth1eth2

eth13

eth1eth2

eth13


Q & A