IEEE CTCN 2016-06-22 Object-based Audio for Home Theater ... · and Video Games Presented to the...

Object-basedAudioforHomeTheaterSystems

andVideoGamesPresentedtothe

IEEECentralTexasConsultantsNetworkby

SergioLiberman2016-06-22

Abstract

Home theater systems have seen great advanced invideo quality with 4K resolution, 3D and highdynamic range with the recently introduced UltraHD and Dolby VisionTM.The correspondent advances for the soundtrackuses object-based audio technology to offer 3D-likesound fields. This presentation will discuss DolbyAtmos® and DTS:X® object-based audio, and theapplications for home theater, video games andmobile.

Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

2

3Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

Object-BasedAudio

ObjectvsChannelBasedAudio

• Channel-basedaudioformatisfundamentallylimitedbecauseitiscreatedtoplaybackonaspecificspeakerarrayconfiguration.Expandingthesystembyaddingmorespeakersdonotresultinbetteraudiofield.

• Ifamovieismixedfora5.1speakerconfiguration,ithasjusttheinformationrequiredtoplaybacktofivespeakers,setinpredefinedlocations,andonesubwoofer.Thereisnoinformationforadditionalspeakers.Thespeakerpositionsarerigidlydefined.

Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

4

ObjectvsChannelBasedAudio

• Objectbasedaudioisnotlockedtoacertainnumberofspeakers.Instead,theaudiodatacarriesadditionalinformationabouttheaudioobjectstoallowthefinalaudiorenderingtooccurattheprocessorinthelivingroom,usingtheparticularspeakerconfiguration.

• InDolbyAtmosandDTS:X,eachsoundinamoviescene—agunshotorascream,forinstance—canbeanobject.Filmmakerscanpreciselyspecifywherethosesoundobjectsshouldappearinthe3Dacousticspaceandhowtheyshouldmovearound.

Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

5

Object-basedAudioCodecs

• Dolby Atmos• DTS:X• Auro 3D• MPEG-H

Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

6

7Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

3DAudioinHomeTheater

DOLBYATMOS®FEELEVERYDIMENSIONTM

“DolbyAtmostransportsyouintothestorywithmovingaudiothatflowsallaroundyouwith

breathtakingrealism.”

Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

8

DTS:X®EXPERIENCEDTS:X

“DTS:X places sound where it would occurnaturally in space, creating the most lifelike,multi-dimensional audio experience ever. Beprepared — this improved immersion andheightened realism makes horror movies scarier,comedies more laugh-out-loud, and car chasescenes even more intense.”

Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

9

EvolutionofHomeTheaterAudio(Dolby)

• Mono: one Front speaker (C)• Stereo: two Front speakers (L, R)• Dolby Prologic: three Front speakers (L, C, R), plus rear

surround.• Dolby Digital 5.1 surround sound - Front speakers (L, C, R)

and Surround speakers (LS and RS), plus effects channel.• Dolby Surround 7.1 - Front speakers (L, C, R), Surround

speakers (LS and RS), Rear Surround (RLS and RRS), pluseffects channel. May get to 9.1 with the addition of twofront height speakers.

• Dolby Atmos – builds on top of Dolby Surround 7.1, addingoverhead speakers, from 5.1.2 up to 9.1.2 speakerconfigurations.

Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

10

DolbyAtmosandDTS:XChannelandObjectAudioHybrids

• Dolby Atmos adds object based audio tochannel based Dolby Digital Plus. Assumesspecific speaker arrays to reduce complexity.

• DTS:X also adds object based audio to DTSchannel audio streams. However, DTS:X allowsarbitrary speaker array configurations formore flexibility.

Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

11

5.1SpeakerArray

Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

12

5.1.2AtmosCeilingSpeakerArray

Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

13

5.1.2AtmosEnabledSpeakerArray

Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

14

9.1SpeakerArray

Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

15

9.1.2AtmosSpeakerArray

Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

16

YamahaYSP-5600DolbyAtmosEnabledSoundBar

Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

17

WhatequipmentisrequiredforDolbyAtmosandDTS:Xplayback?

• Blu-rayplayer– existingBlu-rayplayersarecompatible.

• Soundbar– mustbeequippedwithDolbyAtmosand/orDTS:Xdecoders,andtheadditionalheightspeakers.

• A/VReceiver– mustbeequippedwithDolbyAtmosand/orDTS:Xdecoders.

• Speakers:additionalheightspeakersorDolbyAtmosEnabledspeakersarerequired.

18Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

DolbyAtmosandDTS:XBlu-RayDiscs

• DolbyAtmos:– http://www.dolby.com/us/en/experience/dolby-atmos/bluray-and-streaming.html

• DTS:X:– http://dts.com/dtsx

19Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

Formoreinformation

• http://dts.com/dtsx• http://www.dolby.com/us/en/brands/dolby-atmos.html

DolbyAtmosatthemovietheater:• http://www.dolby.com/us/en/experience/dolby-

atmos/movies.htmlDolbyAtmosmovietheatersintheAustinarea:• EVOEntertainmentCenter,3200KyleCrossing,KyleTX78640• Santikos MayanPalace,1918S.W.MilitaryDrive,SanAntonio

TX78221

20Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

21Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

3DAudioinGames

3DAudioinGames• Object-basedaudioofferstheflexibilityrequiredforsound

eventsingames.• Beingfreeoftherestrictionsofchannel-basedaudioallows

precisepositioningoftheaudioeventsinthe3Dacousticspace,tailoredtotheend-pointspeakerorheadphonesystemconfiguration.

22Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

3DAudioinGames“Avideogame'saudiosceneismadeupofmanyindependentaudioobjects,liketheenginesofashipflyingaboveyouorweaponsfiringattargetspastyourhead.Traditionalaudiotechnologiesrequiregamesounddesignerstoflattenthethree-dimensionalaudiointoatwo-dimensionalplane,losingvaluablepositioninginformationintheprocess.ButDolbyAtmosremovesthisbarrier.Forthefirsttime,thethree-dimensionalaudiosceneispreserved,soyou'rerightinthemiddleoftheaction.Now,notonlycanyoucanheartheenemyinfrontandbehindyou,butaboveyouaswell—givingyouacompetitiveadvantage.”

23Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

StarWarsBattlefrontwithDolbyAtmos

24Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

25Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

3DAudioinHeadphones

Head-relatedTransferFunction

26Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

3DAudioinHeadphones• Ahead-relatedtransferfunction(HRTF)isaresponsethatcharacterizeshowanearreceivesasoundfromapointinspace;apairofHRTFsfortwoearscanbeusedtosynthesizeabinauralsoundthatseemstocomefromaparticularpointinspace.

• Humanshavejusttwoears,butcanlocatesoundsinthreedimensions– inrange(distance),indirectionaboveandbelow,infrontandtotherear,aswellastoeitherside.Thisispossiblebecausethebrain,innerearandtheexternalears(pinna)worktogethertomakeinferencesaboutlocation.

27Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

3DAudioinHeadphones• DolbyHeadphone• DTSHeadphone:X• SmythRealiser

TheRealiserprovidesanexperienceinwhichmultichannel(orstereo)recordingsoundsareindistinguishablythroughheadphonesasitdoesthroughaloudspeakerarrayinarealroom.TheRealiserappliesHRTFstomultichannelsoundtodrivetheheadphones.TheRealiseremploysthreecriticalcomponentsnotseenintheotherproducts:

• personalization• headtracking• thecaptureofthepropertiesofanyreallisteningspaceand

soundsystem.

28Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

29Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

SignalProcessingPlatformsforDevelopmentand

Implementation

30Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

MomentumDataSystemsEQ1• DevelopmentplatformforDolbyAtmosandDTS:X• UsesstandardDA8xxTItools(CCS,PA,Linux,etc.)• MultiDSPsystem:

– ThreeTIDSPchips:DA830+2xDA808– ARM926+3xC647xDSPcores@456MHz– 12-channelanalogin,24-channelanalogout.– HDMII/O

31Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

MDSEQ1BlockDiagram

MDSAPM-89L

32Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

• APM-89LprocessormoduleforDolbyAtmosandDTS:Xdecoding

• TwoDSPchips:DA830+DA810

33Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

MDSEVMD• DolbyAtmosandDTS:XdemoplatformfortheAPM-89Lprocessormodule.

• 8-channelanalogin,16-channelanalogout.• HDMII/O

ThankYou

Myname:SergioLibermanMyemail:sergio.liberman@gmail.com

34Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22