Embed Size (px)
Citation preview
© 2011 Nexidia Inc. CONFIDENTIAL.
New Audio Technologies for Automating Digital
Pre-Distribution Processes
Drew Lanham
SVP/GM, Media and Entertainment
February 18, 2011
Overview
Nexidia enables media discovery and enrichment through audio analysis
Demonstration of next generation Nexidia technologies:
• Dialog Search – large scale dialogue search
• Dialogue to Transcript Alignment – automatically associating text, dialog and time code
• Audio Conform – ensuring synchronization between master and all related sound elements throughout the post and distribution processes
Applications for all program types, spanning production through distribution
Looking for feedback on these and other potential use cases
© 2011 Nexidia, Inc.
Corporate Background
Core technology enables search of dialogue in audio and video
• Research started in 1997 at Georgia Tech; company incorporated in 2001
• 10 patents awarded, many pending
• Media & Entertainment customers include Avid, MSNBC, Thought Equity, Cisco, Microsoft and others.
Proven success in several areas
• Award-winning products and market-leading customers in Government, Contact Center, Legal and Media & Entertainment
© 2011 Nexidia, Inc.
Nexidia SearchGrid
Dialogue is a rich source of metadata in almost all program types
Traditionally difficult to access in automated way or required expensive logging and or transcripts
Objective was to make searching dialogue as easy and fast as text search
Search dialogue in massive audio and video libraries
• Fast indexing and search
• Accurate
• Search for any word or phrase
• Complementary to metadata
• Boolean operators + time
• Broad language support (32+ currently)
© 2011 Nexidia, Inc.
© 2011 Nexidia, Inc.
Nexidia SearchGrid
© 2011 Nexidia, Inc.
Nexidia SearchGrid
Dialog to Transcript Alignment
Automatically creates a time-based relationship between dialog and text file, specifically a script, transcript, caption or subtitle file.
• Navigate through the program by clicking on text or vice versa
• Identify areas where the text and dialog do not match
• Identify changes between multiple versions (script to movie, etc.)
• Create rough cuts by selecting text
• Generate timing lists for ADR, captioning and dubbing
• Downstream uses including MAM search, SEO, social media, etc..
© 2011 Nexidia, Inc.
© 2011 Nexidia, Inc.
Audio Conform
Audio-based similarity analysis
Automatically alert operators to differences between the “gold master” reference audio and the individual stems of the new versions.
Instantly detect and visually identify at any point:• Whether tracks are related or unrelated to each other and the master
• Drift (both continuous and gradual) within the file
• Gaps (inserted scenes and appended commentary)
• Incorrect content inserted into an audio track (e.g. different song or effect)
• Detects added distortion or dropouts
Several hundred times faster than real time (>300x)
More accurate and consistent than human review
Verifies correct language
XML based output© 2011 Nexidia, Inc.
© 2011 Nexidia, Inc.
Solutions Overview
Software based
Highly scalable in size and performance
Multiple language support
Easy to integrate as toolset, platform or application(s)
SDK supports Windows, Mac, Linux
© 2011 Nexidia, Inc.
In Closing
• Questions?
• Tell us what you think!
• dlanham (at) nexidia.com
• Thank you Michael Phillips
• Thank you HPA
© 2011 Nexidia, Inc.
© 2011 Nexidia Inc. CONFIDENTIAL.
Reference Slides
Overview
The Opportunity
• Monetizing libraries to take advantage of new distribution partners and channels
The Challenge
• Finding streamlined, cost effective, high quality solutions to discover, manage, and deliver large libraries of content
© 2011 Nexidia, Inc.
Domestic and Foreign Captioning – Challenges
Creating high quality foreign versions under pressure due to day and date releases
Synchronization of multiple versions is time consuming
Closed captioning is required by law and will soon apply to online video, compounding challenges
Manual intervention is expensive, time consuming, and prone to errors
• Caption timing or retiming can take ~2x program length
© 2011 Nexidia, Inc.
Transcript to Video Sync Scenarios
Digital Pre-Distribution
• Align audio in a movie or documentary with shooting script or transcript, identifying:
−Exact timing of spoken dialogue (to the word level, centi-second)
−Retains structure of all script elements, including Character, Dialog, Scene
• Generate master timing report driving downstream deliverables (subtitles, ADR sessions, translations, etc.)
• Dynamic retiming of subtitles for edits and versioning
Program Edit
• Instantly identify areas of missing or poorly matching CC or audio
• Re-align original captions to edited programs, accounting for expansion, compression, or removal of content from source material
© 2011 Nexidia, Inc.
Audio Conform - Challenges
Current process for quality control and verification is manual and time consuming
Significant number of combinations within a single program
• Programs released in multiple versions in original language
• Over 30 different languages for some films
• Master may consist of dozens of unique or related tracks; all must be conformed for each version in each language
• Hundreds to thousands of assets in the archives
Expense and complexity limit distribution, constraining monetization
© 2011 Nexidia, Inc.
Audio Conform Scenarios – DEMO 1
Dialogue Conform• Compare audio from various versions of a movie against master dialogue stem to identify
where dialogue does not identically match the master.
Extended vs. Theatrical Release
• Determine if the differences between the standard (theatrical) and extended release of a movie comply with the expected changes and additions made to the extended release.
Foreign Language• Compare audio from various versions of a dubbed movie against audio in the original
language to identify if non-translated content is conformed.
Music Conform• Compare audio from various versions of a movie against master music stem to identify
where music does not identically match the master.
© 2011 Nexidia, Inc.
