Using Captions to Develop a Searchable Video Library

Using Captions to Develop a Searchable Video Library

COLTT 2013

Josh Miller josh@3playmedia.com

Tel: (617) 764-5189 x102

Agenda

Accessibility trends

Captioning basics

Process

Accessibility legislation

Value propositions

Using captions for search

Demos

Open discussion

Accessibility: a Growing Concern

• More than 1 billion people have a disability

• 56.7 million report a disability in the U.S.

• 48 million (20%) in U.S. have some hearing loss

• 11% of postsecondary students report having a disability

• 45% of 1.6 million veterans sought disability

• 177,000+ veterans claimed hearing loss

What Are Captions?

• Text that has been time-synchronized with the media

• Captions convey all spoken content as well as relevant sound effects

• Originated in the early 1980s from an FCC mandate for broadcast TV

What Are Captions?

Terminology

• Captioning vs. Transcription

What Are Captions?

Terminology

• Captioning vs. Transcription

• Captioning vs. Subtitling

What Are Captions?

Terminology

• Captioning vs. Transcription

• Captioning vs. Subtitling

• Closed Captioning vs. Open Captioning

What Are Captions?

Terminology

• Captioning vs. Transcription

• Captioning vs. Subtitling

• Closed Captioning vs. Open Captioning

• Post Production vs. Real-Time

How Are Captions Used?

Accessibility Laws

Section 504 • Part of Rehabilitation Act of 1973 • Anti-discrimination law

Section 508 • Added to Rehabilitation Act in 1986 • Applies to federal agencies and organizations

with federal subsidies

Accessibility Laws

Section 504 • Part of Rehabilitation Act of 1973 • Anti-discrimination law

Section 508 • Added to Rehabilitation Act in 1986 • Applies to federal agencies and organizations

with federal subsidies

ADA • Updated in 2008 via ADAAA • For schools, same requirements as Section 504 • Netflix lawsuit implications

Accessibility Laws

Section 504 • Part of Rehabilitation Act of 1973 • Anti-discrimination law

Section 508 • Added to Rehabilitation Act in 1986 • Applies to federal agencies and organizations

with federal subsidies

ADA • Updated in 2008 via ADAAA • For schools, same requirements as Section 504 • Netflix lawsuit implications

21st Century Communications & Video Accessibility Act (CVAA) • Applies to content that airs on TV and the

Internet.

Accessibility Laws

CVAA Phase-In Timeline Phased In: All prerecorded programming that is not edited for Internet distribution

Phased In: Live & near-live programming originally broadcast on television.

Sep 30, 2013 : Prerecorded programming that is edited for Internet distribution.

Mar 30, 2014: Archival programming

Value Propositions

• Accessibility for deaf and hard of hearing

• For ESL viewers

• Flexibility to view anywhere, such as noisy environments or offices

• Search

• Reusability

• Navigation, better UX

• SEO/discoverability

• Used as source for translation

Captioning Process

1. Upload 2. Download 3. Publish

Step 1. Upload Media Files

Step 2. Download Captions File

Captions Formats

Common Caption Formats

SRT YouTube and other web players

DFXP Flash players

SCC iPods, iTunes, DVD encoding

SAMI Windows Media

QT QuickTime

STL DVD Studio Pro

CPT.XML Captionate

SBV YouTube

RT Real Media

WebVTT Emerging HTML5

Custom XML Custom formats

Custom Text Custom formats

SRT Example

Emerging standards for HTML5

Step 3. Publish Captions

Simplifying the Workflow Video Player / Platform Integrations

Captions Plugin

• Works with most video players

• Searchable • Supports multiple

languages

• SEO boost • Customizable • Free

Using Captions for Search

Demos

• Implementations of captions + transcripts

• Examples of automated captioning workflows

• Searchable, interactive video libraries

Captioning + Search with Lecture Capture

Searchable Interactive Transcript

Search By Speaker ID

Searchable Captions + Transcript

Search Across Large Video Libraries

Searchable MOOC

Results @ MIT OpenCourseWare

97% of students said interactive transcripts enhanced their learning experience

Significantly enhances (57%)Enhances (40%)Detracts (1.7%)Greatly detracts (3.4%)

Results @ MIT OpenCourseWare

95% of students were able to find desired content using the search features

Very successfulSomewhat successfulSomewhat unsuccessfulVery unsuccessful

Results @ MIT OpenCourseWare

97% of students said the interactive transcripts were easy to use

Very easy (72%)Somewhat easy (25%)Somewhat difficult (2%)Very difficult (1%)

Resources

http://www.3playmedia.com/how-it-

works/overview/

Questions

Josh Miller 3Play Media josh@3playmedia.com Tel (617) 764-5189 x102