Ingest, Data and Metadata

Digital Archive & Asset Management Brad Gilmer

Executive Director - AAF AssociationPasadena, CA, 2000

11/30/00 2

Metadata Ingest & Validation

Capture

Planning

Edit Validate

Definition File Definition File

Program Spec

MetadataDictionary

Generate

Definition File

SDKSDKSDKSDK

Ingest Annotate QC

11/30/00 3

Why File Formats?

• Interchange via› Analog› SDI› SDTI

• File or files created any time a real-time signal is fed to a computer

• Trend toward computer-based devices increasing

• Could exchange files (& metadata)

11/30/00 4

Role of File Format

• Importance of a common file format is similar to a signal standard

• Enables interchange

11/30/00 5

What is a file?

Essence

Metadata

22453;4 (edge number)

Essence

Container

11/30/00 6

Metadata Worldview

Elaboration Analysis

Synthesis

Composition

Packaging

Delivery

Interaction

Commission

Consumption

Archiving

Flow of Metadata

Flow of Essence

Capture

Production Post-production

DeliveryConsumption

11/30/00 7

File Vs. Stream Transfer

File Transfer• Pull model, usually• Guaranteed error free• Point-to-point • Delivery rate not linked

to presentation rate• Receiver may not JIP• Bi-directional links

required, usually

Stream Transfer• Push model, usually• Point-to-point or point-

to-multipoint• Bounded quality of

receive signal› Link QoS› Uni-directional

links,usually

• Links often Isochronous• Receivers may JIP

11/30/00 8

Three major file format types

• On-the-wire• Removable media• On storage (disk)

11/30/00 9

File Interchange Key Concepts

• Content, Essence and Metadata• Unique Media Identifiers (UMIDs)• Key-Length-Value Coding (KLV)• Registries

11/30/00 10

Content = Essence+Metadata

Essence

Metadata

22453;4 (edge number)

Essence

Content

11/30/00 11

Metadata Size

Source Objects Properties Metadata Properties Property Size Object Size

Count Count Bytes per Object Bytes BytesNews Story 212 1435 13702 6.8 9.5 64.6News Story 381 2800 25101 7.3 9.0 65.9Effects Clip 485 2971 59173 6.1 19.9 122.0News Story 501 3307 53395 6.6 16.1 106.6News Story 977 7426 76135 7.6 10.3 77.9News Story 1662 12129 115651 7.3 9.5 69.6News Story 1825 12962 156912 7.1 12.1 86.0Layered Effects 2173 16224 152210 7.5 9.4 70.0Film Roll (audio) 3945 23077 123691 5.8 5.4 31.4Film Scene 8152 61159 507947 7.5 8.3 62.3Film Roll 11672 75844 868635 6.5 11.5 74.4Documentary Audio 17677 124408 813511 7.0 6.5 46.0AVERAGE 4139 28645 247172 6.9 10.6 59.7

11/30/00 12

Why a Registry?

• Systems can share metadata• Common repository for definitions• Systems can be extended• Vendors can add features

11/30/00 13

Types of Registry

• National (or Global) Public Registry› for universally standardized parameters› e.g., Programme Identifiers

• Industry Association Public Registry› for domain-specific sharing› e.g., Plugins, Program Syndication

• Intranet Private Registry› for user private metadata› e.g. Contract and Rights Management

11/30/00 14

Key Len Value

KLV Encoding and Registries

11/30/00 15

Key Len Value

06 0E 26 34 01 01 01 02 01 05 08 00 00 00 00 00 18 47 6F 6E 65 20 57 …

Key Type MeaningNameDictionary(Local)

KLV

Not to scale

KLV, UMIDs and Registries

11/30/00 16

Key Type MeaningNameDictionary(Local)

KLV

Registry(Public)

Lookup

Key Type MeaningName01 05 08 00 00 00 00 00 ISO 7 bit The Version TitleVersion Title01 04 07 01 00 00 00 0000

ISO 7 bit Film Edge CodeEdge CodeTitle

Key Len Value

06 0E 26 34 01 01 01 02 01 05 08 00 00 00 00 00 18 47 6F 6E 65 20 57 …

KLV Encoding and Registries

11/30/00 17

Key Type MeaningName01 05 08 00 00 00 00 00 ISO 7 bit The Version TitleVersion Title

Dictionary(Local)

KLV

Registry(Public)

Lookup

Key Type MeaningName01 05 08 00 00 00 00 00 ISO 7 bit The Version TitleVersion Title01 04 07 01 00 00 00 0000

ISO 7 bit Film Edge CodeEdge CodeTitle

Key Len Value

06 0E 26 34 01 01 01 02 01 05 08 00 00 00 00 00 18 47 6F 6E 65 20 57 …

KLV Encoding and Registries

11/30/00 18

KLV Encoding and Registries

Key Type MeaningName01 05 08 00 00 00 00 00 ISO 7 bit The Version TitleVersion Title

Dictionary(Local)

KLV

Registry(Public)

Lookup

Key Type MeaningName01 05 08 00 00 00 00 00 ISO 7 bit The Version TitleVersion Title01 04 07 01 00 00 00 0000

ISO 7 bit Film Edge CodeEdge CodeTitle

Key Len Value

06 0E 26 34 01 01 01 02 01 05 08 00 00 00 00 00 18 Gone With the Wind

11/30/00 19

User Requirement Categories

• Authoring Interchange• Finished Interchange• Content Repository• Publication (emission, transmission, store-

and-forward)• Digital Cinema (DC-28 Study Group)

11/30/00 20

Packaging and File Interchange

11/30/00 21

Software & Software

Essence

Metadata

AAF

Essence

Metadata

AAFFile

Interconnect(IP)

SoftwareApplication

File Access API

Essence

Metadata

AAFFile

SoftwareApplication

File Access API

11/30/00 22

What is the AAF Association?

• AAF - Advanced Authoring Format• An independent non-profit organization• Incorporated January 2000• Dedicated to fostering implementation of AAF• International focus• Open to all

http://www.AAFassociation.org

11/30/00 23

Who is the AAF Association?

• As of August 11, 2000:• 4MC, AIST GmbH, Avid, British Broadcasting

Corporation, Cable News Network, Discreet, EMC, Enterprise Systems Group, Fox, International Digital Cinema Festival, Leitch, Matrox, Microsoft, NOB, Omneon, Panasonic, Philips, Pinnacle, Quantel, Sonic Foundry, Sonic Solutions, Sony, tecmath, Turner Entertainment Networks, US NIMA, Warner Bros.

11/30/00 24

AAF SDKSource Code

SMPTEMetadataDictionary

Specifications, Tutorial, Reference Guide, Examples

What is the AAF?Software• Documentation

› API Spec› Object Spec› Bytestream Spec

• Reference Implementation

• Public Registry• Utilities• OpenSource

Key Type MeaningNameKey Type MeaningNameKey Type MeaningNameKey Type MeaningNameKey Type MeaningName

11/30/00 25

Cross-platform

• Tested for Windows, MacOS, Unix (IRIX, Linux)• Portable to embedded OS (e.g. VxWorks)• Source Code is distributed• Does not require proprietary OS libraries

MetrowerksCode

Warrior

UNIX

AAF SDKSource

MicrosoftVisual C++

GNU GCC

11/30/00 26

What Can You Do With AAF?

• Describe complex relationships• Map essence onto a timeline• Synchronize essence streams• Layering and effects compositions• Retain history information• Reference external essence• Round trip• Carry all essence and metadata for a project

in one file

11/30/00 27

Applications of AAF

• Repurposing of Content› Using one movie on different distribution channels

(theater Vs. broadcast)

• Regionalizing Content› Language, titling

• Workflow improvements› Productivity

11/30/00 28

What is ‘GXF’?• GXF is an exchange format implemented by

Grass Valley Group• supports JPEG, MPEG, DVCPro,

Uncompressed Audio, Timecode• Metadata not SMPTE compliant• A GXF file can be a simple stream or

compound collection of tracks (essence is multiplexed)

11/30/00 29

What is ‘MXF’?• …… MXF = ‘Material eXchange Format’

› A file for the exchange of programme material between file servers, but also for tape streamers and digital archives

• It contains one complete programme› But this may comprise a sequence of clips and

programme segments

• The ‘body’ is a stream-based multimedia container› It contains a sequence of frames where each

frame comprises audio, video and data essence plus frame-based metadata

11/30/00 30

AAF and MXFAAF• Primarily intended for

authoring interchange• External references

allowed• Ability to have down-

stream processing (effects, fades, etc.)

• May include complete “programs” and/or partial clips

MXF• Primarily intended for

store and forward and broadcast playout interchange

• External references not allowed

• No downstream processing should be required

• Usually contains one complete material sequence

11/30/00 31

Templates

• Application specific templates constrain AAF in a specific, pre-defined way

• Files that conform to templates are readable by AAF without processing or conversion

• Templates can be used to “filter” metadata that should not be released

11/30/00 32

MXF Interchange Template

Adaptations• No History Information• Fixed Byte Pattern Header• No external references allowed• No Structured StorageResult• Easy to implement in tape machines• Low latency• Simplified metadata structure

11/30/00 33

Application-specific TemplatesDistribution template

Essence Data

Essence Data

Essence Data

Essence Data

Content Repository template

AAF File

11/30/00 34

Overall Structure

File Header

Preamble HeaderMetadata

Run-in

SMPTELabel

Len Null

Preamble Detail

KLV-coded Body IndexTable

Post-amble

Body File Footer

SMPTELabel

Len

Post-amble Detail

Optional Optional

11/30/00 35

Object Structure Flattening

Pre-amble OverallMetadata

Body IndexTable

Postamble

File Header Body Index Postamble

Header

Ident(s)

Master

Slots

Source

Slots

Essence Descriptors

Sequences

Essence Data

Index Table

Essence Items

11/30/00 36

Mapping to Transports

Header

Ident(s)

Master

Slots

Source

Slots

Essence Descriptors

Sequences

Essence Data

Index Table

Essence Items

ContentContent ContentContentContent ContentContentContent Content

11/30/00 37

What’s happening soon?

• AAF Developer Release 3 - NOW!› Unix, XML/XSL, More Codecs

• Products shipping with AAF V1 in Q3/Q4

• 1st Developer Conference - Nov 12-16› Training and Marketing workshop

11/30/00 38

AAF Developer’s Conference

• Where - Santa Fe, New Mexico• When - November 13-16• Why - to learn more, to talk to the

developers, to shape the future direction of AAF, to build software with the AAF SDK (with experienced folks to help!)

11/30/00 39

Related SMPTE Paper

Saturday Afternoon

Metadata Applications and Options for Production and Transmission

Hans Hoffmann - EBU

A Common File Format for the Exchange of Content for networked Television Production- A status report

11/30/00 40

For more information…

http://www.AAFassociation.org

11/30/00 41

Questions?