Arnoud Goos, Erwin Verbruggen

First Information Managers in International Organisations meeting

The Hague, 18 Februari 2015

Video Migration

& Preservation Practices

Agenda

1. Sound and Vision & Images for the Future2. Video Migration3. Digital preservation: Issues & Research4. Preforma: Development for File Compliance

‹nr.›

Presto4u - Technology for Digital Audiovisual Media

Preservation: www.presto4u.eu / www.prestocentre.org

Image

: gea

rho

use

bro

adca

st.c

om

Cultural Audiovisual HeritageBroadcast archives have massive amounts of

materials. They’re our main source for 20th Century

day-to-day history.

109.000 HOURS OF VIDEO

18.000 HOURS OF FILM

190.000 HOURS OF AUDIO

DIGITISED IN THE FRAMEWORK OF IMAGES FOR THE FUTURE

1.200.000 PHOTOGRAPHS

ACCESS TO

CULTURAL AUDIOVISUAL HERITAGE

DUTCH DIGITAL

AUDIOVISUAL COLLECTION

DIGITISATION DIGITAL INGESTDATA

MINING

PUBLIC EDUCATION PRO

CROWDS

OURCING

RECOMME

NDATION

INTERNATIONAL

Wide range of media formats

● Spectrum of formats starts expanding from 1920s onwards

● Latest technologies include ever-changing code bases

● At the vanguard of / overlapping with other media industries

Video Formats at Sound and Vision

IftF Carrier File Q > VHS? Digitisation project

Digital betacam / Digibeta Betacam y 85,000 hrs

Betacam SP/SX Betacam y

Digital-S Digital-S y 1,750 hrs

C-format / 1-inch

BCN / Type B / B-format / 1-inch BCN y 715 hrs

IVC y

DV (cam) DV y

2" Quadruplex / vierkops

Ampex / type A / A-format / 2-inch

2”

Quadruplexy

BVU BVU y

VHS & S/VHS VHS same 22,000 hrs

V2000 n

Betamax n

VCR n

Umatic Umatic n

Video Collections at Sound and Vision

Publieke omroep

Journaal

Actualiteiten

Sport

Overige programma's

Commerciële omroep

Polygoon

Hollands nieuws

Wereldnieuws

Opdrachtfilms

Profilti

Overige collecties

Overheidsfilms (RVD)

Hogesnelheidslijn-Zuid

VN-tribunaal Joegoslavië

NPS-registraties

Overig materiaal

Digital betacam / BCN• Digibeta: External encoding

– 2007-2011

– 85.000 hours of digital files as a result

------------------• BCN

– 2011-2012

– 715 hours of digital files as a result

– Baking of the tapes

• Last resort

VHS tapesPresent in the archive

110.000 VHS-tapes

Selected for digitisation

• 6.700 tapes

• Late 1970’s - 2005

• VHS and S-VHS

• 50% “Dutch TV Week”

• 18 - 20.000 hours

• Transferred to MXF D10-30

SAMMA System

• System for Automated

Migration of Media Assets

• Can be adapted to Digital-S,

Umatic, Digital Betacam

• Stored in DIVA system

Two tape robots: Ericsson +

In-house

Digitisation equipment

VHS Workflow

Digital-S• 2.185 tapes from the collection “Dutch Weeks of

Television”

• Recorded between 1999 – 2005 on VHS, then

copied to Digital-S

– Digital-S considered an upgrade from VHS.

– Conserving

• Using the same workflow as VHS.

– Change the recorders in the robot

– adjust the robotarm

Digital-S issues

Blocking

Digital-S issues

Banding

Digital-S issues

Binder residue

on the

cleaning tape

• Solution:

–Digitize the VHS copies of the Digital-S tapes

• Rebuilding the workflow back to VHS

Digital-S issues

Topic Lesson

1 - Equipment Check availability of equipment and spare parts

2 - Technology Gather (technical) information about your collections

3 - Knowledge Knowledge of unusual formats is rare

Lessons Learned

Trusting Our Digital Repository

Knowledge Finding & Community Building

– Surveys to establish knowledge base

– Regular blog & newsletters

– Webinars, Workshops & Edit-a-thon

www.prestocentre.org

Slid

e w

ith

th

an

ks to

Cla

ud

io P

ran

do

ni

PREservation FORMAts for culture

information/e-archives

Empower memory institutions to gain full control over

the technical properties of digital content intended for long-term preservation

Challenge Brief❑Develop an open source conformance checker that:

–checks if a file complies with standard specifications –checks if a file complies with the acceptance criteria of the memory institution –reports back to human and software agents –perform simple fixes

❑ Establish an ecosystem around an open source reference implementation that: –generates useful feedback for those who control software –advances improvement of the standard specification –advances development of new business cases for managing preservation files

Slid

e w

ith

th

an

ks to

Cla

ud

io P

ran

do

ni

File formats

Content type Standard specifications

TEXT

ISO 32000-1:2008 (PDF 1.7)

ISO 19005-1:2005 (PDF/A-1)

ISO 19005-2:2011 (PDF/A-2)

ISO 19005-3:2012 (PDF/A-3)

IMAGEISO 12234-2:2001 (TIFF/EP)

ISO 12369:2004 (TIFF/IT)

MOVING IMAGE

Open standard:

• maintained by a not-for-profit organization,

• available either freely or at a nominal charge.

• IPR made irrevocably available on a royalty-free basis.

• no constraints on re-use

Capture AV-files that comply with the set of minimum technical

parameters

Slid

e w

ith

th

an

ks to

Be

rt L

em

me

ns

Open

standard?

AUDIOVISUAL TEXT IMAGE

broadcast film Consumer

PREFORMA

stakeholders

MPEG-IMX

(MXF/MPEG2)

XDCAM HD422

(MXF/MPEG4)

DPX

DCP

(MXF/JPEG2000)

MOV/MPEG2

AVI/MPEG2

MPEG/MPE

G2

MPEG/MPE

G4-AVC

PDF 1.4

PDF/A1

TIFF 6.0

JPEG

JPEG2000

RAW

Industry

standards

AS|07

(MXF/MPEG2)

(MXF/JPEG2000)

FIMS

(MXF/MPEG2)

DCDM

(TIFF 6.0)

DCP

(MXF/JPEG2000)

IMF (MXF/MPEG4)

MPEG-AF PDF JPEG2000

TIFF

Open

standards

MKV/FFV1

OGG/Dirac

PNG WebM/VP8

OGG/Theora

PDF/A1

PDF/A3

PDF/A3

PNG

PREFORMA MKV (?) | OGG | JPEG2000 (?) | FFV1 | Dirac | LPCM

(?)

PDF/A TIFF 6.0 (?)

Slid

e w

ith

th

an

ks to

Be

rt L

em

me

ns

Main public events1. Training event for Open Source companiesStockholm, December 2015 Includes first Prototype Demonstration

2. Experience WorkshopBerlin, December 2016Includes second Prototype DemonstrationPREFORMA partners will share with memory institutions their experiences of working with suppliers under R&D service agreements.

3. Final conferenceStockholm, December 2017Results of the project.

Slid

e w

ith

th

an

ks to

Cla

ud

io P

ran

do

ni

Arnoud: agoos@beeldengeluid.nl

Erwin: everbruggen@beeldengeluid.nl

http://www.beeldengeluid.nl/en

http://www.prestocentre.org

Twitter: @erwinverb | @benglabs

2

8

Thank you