Creating a Preservation Master & Automating On-Line Access

ARSC 2009

Creating a Preservation Master & Automating On-Line Access

FROM INGEST TO WEBSITE:

Rob PorettiCube-Tec North America

ARSC 2009

Assumptions…

From Ingest to Website:

Size Content Physical State Historical Human Resources Equipment Resources Expertise

ARSC 2009

The Bottlenecks…


Activities with a high human labor component: Inspecting and cataloguing media. Categorizing and organizing collections & creating descriptive metadata. Pre-digitization preparation of media. Digitizing legacy audio formats. Metadata entry:

Archive numbers Descriptive & technical metadata

Post-digitization activities: File Security – Check-sum generation, validity tests, file management Quality analysis – restoration. Derivative creation – testing massive derivative collections.

ARSC 2009

Computer Automation…


Activities benefiting from computer automation: Multiple digitization streams. High-speed, multi-channel, dual-direction ingest. Automated quality analysis of digital intermediates or masters. Automated metadata creation/import/export. File level security for audio data and metadata. Automated creation of derivatives for access purposes. Automated quality analysis of derivative creation. Automated reporting and notification systems.

ARSC 2009

An input to output solution…


Friendly purpose-built digitization GUI.

Import modules for most legacy media formats.

Multiple stream ingest with integrated monitor.

Emphasis on audio quality and metadata.

Metadata driven workflow management & supervision software.

Import/Export XML metadata - web-service integration with Cube-Tec and 3rd party products.

Scalable distributed batch processor.

Audio and metadata processing engine.

Simple graphical interface for creating workflow processes.

Powerful decision making

QUADRIGA DOBBINCUBEWORKFLOW

ARSC 2009

System Integration


LegacyDatabase

CorporateAsset

ManagementSystem

QUADRIGA DOBBIN AUDIOCUBE

CUBE WORK-FLOW

ARSC 2009

Multiple Digitization Streams


Traditional Approach: Requirements for a digitization studio needs to be replicated multiplied by the

number of ingest streams desired. Expensive – Example: six parallel ingest streams require…

6 studios/rooms 6 transfer engineers 6 sets of digitization stations – computers, monitoring, etc.

Quality analysis potential and cost/performance assessment:Quality Analysis: Critical:- Active listening by human.- Descriptive information & quality analysis can be collected while recording. - High skill = high cost.

Quality Analysis: Non-Critical:- Non-skilled workers lowers labor costs. - Limited ability to perform quality analysis. Quality analysis may not be required.

ARSC 2009

QUADRIGA


ARSC 2009

Multiple Digitization Streams


QUADRIGA Approach: One workstation can provide up

to eight parallel ingest streams simultaneously.

System costs offset redundant real-estate and equipment costs – only require: 1 studio, 1 computer

system, 1 audio monitoring system, etc.

Labor costs are dramatically decreased.

ARSC 2009

QUADRIGA: Hyper-Efficient Ingest


Multi-Speed Recording Speeds from ½x to 4x with accurate playback equalization and

pitch correction for proper real-time monitoring. Multi-Channel Recording

Ingest mono, stereo or multi-channel sources to 8 tracks with appropriate monitoring functions.

Dual-Direction Ingest ½ track mono or ¼ track stereo open reel and compact

cassette formats in one pass. Includes real-time, reverse-corrected monitoring during capture.

Combine Formats Ingest a ¼ track compact cassette using double-speed, 4-channel,

dual direction for a one pass ingest: 90 min cassette would take 22.5 minutes to digitize.

Library of Congress

System Connection


QUADRIGA

USB

RS-232RS-422

ARSC 2009

Automated Quality Analysis


AudioFile Inspector and Digital Error Checker are real-time analysis tools that automatically detect both analog and digital domain events in the audio stream.

Time domain events are time-stamped and displayed in a Report List. Events can be used as location markers in the recorded file.

Statistical analysis such as averages, means, ratios, etc. are displayed in real-time. Critical thresholds can be set for each event typed.

The complete analysis reports can be stored in the Quality Chunk of the BWF header and exported as XML based metadata.

Multiple analysis profiles can be created for any media type.

ARSC 2009

Automated Quality Analysis


Automatically Detected Events: Start/End of Modulation, Signal Pauses Analog Distortion, Clicks, Dropouts, Hum Stereo/Mono, Speech/Music Content S/N Ratio, Bandwidth, DC-Offset Dynamic, Peaks, Average Level Stereo Balance, Correlation, Azimuth

Errors Digital Zero, Digital Clicks, Digital

Clipping, Block Repetition, Sample-Holds

ARSC 2009

CUBE WORKFLOW


CUBE WORKFLOW

ARSC 2009

Automated Metadata Management


Cube-Workflow Integration: Manages the task of generating

work-order processes for QUADRIGA and Dobbin systems.

Operates as a stand-alone work-group solution with it’s own database engine, or as the link between an existing asset management system.

Exchanges database information from any external database source to QUADRIGA and Dobbin systems, and back…

ARSC 2009



Driven By Metadata: Use existing collected

information throughout the digitization, ingest and post-processing life-cycles.

Cube-Workflow’s process chains can be dynamic - adapting to collected metadata.

Exchanging process service information with other Cube-Tec products enable automatic processing between software applications.

ARSC 2009



Manage your Workflows Supervises scheduled jobs and

traces production issues using bi-directional messaging.

Email and SNMP notifications are event triggered from workflow processes.

Time-line based statistical information collected by QUADRIGA and Dobbin can be viewed in Cube-Workflow.

ARSC 2009

DOBBIN


ARSC 2009

Create Powerful Workflows Simply


Dobbin: Automated Processing Drag and drop your workflows.

Connect processes using virtual audio, logic or metadata wiring.

Performs syntactic wiring check. Test newly created jobs with a single file.

Trigger jobs from file creation, file movement, metadata criteria, statistical analysis, external applications or manually.

ARSC 2009

Automate Anything…


Content AnalysisAutomatic quality analysis:Analog and Digital errors.

ProcessingComprehensive re-masteringand re-formatting tools.Automatic restoration tools.

File ConversionConvert any PCM format.DDP translation.Integrate metadata.

File SecurityFSC , MD5 and DDP integrity

tools. File correlators.

Audio File EncodingDerivative generation for mp2/3, AAC, mpeg, DTS,

AC3, WMA, MLP & more.

ToolsComplete logic tools for

automated decisions. Integrates 3rd party

applications and scripts.

ARSC 2009

The Dobbin Job Manager


Manage your Jobs: Real- time status of each job

progress. Re-prioritize job queue on-the-

fly. Accurate job-time estimates.

Sorting and filtering of job list by any criteria.

Complete logging of all workflow processes.

Messaging service to Cube-Workflow for on-line updates

ARSC 2009

Result Viewer - Automated Reporting


View Your Results: Complete reporting with drill-

down capability and integrated waveform displays.

Sorting and intelligent filtering of all events. Events displayed on graphical timeline along with audio image.

Uses web technologies – available at any connected PC. Exchanging process service information with other Cube-Tec products.

ARSC 2009

The Dobbin Event Player


Play Your Results: Launch the BWF player from

your web-page with integrated event list and waveform graphical display.

Built in sample rate converter to audio playback on any computers sound card.

List can re-populate with any event-type and each item can be used to locate with pre-roll.

ARSC 2009

Printing Reports and XML Exporting


Print your Results: XML reports are styled using

XSLT. Templates are provided for viewing and printing.

Easily customizable by any web developer. This can include connections to external data sources.

Can be stored as intranet resource for archive group stakeholders.

ARSC 2009

The Rule Editor Workbench


A simple API for creating rules consumed by modules that perform workflow decisions – Example: Decider.

These rules are loaded and stored into a module from Job Designer.

The Rule Editor Workbench allows simple drag-and-drop techniques to define the elements and rule logic.

ARSC 2009

Metadata Schemas


Completely integrated meta-data schema - the BWF format, reports, FPUs, etc. This is used to create the source parameter set used by rules.

Schema and parameter selection and then assigning the desired value for the rule criteria is performed in a simple dialog box.

ARSC 2009

Defining Your Rules


The Workspace area is used to define the rule. Each rule has a Start and End element with some number of internal elements that tests criteria, performs conditional branching or manipulates data.

Drag-and-Drop from any Workspace window or element field facilitates simple rule creation and minimizes human-error.

ARSC 2009

XML Logic & Function Toolbox


The Rule Editor modules are similar to a programming language syntax. They allow a simple and common approach to creating the rule logic that is applied to the meta-data.

Control items are used for defining the logic flow of a rule. Includes elements for conditional branching, and looping through element sets.

Functions are used for calculations, searching, defining logic paths, and manipulating numbers and strings.

Complex are presets of user-created combinations of Controls and Functions.

ARSC 2009

Putting it all together….


ARSC 2009

ARSC 2009

Example: File Security – The Rule Editor


Rule Editor

ARSC 2009

Managing Multiple Ingest Streams


QUADRIGA CD INSPECTOR

QUADRIGA

PYRAMIXWAVELABNUENDO

SONICPROTOOLS

CD-DVD ROM

FTP/Internet…whatever!

ARSC 2009

Creating a Preservation Master & Derivatives


PreservationMaster

24/96 BWF

InternetBrowsing

mp3

Rule Editor

TelephonyAccess

G.xxx

IntranetBrowsing

16/44.1 WAVE

ARSC 2009

Create Derivatives with Automated Testing


ARSC 2009

WEB PAGE

Automate your Web-Page Creation


WEB SERVERWEB APPLICATION

END

Derivatives

XML

SCHEDULING

PAGE TEMPLATES

SKIN TEMPLATES

ARSC 2009

Summary


Parallel digitization produce dramatic results in efficiencies. Multi-speed, multi-channel and dual direction ingest, leverages

existing resources further increasing efficiencies. Metadata integration minimizes repetitive data entry and associated

human error. Automated quality analysis facilitates parallel ingest and produces

rich technical metadata for your media. Automated batch processing eliminates human activities relating to

derivative generation. Powerful, metadata driven workflows, allow for rich media content

to flow from ingest to on-line access in a secure but automated fashion.

ARSC 2009Rob PorettiCube-Tec North America

Thank-you!

Thank-you – E-Mail

?r.poretti @cube-tec.com

ARSC 2009

Library of Congress

Ingest Cassette with Double Speed

Input Modules

Analog Compact Cassette 4.75 cm/s

AD

PLAYBACK EQ

DE-EMPHASIS

SPEEDCORRECTION

AD

Cassette Player4.75 cm/s PlaybackEQ - OFF

HD

HD

ADC96 kHz

AESINPUT96 kHz

Preservation File OutputBWF/MBWF

AESOUTPUT96 kHz

File PlayMonitor

Mode

Record InputMonitor

Mode

Documents

Creating a Preservation Master & Automating On-Line Access