Semantic Copyright Management of Media Fragments

Semantic Copyright Management of Media Fragments

Roberto García, David Castellà, Rosa GilUniversitat de Lleida, Spain

DATA 20132nd International

Conference on Data Management

Technologies and Applications

29-31 July 2013Reykjavik, Iceland

12.04.2023 Slide 2 of 28

MediaMixerCommunity set-up and networking for the reMIXing of online MEDIA fragments

• FP7 Coordination Action– Started November 2012 – Create an European market for media

fragments re-purposing and re-sellingA history of G8 violence (© Reuters) http://slideshare.net/troncy/a-semantic-multimedia-web-create-annotate-present-and-share-your-media

12.04.2023 Slide 3 of 28

Introduction

• The MediaMixer project and community promote the use of semantic technologies for media mixing

• Real use cases and demos that showcase these technologies– Fragmenting media assets– Annotating them using semantic descriptions– Exposing these descriptions for fragment level search

and selection

– Representing rights information using a copyright ontology that integrates licenses, policies and rights expressions languages

12.04.2023 Slide 4 of 28

Producer checks reused media licenses vs. internal policies and agreements (with providers and rights holders)

Policy example: “…avoid media fragments showing violence when producing content for children”.

Problems:1.) Semantic annotation

a) For instance, automatically tagviolent content

2.) Rights Integrationa) Policies and agreements (unstructured documents) b) Media fragments licenses (rights expression languages)

3.) Intelligently detect conflicts

Example Use Case

12.04.2023 Slide 5 of 28

Current SituationIssues:• scalability

(mostly a manual process)

• conflicts detected too late (added costs)

• missed opportunities (media already available)

• …

12.04.2023 Slide 6 of 28

Proposals:Assisted Policy and Agreement Modelling• Model policies and

agreements• Formal model that

allows automatic integration and intelligence support

• Semantic model based on Copyright Ontology

• Editor with assistance guided by the ontology

12.04.2023 Slide 7 of 28

Policy and Agreement Modelling Assistant

12.04.2023 Slide 8 of 28

Media Fragments Ingestion

Provider offers media fragment:

• Content: automatic annotation

• Detect topics: Violence? Outdoors? Cars?...

• Rights:automatic translation of rights language to Copyright Ontology

• DDEX, ODRL, MPEG-21, Creative Commons…

12.04.2023 Slide 9 of 28

Semantic Annotation

9

• Transform whole videos to sets of meaningful, indexable and re-usable video fragments

Person, Snow, Trees, Building, Ski, …

Baseball, Throwing, Sports, Plant, Running, …

Kitchen, Indoor, Cake, …

…

12.04.2023 Slide 10 of 28

Semantic AnnotationMetadata

• Metadata for semantic annotation:– Descriptive metadata for media

characteristics– Provenance metadata to credit source

and specify rights– Conceptual metadata to reflect what

media is perceived to represent

12.04.2023 Slide 11 of 28

Conceptual Metadata

• Globally unambiguous identifiers for any concept needed– Ideally more information

about the concept itself is available via the identifier

– Use of Web URIs → Linked Data concept space

– Would allow for inference of concept type and relationship to other concepts

12.04.2023 Slide 12 of 28

Producer Proposed Workflow

12.04.2023 Slide 13 of 28

Semantic Data Exploration

12.04.2023 Slide 14 of 28

Implementation

• Rights, License and Policies implemented as Classes– Reproduction Right, Copy,

Copy Pattern for fragment #1,...

• Uses implemented as Instances– u: Peter copies media fragment #1

in the US on 2013-06-03 using…

• if u ∈ Copy Pattern thenpattern authorises u

Reproduction Right

Copy

Copyright

CopyPattern

u

?

12.04.2023 Slide 15 of 28

Pattern BuildingActions (“verbs”)

12.04.2023 Slide 16 of 28

Pattern BuildingCase Roles (from linguistics)

• Connect verbs to the action participants– Example: “The dog ate food”

initiator resource goal essence

Action agent, instrument result, patient,effector recipient theme

Process agent, matter result, patient,origin recipient theme

Transfer agent, instrument, experiencer, themeorigin medium recipient

Spatial origin path destination location

Temporal start duration completion pointInTime

Ambient reason manner aim, conditionconsequence

Subject, role “agent” Object, role “theme”

12.04.2023 Slide 17 of 28

DDEX Sample-08.04.xml<Deal>

<DealTerms><ValidityPeriod><StartDate>2013-01-01</StartDate></ValidityPeriod><Usage><UseType>OnDemandStream</UseType><DistributionChannelType>Internet</DistributionChannelType></Usage><TerritoryCode>ES</TerritoryCode><TerritoryCode>US</TerritoryCode></DealTerms>

</Deal>

Copyright Ontology Model<http://media.com/agreement#1> owl:Class;

co:start "2013-01-01" ;owl:intersectionOf (ddex:OnDemandStream [ a owl:Restriction ;

owl:onProperty co:medium ;owl:someValuesFrom ddex:Internet ][ a owl:Restriction ;owl:onProperty co:location ;owl:someValuesFrom [ a owl:Class ;owl:oneOf (territory:ES territory:US) ][ a owl:Restriction ;owl:onProperty co:theme ;owl:hasValue<http://my.tv/video.ogv#t=60,100> ]

]) .

Scenario

DDEX to RDF

12.04.2023 Slide 18 of 28

Scenario

Logical interpretation of a license model

Reasoning with DDEX

12.04.2023 Slide 19 of 28

Scenario

Reasoning with DDEX

Policy #1

Agreement #1

12.04.2023 Slide 20 of 28

reasoner = new Sesame(new OWLIM-SE_5.3())reasoner.loadOntologies()

> Loaded: iso3166a2.owl (territories), ddex.owl, copyrightonto.owl

reasoner.loadPolicy("NoStreamingInUS.owl")reasoner.loadLicense("DDEX_Sample-08.04.owl")use1 = new Use(use1URI, "user01", "OnDemandStream", "Internet",

"http://my.tv/video.ogv#t=60,100", "ES", "2013-04-19")

reasoner.load(use1)response = reasoner.isUsePermitted(use1URI)print response

> Authorised: http://mediamixer.eu/copyright/examples/agreement#1

use2 = new Use(use2URI, "user01", "OnDemandStream", "Internet","http://my.tv/video.ogv#t=60,100", "US", "2013-04-19")

reasoner.load(use2)response = reasoner.isUsePermitted(use2URI)print response

> Prohibited: http://mediamixer.eu/copyright/examples/policy#1

Scenario

License Checking Implementation

12.04.2023 Slide 21 of 28

@prefix co: <http://rhizomik.net/ontologies/2013/05/copyrightonto.owl#> . @prefix odrlv: <http://w3.org/ns/odrl/vocab#> . @prefix owl: <http://www.w3.org/2002/07/owl#> .

<http://example.com/policy> a co:Agree ; co:agent <http://example.com/billie>, <http://example.com/sony> ; co:theme [ a owl:Class ; co:end "2012-12-31" ; co:start "0001-01-01" ; owl:intersectionOf (

[ owl:intersectionOf (odrlv:play [ owl:complementOf odrlv:mobile_ringtone ] ) ]

[ a owl:Restriction ;owl:hasValue <http://example.com/billie> ;owl:onProperty co:agent ][ a owl:Restriction ;owl:hasValue <http://example.com/music> ;owl:onProperty co:theme ] ) ] .

<http://example.com/sony:10> a co:Person .<http://example.com/music> a co:Creation .<http://example.com/billie> a co:Person .

ScenarioODRL Example from LCC Rights Reference Model Spec

Copyright Ontology license to text: “sony and billie Agree that billie play and not mobile ringtone music”.

12.04.2023 Slide 22 of 28

Creative Commons BY-SA ModelScenario

12.04.2023 Slide 23 of 2823

• Following Linked Data principles, starting from just content ID (URI)…

Long term vision…

Content

URI

URI a ebucore:Image dct:title “EBU HQ” dct:copyright URI … H

TT

P G

ET

text/n3

HTTP GETimage/jpeg

12.04.2023 Slide 24 of 2824

Linked Data for Worldwide Copyright Management?

Content

URI

URI a ebucore:Image dct:title “EBU HQ” dct:copyright URI …

HT

TP

GE

T

Agreement

URI

URI a co:Agreement co:agent URI co:theme … …

HT

TP

GE

T

Person

URI

URI a foaf:Person foaf:name “…” vcard:address … vcard:country URI

HT

TP

GE

T

12.04.2023 Slide 25 of 28

Get involved

• Join MediaMixer community to know more (http://community.mediamixer.eu):– discussions, use cases, demonstrators,

tutorials, presentations, software,…

More details:http://community.mediamixer.eu http://rhizomik.net/copyrightonto/

Roberto GarcíaUniversitat de Lleida, Spain

http://rhizomik.net/~roberto

Thank you for your attention

DATA 20132nd International

Conference on Data Management

Technologies and Applications

29-31 July 2013Reykjavik, Iceland