26
Semantic Copyright Management of Media Fragments Roberto García, David Castellà, Rosa Gil Universitat de Lleida, Spain DATA 2013 2 nd International Conference on Data Management Technologies and Applications 29-31 July 2013 Reykjavik, Iceland

Semantic Copyright Management of Media Fragments

Embed Size (px)

DESCRIPTION

The amount of media in the Web poses many scalability issues and among them copyright management. This problem becomes even bigger when not just the copyright of pieces of content has to be considered, but also media fragments. Fragments and the management of their rights, beyond simple access control, are the centrepiece for media reuse. This can become an enormous market where copyright has to be managed through the whole value chain. To attain the required level of scalability, it is necessary to provide highly expressive rights representations that can be connected to media fragments. Ontologies provide enough expressive power and facilitate the implementation of copyright management solutions that can scale in such a scenario. The proposed Copyright Ontology is based on Semantic Web technologies, which facilitate implementations at the Web scale, can reuse existing recommendations for media fragments identifiers and interoperate with existing standards. To illustrate these benefits, the papers presents a use case where the ontology is used to enable copyright reasoning on top of DDEX data, the industry standard for information exchange along media value chains.

Citation preview

Page 1: Semantic Copyright Management of Media Fragments

Semantic Copyright Management of Media Fragments

Roberto García, David Castellà, Rosa GilUniversitat de Lleida, Spain

DATA 20132nd International

Conference on Data Management

Technologies and Applications

29-31 July 2013Reykjavik, Iceland

Page 2: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 2 of 28

MediaMixerCommunity set-up and networking for the reMIXing of online MEDIA fragments

• FP7 Coordination Action– Started November 2012 – Create an European market for media

fragments re-purposing and re-sellingA history of G8 violence (© Reuters) http://slideshare.net/troncy/a-semantic-multimedia-web-create-annotate-present-and-share-your-media

Page 3: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 3 of 28

Introduction

• The MediaMixer project and community promote the use of semantic technologies for media mixing

• Real use cases and demos that showcase these technologies– Fragmenting media assets– Annotating them using semantic descriptions– Exposing these descriptions for fragment level search

and selection

– Representing rights information using a copyright ontology that integrates licenses, policies and rights expressions languages

Page 4: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 4 of 28

Producer checks reused media licenses vs. internal policies and agreements (with providers and rights holders)

Policy example: “…avoid media fragments showing violence when producing content for children”.

Problems:1.) Semantic annotation

a) For instance, automatically tagviolent content

2.) Rights Integrationa) Policies and agreements (unstructured documents) b) Media fragments licenses (rights expression languages)

3.) Intelligently detect conflicts

Example Use Case

Page 5: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 5 of 28

Current SituationIssues:• scalability

(mostly a manual process)

• conflicts detected too late (added costs)

• missed opportunities (media already available)

• …

Page 6: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 6 of 28

Proposals:Assisted Policy and Agreement Modelling• Model policies and

agreements• Formal model that

allows automatic integration and intelligence support

• Semantic model based on Copyright Ontology

• Editor with assistance guided by the ontology

Page 7: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 7 of 28

Policy and Agreement Modelling Assistant

Page 8: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 8 of 28

Media Fragments Ingestion

Provider offers media fragment:

• Content: automatic annotation

• Detect topics: Violence? Outdoors? Cars?...

• Rights:automatic translation of rights language to Copyright Ontology

• DDEX, ODRL, MPEG-21, Creative Commons…

Page 9: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 9 of 28

Semantic Annotation

9

• Transform whole videos to sets of meaningful, indexable and re-usable video fragments

Person, Snow, Trees, Building, Ski, …

Baseball, Throwing, Sports, Plant, Running, …

Kitchen, Indoor, Cake, …

Page 10: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 10 of 28

Semantic AnnotationMetadata

• Metadata for semantic annotation:– Descriptive metadata for media

characteristics– Provenance metadata to credit source

and specify rights– Conceptual metadata to reflect what

media is perceived to represent

Page 11: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 11 of 28

Conceptual Metadata

• Globally unambiguous identifiers for any concept needed– Ideally more information

about the concept itself is available via the identifier

– Use of Web URIs → Linked Data concept space

– Would allow for inference of concept type and relationship to other concepts

Page 12: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 12 of 28

Producer Proposed Workflow

Page 13: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 13 of 28

Semantic Data Exploration

Page 14: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 14 of 28

Implementation

• Rights, License and Policies implemented as Classes– Reproduction Right, Copy,

Copy Pattern for fragment #1,...

• Uses implemented as Instances– u: Peter copies media fragment #1

in the US on 2013-06-03 using…

• if u ∈ Copy Pattern thenpattern authorises u

Reproduction Right

Copy

Copyright

CopyPattern

u

?

Page 15: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 15 of 28

Pattern BuildingActions (“verbs”)

Page 16: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 16 of 28

Pattern BuildingCase Roles (from linguistics)

• Connect verbs to the action participants– Example: “The dog ate food”

initiator resource goal essence

Action agent, instrument result, patient,effector recipient theme

Process agent, matter result, patient,origin recipient theme

Transfer agent, instrument, experiencer, themeorigin medium recipient

Spatial origin path destination location

Temporal start duration completion pointInTime

Ambient reason manner aim, conditionconsequence

Subject, role “agent” Object, role “theme”

Page 17: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 17 of 28

DDEX Sample-08.04.xml<Deal>

<DealTerms><ValidityPeriod><StartDate>2013-01-01</StartDate></ValidityPeriod><Usage><UseType>OnDemandStream</UseType><DistributionChannelType>Internet</DistributionChannelType></Usage><TerritoryCode>ES</TerritoryCode><TerritoryCode>US</TerritoryCode></DealTerms>

</Deal>

Copyright Ontology Model<http://media.com/agreement#1> owl:Class;

co:start "2013-01-01" ;owl:intersectionOf (ddex:OnDemandStream [ a owl:Restriction ;

owl:onProperty co:medium ;owl:someValuesFrom ddex:Internet ][ a owl:Restriction ;owl:onProperty co:location ;owl:someValuesFrom [ a owl:Class ;owl:oneOf (territory:ES territory:US) ][ a owl:Restriction ;owl:onProperty co:theme ;owl:hasValue<http://my.tv/video.ogv#t=60,100> ]

]) .

Scenario

DDEX to RDF

Page 18: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 18 of 28

Scenario

Logical interpretation of a license model

Reasoning with DDEX

Page 19: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 19 of 28

Scenario

Reasoning with DDEX

Policy #1

Agreement #1

Page 20: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 20 of 28

reasoner = new Sesame(new OWLIM-SE_5.3())reasoner.loadOntologies()

> Loaded: iso3166a2.owl (territories), ddex.owl, copyrightonto.owl

reasoner.loadPolicy("NoStreamingInUS.owl")reasoner.loadLicense("DDEX_Sample-08.04.owl")use1 = new Use(use1URI, "user01", "OnDemandStream", "Internet",

"http://my.tv/video.ogv#t=60,100", "ES", "2013-04-19")

reasoner.load(use1)response = reasoner.isUsePermitted(use1URI)print response

> Authorised: http://mediamixer.eu/copyright/examples/agreement#1

use2 = new Use(use2URI, "user01", "OnDemandStream", "Internet","http://my.tv/video.ogv#t=60,100", "US", "2013-04-19")

reasoner.load(use2)response = reasoner.isUsePermitted(use2URI)print response

> Prohibited: http://mediamixer.eu/copyright/examples/policy#1

Scenario

License Checking Implementation

Page 21: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 21 of 28

@prefix co: <http://rhizomik.net/ontologies/2013/05/copyrightonto.owl#> . @prefix odrlv: <http://w3.org/ns/odrl/vocab#> . @prefix owl: <http://www.w3.org/2002/07/owl#> .

<http://example.com/policy> a co:Agree ; co:agent <http://example.com/billie>, <http://example.com/sony> ; co:theme [ a owl:Class ; co:end "2012-12-31" ; co:start "0001-01-01" ; owl:intersectionOf (

[ owl:intersectionOf (odrlv:play [ owl:complementOf odrlv:mobile_ringtone ] ) ]

[ a owl:Restriction ;owl:hasValue <http://example.com/billie> ;owl:onProperty co:agent ][ a owl:Restriction ;owl:hasValue <http://example.com/music> ;owl:onProperty co:theme ] ) ] .

<http://example.com/sony:10> a co:Person .<http://example.com/music> a co:Creation .<http://example.com/billie> a co:Person .

ScenarioODRL Example from LCC Rights Reference Model Spec

Copyright Ontology license to text: “sony and billie Agree that billie play and not mobile ringtone music”.

Page 22: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 22 of 28

Creative Commons BY-SA ModelScenario

Page 23: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 23 of 2823

• Following Linked Data principles, starting from just content ID (URI)…

Long term vision…

Content

URI

URI a ebucore:Image dct:title “EBU HQ” dct:copyright URI … H

TT

P G

ET

text/n3

HTTP GETimage/jpeg

Page 24: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 24 of 2824

Linked Data for Worldwide Copyright Management?

Content

URI

URI a ebucore:Image dct:title “EBU HQ” dct:copyright URI …

HT

TP

GE

T

Agreement

URI

URI a co:Agreement co:agent URI co:theme … …

HT

TP

GE

T

Person

URI

URI a foaf:Person foaf:name “…” vcard:address … vcard:country URI

HT

TP

GE

T

Page 25: Semantic Copyright Management of Media Fragments

12.04.2023 Slide 25 of 28

Get involved

• Join MediaMixer community to know more (http://community.mediamixer.eu):– discussions, use cases, demonstrators,

tutorials, presentations, software,…

Page 26: Semantic Copyright Management of Media Fragments

More details:http://community.mediamixer.eu http://rhizomik.net/copyrightonto/

Roberto GarcíaUniversitat de Lleida, Spain

http://rhizomik.net/~roberto

Thank you for your attention

DATA 20132nd International

Conference on Data Management

Technologies and Applications

29-31 July 2013Reykjavik, Iceland