23
FactForge Data Service and the Value of Inferred Knowledge over LOD Inferred Knowledge over LOD Mariana Damova, PhD European Open Data Forum June 2012

Fact forge20 edf

Embed Size (px)

DESCRIPTION

This presentation discusses the value of inferred knowledge over LOD and presents a new version of FactForge, a reason-able view, the biggest body of heterogeneous generic knowledge on which inference is performed, showing examples of inferred statements across LOD datasets.

Citation preview

Page 1: Fact forge20 edf

FactForge

Data Service and the Value of

Inferred Knowledge over LODInferred Knowledge over LOD

Mariana Damova, PhD

European Open Data Forum

June 2012

Page 2: Fact forge20 edf

Ontotext

– Top-5 provider of core Semantic Technology

– Established in year 2000; offices in Bulgaria, UK, USA

– Active both in research and commercial projects (FP7 funding for 10 years)

• 360° semantic technology – unique portfolio:

– Semantic Databases: high-performance RDF DBMS, scalable reasoning

– Semantic Search: text-mining (IE), metadata generation, Information Retrieval (IR)

– Web Mining: focused crawling, screen scraping, data fusion

– Linked Data Management and Data Integration

Good recognition in the SemTech community

– Ontotext pages are ranked #1 for “semantic annotation” and “semantic repository” at

GYM, #3 for “linked data management” at Google

Several joint ventures and subsidiaries

– Innovantage: leading online recruitment intelligence provider in UK

Page 3: Fact forge20 edf

Ontotext Clients (selected)

British Broadcasting Corporation (BBC)– Run its World Cup 2010 sites on top of OWLIM

– Since Mar’12 BBC Sports and 2012 Olympics sections are driven by OWLIM and a Concept Extraction service developed by Ontotext

Press Association (UK)– Analysis of Sports news

– Concept extraction

– Linked data generation– Linked data generation

Top-3 USA media (not allowed to name)

The National Archives (UK) contracted Ontotext to implement

semantic KB and semantic search for the Government Web Archive

British Museum (UK) Ontotext leads the development of Phase 3 of

ResearchSpace project on collaborative research in cultural heritage; British Museum’s public SPARQL end-point is powered by OWLIM

de Bibliothek (Holland) aggregation of data from 150 library databases

Page 4: Fact forge20 edf

Linked Open Data is maturing

LOD cloud grows by billions of triples yearly

Technologies and guidelines about

how to produce linked data fast how to produce linked data fast

how to assure their quality

how to provide vertical oriented data services

LOD2, LATC, baseKB

#4June2012European Data Forum

Page 5: Fact forge20 edf

This talk is about

reasoning

and

coping with diversity of the data on the web of data coping with diversity of the data on the web of data

#5June 2012European Data Forum

Page 6: Fact forge20 edf

Outline

• FactForge (beta)

• Reference Layer

• Access Modes

• Querying

– Airports around London– Airports around London

– US city – a subject of a Novel

– US city – contactInformation

• Challenges

• Conclusion

European Data Forum

Page 7: Fact forge20 edf

FactForge (beta)

European Data Forum

the largest body of heterogeneous general knowledge on which inference has been performed

– powered by OWLIM 5.0 – supporting SPARQL 1.1

Page 8: Fact forge20 edf

Datasets

CIA FactBookDBpedia 3.7

Freebase

REASON-ABLE VIEW

of LOD datasetsNumber of explicit statements: 1,796,673,630

Implicit statements: 1,3

Retrievable statements: 14,928,925,039

European Data Forum

NY Times

Lingvoj

DBpedia 3.7

Geonames

Freebase

Wordnet 3.0MusicBrainz

Lexvo

materialization is performed with respect to the semantics of OWL-Horst optimized

Page 9: Fact forge20 edf

Reference Layer

#9June 2012European Data Forum

Linking at schema level:(1) using rdfs:subClassOf and rdfs:subPropertyOf statements; (2) using OWL expressions where there is a difference in the conceptualization(3) using inference rules if additional individuals are necessary in the repository to support the mapping

PROTON – light weight upper level ontology~500 classes, ~150 properties

http://www.ontotext.com/proton-ontology

Page 10: Fact forge20 edf

Access modes

RDF Search - retrieve ranked list of URIs related to literals, which contain specific keywords

#10June 2012European Data Forum

Page 11: Fact forge20 edf

Exploration - traversing the data, one resource at a time

Access modes (condt)

Page 12: Fact forge20 edf

Access modes (condt)

Exploration - traversing the data, one resource at a time,

inspecting inferred knowledge

- locatedIn – Denmark, Northern Europe- Geonames types/FearureCodes (dc:type P.PPL)- parentFeature – Denmeark, Europe…

#12June 2012European Data Forum

Page 13: Fact forge20 edf

Access modes (condt)

Exploration - traversing the data, one resource at a time, inspecting inferred knowledge

- locatedIn - Europe- subRegionOf - Europe- hasContactInfo –

website via Freebase- containsLocation

#13June 2012European Data Forum

- containsLocation…

Page 14: Fact forge20 edf

Access modes (condt)

SPARQL endpoint

#14June 2012European Data Forum

Page 15: Fact forge20 edf

Access modes (condt)

RelFinder

#15June 2012European Data Forum

Page 16: Fact forge20 edf

Using LOD concepts

SELECT * WHERE {

?Person dbp-ont:birthPlace ?BirthPlace ;

rdf:type dbp-ont:Politician ;

?BirthPlace geo-ont:parentFeature dbpedia:Germany .

}

Querying

Using the intermediary layer

SELECT * WHERE {

?Person prot:birthPlace ?BirthPlace ;

rdf:type prot:Politicianr ;

?BirthPlace prot:subRegionOf dbpedia:Germany .

}

European Data ForumJune 2012

Page 17: Fact forge20 edf

Find Airports near London

Standard LOD vs. PROTON query 13 vs. 20 resultsDBpedia vs. DBpedia and Geonames

#17June 2012European Data Forum

Page 18: Fact forge20 edf

Find airports near London - Results comparison

#18June 2012European Data Forum

Using Geospatial index of OWLIM

Page 19: Fact forge20 edf

City – a subject of a science fiction author

#19June 2012European Data Forum

Page 20: Fact forge20 edf

OWLIM 5.0 and SPARQL 1.1

Exemplary queries :

GROUP BY, min

— Minimal and maximal population counts of European countries

Federated Query between FactForge and LinkedLifeData

— Drugs that cure the disease from which died Alexandre Graham Bell

Literal index over datesLiteral index over dates

– World governors in office between 1980 and 2005

Literal index over digits

― European countries with population above 20 MLN

Geospatial index

— Show the distance from London of airports located at most 50 miles away from it

#20June 2012European Data Forum

Page 21: Fact forge20 edf

Challenges and usage

• Clean data

– Clean up input data

• At model level

– Contradiction detection

– Consistency checking

• Curation and upgrading methodology• Curation and upgrading methodology

#21June 2012European Data Forum

FactForge has been used as data layer infrastructure in FP7 projects, like RENDERFactForge has been used in tasks of

linked data generation from unstructured data,metadata enrichment of structured data

providing linkage to the entire LOD cloudfor example The National Archive of UK

EDAMAM - food recommendation app

Page 22: Fact forge20 edf

Acknowledgements

ColleaguesAtanas Kiryakov, CEO of OntotextZdravko Tashev, OntotextIvan Peikov, OntotextRouslan Velkov, Ontotext

Partial funding

#22June 2012European Data Forum

Rouslan Velkov, OntotextKiril Simov, OntotextBarry Bishop, OntotextBarry Norton, OntotextMarin Dimitrov, OntotextAlex Simov, OntotextJordan Dichev, OntotextKonstantin Penchev, Ontotext

Linkshttp://ff-dev.ontotext.comhttp://www.ontotext.com/owlimhttp://www.ontotext.com/factforgeEmail:[email protected]

Page 23: Fact forge20 edf

Thank you for your attention!

[email protected]