Linked Data Warehouses: A new breed of Business Intelligence

Linked Data Warehouses:A New Generation of BI

ENTERPRISE DATA WORLD 2012ATLANTA 2-MAY-2012

By: Bernadette Hyland, Chair, W3C Government Linked Data WG

CEO, 3 Round Stones, Inc

Email. bhyland@3roundstones.comTwitter: @BernHyland

This presentation: http://slideshare.net/3roundstones

Wednesday, May 2, 12

• Linked Data is about publishing and consuming data using international data standards

• Based on 20 year old idea

• A system of linked information systems

Photo credit: http://www.flickr.com/photos/sjungling/5974860/

1970s 1980s 1990s

$ cat foo.txt | grep blah | sort

A neat little package Client-Server The Early Web

A HISTORY OF SILOS

There is a better way to connect data silos ...•No one vendor owns it•It scales ... to Web-scale•Doesn’t require a super model•Based on International Data Exchange Standards (RDF, SPARQL)

6 months12 months18 months24 monthsMore than 24 months

ACCEPTABLE ROI FOR IT

GovernmentsGoals: Governmental transparency and/or improved

internal efficiencies (data warehouses)

Hardware/Software Vendors

Goal: Improve interoperability between products and product lines

RetailersGoal: Improve click-throughs on search results

Book PublishersGoals: Improve internal manuscript pipelines, expose

additional ways of finding and using content

New Media

Universal Client

Universal Connection

Universal Database

Logic and interlinking

Ubiquitous,reusable applications

URL Curation

of Data

Linked Data in Context

Why is RDF important?• It is an international standard for publishing data on the Web (public and private)

•Data exchange model

•Serializations include RDF/XML, N-triples, N3, Turtle, ...

• It is the future of using the Web

Today’s data warehouses•Data warehouse costs are high•Failure rates are high•Requires a lot of cooperation ...•Vocabulary alignment & data harmonization•Data formats not inter-operable•Cooperation requires coordination•18 months or longer ...

Alternatives include ...•Use Data Exchange Standards to host structured content

•Create Linked data warehouses

•Faster & less expensive

•Web architecture, Web-scale

store name

address

services

ratings

events

58% of Americans research online before they buy.

“We really didn’t go into it with any expectations. We just wanted to see if it was something we might want to do. That’s why we were caught by surprise by

the results… we weren’t really expecting any.”

-- Jay Myers, Lead Development Engineer, Best Buy

30% increase in organic search results15% increase in click-through rate (CTR)

The impact:

Paid search

30%0% 10% 20% 30% 40% 50% 60%

House email

Marketers Reporting “Great” Return on Investment

Banners, buttons

Text-link ads

Affiliate MarketingBehavioraltargetingContextual

targeting

Pop-ups/pop-unders

Rich media/video

Rented emaillists

BBC WANTEDThe BBC publishes large amounts of content online, as text, audio and video.

As the amount of content grows, we need to make it easy for users to locate items of interest

"The RDF representations of these web identifiers allow developers to use our data to build applications."

-- Yves Raimond, BBC

WE’VE SEEN THIS BEFORE

EMRData

InternalPortal Data

Linked DataCloud

Open Government Data

Social Media

Clinical Condi*on Specific

PhysiciansServicesLoca*ons

DBpediaPub MedNLM

CDCEPA

US Census

FacebookTwiCer

ClinicalOntology

BusinessOntology

•Decrease costly emergency department visits

•Reduce hospital re-admissions after treatment

• Improved self-care and medication compliance

•Education of triggers and disease management

Value Proposition

Func*onal Model

1. Define target popula*on and clinical data from electronic medical record

2. Iden*fy sources of open government data related to environmental, weather, and other variables related to chronic pulmonary disease exacerba*ons

3. Combine open content from NLM, PubMed, Medline to support educa*on

4. Leverage a Linked Data approach, using Open Source and interna*onal data exchange standards (RDF)

5. Alert pa*ent of possible hazardous condi*ons and recommend appropriate ac*ons

CA-‐email-‐message.jpg

Leverage Linked Data, Open Source & Standards

CDCEPA

US Census

DBpediaPub MedNLM

Web of Data

Shows:

1) Air Quality data from US EPA

2) Anonymized EMR data

3) Doctor’s details from CSV file

Uses Callimachus,a Linked Data Management Platform

• Large and small vendors are involved in Linked Data

• From Oracle, IBM to 3 Round Stones

• Listing of active projects, companies and research See http://dir.w3.org/

• Best practices, see http://www.w3.org/2011/gld/charter

Tools & best practices?

•Callimachus is a framework for data-driven applications based on Linked Data principles

•Callimachus allows Web developers to easily create data driven applications for the Web

•Callimachus Enterprise

•http://3roundstones.com

“Linked Data means

Cooperation without coordination”

-- David Wood, PhD

Where the Web has been,

the enterprise is going ...

• Additional information available on the Web, in books ...

• Open Source Linked Data Management System

http://callimachusproject.org

Bernadette Hyland

Contact me at

@BernHyland

bhyland@3roundstones.com

If you’d like to learn more ...

http://semtechbizsf2012.semanticweb.com

Linked Data Warehouses: A new breed of Business Intelligence

Technology

Data Warehouses - moodle.up.pt

Final Report Refrigerated Warehouses

General “Storage” Warehouses to “Small User” Warehouses · 2020. 1. 22. · T H E E I R E C O M P A N I E S General “Storage” Warehouses to “Small User” Warehouses

Joins for Hybrid Warehouses: Exploiting Massive ...taozou/edbt15/paper-56.pdf · Joins for Hybrid Warehouses: Exploiting Massive Parallelism in Hadoop and Enterprise Data Warehouses

Transformation through Sensors, Software and Services€¦ · Bosch Production plants 288 Suppliers 43K Inward Bosch warehouses Bosch finished goods warehouses + 3PL warehouses 400M

Registered Warehouses

Construction of Warehouses

Network of Suppliers warehouses, operations, warehouses, distribution centers, retail outlets, and customers. Supply Chain

Comparison of Single-Breed and Multi-Breed Training

Cities as warehouses

Next Generation Data warehouses

Fsra Factories Warehouses

Trakhees EHS Green Building Regulations Warehouses and ...trakhees.ae/en/ehs/gb/Documents/Regulations/warehouses-and... · Trakhees – EHS Green Building Regulations – Warehouses

TO VIEW CONSERVATION AREA MAPtransact.westminster.gov.uk/docstores/publications... · Inigo Jones’ scheme. Warehouses linked to the market function were constructed north of the

Case Study – Digital Warehouses

Real World Data Warehouses

CATS CATS Breed Identification Breed Identification

Data Warehouses & OLAP

P POTATO WAREHOUSES

Lecture 10: Data Warehouses