Waternomics: Making Sense of Data

Preview:

Citation preview

@WATERNOMICS_EU www.waternomics.eu

Project co-funded by the European Commission within the 7th Framework Program (Grant Agreement No. 619660)

MAKING SENSE OF WATER DATA

WASSIM DERGUECH

Waternomics End of Project Meeting 30/01/2017Galway, Ireland

@WATERNOMICS_EU www.waternomics.eu2

EVERYTHING IS BECOMING SMART

2

Everything can be sensed and measured

Everything is connected: people,

systems, objects, etc.

Decision support systems can analyze, optimize, predict, etc.

Adapted from Cameron Brooks, Lets Build a Smarter Planet: IBM Smarter Water Management, Water Resources Conference, 2010

@WATERNOMICS_EU www.waternomics.eu3

SMART SYSTEMS FOR EVERYTHING

3

SMART Water SMART Transport SMART Energy

Water

Energy

ChemicalsPublic

Transport

Traffic

Energy

Energy Grid

Sources ofEnergy

Smart Homes

CO2

CO2

Apply ICT for monitoring, analysis, prediction, quality control, …

Adapted from Cameron Brooks, Lets Build a Smarter Planet: IBM Smarter Water Management, Water Resources Conference, 2010

From Sensors to Apps

4

SmartSensors/Meters

PredictiveAnalytics Leak

Detection

CostCalculation

CO2Emission

SensorDataManagement

Data Modeling

Collection

Aggregation

Enrichment

Linking

ClassificationCleaning

Integration

Storing

Querying

Objective: prepare the data for application developers

@WATERNOMICS_EU www.waternomics.eu5

OVERALL ARCHITECTURE

@WATERNOMICS_EU www.waternomics.eu6

Installed in

3/4Pilot Sites

43Sensors

HIGHLIGHTS (HARDWARE)

3Types of Sensors

@WATERNOMICS_EU www.waternomics.eu7

OVERALL ARCHITECTURE

@WATERNOMICS_EU www.waternomics.eu8

MULTIPLE SOURCES OF DATA

IoT Sensors

BuildingData

EnterpriseData

Open Data8

@WATERNOMICS_EU www.waternomics.eu9 9Img credit (flickr) Dominik Staszowski

@WATERNOMICS_EU www.waternomics.eu10

A POTENTIAL SOLUTION: LINKED DATA

10

@WATERNOMICS_EU www.waternomics.eu11

LINKED DATA AN EXAMPLE

@WATERNOMICS_EU www.waternomics.eu12

MINIMAL VOCABULARY FOR ENTITIES

@WATERNOMICS_EU www.waternomics.eu13

WKAN AS A DATA CATALOG

Powered by

• single search & browse interface for data

sources, datasets, entities, and open data

related to Waternomics Project

• metadata available through API in standard web

format

@WATERNOMICS_EU www.waternomics.eu14

SEARCH SERVICE

@WATERNOMICS_EU www.waternomics.eu15

OPENCUBE AS WATER DATA EXPLORER

• Search & browse entities and aggregates

• Make entity metadata and aggregate data

available as Linked Data

@WATERNOMICS_EU www.waternomics.eu16

LAMBDA ARCHITECTURE

@WATERNOMICS_EU www.waternomics.eu17

REAL-TIME LINKED WATER DATASPACE

@WATERNOMICS_EU www.waternomics.eu18

@WATERNOMICS_EU www.waternomics.eu19

HISTORICAL DATA PROCESSING

@WATERNOMICS_EU www.waternomics.eu20

REAL-TIME DATA PROCESSING

@WATERNOMICS_EU www.waternomics.eu21

LINKED WATER DATASPACE

The Waternomics dataspace is designed to scale and deal with big data through the use of Druid,

Kafka, Spark, etc.

Technology used by big data companies

@WATERNOMICS_EU www.waternomics.eu22

LINKED WATER DATASPACE

• A dataspace as one stop shop for all data• Easy integration of new data sources• Reduced data integration costs• Pay As You Go data management• Use of standards and Open Data

KeyBenefits

KeyTechnologies

• Lambda Architecture• Semantic Web• Linked Data• Real-time data ingestion• Historical data integration• Open Data

@WATERNOMICS_EU www.waternomics.eu23

IMPACT

• One dataspace for all apps

• Open Source for all the dataspace components

• Training and Education

• Use of Open Data

@WATERNOMICS_EU www.waternomics.eu24

OVERALL ARCHITECTURE

@WATERNOMICS_EU www.waternomics.eu25

NEXT: BUILDING SMART WATER APPLICATIONS

25

@WATERNOMICS_EU www.waternomics.eu26

20+Water Applications

28Datasets

10+Support Services and

Libraries

HIGHLIGHTS (APPLICATIONS)

@WATERNOMICS_EU www.waternomics.eu27

waternomics.eu @waternomics_eu

@WATERNOMICS_EU www.waternomics.eu28

This project has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement no 619660.

waternomics.eu @waternomics_eu

This project is member of and

Recommended