41
GRANT AGREEMENT: 601138 | SCHEME FP7 ICT 2011.4.3 Promoting and Enhancing Reuse of Information throughout the Content Lifecycle taking account of Evolving Semantics [Digital Preservation] “This project has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement no601138”. PERICLES IN PRACTICE Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information Anna Eggers (State and University Library Göttingen) Fabio Corubolo (University of Liverpool)

PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

Embed Size (px)

Citation preview

Page 1: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

GRANT AGREEMENT: 601138 | SCHEME FP7 ICT 2011.4.3 Promoting and Enhancing Reuse of Information throughout the Content Lifecycle taking account of Evolving Semantics [Digital Preservation]

“This project has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement no601138”.

PERICLES IN PRACTICEWorkflow for the automated updating of Digital Ecosystem Models with Significant Environment InformationAnna Eggers (State and University Library Göttingen)Fabio Corubolo (University ofLiverpool)

Page 2: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

1. Overview of the Workflow2. The Digital Ecosystem Model

a. Our Scenario3. The Mediator Script for our workflow4. The PERICLES Extraction Tool5. The EcoBuilder6. The Entity Registry Model Repository7. What to do with the resulting model▶For each workflow step: live demo ▶After each demo: Questions and discussion

Agenda

Page 3: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

▶PERICLES Extraction Tool◦ extraction of Significant Environment

Information▶Digital Ecosystem Model

◦ ontology for modelling Digital Ecosystems▶EcoBuilder

◦ tool to create Digital Ecosystem Models▶Entity Registry and Model Repository

◦ repository for the created models▶further models and model processing Tools

Overview PERICLES Tools for the Model Updating Workflow

Page 4: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

▶Complex Digital Ecosystems are hard to maintain.▶It is also hard to estimate and analyse the

impact of planned and unplanned change, and to identify and solve problems.

→ Automated updating of models supports maintaining, preservation, and analysis

Problems & solutions

Page 5: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

Model Updating Workflow

Page 6: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

The Digital Ecosystem Model

Page 7: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016
Page 8: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

General Description▶Scenario: A weather scientist is doing research

on cloud thickness. He uses data from the Eumetsat data services, and cloud computing Service (BIRA).

▶EUMETSAT is the European Organisation for the Exploitation of Meteorological Satellites. Besides the launch and operation of satellites it is also responsible for delivering satellite data to end-users, e.g. scientists.

Space Science: Experiment Workflow

Page 9: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

General Description▶SEVIRI Images is data from the Meteosat

Second Generation (MSG) geostationary satellite with Spinning Enhanced Visible and InfraRed Imager (SEVIRI). It senses the Earth's atmosphere in 12 different spectral channels.

▶BIRA: Belgian Institute for Space Aeronomy.Provides the necessary technical infrastructure for carrying out the calculation based experiment.

Space Science: General Workflow

Page 10: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

General Description▶Workflow: A Scientist…

◦ accesses the EUMETSAT data service via a web portal interface to select and download the relevant data

◦ makes use of an own calculation script◦ transmits data and calculation script to BIRA

services◦ executes the calculation process◦ downloads the resulting data to his local system◦ view and analyze the results for a scientific

publication. ▶Three complex areas are interacting: Local system of

the scientist, EUMETSAT data services, BIRA computing system.

Space Science: General Workflow

Page 11: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

DEM

of

Sce n

a rio

Ove

rvi e

w w

h ole

w

orkfl

ow

Page 12: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

Our Scenario for the first workflow

Page 13: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016
Page 14: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

Step 1: Template Creation

Page 15: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

The Mediator Script is the controller of the workflow.

▶has a scenario specific template▶gets information from PET▶puts the information into the template to

create DEM instances ▶sends the model instances to ERMR

The Mediator Script

Page 16: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

→ Create scenario dependent DEM template

DEMO Step 1:Template for our science Scenario

Page 17: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

▶The Digital Ecosystem Model▶Our scenario▶Mediator Script▶Creation of scenario dependent templates

Questions?

Page 18: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

The PERICLES Extraction Tool

Page 19: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

PERICLES Extraction Tool (PET)

• Open source framework for the extraction of environment information

• Sheer curation• Generic, modular, domain agnostic• Collection by observation

o monitor environment changeso extraction in case of change

• Snapshot of the system environment • To observe unstructured workflows

Page 20: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

• Extract information that is usually ignored by current metadata extractors

• From outside the digital object• At the right time and place: within the

creator or curator’s environment• Supporting continuous extraction (time

series)• Be easily customisable with extraction

profiles

PET aims

Page 21: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

The PERICLES Extraction Tool

Page 22: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

• Available and used system resources• File format identification and checksums• Currently running processes• Event information from processes• Graphic configuration information• MS Office and PDF font dependencies• Native commands

PET Extraction Modules

Page 23: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

Step 2: PET Configuration

Page 24: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

Step 3: SEI Extraction

Page 25: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

Step 4: Information Sending

Page 26: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

→ Step 2: Configure PET for the scenario→ Step 3: Extraction of Significant Environment

Information→ Step 4: Send extracted information

DEMO Step 2-4:PET in our Workflow

Page 27: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

▶ The EcoBuilder▶ Model Instantiation▶ The Entity Registry Model Repository▶ Model sending / storing

Questions?

Page 28: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

The EcoBuilder

Page 29: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

Tool for the creation of Digital Ecosystem Models▶GUI

◦ Simplifies the creation of the model◦ Usable by scenario experts without the

necessity to write ontology or Java sources▶Java API

◦ Facilitates integration into workflows ◦ Used by our Mediator Script!

▶Uses Java Jena API - can output OWL/XML or Turtle

EcoBuilder

Page 30: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016
Page 31: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

Step 5: Template Instantiation

Page 32: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

→ Instantiate the template with the extracted information

DEMO Step 5:Template instantiation

Page 33: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

Entity Registry Model Repository

Page 34: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

▶Large scale distributed data store and model repository (triple store)

◦ in PERICLES model and data store▶Accessible via Web interface or RESTful API▶Notification system

The Entity Registry Model Repository

Page 35: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

Step 6: Model Submission

Page 36: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

→ Send the updated model to the repository

DEMO Step 6:Model Submission

Page 37: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

▶The EcoBuilder▶Model Instantiation▶The Entity Registry Model Repository▶Model sending / storing

Questions?

Page 38: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

Step 7: Model Analysis

Page 39: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

Other PERICLES tools connect to the ERMR where the models are stored. They can get the models to▶model validation and difference calculation

(LRMS)▶visualise the impact of change (MICE)▶edit policies (Policy editor)▶assess content and risks (Appraisal Tool)▶high level translation/connection layer for

PERICLES tools (PerSIST API)

DEM Step 7:Get and analyse the models

Page 40: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

▶simulate impact of change▶reveal single point of failures▶use in a sheer curation scenario

◦ extraction of significant environment information

◦ automatic updating of models▶analyse provenance

Resulting Model

Page 41: PERICLES Workflow for the automated updating of Digital Ecosystem Models with Significant Environment Information - Acting on Change 2016

Questions?

The presented tools are available under open source license on GitHub: https://github.com/pericles-project