PARTHENOS' Underlying Infrastructure

PARTHENOS-project.eu

Parthenos underlying infrastructure

Introducing PARTHENOS – integrating the digital humanities,

14th December 2016, Prato, Italy

Donatella Castelli

CNR-ISTI


CONTEXT

e-InfrastructureElecronic platform operated by a responsible entity offering an open set

of basic enabling services (including access to resources) to a distributed Community of Practice

Data infrastructure“e-Infrastructure” offering services for colletion, deposition, storage,

preservation, access, retrieval, analysis/mining/processing, publication, etc.

Data infrastructure for research

Data infrastructure offering services for the research communities

2

PARTHENOS-project.eu 3

More on Infrastructures

The plumber view

How the services are implemented and operated

User services

The chef view


Integrates

WPS

e-Infrastructurecommons

Externale-Infrastructures,repositories&services

”Physical view”Thewayinwhichinfrastrastructureservices areimplemented

THE PLUMBER VIEW

AnalyticsAggregator

StorageMediator Collaboration

4

Registry


THE PLUMBER VIEW: D4Science.org architecture

Mediators/Adapters

AnalyticsFramework AggregatorFramework

InfrastructuresandServiceProviders

CollaborativeServices CoreServices

ResourceMgr.

VREMgr.

Authen

tication,Autho

rization,

Accoun

ting,PolicyMgm

t.

ResourceRegistry

ContentCloudRegistry

SocialNetworking Workspace UserMgmt.

Standardbased

Ad-hocmediators

Collect

Transform

Clean

Dashboard

Process

Workflow

Index

Access

Store

StorageFramework

StoreInterface AccessInterface

StorageandComputingResources

Monitoring

5


E-services(Aggregator’sdatasources)

API

ftp

OAIPMH

http

Filesystem

OAIPMH

sftp

CollectorService

NativeMDStore

TransformatorandcleanerService

TransformedMDStore

IndexService

OAIstoreService

OAIstore

OAI-PMHAPI

Metadatainspector

Aggregator Framework

Key components

ResourceRegistry

ContentCloudRegistry

6


The Chef View: Virtual Research Environments

WPS

e-Infrastructurecommons

UnifiedResourceSpace

Enables VRE VRE VRE

Externale-Infrastructures

”Logical view”Thewayinwhichinfrastrastructureservices areperceived bytheusers andhowthey areexploited

7


OTHER SERVED COMMUNITIES

4.ProcessingandmanagementofheterogeneousenvironmentalandEarthsystemdatawww.envriplus.eu

1.SocialMining & BigDataEcosystem, aresearchinfrastructureforethic-sensitivescientificdiscoveriesandadvancedapplicationsofsocialdatamining.www.sobigdata.eu

5.Usedtobuildapan- Europeangeothermal energymapwww.egip.d4science.org

8

2.MarineBiodiversityMorethan25000taxonomicstudiespermonthMorethan60000speciesdistributionmapsproducedandhosted

www.d4science.eu

3.Fisheries&AquacultureIncreasingscientificknowledge toenlargethespectrumofgrowthopportunitiesasaddressedbytheBlueGrowthSocietalChallenge


D4Science: NUMBERS as on 13 December 2016

+ 430 millions service invocations in the last year

+ 1600 distinct caller hosts

+ 3100 users in 52 countries (133 PARTHENOS users)

+ VREs users belonging to 443 distinct institutions

+ 99.8% service availability


PARTHENOS: NUMBERS

Archaeology

•• Ariadne•• 600,000fromCulturaItalia

Descriptions oflanguage res,tools,lexicons,corpora

••~200,000fromCLARIN•• ~2,000fromLREMap(CNR-ILC)••- ~2,600fromMETASHARE(CNR-ILC)

Archival descriptions

•• 600,000fromCENDARI••~200,000fromEHRI•• CHcollections

CHcollections

••~1,600fromDARIAH

Description ofresources forHum&Socialsciences

•• ~4M500KresourcesfromHumaNum


MORE ON VREs

Web-based, community-oriented, comprehensive, flexible, and secure working environments

11

• Define sub-communities• Allow temporary dedicated assignment of computational, storage, and data

resources• Simplify the management of accounting, authentication and authorization• Hide resources configuration and setup • Facilitate data and information sharing• Facilitate collaboration


VRE DEFINITION

Configuration

ServiceMetadata

Data

Simpleandeffectiveprocesstodefineanewenvironment

12


CURATIONVRE

Inside a VRE

CurationVRE Members ActivityTracker Curation Disambiguation Search

User-sharedNews

Application-sharedNews

ShareNews


SHARED WORKSPACE

ü Files, dataset, workflows, computational anaysis, etc. ü Shared, disseminated via public URLs

ConferenzaDIITET2016,Rome,22-23November2016

CURATIONVRE


[email protected]

Parthenos: www.parthenos-project.eu

D4Science Web site: http://www.d4science.org; [email protected]

gCube Web site: http://www.gcube-system.org

VREs: https://services.d4science.org/web/guest/virtual-research-environments

D-NET web site: http://www.d-net.research-infrastructures.eu