34
Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD [email protected] User Community Transition from EGEE to EGI 17 December2008 Paris (France) www.d4science.org

Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD [email protected] User Community Transition from

Embed Size (px)

Citation preview

Page 1: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

Supporting eScience Communities: The D4Science Perspective on EGI

Pasquale PaganoD4Science [email protected]

User Community Transition from EGEE to EGI 17 December2008

Paris (France)

www.d4science.org

Page 2: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

2

www.d4science.org

Outline

• D4Science in a nutshell

• Communities characterization

• D4Science as a mediator• Resources • Support

• Speculation on the EGI model

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 3: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

3

www.d4science.org

D4Science highlights

Introduction

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 4: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

4

www.d4science.org

D4Science vision

D4Science vision

calls for the realization of scientific e-Infrastructures that will remove technical concerns from the minds of scientists, hide all related complexities from their perception, and enable users to focus on their science and collaborate on common research challenges

gCube is

a framework to manage distributed e-infrastructures where it is possible to define, host, and maintain dynamic virtual research environments capable to satisfy the collaboration needs of distributed Virtual Organizations (VOs)

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 5: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

5

www.d4science.org

Virtual Research Environment (VRE)

VRE is a distributed highly dynamic environment for

• carrying out cooperative activities like data analysis and processing; data generation, integration, enrichment, and curation; production of new knowledge using specialized tools

• largely based on retrieval and access of always updated knowledge from diverse heterogeneous data sources

• produce knowledge that is preserved and made available for other usages inside and outside the VRE

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 6: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

6

www.d4science.org

Virtual Research Environments Resources

VRE environment is designed, dynamically deployed, and operated as a set of cooperating resources:

computing, storage VRE enabling middleware

Information system, monitoring, resource management and orchestration VRE services

content and storage management, discovery and access, … applications

mostly provided by the VOs collections of raw data, content, and metadata

enriched with schemas, mapping rules, transformation programs, relationships, …

processes defined to manage such resources

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 7: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

7

www.d4science.org

Communities characterization

Part 1

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 8: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

8

www.d4science.org

ENVIRONMENTAL MONITORING VO:

CHLOROPHYLL AND VEGETATION DISTRIBUTION VREs

Courtesy by

Luigi FuscoESA

Page 9: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

9

www.d4science.org

VREs: to enhance current procedures

The VRE integrated environment puts at disposal a functionality set which is not today available in Earth Science to support and perform research activities: examples are

the ability to process information on-demand ingesting the results,

to set-up further VREs opening to colleagues, to perform customized collection of information, to store user actions and exploit them for further use, to aggregate relevant information into ad-hoc

information sources and keeping them updated.

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 10: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

10

www.d4science.org

VREs data sources

eogrid.esrin.esa.int: daily updated data sets and applicationswww.fao.org/geonetwork: ~4.7k global data setwww.gmes.info: key community portal to data set and

applicationswww.medspiration.org: daily updated data setswww.eoportal.org: reference documentation, metadata, and

applicationsidn.ceos.org: reference thesaurus, ~30k productswww.eea.eu.int: environmental data sets and reports

Products: Landsat 7, AATSR, Meris level 2, Meris Level 3, MGVI.

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 11: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

11

www.d4science.org

VREs: to enhance current procedures

Currently these steps are carried on manually, on different technologies and systems delaying the delivery of research results.

The planned VREs offer a dynamic set up and utilization of Virtual DL which are created for the specific scope defined by the users.

The focus, once again, is not in the processing, but in the dynamic allocation of resources.

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 12: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

12

www.d4science.org

FISHERIES AND AQUACULTURE RESOURCES MANAGEMENT VOs

INTEGRATED FISHERIES CAPTURE INFORMATION SYSTEM - ICIS VRE

Courtesy by

Marc Taconet FAO

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 13: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

13

www.d4science.org

WorldFish Center

One of 15 centers supported by the Consultative Group on International Agricultural Research (CGIAR). Close relationship with IWMI (water management)

HQ in Penang, Malaysia with 11 Country Offices: AFRICA: Cameroon, The Democratic Republic of Congo, Egypt, Malawi, Zambia; ASIA: Bangladesh, Cambodia, China , The Philippines; PACIFIC: New Caledonia, Solomon Is.

Partnership with government and non-governmental agencies at regional, national and local levels in the developing world, and with advanced research institutions in more than 25 countries with more than 200 partners representing 50 countries

Priority to help regional and national bodies to develop fisheries and aquaculture management strategies

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 14: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

14

www.d4science.org

Food and Agriculture Organization of the United Nations

FAO: www.fao.org, UN agency Institutional, inter-governmental Establish standards, controlled vocabularies, ontologies Gather data, information incl. landing statistics, and

methodologies Propose recommendation of good practices

Fishery Department investigates the impact of fisheries on the world's marine ecosystems in collaboration with Regional Fisheries Bodies

Academic research Reconstruct historical catches and biomasses at ocean level

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 15: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

15

www.d4science.org

Regional Fishery Bodies

Intergovernmental bodies Management of shared resources

• On geography basis (sea)• On stock basis (migratory species like tuna)

Gather data, information including catches and landing statistics

Recommendations for quotas by country (to be endorsed by regional political bodies)

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 16: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

16

www.d4science.org

Regional Fishery Bodies

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Source: FAO: http://www.fao.org/figis/

Page 17: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

17

www.d4science.org

Community member selection– phase one

Begin at regional level Clearest need for VRE’s at this level Multiple nations Multiple data sources High profile assessments on commercially important stocks

Partner selection criteria who FAO is currently involved with who is regularly performing assessments who has expressed interest who has good IT experience data without problems of access rights

Current candidates

ICES NAFO

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

SEAFDEC SPC

Page 18: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

18

www.d4science.orgICES FAO (GFCM/CECAF) NAFO

Data services

Data model

Data services

Data model

Data services

Data model

Mapping rules

Data import services

Reallocation rules

Data formatting

CSV table DB connection XML WSDL PDF HTML

imp

ort

mo

de

lh

arm

on

-iza

tion

an

aly

sis

rea

lloc

-a

tion

ou

tpu

t

An

no

tatio

n / U

ser rig

hts

Query support

GIS services data services

Common data model

Reliability indexFAO (GFCM /

CECAF)NAFOICES

Geo Network

Aqua MapSpecies habitat

index

VREs: to enhance current assessment procedures

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 19: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

19

www.d4science.org

Professional backgrounds

Fishery biologists and marine ecologists Statisticians and modelers Economists Sociologists Lawyers and enforcement skills (rangers, customs,

coast guards)

Conservationists: Threatened species and Marine Protected Areas (MPA: are also seen as a fishery management tool)

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 20: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

20

www.d4science.org

Scope: Socio-Ecological Systems (SES)

Increase the resiliency (= decrease the vulnerability) of fisher communities (with respect to e.g.

Overfishing (by locals or intruders) Natural stock variability Natural hazards Global climate change

Taking into account external impacts e.g. Political and economic situations Cultural peculiarities Epidemiological situations

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 21: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

21

www.d4science.org

D4Science as a mediator

Part 2

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 22: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

22

www.d4science.org

D4Science Mediation

Mediates over the definition, deployment, and maintenance of EGEE sites• VOs users management• Applications porting to the Grid and execution, e.g. Aquamaps data challenge

(>100k jobs, >10M compound products)• Applications integration, e.g. Landsat 7• Grid Services integration, e.g. ESA gPod MGVI

Support the definition, deployment, and maintenance of gCube sites for the creation and maintenance of VREs

• Resource description, monitor, and provision (GLUE, WSRP, WSDL, ..)• Dynamic selection, configuration, and secure resources exploitation in VREs

scope• Services orchestration (BPEL)• Data integration

• Support for compound objects, multiple metadata formats, mixed media annotation• Support for advanced information retrieval, fusion and merge of the result, access• Support for curation, transformation, and enhancement of data

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 23: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

23

www.d4science.org

D4Science Resources

D4Science provides seed resources • through the provision of 3 EGEE sites maintained by

technological partners (64 WNs, >100 cores)

D4Science supports communities • through SA and its production support team but the

maintenance of am EGEE site is still perceived too costly (number of updates and duties)

D4Science promotes communities VOs• through the establishment of agreements with other EGEE

VOs, e.g. csTCDie (Trinity College, Dublin)

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 24: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

24

www.d4science.org

Speculation on the EGI model

Part 3

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 25: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

25

www.d4science.org

Towards EGI

D4Science facts: Institutional partners with world-wide mandate Shared vision towards a data infrastructure ecosystem User-pulled requirements Buying-in plans from partners organizations Strategy for growth by contamination

Long Term Vision: Institutionalized entity responsible for

the coordination and maintenance of the data infrastructure ecosystem the secretariat for the ecosystem governing body

Current implementation: Project-based organization coordinating project partners and

EGEE provided resources

Page 26: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

26

www.d4science.org

Towards EGI

Envisioned solution: Specialised Support Center Hosted by EGI.org

Providing seed resources

Empowered and Governed by Ecosystem Members

Project-based Project-based Institutionalized EntityInstitutionalized Entity

FROM TO

Page 27: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

27

www.d4science.org

TIME FOR QUESTIONS AND DISCUSSION

Thanks for your attention

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 28: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

28

www.d4science.org

ADDITIONAL SLIDES

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 29: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

29

www.d4science.orgFisheries User Community: Overview10 January 2008, Sophia Antipolis (France)

World FAO areas

Page 30: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

30

www.d4science.org

Organizational level and workflow

Roles distributed: by themes

Ecology – environment Fisheries

by mission: Policy – management – development Research Control and enforcement

by geographical scale: Global level Regional level National level

FAO WFC RFBs National research center

National administ

ration

xx x

xxx x

xx x

x

xx

x

x

x xx

x x

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 31: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

31

www.d4science.org

Needs at global level for High Seas fisheries UN recommendations

“distinguish catch in the High Seas from catch within EEZs”

current status: reporting by statistical areas

Organizational level and workflow Global organizational framework: High Seas

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 32: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

32

www.d4science.org

Needs at global level for High Seas fisheries UN recommendations

“distinguish catch in the High Seas from catch within EEZs”

current status: reporting by statistical areas

Organizational level and workflow Global organizational framework: High Seas

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 33: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

33

www.d4science.org

REGIONAL LEVEL

standard reporting

format

fishbase DBFAO

WFC

RFBsCatch + GIS

peer reviewediting

NOAA

OBIS

GLOBAL LEVEL

Catch + GIS

Satelliteoceanographic

Species occurrence

end user

Fishery ontology

Reference system

Aquamap

Needs for High Seas fisheries Organigram of possible workflow

Organizational level and workflow Global organizational framework: High Seas

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)

Page 34: Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD pasquale.pagano@isti.cnr.it User Community Transition from

34

www.d4science.org

Conclusion on needs

Regional level: Scope: assessment and management of shared and straddling

stocks Needs for VREs: sharing workspace, replaying and streamlining

legacy information systems scientific knowledge elaboration management advice status and trends reporting

Global level: Scope: High Seas fisheries Needs for VREs: permanent shared services to providers and

web-services to end users Networked catch regional databases, and global fishery ontology Modelling of ecological processes - Aquamap process: Species

likeliness of spatial occurrence indexes Peer review processes

Supporting eScience Communities: The D4Science Perspective on EGI17 December 2008, Paris (France)