GEOSS Task AR-09-01b Architecture Implementation PilotAIP Phase 4, (AIP-4)

AIP Task Team

February 2011

GEO Task AR-09-01bArchitecture Implementation Pilot

“fostering interoperability arrangements and common practices for GEOSS”

Other discussions

• in CFP slide 6, need to elaborate on the SBA integrator role

• In general, need to add improving usability of GEOSS/geoportal

• Developing/piloting practice/tools that better support web experiences and better dissemination of resources already submitted by providers

• Discussion about the availability of the Ontology registry in time for AIP-4

AIP-4 Call for Participation

• CFP Main Body• AIP Evolutionary Development Process• GEOSS Services Architecture

GEOSS AIP Phase 4 (AIP-4)

• SBAs: Increasing implementation of GEOSS with CoPs• Data: Foster access to EO Priority Observations

consistent with Data-CORE and Interoperability Arrangements.

• GCI: Utilize the agreed components baseline

DRAFT Schedule and Priorities

SBAs supported by GCI and Data Servers

GEOSS CORE-Priority EO Parameter Access Services

Communities of Practice

Water Energy

Data sharing

Data Harmonization

. . .

. . .

GCI

CoP Toolkit

Data Server deployment

AIP-4 Scope - draft

• Communities of Practice: SBA Integrators, CoP Toolkit

• GCI selected components as baseline• Data Servers:

– Foster access to UIC Priority Observations consistent with Data-CORE and Interoperability Arrangements

• Technology development– Semantics and ontologies for mediation– Data harmonization: quality, schemas– Data Sharing: DSTF, User identity

AIP-4 Call for Participation

• CFP Main Body• AIP Evolutionary Development Process• GEOSS Services Architecture

OperationalCapability

OperationalCapability

UserNeeds,

Scenarios

UserNeeds,

Scenarios

Design, Develop,Deploy

Design, Develop,Deploy

ADC activities including:

ArchitectureImplementation

Pilot (AIP)Task AR-09-01b

GEOSS CommonInfrastructure (GCI)Task AR-09-01a

support

persistentimplementation

requirements

SBA Tasks,UIC, CBC, STC

A process, elaboration of GEOSS Architecture

Consider:Role of Task ForcesRole of CoPsOther ADC tasks: DIAS

AIP Evolutionary Development Phases has piloted the GEOSS 10 Year Plan Architecture • AIP-1 

– Kickoff: June 2007

– Result: "Core" Architecture defined most of the GCI IOC – Architecture Workshop

• AIP-2 

– Kickoff: September 2008

– Result: SBA implementations of common cross-cutting architecture

• AIP-3

– Kickoff: March 2010

– Result: Enabled data sharing and network building in GEOSS SBA communities

DevelopmentDevelopmentActivitiesActivities

Kick-offKick-offWorkshopWorkshop

Call for Call for ParticipationParticipation

ConceptConceptDevelopmentDevelopment

PersistentPersistentOperationsOperations

(AR-09-01a)(AR-09-01a)

Participation

Participation

Participation

Participation

ParticipationArchitectureArchitecture

DocumentationDocumentation

Updates for each step

Baseline

AR-09-01b Architecture Implementation PilotEvolutionary Development Process

Operational Baseline and Lessons Learned for next evolutionary spiral

Continuous interaction with external activities

AIP Development Approach

AIP coordinates with other GEO Tasks

• DI-09-02: Multi-Risk Management • DI-06-09: Use of Satellites for Risk

Management• WA-06-02: Droughts, Floods and

Water Management• WA-06-07: Water Resource

Management• BI-07-01: BON• EN-07-02 - Energy Enviro. Impact• HE-09-01: Info Systems for Health• HE-09-02: Monitoring and

Prediction for Health

• US-09-01: User Engagement• DA-06-01: Data Sharing

Principles• DA-09-01: Data

Management• DA-09-02: Data Integration

and Analysis• DA-09-03: Global Data Sets• AR-09-02: Interoperable

Systems for GEOSS• AR-09-04: Dissemination

and Distribution Networks

AG- Agriculture Task

Community of Practice:Chartered to meet Decision Supportneeds

Community of Interest/Practices and AIP

SBA/CoP Integrator

Service Providers: Data, Observation, Mediation, Processing

CoP Science Community

GCI

Community of Interest:Birds of a feather, discussion group

Communities of Practices in AIP-4:-Integrated Global Water Cycle Obs.-Energy-Air Quality-Biodiversity-Global Agricultural Monitoring?-Geohazards?

SBA/CoP Integrator-Lead AIP CoP WG-Liaison from AIP to CoP-Expert in SBA science and geoinformatics-Lead application of GEOSS architecture to CoP

CoPs supported by AIP

• Objective: Work with CoPs to increase network building and data sharing

• Role of the SBA Integrator– Builds network through Community Portal, using CoP toolkit

and other information and services to meet the needs of the community

– Build on the best practices and interoperability arrangements.

• CoP Toolkit– Community Portals and Application Clients for DSS needs– Community Catalogues– Priority Data Servers for SBA

Support of SBAs/CoPs by AIP processes

• Existing scenario and Use case process

• Add processes to support data needs– Priority observations with CORE and web services– Data quality, e.g., GeoViQua

Building on WPS progress

• Several WPS’s in previous AIP phases.• WPS are building blocks for workflow• Introduce workflow into WIP-4 with tools, e.g.,

Taverna toolbox– Example from WPS and Teverna from GeoViQua

e.g. PyWPS– Publish via myExperiment

EC FP7 Projects Participating in AIP

• Current in AIP-3– EnerGEO, – EO2Heaven, – EuroGEOSS, – GENESIS, – GIGAS, – GIS4EU, – SAFER, – UncertWEB

• New contributions possible:– ISTIMES - DM– DEWFORA- Drought– ENDORSE: "Energy

Services for GMES" - www.endorse-fp7.eu

– GeoViQua– GLOWASIS - Water– (Current GCI call)

AIP-4 Call for Participation

• CFP Main Body• AIP Evolutionary Development Process• GEOSS Services Architecture

Architecture ViewpointsArchitecture Viewpoints

InformationViewpoint

ComputationalViewpoint

EngineeringViewpoint

Implementation/Development

Viewpoints in “Reference Model - Open Distributed Processing (RM-ODP)” ISO/IEC 10746

TechnologyViewpoint

EnterpriseViewpoint

Community Objectives Business aspects: purpose, scope and policiesWhat for? Why? Who? When?

Information sources and models What is it about?

Types of services and protocolsHow does each bit work?

Solution types: distribution infrastructureHow do the components work together?

Implementation system: hardware, software, distributionWith what?

Abstract/Best Practices

SBAs for AIP-4

• Established– Disaster

Management– Energy– Health: Air Quality– Water Drought– Arctic SDI– Biodiversity and

Climate Change

• New in AIP-4– Agriculture

• Maybe in AIP-4– Climate (Liping

NOAA) – Weather (FP7)

One page for each SBA needed in the following pages

GEOSS SoA Enterprise Viewpoint

Cloud Computing Infrastructure

Disaster Management (Arnaud, GIS-FCU)

GEOSS SoA Enterprise Viewpoint

res

reqWPS

Clients

At a specific service levelAt a specific service level

Resources

Disaster Management (Arnaud, GIS-FCU)

GEOSS SoA Enterprise Viewpoint

Encapsulating WPS(OGC-compliant )

Standard Services(Hadoop-based)

Cloud Computing Infrastructure

Services

Resources

Clients

The features of decision making in response phase

unpredictablesemi-structured to unstructuredtransnational

Cloud/Grid computing will be a good solution to support the semi structured to unstructured decision making at a specific service level

Geo Portal

RegistrationSearch

Interact with

Services

Execute AccessAccess

Energy• AIP-2 and AIP-3 have established the GGI capacity to disseminate Energy and Environment related Web

Services using existing standard (OGC).• The on-going FP7 MACC project has established Quality and Uncertainties, as key parameters to be part of

any data set for Energy and/or Environment• Focus for AIP-4 will be made on:

– Providing end-user with Quality and Uncertainties parameters for any relevant data set at Metadata level for Search & Discovery purpose and at Web Service level for end-user full information presentation

– Selecting the suitable development framework for building Graphical User Interface that has the capacity to trigger remote Web Services (WMS, WFS and WPS) in operational services such as SoDa

• Support will be needed from existing initiative such as QA4EO to help Energy Web Services providers to properly build Metadata taking into account the Quality and the Uncertainties parameters associated to the data sets. Metadata should latter be deployed on a GEOSS compliant Catalogue.

• Collaboration with GEO Portal developers should be considered in order to ensure a proper and consistent dissemination and presentation of Energy and Environment data sets on the GEO Portal

• A persistent example addressing Quality and Uncertainty parameters should be deployed as a Web Service, preferably exploited in an operational service such as SoDa. This Web Service should be able to properly carry those parameters for end-user’s information.

• Search, Find Bind mechanism must be addressed and demonstrated through the GEO Web Portal facilities.• Web-based applications using generic framework and triggering Energy and/or Environment related Web

Services must be realized. These Web-based applications must ensure that they properly display the Quality and Uncertainties parameters attached to the geo-localized data. Collaboration with IT partners offering existing frameworks is foreseen.

Reference to MACC project: http://www.gmes-atmosphere.eu/documents/deliverables/r-rad/D_R-RAD_2.1_1.RAD.MACC.v1.0.pdf

Health: Air Quality (Stefan/NGC, EO2Heaven)

• Durban Scenario

GEOSS SoA Enterprise Viewpoint

GEOSS Architecture Implementation Pilot, Phase 4, GEO Water Tasks

Will Pozzi and George Percivall

GEO Task WA-06-02b, Impacts of Drought, Co-POC and NASA WaterNet Project Manager, and Open Geospatial Consortium, GEO Task AR-09-01b Task POC

Presentation before the 2010 GEO Drought Response Initiative, Winnipeg, CA, 10 May 2010

www.ogcnetwork.net/AIP

Proposed Decision Making Services in the Final GEO Water Societal Benefit Area Workplan (discussed within IGWCO and Doug Cripe)

courtesy of Justin Sheffield, Princeton, African Drought Monitor

Global Drought Monitoring and Early Warning Service

Proposed Decision Making Services in the Final GEO Water Societal Benefit Area Workplan (discussed within IGWCO and Doug Cripe)

Architecture courtesy of USA NOAA National Office of Hydrology Remote Sensing Center (NOHRSC)

Cryosphere Monitoring Service

Drought Early Warning requires assembly within an information system (GEOSS) the uses of water, so that drought vulnerability can be assessed or included

Soil Moisture in the European Union Europe Drought Observatory: agricultural impact (http://edo.jrc.ec.europa.eu/php/index.php?action=view&id=19)

Agricultural use, cooling water for power generation, domestic use, environmental flow requirement for ecosystems

Agriculture (Liping Di)

• Crop condition monitoring

• USDA, China, • CoP • Will – irrigation

water

GEOSS SoA Enterprise Viewpoint

Agriculture-Crop Condition Monitoring (Liping Di)• Crop condition information is critical to

decision making in both public and private sectors that concern agricultural policy, production, food security, and food prices.

• Crop conditions change quickly due to changes of various growing conditions, such as temperature, soil moisture, fertilization, or disease, etc.

– Timely and repeat monitoring with a full spatial coverage and sufficient spatial resolution throughout the growing season is necessary.

• Satellite remote sensing provides the best method to monitor crop condition globally.

– Conditions are measured by comparing the current vegetation indices derived from remote sensing to multiple-year statistics of the indices (e.g., Mean, Maximum, Minimum, Medium, etc).

– Multiple nations and organizations are monitoring the crop conditions.

– Standardizing the condition measures and serving the measures to global users under GEOSS framework will be meaningful

• Participants: GMU, USDA NASS, Chinese Academy of Agricultural Science..

GEOSS SoA Enterprise Viewpoint

Arctic SDI (Doug N, EEA?)

GEOSS SoA Enterprise Viewpoint

Biodiversity and Climate Change (CNR and USGS)• Continue the collaboration with EC-JRC

(G. Dubois) Digital Observatory of Protected Areas (DOPA) enhancing the AIP-3 eHabitat Pilot

• Continue the collaboration with NASA JPL (G. Geller) working on interoperability and data/model integration

• Try to contribute also to the GEO Model Web sub-task (AR-09-02d)

GEOSS SoA Enterprise Viewpoint

Climate and Weather

• WMO Information System (WIS)

• NESDIS: Martin• CEOS?• GOOS - Liping

GEOSS SoA Enterprise Viewpoint

GEOSS Information framework

GEOSS SoA Information Viewpoint

Data Harmonization in AIP-4 (Herve updates)

• Uncertainty – GeoViqua, UncertWeb• QA4EO - CEOS• Data Schemas – INSPIRE

– Test Facility for validating schemas

GEOSS SoA Information Viewpoint

Components deploy Services

GEOSSClearinghouse

GEO Web Portal

GEOSS Common Infrastructure

Components & Services

Standards andInteroperability

Best PracticesWiki

User Requirements

Registries

Main GEOWeb Site Registered Community Resources

Community Portals

Client Applications

Client Tier

Mediation Tier

CommunityCatalogues

AlertServers

WorkflowManagement

ProcessingServers

Access Tier

GEONETCastProduct AccessServers

Sensor WebServers

Model AccessServers

Test Facility

MediationServers

GEOSS SoA Engineering Viewpoint

Component Development in AIP-4

• GCI usage and enhancement– New: Ontology Registry, URR

• Community Portals– CEOS portals for Virtual Constellations and CWIC– Geonetcast via Eumetsat Portal– CBC connection

• Data Servers– Data Sharing– Geoss data CORE

 GEOSS SoA Engineering Viewpoint

Development status for ADC activities

Development Status

AIP SIF GCI CT

Development X

Demonstrational X

Pre-operational X X X

Operational uses X X

Superseded X

Discontinued X

EUMETSAT development status categories

CoP web presence: Community Portals

• IGWCO not on Community Portal– Watercycleforum.com

• Nadine

GEOSS SoA Engineering Viewpoint

Deployment of Priority data services

• Deploying a data service– See AIP-2 video

• Metadata for adding into GCI– Confirm visibility (browse, access) in GWP

• Data Sharing: CORE, user registration/identity– Metadata about data sharing

• Data harmonization: schemas, quality.

• Used by many CoPs

GEOSS SoA Engineering Viewpoint

Make priority data fully available as services

US-09-01aCritical Earth Observation

Priorities

DSTFGEOSS

Data-CORE Roadmap

Compare the 2 lists

Highest Ranked EO Parameters

Datasets tagged as CORE

(Pledge List)

AIP-4 Access

Services Pilot

Priority EO Parameters available as

CORE

GEOSSCORE-Priority EO Parameter Access

Services

Sbageotask.larc.nasa.gov

CORE = full and open with no restrictions. No data reuse conditions. There may be cost and attribution requirements.

No cost recovery in AIP-4

DIAS connection to this emphasis?GTHN – Global terrestrial Hydro Network

Data Sharing (Steve Browdy)

• Working with the DSTF, • User Management

– User identity– User registration

• Data Access Conditions:– Data-CORE, Non-Commercial Use, other

• let a user know when she/he is leaving the GEO site and entering another.

Semantic Mediation (Cristiano, Nagai)

•Coordination with GEO task AR-09-01d on semantic mediation issues•Support to the optimization and extension of the GI-DAC service broker•Integration and harmonization of thematic thesauri with reference ones:

•Water Ontology from AIP-3•Drought Vocabulary from EuroGEOSS•More contributions are welcome…

•Coordination with GEO task AR-09-01d on semantic mediation issues•Support to the optimization and extension of the GI-DAC service broker•Integration and harmonization of thematic thesauri with reference ones:

•Water Ontology from AIP-3•Drought Vocabulary from EuroGEOSS•More contributions are welcome…

References

• GEO – earthobservations.org

• GEO Architecture Implementation Pilot– www.ogcnetwork.net/AIpilot

• GEOSS registries and SIF– geossregistries.info

George Percivallpercivall@myogc.org

Nadine Alamehnalameh@opengeospatial.org