Workshop on Information Access EnablersMétéo France Strategy

Geneva17-18 May 2010

Jacques Roumilhac

Information access in Météo France

Stage 1: Current status– Okapi production platform (finalized products) with a Web portal– IAA (Random Access on Legacy databases) with a bespoke language via ftp

Stage 2: Information system evolution– SOA (with a part of OGC services) – Information model with geographic references– Spatial databases– Light and smart client (forecaster station project)

Stage 2 bis: WIS solution– OpenWIS developed with UKMO– Metadata generator

Stage 1: Production Service Okapi - IAA

OKAPI: Three software bricks, loosely linked :

– Okapi production platform (products factory).– Internal production portal : Okapimet (For web and webservice customers).– production portal : Climatheque (For web and webservice customers).

IAA– Random access– On the legacy databases– Archive access possible– With a bespoke language

System schema

orchestration, traffic shaping

Traffic shaping mechanisms Balanced charge. Product factory (close WTS) Identity management (authorization,

authentication)

Stage 2: New project Synopsis: Forecaster tools based on SOA

Two main requirements SOA

– Development efforts factorization– Processing and data pool access – Standard interfaces– Management of different topologies (local or remote server, standalone)– WMO needs and INSPIRE recommendation

Client station– Last technologies– Deployment and support easy– Light or smart client– Scalable, efficient– Multi-platforms

Technical choices

Synopsis Server :

– Linux 64 bits :• Re-use of current services in different systems• Use of programs and libraries of ECMWF

– Use of bricks OpenSource• Databases: PostgreSQL, PostGIS• Image processing: GDAL, Proj4• Mapserver : services OGC• Geonetwork for the catalogue

The services

Different service levels– Metadata access (catalogue)– Data access– Business processing (graphic processing)– Presentation services (images, maps, graphics…);

Interoperability for the map services– So : WMS (Web Map Service) et CSW (Web Catalog Service)

For INSPIRE, interoperability also on data and processing services (transformation and downloading)

– So : WCS (Web Coverage Service) WFS (Web feature Service), WPS (Wep processing Service) ….

SOA : Reference architecture

Application composite

Business process

Engine OrchestrationBPM

Supervision

SAM BAM

Data access

CRUD CRUD CRUD

Application composite

Administration Plate-Form

Business servicesProcessing / Transformation

Bus for messages

Legacy databases

Application composite

Services Registry

SAM : Service Activity Monitoring

BAM : Business Activity Monitoring

BPM : Business Process Management

CRUD : Create Read Update Delete

Interoperability

Strategic target Use of the standards OGC standards for geo-referenced data

Web MapServer

Web CoverageServer

Web FeatureServer

Web Map Service (WMS) Web Feature Service (WFS)Web Coverage Service (WCS)Catalogue (CSW)Geography Markup Language (GML) Web Map Context (WMC)OGC KMLOthers…

SOA : Architecture interoperability on legacy databases with geographic extension

Client SYNOPSIS Java Web Start Supervision Plate form

Interface HPOV

Data Service

WFS WCS

Client SYNOPIS Full Web

Administration Plate-Form

Bus of messages JMS

Other applications composites Catalogue

CSW

SOS

Processing service Presentation service

FPSWMSWPS SPS

BDMO

Geo-extension

BDMO

Ref)

Legacy databases

BDAP

Ref

BDI

Ref

BDEPI

Ref

BDE

Ref

BDI BDEPI BDE BDAP

Geo-ext

Data Access Services

Services de DONNEES

WCS WFS SOS

WFSWeb Feature Service

Coast map lines

Objects : Anasyg

Pi, Sympo2,

Aeronautic

OACI Annex 3

Portrayal Services

Services PRESENTATION

FPSWMS

Observation

Objects : Anasyg

Pi, Sympo2,

WMSWeb MapService

Static geographic layers

Models plots

Aeronautic

OACI Annex 3

Images

Radar, Sat

Different clients

Client SYNOSIS Smart

Data access services(CRUD)

WCS WFS

Client SYNOPIS Light (Full Web)

Presentation services

WMSFPSSOS

Processing services

WPS SPS

CATALOGUE Service

CSW

OKAPI

BDMO

Extension

BDMO

Ref)

Legacy databases

BDAP

Ref

BDI

Ref

BDEPI

Ref

BDE

Ref

BDI

Extension

BDEPI

Extension

BDE

Extension

BDAP

Extension

VGISC

Client VGISCAdvanced Production INSPIRE

answer

General Architecture

Data and services catalogue (standard)– On line products and services discovery.– Message bus

• Balanced flow (cluster services)• Loosely link between server and client

Spatial database– Using MapServer and other OGC implementations

Standard interfaces used by the clients– Possibility to access to extern services (without guarantee of

performances)– Useful for a wandering forecaster

Prototype Architecture

Middleware ( bus JMS )Middleware ( bus JMS )

Frontal SYNOPSIS (SynFront) HTTP -> JMS

Network (IP)Network (IP)

MetadataISO 19115ISO 19119

BD Spatiale(SynBase)

PosGIS

Services on Services on clustercluster

WMSWMS(cartes)(cartes)

CATALOGUEGeonetwork

ISO 19115-19119

CSWCSW

MapServerM

agics++M

agics++

Business serviceMapScript Servlet

Executable CGI

Server SYNOPSIS (SynServ) JMSWMSWMS

SopranoSopranoTransmetTransmetRetimRetim

File System

Client Client SYNOPSIS SYNOPSIS Full WebFull Web

Client SYNOPSIS Client SYNOPSIS JAVA Web StartJAVA Web Start

Alimentation BD (SynDATA)

Premières maquettes

Premières maquettes

Architecture Target (Back Office)

““Backbone” of servicesBackbone” of services(ESB ?)(ESB ?)MonitoringMonitoring

AdministrationAdministrationSécuritySécurity

Front End

WMSWMSPrésentationPrésentation

cartescartes

WPSWPSProcessingProcessing

CRS transf.CRS transf. … …

CATALOGUEGeonetwork

ISO 19115-19119

CSWCSW

Serveur SYNOPSIS Serveur SYNOPSIS

Servers

CEP WEB High availability

Obs Front End

WMS WMS PrésentationPrésentation

Cartes Cartes

SOS SOS SPSSPS

bus JMS internalbus JMS internal

BD’s SOPRANO

BDMBDCLIMBDAP

BDI

Front End CBD [OKAPI ?]

SOS SOS AccessAccess

Obs Obs validatedvalidated

BD spatiale(SynBase)

PostGIS

BD’s Spatiales PostGIS

BDEPIBDE

BDI « new »

ClientsClientsWCSWCSAccess Access

ImagesImages

ModèlesModèles

WMS WMS PrésentationPrésentation

Maps Maps

WPSWPSProcessingProcessing

StatsStats

Client Synopsis Client Synopsis JAVAJAVAClient Client

Synopsis Synopsis WEBWEB

Client Client ProductionProduction

Obs & time seriesObs & time series

CLUSTER CLUSTER

WFSWFSObject accessObject access

PI, SYMPO2PI, SYMPO2

AERO (WXXM)AERO (WXXM)

RMDCNRMDCN

Stage 2 bis: WIS Approach

OpenWIS development :

– Information fetching: Different use cases– OpenWIS: Open interfaces– Request or subscription– Météo France use two diffusion systems

Metadata GTS generator– To populate the WIS catalogue– Mapping between Volume C1 and Core Metadata Profile– Close the prompting question on information sources

5: Storage in the shopping cart for an online distrbution, or preparation of the dissemination instructions: they are constructed from the user profile, among other elements.

DAR

3: the user composes an ad-hoc request for the product type. The user specifies which products are of interest, and the chosen dissemination options.

Portal

subscriptions(user profile)

4: The product type is part of the global dataset. The requested products are extracted from the Cache.

Routing

MSS FSS

6: the products and instructions are forwarded.

7: Dissemination according to instructions.

7bis: the user receives the products.

Ad-hoc Request for a product in the Cache – dissemination via the FSS (GISC function)

OpenWIS

1: the user discovers local product type in the catalogue

2: the user is authenticated (several steps)

5bis: the user obtains the products from the shopping cart.

6: Storage in the online shopping cart, or preparation for dissemination.

DAR

Portal

subscriptions(user profile)

4: the product type is owned by a local NC or DCPC.

Routing

MSS FSS

6bis: the user obtains the products from the shopping cart.

SOURCE5: the required products are extracted and returned.

Ad-hoc Request for a local product – dissemination via the FSS (NC or DCPC function)

OpenWIS

1: the user discovers local product type in the catalogue

2: the user is authenticated (several steps)

3: the user composes an ad-hoc request for the product type. The user specifies which products are of interest, and the chosen dissemination options.

8bis: the user receives the products.

7: the products and instructions are forwarded.

8: Dissemination according to instructions.

4: Storage in an online shopping cart or preparation for dissemination: construction of the dissemination instructions.

DAR

Portail

subscriptions(user profile)

3: Is someone subscribed to this type of product ?

Routing

MSS FSS

1: the MSS receives a new product

5: the product and instructions are forwarded

2: the MSS routes the product according to its

routing table

2bis: the product is collected and inserted in the GISC Cache

4bis: the user obtains the product from the shopping cart.

6: Dissemination according to instructions.

6bis: the user receives the product.Arrival of a new GTS product at the MSS (GISC function)

OpenWIS

5: Storage in an online shopping cart or preparation for dissemination: construction of the dissemination instructions.

OpenWISDAR

Portal

subscriptions(user profile)

3: Is someone subscribed to this type of product ?

Routage

TRANSMET FSS

6: the product and instructions are forwarded

2: Notification of the product availability

5bis: the user obtains the product from the shopping cart.

7: Dissemination according to instructions.

7bis: the user receives the product.

SOURCE

1: New local product

4: the required products are extracted and returned.

New local product available (NC or DCPC WIS function)

External Interface

Metadata service Data service

User Interface (web portal)

DARMet

User & Data Policies

MetadataCatalogue

Cache

A7

A1 A3 A5 A1 A3

A1 A3 A5

A2 A4 A6

A1 A5 A5A1

Make / FollowRequest

Browse /Search DAR

Admin /Monitoring

Authentication

AuthorisationManage

Requests

CatalogueAccess Monitoring

Administration

CollectionSynchro &Harvesting « Ad Hoc »

Routine« Push »

DIFFMSS/FSS

Local System

POSSIBLE CHOICESSIMDAT base

Sun OpenSSO baseGeoNetwork base

MSSSMART / GEMS

OpenWISUK MetOffice

Replication

GTS Metadata GeneratorClose to prompting question on digitization