IS-ENES2 KPIs and figures up to 03-2016 version du 27-07 FV-1

March 2016

1/20

IS-‐ENES2 Key Performance Indicators

Defini1onAssessing IS-‐ENES2 events' degree of openess and feedback from recipient community

Measure UnitNumber of external a?endees/contributors to project workshops since the start of the project. Are not included internal working sessions.

Related Project Objec1ve

1Related Project ac1vity/ies All WPsResponsible Partner CNRS-‐IPSLSource InformaKon from workshops a?endance lists

MethodologyManual analysis of a?endance lists. Cumulated indicator from the start of the project (04-‐2013).

Limita1ons (if any) n/a

The current update of these indicators reflects the state of the infrastructure as of March 2016. They are presented according to the four project objecKves. They have been designed in order to deliver significant figures on the progress of the infrastructure every 6 months. Some indicators are proposed in cumulaKve form. For those indicators that are provided at monthly resoluKon, we show, based on data availability, the values from the start of the project to give informaKon on the history of the infrastructure.

QUANTITATIVE ESTIMATE

Project Objec:ves:1 -‐ Foster the integra:on of the European Climate and Earth system modelling community2 -‐ Enhance the development of Earth System Models for the understanding of climate variability and change3 -‐ Support high-‐end simula:ons enabling to beGer understand and predict future climate change4 -‐ Facilitate the dissemina:on of Earth system model simula:ons to beGer predict and understand climate change impacts on society

1 -‐ Foster the integra:on of the European Climate and Earth system modelling community

DESCRIPTION

Involvment of external par:es in project workshops

March 2016

2/20


Defini1onNumber of soXware downloads from OASIS/CDO/NEMO websites

Measure Unit NumberRelated Project Objec1ve 2, 3Related Project ac1vity/ies WP7 T3 &T4Responsible Partner CERFACS/MPG/CNRS-‐IPSL

Source

OASIS download page (h?ps://verc.enes.org/oasis/download), CDO download page (h?ps://code.zmaw.de/projects/cdo/files), NEMO download page (h?p://www.nemo-‐ocean.eu/Using-‐NEMO/User-‐Guides/Basics/NEMO-‐Quick-‐Start-‐Guide)

MethodologyAcquisiKon of data from the OASIS/CDO/NEMO download sites.

Limita1ons (if any) Figures are only available since March 2015.

2 -‐ Enhance the development of Earth System Models for the understanding of climate variability and changeSecondary objec1ve:3 -‐ Support high-‐end simula1ons enabling to beSer understand and predict future climate change (for OASIS3-‐MCT which is op1mised for parallel HPC)

Number of OASIS/CDO/NEMO downloads

DESCRIPTION


March 2016

3/20


Defini1on

Number of threads and number of exchanges for each thread on OASIS/CDO/NEMO forum, plus number of mails exchanged on the OASIS/CDO/NEMO support or user mailing list

Measure Unit NumberRelated Project Objec1ve 2, 3Related Project ac1vity/ies WP7 T3 & T4Responsible Partner CERFACS/MPG/CNRS-‐IPSL

Source

OASIS forum: h?ps://verc.enes.org/oasis/faq-‐forum/oasis3-‐forum/ and OASIS user mailing list ; CDO forum: h?ps://code.zmaw.de/projects/cdo/boardsNEMO forum: h?p://www.nemo-‐ocean.eu/Developing-‐with-‐NEMO/Forum and NEMO mailing lists (NEMO System Team and NEMO users).

MethodologyAcquisiKon of data from the OASIS/CDO/NEMO forum and from the OASIS/NEMO mailing list staKsKcs



Number of discussions on OASIS/CDO/NEMO forums and number of mails exchanged on OASIS/CDO/NEMO support or user mailing list

DESCRIPTION


March 2016

4/20


Defini1onNumber of Kckets opened and closed in OASIS/CDO/NEMO project management system

Measure Unit NumberRelated Project Objec1ve 2, 3Related Project ac1vity/ies WP7 T3 & T4Responsible Partner CERFACS/MPG/CNRS-‐IPSL

Source

OASIS Redmine site: h?ps://inle.cerfacs.fr/projects/oasis3-‐mct ; CDO Redmine site: h?ps://code.zmaw.de/projects/cdo ; NEMO Trac system: h?ps://forge.ipsl.jussieu.fr/nemo/report/1

MethodologyAcquisiKon of data from the OASIS/CDO/NEMO project management system



DESCRIPTION


Number of :ckets opened and closed in OASIS/CDO/NEMO project management system

March 2016

5/20


4 -‐ Facilitate the dissemina:on of Earth system model simula:ons to beGer predict and understand climate change impacts on society

Regarding the following 3 KPIs: the ENES data federa1on established and maintained by IS-‐ENES is part of the interna1onal Earth System Grid Federa1on (ESGF), which in June 2015 was driven down for security reasons. All components of he ESGF so]ware were completely recondi1oned, partly rebuilt and extensively tested. Here the first step focused on the core func1onali1es for data distribu1on. The dashboard so]ware is part of the second overhaul step which is running now (2016-‐06). In addi1on, many sites changed names and layout of their data nodes. Un:l present, only six of 18 data nodes (2 at BADC, CEA, CNRM, DMI, SMHI; see adjacent table) are up in a comparable configura:on as before the overhaul. Other nodes got up again but had set up a complete new system without transferring the old sta1s1cal data to the new node. Furthermore, a possible security issue was with the dashboard, which in the new ESGF version also is the source of the sta1s1c's raw data. As the dashboard is announced to be back opera:onal late this summer, sta:s:cs aUer start of 2016 could not be gained from it.

So, sta:s:cs on Data Node Usage (downloads by transac1ons & volume; sum of users) are, as of July 2016, not available, and will be opera:onal again as soon as the new secure dashboard version is opera:onal.

Sta1s1cs on user support via mailing list on the other hand are con1nuously possible and are given below (#/% of user query threads).

During the down1mes of the different nodes between June 2015 and the first quarter of 2016, IS-‐ENES2 was able to help lots of users to get the data needed by two different means: first, IS-‐ENES2 had backuped many of the data to the CERA database system of DKRZ. There, access was possible via various user interfaces (See Fig. below). Second a website was con1nuously supplied, leading directly to many of the nodes to apply for direct data download by ]p.

March 2016

6/20


Defini1onVolume per month of data successfully downloaded through the ESGF data nodes belonging to IS-‐ENES.

Measure Unit GB/month, for all projects (CMIP5, CORDEX and few others)Related Project Objec1ve 4Related Project ac1vity/ies SA2 / T1Responsible Partner DKRZ (SA2 WPL)

SourceStaKsKcs informaKon collected in distributed data node databases by script/dashboard applicaKon

Methodology

Volume per month computed since the start of the project. EU and outside EU users are counted separately. WDCC data node staKsKcs is added separately since it uses a different staKsKcs script (long-‐term archive which is Oracle and tape-‐based). Users from EU and outside EU cannot be disKnguished at wdcc-‐esgf.dkrz.de.

Limita1ons (if any)

ReplicaKons done by ESGF staffs cannot be disKnguished from user acKviKes and are counted; error ~ 10% since the query results may depend on the logging; FluctuaKons by replicaKons and power user acKviKes. DATA FROM THE FOLLOWING DATA NODES ARE MISSING FROM 2014-‐07 ON: -‐ cmip-‐dn1.badc.rl.ac.uk-‐ esgf-‐data1.ceda.ac.uk-‐ cordexesg.dmi.dk (tech. problems)-‐ esgf2.e-‐inis.ie


4 -‐ Facilitate the dissemina:on of Earth system model simula:ons to beGer predict and understand climate change impacts on societyModel data download volumes

DESCRIPTION

[Data from 07/2015 to 03/2016 not available. See remarks above]

March 2016

7/20


Defini1onNumber of downloaded files per month from all IS-‐ENES data nodes. RepeKKons are counted, if files are mulKply downloaded from one node.

Measure UnitNumber (monthly values) for all projects (CMIP5, CORDEX and few others)

Related Project Objec1ve 4Related Project ac1vity/ies SA2 / T1Responsible Partner DKRZ (SA2 WPL)


MethodologyFile numbers per month computed since the start of the project. Users from EU and outside EU are disKnguished.

Limita1ons (if any)

Node wdcc-‐esgf.dkrz.de could not be included unKl now (no file numbers available), tool is in progress; error ~ 10 % since the query results may depend on the logging; fluctuaKons: replicaKons and power user acKviKes are count.DATA FROM THE FOLLOWING DATA NODES ARE MISSING FROM 2014-‐07 ON:-‐ cmip-‐dn1.badc.rl.ac.uk-‐ esgf-‐data1.ceda.ac.uk-‐ cordexesg.dmi.dk (tech. problems)-‐ esgf2.e-‐inis.ie


Model data file downloads



DESCRIPTION

March 2016

8/20


Defini1onSum of acKve users per month over all IS-‐ENES data nodes. Counted are users who successfully downloaded a file from an ESGF data node belonging to IS-‐ENES.

Measure Unit Number (monthly values)Related Project Objec1ve 4Related Project ac1vity/ies SA2 / T1Responsible Partner DKRZ (SA2 WPL)


MethodologyUsers from single node data have been summed to get an esKmate of IS-‐ENES total.EU and non-‐EU users are counted separately. InformaKon since start of the project.

Limita1ons (if any)

Users that accessed various data nodes cause mulKple counts; reversely some acKve users serve a large community of users in their insKtuKon.

-‐ node wdcc-‐esgf.dkrz.de could not be included unKl now (no file numbers available), tool is in progress.DATA FROM THE FOLLOWING DATA NODES ARE MISSING FROM 2014-‐07 ON:-‐ cmip-‐dn1.badc.rl.ac.uk-‐ esgf-‐data1.ceda.ac.uk-‐ cordexesg.dmi.dk (tech. problems)-‐ esgf2.e-‐inis.ie



Ac:ve users per data node


DESCRIPTION

March 2016

9/20


Defini1onNumber/percentage of reply threads to internaKonal ESGF user queries to which IS-‐ENES partners have contributed.

Measure Unit Percentage, Number (monthly values)Related Project Objec1ve 4Related Project ac1vity/ies SA2 / T1Responsible Partner DKRZ (SA2 WPL)Source InformaKon from [esgf-‐user] mailing listMethodology Manual evaluKon of support mailing list.

Limita1ons (if any) Few answers of non-‐ENES Europeans may be included.


Number of answers to user queries with IS-‐ENES contribu:on

DESCRIPTION


March 2016

10/20


Defini1onNumber of visitors to the climate4impact (C4I) website. Added are related informaKon on pages, hits and Bytes to inform on type of visit.

Measure Unit number, bytes (monthly average since January 2015) Related Project Objec1ve 4Related Project ac1vity/ies SA2 / T3Responsible Partner KNMISource AWStats

Methodology

In addiKon to people just having a look, the number of visitors shows also the people searching and downloading data from ESGF or browsing through the documentaKon. -‐ Using apache log files and AWStat for the user staKsKcs; AWstats takes care of excluding bots etc.

Limita1ons (if any) The staKsKcs of C4I only started in Jan 2015.

DESCRIPTION



Sta:s:cs for use of the Climate4impact portal

Documents

IS-ENES2 KPIs and figures up to 03-2016 version du 27-07 FV-1