9
www.eu-eela.eu E-science grid facility for Europe and Latin America WAM Final Report Yassine LASSOUED & Ali Al Othman Coastal and Marine Resources Centre University College Cork Ireland

Www.eu-eela.eu E-science grid facility for Europe and Latin America WAM Final Report Yassine LASSOUED & Ali Al Othman Coastal and Marine Resources Centre

Embed Size (px)

Citation preview

www.eu-eela.eu

E-science grid facility forEurope and Latin America

WAMFinal Report

Yassine LASSOUED & Ali Al Othman

Coastal and Marine Resources Centre

University College Cork

Ireland

Itacuruçá , First EELA-2 Grid School, 13.11.2008 2www.eu-eela.eu

Application: WAM

• WAM = Global ocean Wave prediction Model• Field:

– Earth Sciences (Marine)

• Objective:– forecast wave conditions around Ireland on a fine

resolution, using high resolution winds obtained as boundary conditions from Met Eireann, for the periods 2020-2030 and 2050-2060

• Resolution:– 5 km (Met Eireann: 25 km)

• Code: Fortran

Itacuruçá , First EELA-2 Grid School, 13.11.2008 3www.eu-eela.eu

Difficulties

• Input Data:– Bathymetry

160 KB

– High Resolution Wind Fields 60 MB per file 1 file per month 100 years

Total size: 72 GB

– Wave Boundary Conditions 50 MB per file 2 files per day 100 years

Total size: 3.6 TB

Itacuruçá , First EELA-2 Grid School, 13.11.2008 4www.eu-eela.eu

Difficulties

• Code compiled on 64b machine does not work

Itacuruçá , First EELA-2 Grid School, 13.11.2008 5www.eu-eela.eu

Done

• Transfer code and sample input data to a SE• Script to:

– download code and data from SE,– Rebuild directory structure as required,– Execute model on a working node,– Store outputs on SE.

• AMGA catalogue for processed data• Script to check whether data have been processed• Command line user interface:

– Script to generate JDL files and submit jobs– Script to check jobs status– Script to download outputs

Itacuruçá , First EELA-2 Grid School, 13.11.2008 6www.eu-eela.eu

Difficulties

Storage Element

TAR.GZ TAR.GZ

Code

TAR.GZ

TAR.GZ

TAR.GZ

TAR.GZ

Input Data Output Data

AMGACatalogue

YearMonth Period Done LFN

--- --- --- ---

--- --- --- ---

Working Node

wam.sh execute_wam.sh

loading

Code

TAR.GZ TAR.GZ

TAR.GZloading

wam.jdl

wam.sh execute_wam.sh

wam-status.sh wam-output.sh wam-clean.sh

User Interface

wam_template.jdlwam-exe.sh

generates

Uservoms-proxy-init

Thanks Daniel and Michael

Itacuruçá , First EELA-2 Grid School, 13.11.2008 7www.eu-eela.eu

Synergy with Other Teams

• HMMER Team– Similarities in work flows and user interfaces– Build on user interface developed by Daniel and Michael

• Satellite Images Team– Potential for using same approach for seabed classification

using large multi/single beam data

Itacuruçá , First EELA-2 Grid School, 13.11.2008 8www.eu-eela.eu

Next Steps

• Benchmarking [3-4 Months]• Production [6-8 Months]

– Transfer 3.6 TB of data to the grid– Deploy WAM on the EELA Grid

• Develop a user interface using GENIUS [9-12 Months]

Support needed

www.eu-eela.eu

E-science grid facility forEurope and Latin America

Thank You EELA-2, tutors, students, et. al…

Yassine LASSOUED

CMRC, UCC (Ireland)

[email protected]

+353 21 470 31 03

Skype: yassine.lassoued

Jeremy GAULT

CMRC, UCC (Ireland)

[email protected]

+353 21 470 31 00