Implementing the WPS StandardA Case Study for Dissemination of Coastal and Marine Tools

GIMA Master ThesisJoost Boerboom

2Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Welcome

GIMA Master Thesis

Carried out at Deltares in DelftFebruary – August 2013

Committee:dr. Fedor Baartdr.ir Gerben de Boerdrs. Marian de Vriesprof.dr.ir. Peter van Oosterom

3Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Contents

1. Introduction

2. Case 1 – Tide Forecasting Service

3. Case 2 – Interactive Dredge Planning Tool

4. Discussion

5. Conclusion

6. Recommendations

Questions

4Joost Boerboom – GIMA Thesis Implementing the WPS Standard

1. IntroductionIntroduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

5Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Remote ProcessingIntroduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

1+1=?

1+1=?

1+1=2

1+1=2

1+1=2

6Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Web Processing Service

- OGC Standard for (operating) remote processes

- No limitations to:

- Script language

- Data types

- Etc.

- Bridge between client and server

Introduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

7Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Why StandardsIntroduction – Case 1 – Case 2 – Discussion – Conclusion - Recommendations

8Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Web Services

Online medium for:- Processing- Coverages - Features- Rasters

Introduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

WPS WCS WFS WMS

9Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Different requests:- GetCapabilities- DescribeProcess- Execute

Using Web Services

Browser

http://dtvirt5.deltares.nl/wps/?request=Execute&service=wps&version=1.0.0&identifier=constituents&datainputs=[constituent=M2]

Introduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

10Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Web Service AdvantagesIntroduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

Always the latest version of data / software

No more downloading everything

Interoperability

11Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Goal

Goal of the research:

“expose complex processes that feed coastal and marine models via a Web Processing Service”

Introduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

Deltares’ goals:

“provide a path for existing Matlab tools to be used in next generation user interface”

“use boundary conditions from large datasets”

12Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Research Questions

1. Can complex processes that feed coastal/marine models be exposed via a Web Processing Service?

2. Can a Web Processing Service be used as a wrapper service for non domain-specific processing services?

3. Which adaptations could be made to the WPS standard to improve the possibilities for application of the standard?

Introduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

13Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Methodology

- Literature study

- Practical work in the sense of, for Deltares, relevant case studies

Introduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

14Joost Boerboom – GIMA Thesis Implementing the WPS Standard

System Setup

PyWPS- Python based- Open Source- Relatively small developer community

Deltares test server- http://dtvirt5.deltares.nl/wps/?

Introduction – Case 1 – Case 2 – Discussion – Conclusion - Recommendations

15Joost Boerboom – GIMA Thesis Implementing the WPS Standard

2. Case 1 – Tide Forecasting Service

What: Global tide forecasting service

Why: Relevant for Deltares and expected to be a popular service

Introduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

16Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Tide Forecasting

What is the tide:- The tide is an extremely long wave- Astronomical influences- Water levels are location specific

Required for forecasting:- Constituents- Amplitudes- Starting point in time

How to get the inputs:- Long period measurements

Introduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

17Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Tidal ConstituentsIntroduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

K1 and M2 – Lunar diurnal

18Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Satellite AltimetryIntroduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

19Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Different Services

Different services have been developed- Base of the script is similar

Introduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

20Joost Boerboom – GIMA Thesis Implementing the WPS Standard

3. Case 2 – Interactive Dredge Planning Tool

What:Existing online tool made by Deltares/Ecoshape to forecast

environmental effects of dredging operations

Why:Show that WPS is also able to ‘wrap’ existing (legacy) services

Introduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

21Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Working of IDPTIntroduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

22Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Method of Wrapping

Have the WPS service post input files and read the outputs

Introduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

23Joost Boerboom – GIMA Thesis Implementing the WPS Standard

IDPT via WPS

- Limited input- Less user friendly compared to the original- Identical results

Introduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

24Joost Boerboom – GIMA Thesis Implementing the WPS Standard

4. Discussion

PyWPS- Small community- Slow development

Tide Forecasting Service- Expected limited accuracy (better dataset available)- Too slow

IDPT Wrapper- No status support- Timeouts- Slow, just like the original one

Introduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

25Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Performance Issues

Both services are slow, why?

Tide forecasting service:- Reading 400MB dataset- Interpolating the whole dataset instead of a few points

IDPT Wrapper:- Limited performance of the original one- Saving, loading, reading files via FTP (slow)

Introduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

26Joost Boerboom – GIMA Thesis Implementing the WPS Standard

5. ConclusionIntroduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

1. Can complex processes that feed coastal/marine models be exposed via a Web Processing Service?

Yes!

27Joost Boerboom – GIMA Thesis Implementing the WPS Standard

5. ConclusionIntroduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

2. Can a Web Processing Service be used as a wrapper service for non domain-specific processing services?

In case of IDPT, yes!

28Joost Boerboom – GIMA Thesis Implementing the WPS Standard

5. ConclusionIntroduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

3. Which adaptations could be made to the WPS standard to improve the possibilities for application of the standard?

Based on the practical experience gathered during the thesis work:- Improve status support, continuous communication- Implementation of a ‘stop’ request- More possibilities for dynamic processes/interfaces

29Joost Boerboom – GIMA Thesis Implementing the WPS Standard

OverallIntroduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

- WPS is very broad applicable

- (single) WPS processes are somewhat static

- WPS will not speed up existing processes

- WPS allows great interoperability

30Joost Boerboom – GIMA Thesis Implementing the WPS Standard

6. Recommendations

Tide forecasting service:- Performance improvement- Accuracy improvement- Path/vector input in GML

IDPT Wrapper:- More input parameters- Graphical interface- Status support

Introduction – Case 1 – Case 2 – Discussion – Conclusion – Recommendations

31Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Fast Response!

Tide forecasting service:- Improved performance- Improved input options

IDPT Wrapper:- Fixed status support

PyWPS:- Number of developers increased

Introduction –Case 1 – Case 2 – Discussion – Conclusion – Recommendations

32Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Questions?

33Joost Boerboom – GIMA Thesis Implementing the WPS Standard

Thank you for your attention

Contact:joostboerboom@gmail.com

06 41921002http://nl.linkedin.com/in/joostboerboom

Drinks:Tomorrow, 20:00u

Sportparklaan 16, Heemstede