32
On Localised Particle Filters for the Global Weather Prediction Model ICON Roland Potthast and Anne Walter and Andreas Rhodin German Meteorological Service (DWD) Data Assimilation Unit

On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON [email protected] 12 • Weights W are

  • Upload
    others

  • View
    14

  • Download
    0

Embed Size (px)

Citation preview

Page 1: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

On Localised Particle Filters for the Global Weather Prediction Model

ICONRoland Potthast and Anne Walter

and Andreas Rhodin

German Meteorological Service (DWD)

Data Assimilation Unit

Page 2: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 2

Content

1. The ICON-Model and DA-System

2. Bayesian Filtering via Particle Filters

3. The Localised Adaptive Particle Filter (LAPF)

4. The Localised Markov Chain Particle Filter (LMCPF)

5. Numerical Testing

6. Summary

06.03.2018

Page 3: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 3

1. The ICON-Model

• Operational NWP model of DWD: ICON (ICOsahedral Nonhydrostatic)

• Two-way NEST over Europe (~6.5 km)

• Resolution: 13 km deterministic 40 km ensemble (40 member)

06.03.2018

Page 4: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 4

1. DA System at DWD

• Hybrid EnVar operational since January 20, 2016

• Following Hunt et al. (2007), (see also Schraff et al., 2016)

• EnVar-B-Matrix: 70% LETKF, 30% Climatology

06.03.2018

B-Matrix

Page 5: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 5

Global Model Verification Comparison

06.03.2018

Created: 28.02.2018

EnVarICON

Page 6: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 6

• Our Particle Filters are based on the LETKF philosophy

Localisation: as LETKF in ensemble space

Adaptivity: tools for spread control

2. Bayesian Filtering via PF

06.03.2018

PRIOR

DATA

Posterior

AnalysisEnsemble

Able to handle with multi-modal distributions

Able to handle with Non-Gaussianity

Page 7: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 7

2. Bayesian Filtering via PF

06.03.2018

LETKF

Classical PF

DATA

PriorPosterior

DATA

Prior

Posterior

LAPF

DATA

Prior

Posterior

Page 8: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 8

2. Bayesian Filtering via PF

• Employ Bayes formula to calculate new analysis distribution

is a normalization factor:

• To carry out the analysis step at time a posteriori weights are calculated

is chosen such that

06.03.2018

First Step: The Classical Particle Filter

Page 9: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 9

2. Bayesian Filtering via PF

• Accumulated weights are defined:

where denotes the ensemble size

• Drawing , set and define transform matrix W for the particles by:

with , denotes the interval of values .

06.03.2018

Second Step: Classical Resampling

Page 10: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 10

2. Bayesian Filtering via PF

• Based on the adaptive multiplicative inflation factor determined by the LETKF

• Weighting factor has been chosen, due to the small ensemble size ()

06.03.2018

Third Step: Spread Control

Page 11: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 11

2. Bayesian Filtering via PF

• Pertubation factor is used to add spread to the system

where , , and , with if and if

06.03.2018

Third Step: Spread Control

Page 12: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 12

• Weights W are modified by applying the pertubation factor

with normally distributed random numbers

06.03.2018

3. The LAPF

Fourth Step: Gaussian Resampling

An example for a W-Matrix after applying determined with the LAPF for 60°N/90°O ~500 hPa, 26.05.2016 0 UTC is shown. 10 particles are chosen

DATA

Prior

Posterior

Page 13: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 13

4. The LMCPF

06.03.2018

LMCPFLAPFDATA

Prior

Posterior

LETKF

DATA

PriorPosterior

DATA

Prior

Posterior

Page 14: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 14

• Weights W are calculated by drawing from the posterior•

06.03.2018

Fourth Step: Gaussian Resampling

4. The LMCPF

with normally distributed random numbers, and calculated with Gaussian radial basis function (rbf) Approximation for prior density and observation error

DATA

Prior

Posterior

It is an explicit calculation of the Bayes posterior based on radial basis function approximation of the prior.

Centers of posterior RBFs Shape of posterior RBFs

Page 15: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

5. Numerical Testing

Page 16: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 16

Experimental set-up

• Full ensemble: 40 members

• Reduced resolution: - 26km deterministic- 52km ensembles

• Period: 01.05.2016 – 31.05.2016

06.03.2018

5. Numerical Testing

T [K] at 03.05.2016 15 UTC ~1000 hPa

Page 17: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

5. Numerical TestingAssimilation Cycle

Page 18: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 1806.03.2018

5. Numerical Testing - LAPF

RMSE

LETKFLAPF

RMSE

p-le

vel [

hPa]

Global RMSE for obs-fg statistics (Radiosondes vs. Model)Period: 08.05.2016 – 31.05.2016

Relative humidityTemperature

~14%~15%

~14%

Page 19: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 1906.03.2018

5. Numerical Testing - LMCPF

RMSE

LETKFLMCPF

RMSE

p-le

vel [

hPa]

Global RMSE for obs-fg statistics (Radiosondes vs. Model)Period: 08.05.2016 – 22.05.2016

Relative humidityTemperature

~11%~12%

~11%

Page 20: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 2006.03.2018

5. Numerical Testing

RMSE

LAPFLMCPF

RMSE

p-le

vel [

hPa]

Global RMSE for obs-fg statistics (Radiosondes vs. Model)Period: 08.05.2016 – 22.05.2016

Relative humidityTemperature

~7%

~7%

Page 21: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 2106.03.2018

5. Numerical Testing

RMSE

LAPFLMCPF

RMSE

Cha

nnel

num

ber

Global RMSE for obs-fg statistics Period: 08.05.2016 – 22.05.2016

Bending Angles (GPSRO) (IASI)

~7%

~10%H

eigh

t [m

]

Page 22: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 22

5. Numerical Testing

06.03.2018

mean

min

max

LETKFLAPFLMCPF

Global spread of T [K] ~ 500 hPa

01.05.2017

06.05.2017

12.05.2017

18.05.2017

25.05.2017

01.05.201706.05.2017

12.05.2017

31.05.2017

25.05.2017

31.05.2017

01.05.2017

06.05.2017

12.05.201718.05.2017

25.05.2017

31.05.2017

18.05.2017

Page 23: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

5. Numerical TestingForecast Cycle

Page 24: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 2406.03.2018

5. Numerical Testing - LAPF

Global verification of different lead times against RadiosondesPeriod: 02.05.2016 – 24.05.2016

LETKF LAPF

Page 25: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 25

6. Summary

• LAPF and LMCPF implemented in an operational NWP system

• Both Particle Filters are able to provide reasonable atmospheric analysis in a large-scale environment and are running stably over a period of one month

• The LMCPF outperforms the LAPF but not yet the LETKF, but both Particle Filters nearly reach the results of the operational LETKF

Both Particle Filters are showing promising results; further tuning is in progress.

06.03.2018

Page 26: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 26

References• Gerald Desroziers and Serguei Ivanov. “Diagnosis and adaptive tuning of

observation-error parameters in a variational assimilation”. Quarterly Journal of the Royal Meteorological Society, 2001

• Brian Hunt, Eric Kostelich and Istvan Szunyogh. “Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter”. Physica D: Nonlinear Phenomena, 2007

• Gen Nakamura and Roland Potthast. “Inverse Modeling”. IOP Publishing, 2015

• Roland Potthast, Anne Walter and Andreas Rhodin. “A Localised Adaptive Particle Filter (LAPF) within an operational NWP Framework”. submitted to MWR

• Sebastian Reich and Colin Cotter. “Probabilistic Forecasting and Bayesian Data Assimilation”. Cambridge University Press, 2015

• Christoph Schraff, Hjendrick Reich, Andreas Rhodin, Annika Schomburh, Klaus Stehphan, Africa Periáñez and Roland Potthast. “Kilometre-scale ensemble data assimilation for the cosmo model (kenda)”. Quarterly Journal of the Royal Meteorological Society, 2016

• Peter Jan van Leeuwen, Yuan Cheng and Sebastian Reich. “Nonlinear Data Assimilation”. Frontiers in Applied Dynamical Systems: Reviews and Tutorials. Springer, 2015

06.03.2018

Page 27: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

Thanks for the attention!

Page 28: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

Appendix

Page 29: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 29

Appendix

06.03.2018

Global histogram of number of particles with weight31.05.2016 21 UTC ~1000 hPa

Page 30: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 30

Appendix

06.03.2018

31.05.2016 21 UTC ~ 100 hPa

31.05.2016 21 UTC ~ 500 hPa

31.05.2016 21 UTC ~1000 hPa

Global histograms of number of particles with weight

Page 31: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 31

Appendix

06.03.2018

Global verification of different lead times

against Radiosondes

Period: 02.05.2016 – 24.05.2016

LETKF LAPF

Page 32: On Localised Particle Filters for the Global Weather ...€¦ · On Localised Particle Filters for the Global Weather Prediction Model ICON anne.walter@dwd.de 12 • Weights W are

[email protected] Localised Particle Filters for the Global Weather Prediction Model ICON 32

Appendix

06.03.2018

Global verification of different lead times

against Radiosondes

Period: 02.05.2016 – 24.05.2016

LETKF LAPF