31
Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Embed Size (px)

Citation preview

Page 1: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Sai Ravela

Massachusetts Institute of Technology

J. Marshall, A. Wong, S. Stransky, C. Hill

Collaborators: B. Kuszmaul and

C. Leiserson

Page 2: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Geophysical Fluids in the Laboratory

Inference from models and data is fundamental to the earth sciences

Laboratory analogs systems can be extremely useful

Page 3: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Planet-in-a-bottleRavela, Marshall , Wong, Stransky , 07

OBS

MODEL

DA

Z

Page 4: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Velocity Observations• Velocity

measurements using correlation-based optic-flow

• 1sec per 1Kx1K image using two processors.

• Resolution, sampling and noise cause measurement uncertainty

• Climalotological temperature BC in the numerical model

Page 5: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Numerical Simulation

MIT-GCM (mitgcm.org): incompressible boussinesq fluid in non-hydrostatic mode with a vector-invariant formulation

• Thermally-driven System (via EOS)• Hydrostatic mode Arakawa C-Grid• Momentum Equations: Adams-Bashforth-2• Traceer Equations: Upwind-biased DST with Sweby Flux limiter• Elliptic Equaiton: Conjugate Gradients• Vertical Transport implicit.

Marshall et al., 1997

Page 6: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Domain 120x 23 x 15 (z){45-8 }x 15cm

1. Cylindrical coordinates.2. Nonuniform discretization of the

vertical 3. Random temperature IC4. Static temperature BC5. Noslip boundaries6. Heat-flux controlled with anisotropic

thermal diffusivity

Page 7: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Estimate what?

Estimation from model and data

1.State Estimation:1.NWP type

applications, but also reanalysis

2.Filtering & Smoothing

2. Parameter Estimation: 1. Forecasting &

Climate

3. State and Parameter Estimation1. The real problem.

General Approach: Ensemble-based, multiscale methods.

Page 8: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Schedule

Page 9: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Producing state estimates

Ravela, Marshall, Hill, Wong and Stransky, 07

Ensemble-methods Reduced-rank

Uncertainty Statistical sampling

Tolerance to nonlinearity Model is fully nonlinear

Dimensionality Square-root representation

via the ensemble Variety of approximte

filters and smoothers

Key questions Where does the ensemble

come from?

How many ensemble members are necessary?

What about the computational cost of ensemble propagation?

Does the forecast uncertainty contain truth in it? What happens when it is

not?

What about spurious longrange correlations in reduced rank representations?

Page 10: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson
Page 11: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Approach

Ravela, Marshall, Hill, Wong and Stransky, 07

P(T ): Thermal BC

Perturbations 4

P(X0|T): IC Perturbation 1

P(Xt|Xt-1): Snapshots in time

10

E>e0?

P(Yt|Xt) P(Xt|Xt-1): Ensemble

update

P(Yt|Xt) P(Xt|Xt-1): Deterministic

update

BC+IC

Deterministic update:5 – 2D updates5 – (Elliptic) temperatureNx * Ny – 1D problems

Snapshots capture flow-dependent uncertainty (Sirovich)

Page 12: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

EnKF revisited

The analysis ensemble is a (weakly) nonlinear combinationof the forecast ensemble.

This form greatly facilitates interpretation of smoothing Evensen 03, 04

Page 13: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Ravela and McLaughlin, 2007

Page 14: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Ravela and McLaughlin, 2007

Page 15: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Next Steps Lagrangian Surface

Observations : Multi-Particle Tracking

Volumetric temperature measurements.

Simultaneous state and parameter estimation.

Targeting using FTLE & Effective diffusivity measures.

Semi-lagrangian schemes for increased model timesteps.

MicroRobotic Dye-release platforms.

Page 16: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Ravela et al. 2003, 2004, 2005, 2006, 2007

With thanks toK. Emanuel, D. McLaughlin and W. T. Freeman

Page 17: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Thunderstorms Hurricanes

Solitons

Many reasons for position error

There are many sources of position error: Flow and timing errors, Boundary and Initial Conditions, Parameterizations of physics, sub-grid processes, Numerical integration…Correcting them is very difficult.

Page 18: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Amplitude assimilation of position errors is nonsense!

3DVAR

Page 19: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

EnKF

Distorted analyses are optimal, by definition. They are also inappropriate, leading to poor estimates at best, and blowing the model up, at worst.

Page 20: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Key Observations

Why do position errors occur? Flow & timing errors, discretization and numerical

schemes, initial & boundary conditions…most prominently seen in meso-scale problems: storms, fronts, etc.

What is the effect of position errors? Forecast error covariance is weaker, the estimator is

both biased, and will not achieve the cramer-rao bound.

When are they important? They are important when observations are uncertain

and sparse

Page 21: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Joint Position Amplitude Formulation

Question the standardAssumption; Forecasts are unbiased

Page 22: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Bend, then blend

Page 23: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Improved control of solution

Page 24: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson
Page 25: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Flexible Application

StudentsRyan Abernathy:

Scott Stransky

Classroom

Data Assimilation Hurricanes , Fronts &

Storms In Geosciences

Reservoir Modeling Alignment a better

metric for structures Super-resolution

simulations texture (lithology)

synthesis

Flow & Velocimetry Robust winds from GOES

Fluid Tracking Under failure of

brightness constancy

Cambridge 1-step (Bend and Blend) Variational solution to

jointly solves for diplas and amplitudes

Expensive

Cambridge 2-step(Bend, then blend) Approximate

solution Preprocessor to

3DVAR or EnKF Inexpensive

Bend, then Blend

Page 26: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Key Observations

Why is “morphing” a bad idea Kills amplitude spread.

Why is two-step a good idea Approximate solution to the joint inference

problem. Efficient O(nlog n), or O(n) with FMM

What resources are available? Papers, code, consulting, joint prototyping

etc.

Page 27: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Adaptation to multivariate fields

Page 28: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Velocimetry, for Rainfall Modeling

Ravela & Chatdarong, 06

Aligned time sequences of cloud fields are used to produce velocity fields for advecting model storms.

Velocimetry derived this way is more robust than existing GOES-based wind products.

Page 29: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Other applications

Magnetometry Alignment (Shell)

Page 30: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Example-based Super-resolved Fluids

Super-resolution

Ravela and Freeman 06

Page 31: Sai Ravela Massachusetts Institute of Technology J. Marshall, A. Wong, S. Stransky, C. Hill Collaborators: B. Kuszmaul and C. Leiserson

Next Steps

Fluid Velocimetry: GOES & Laboratory, release product.

Incorporate Field Alignment in Bottle project DA.

Learning the amplitude-position partition function.

The joint amplitude-position Kalman filter.

Large-scale experiments.