Upload
corey-austin
View
218
Download
2
Tags:
Embed Size (px)
Citation preview
Brookhaven Science AssociatesU.S. Department of Energy 1
Simulation of Multiphase Magnetohydrodynamic Flows for Nuclear Fusion Applications
Roman SamulyakAMS Department, Stony Brook University
andComputational Science Center
Brookhaven National Laboratory
Collaborators:Tianshi Lu (BNL), Paul Parks (General Atomics)
Wurigen Bo, Lingling Wu (Stony Brook)James Glimm, Xiaolin Li (Stony Brook)
Kirk McDonald (Princeton), Harold Kirk (BNL)
The Role of High Performance Computation in Economic Development
Workshop at Rensselaer Polytechnic Institute, October 22 -24, 2008
Brookhaven Science AssociatesU.S. Department of Energy 2
Talk Outline
• Brief description of wide range of applications
• Numerical algorithms for multiphase hydro and MHD flows
• Large scale computing (BlueGene)
• Application specific mathematical models and numerical algorithms (for one selected applications - tokamak fueling)
• Numerical simulations: main results and feedback to applications
• Summary and conclusions
Brookhaven Science AssociatesU.S. Department of Energy 3
• ITER is a joint international research and development project that aims to demonstrate the scientific and technical feasibility of fusion power
• ITER will be constructed in Europe, at Cadarache in the South of France in ~10 years
Fusion Energy. ITER project: fuel pellet ablation
Models and simulations of tokamak fueling through the ablation of frozen D2 pellets
Collaboration with General Atomics
Our contribution to ITER science:
Laser driven pellet acceleration
Brookhaven Science AssociatesU.S. Department of Energy 4
New Ideas in Nuclear Fusion: Magnetized Target Fusion (MTF)
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
Brookhaven Science AssociatesU.S. Department of Energy 5
Fission Energy. DOE Nuclear Energy Research Initiative (NERI)
• Stony Brook University, together with Rensselaer Polytechnical Institute, Columbia University, and Brookhaven National Laboratory, joined a DOE funded consortium within NERI initiative • Project title: Deployment of a Suite of High Performance Computational Tools for Multiscale Multiphysics Simulation of Generation-IV Reactors
Brookhaven Science AssociatesU.S. Department of Energy 6
Simulation of material relocation in a Core Disruptive Accident (CDA) in Gen. IV reactors
Numerical investigation of the surface instability and liquid entrainment in the expansion of an CDA bubble.
Studies of some fundamental problems of multiphase flows Subgrid models for multiphase flows
Numerical Studies within NERI Consortium
Brookhaven Science AssociatesU.S. Department of Energy 7
Spallation Neutron Source: Cavitation induced erosion in mercury target
• Injection of nondissolvable gas bubbles has been proposed as a pressure mitigation technique.
• Numerical simulations aim to estimate the efficiency of this approach, explore different flow regimes, and optimize parameters of the system.
Left: pressure distribution in the SNS target prototype. Right: Cavitation induced pitting of the target flange (Los Alamos experiments)
Brookhaven Science AssociatesU.S. Department of Energy 8
Mercury Jet Target for Neutrino Factory / Muon Collider
Simulation of the mercury jet target interacting with a proton pulse in a magnetic field
• Studies of surface instabilities, jet breakup, and cavitation • MHD forces reduce both jet expansion, instabilities, and cavitation
Jet disruptionsTarget schematic
Brookhaven Science AssociatesU.S. Department of Energy 9
Numerical Algorithms
Common features of all applications:
• Multiphase / free surface hydro and MHD flows interacting with external energy sources
• Phase transitions
They require:
• Explicitly resolved multiphase (free surface) flows
• Our choice is Front Tracking
• Numerical algorithms for coupled hyperbolic - elliptic systems in geometrically complex domains
• Large scale computing
Brookhaven Science AssociatesU.S. Department of Energy 10
( )
ext ext
1
1,
1with ( )
( , ), 0
c
c
c
x t
σ φ
σ φ
φΓ
⎛ ⎞= −∇ + ×⎜ ⎟⎝ ⎠
∇ ⋅ ∇ = ∇⋅ ×
∂= × ⋅
∂
= ∇⋅ ≡
J u B
u B
u B nn
B B B
MHD equations and approximations
Full system of MHD equations Low magnetic Re approximation
( )
( )
( )
2
2
1
1
4
( , ), 0
t
Pt c
e Pt
c
t
P P e
ρρ
ρ μ
ρσ
πσ
ρ
∂= −∇⋅
∂∂⎛ ⎞+ ⋅∇ = −∇ + Δ + ×⎜ ⎟∂⎝ ⎠∂⎛ ⎞+ ⋅∇ = − ∇⋅ +⎜ ⎟∂⎝ ⎠
⎛ ⎞∂=∇× × −∇× ∇×⎜ ⎟∂ ⎝ ⎠
= ∇⋅ =
u
u u u J B
u u J
Bu B B
B
€
ReM =uLσ
c 2<<1,
δB
B<<1
Brookhaven Science AssociatesU.S. Department of Energy 11
Multiphase MHD
Solving MHD equations (a coupled hyperbolic – elliptic system) in geometrically complex, evolving domains subject to interface boundary conditions (which may include phase transition equations)
Material interfaces:• Discontinuity of density and physics properties (electrical conductivity) • Governed by the Riemann problem for MHD equations or phase transition equations
Brookhaven Science AssociatesU.S. Department of Energy 12
Front Tracking: A hybrid of Eulerian and Lagrangian methods
Advantages of explicit interface tracking:• No numerical interfacial diffusion• Real physics models for interface propagation• Different physics / numerical approximations
in domains separated by interfaces
Two separate grids to describe the solution:1. A volume filling rectangular mesh2. An unstructured codimension-1
Lagrangian mesh to represent interface
Main Ideas of Front Tracking
Major components:1. Front propagation and redistribution2. Wave (smooth region) solution
Brookhaven Science AssociatesU.S. Department of Energy 13
FronTier is a parallel 3D multiphysics code based on front tracking Physics models include
Compressible fluid dynamics MHD Flow in porous media Elasto-plastic deformations
Realistic EOS models, phase transition models Exact and approximate Riemann solvers Adaptive mesh refinement
The FronTier Code (SciDAC ITAPS Software)
Turbulent fluid mixing.Left: 2DRight: 3D (fragment of the interface)
Brookhaven Science AssociatesU.S. Department of Energy
Hyperbolic step
nijF
1/ 2,ni jϕ +
1/ 21/ 2,
ni jϕ ++∇
1nijF +
FronTier-MHD numerical scheme
Elliptic step
1/ 2nijF +
• Propagate interface(solve Riemann problem for contact or phase transition equations)• Untangle interface• Update interface states
• Apply hyperbolic solvers• Update interior hydro states
• Generate finite element grid• Perform mixed finite element discretizationor• Perform finite volume discretization• Solve linear system using fast Poisson solvers
• Calculate electromagnetic fields • Update front and interior states
Point Shift (top) or Embedded Boundary (bottom)
Brookhaven Science AssociatesU.S. Department of Energy 15
Normal propagation of interface pointsContact discontinuity
Brookhaven Science AssociatesU.S. Department of Energy 16
Phase boundary problem
€
ρu[ ] = s u[ ]
ρu2 + P[ ] = s ρu[ ]
ρuE + uP −κ∇T[ ] = s ρE[ ]
Interface jump conditions Balance equations
€
M =uv − ul
τ v − τ l
, τ =1
ρ,
M 2 =Pv − Pl
τ v − τ l
, uv − s( ) ul − s( ) =Pv − Pl
ρ v − ρ l
,
el − ev +Pv − Pl
2τ l − τ v( ) =
1
Mκ vTv,x −κ lTl,x( )
Temperature and pressure at the interface
€
Tl = Tv = Ts
M = αPsat (Ts) − Pv
2πRTs
, Psat = P0 expQMmol
R
1
T0
−1
Ts
⎛
⎝ ⎜
⎞
⎠ ⎟
⎛
⎝ ⎜
⎞
⎠ ⎟
Subgrid model for temperature
€
T ≈ Ts + T−1 + Ts( )erfx
4tκ /ρc p
⎛
⎝ ⎜ ⎜
⎞
⎠ ⎟ ⎟
Brookhaven Science AssociatesU.S. Department of Energy 17
Embedded Boundary Elliptic Solver
Main Ideas
• Based on the finite volume discretization
• Domain boundary is embedded in the rectangular Cartesian grid, and the solution is treated as a cell-centered quantity
• Using finite difference for full cell and linear interpolation for cut cell flux calculation
• Advantage: robust, readily parallelizable, compatible with FronTier grid-based interface tracking algorithm.
Brookhaven Science AssociatesU.S. Department of Energy 18
High Performance Computing
Chip(2 processors)
Compute Card(2 chips, 2x1x1)
Node Board(32 chips, 4x4x2)
16 Compute Cards
System(64 cabinets, 64x32x32)
Cabinet(32 Node boards, 8x8x16)
2.8/5.6 GF/s4 MB
5.6/11.2 GF/s0.5 GB DDR
90/180 GF/s8 GB DDR
2.9/5.7 TF/s256 GB DDR
180/360 TF/s16 TB DDR
• We are interested in the development of software for parallel distributed memory supercomputers
• Efficient parallelization• Scalability to thousands of processors• State-of-art parallel visualization• Code portability (for use of local and external (NERSC) computational resources)
Brookhaven Science AssociatesU.S. Department of Energy 19
Application Specific Models and Simulations
Brookhaven Science AssociatesU.S. Department of Energy 20
Pellet Ablation for Tokamak Fueling: Main Models
• Equation of state with atomic processes
• Kinetic model for the interaction of hot electrons with the ablated gas
• Surface ablation model
• Cloud charging and rotation models
• New conductivity model (ionization by electron impact)
Schematic of processes in the
ablation cloud
Brookhaven Science AssociatesU.S. Department of Energy 21
Macroscale Model: AMR simulation of ablation flow in plasma (Ravi Samtaney)
• Focus on plasma flow
• Ablation physics not resolved (simplified analytical models)
Relation to Other Projects
Local (“Microscale”) Model: Front Tracking simulation of pellet ablation
• Focus on detailed ablation physics, ablation rates etc.
• Far field plasma evolution not resolved
Brookhaven Science AssociatesU.S. Department of Energy 22
Saha equation for the dissociation (ionization) fraction
2/
2/
1
1
d
d
i
i
e Tdd
d t
Tii
i t
f TN e
f n
f TN e
f n
α
αε
−
−
=−
=−
2 /t g a in n n n mρ= + + =
2
+
Let's define:
is the total number density of nuclei
is the number density gas molecules D
is the number density atoms D
is the number density of ions D
t
g
a
i
n
n
n
n ( )Dissociation (ionization) fractions:
/ , /d a i t i i tf n n n f n n= + =
Equation of State with Atomic Processes.
d
For deuterium:
e = 4.48 eV
= 13.6 eVie24
21
1.55 10 , 0.327
3.0 10 , 3 / 2
d d
i i
N
N
αα
= ⋅ =
= ⋅ =
Brookhaven Science AssociatesU.S. Department of Energy 23
1 1
2 2
1 1
2( 1) 1 2
d i
d d i d id i
m
kTP f f
m
f f f ke kekTE f f
m m m
ρ
γ γ
⎛ ⎞= + +⎜ ⎟⎝ ⎠
⎛ ⎞− += + + +⎜ ⎟− −⎝ ⎠
EOS with Atomic Processes
Incomplete EOS(known from literature):
High resolution solvers (based on the Riemann problem) require the sound speed and integrals of Riemann invariant type expressions along isentropes. Therefore the complete EOS is needed.
Using the second law of thermodynamics T dS dE PdV= +
we found the complete EOS and showed that the compatibility with the second law of thermodynamics requires:
1 33 ,
1 2d im
α αγ
= − =−
Brookhaven Science AssociatesU.S. Department of Energy 24
Complete EOS with Atomic Processes
( )
( )
11
2 2
1
2
d dd
d
i ii
i
f f
f
f f
f
φ
φ
−=
−
−=
−
Notations:
dd d
ii i
e
Te
T
β α
β α
= +
= +
1
2d
d i
fm
a f f
−=
= +
We will define the sound speed in a form typical for the polytropic gas:2 *c pVγ=
2 21 31 2
d d i i
d d i im
m a
m a
φ β φβ
φ β φβγ
+ + +Γ =
+ + +−
where the effective gamma is the Gruneisen coefficient is
and the entropy is ( ) ( ) ( )ln 11ln ln1 ln 1
2( 1) 2 2 2dd
d i i im
fS T Vf f f
R
ββ
γ
−+= + + + + − − −
−
Brookhaven Science AssociatesU.S. Department of Energy 25
For better numerical efficiency, FronTier operates with three pairs of independent thermodynamic variables:
Numerical Algorithms for EOS
( ) ( ) ( ), , , , ,E P Tρ ρ ρ
• For the first two pairs of variables, solve numerically nonlinear algebraic equation, and find T. Using , find the remaining state.
• Such an approach is prohibitively slow for the calculation of Riemann integrals (involves nested nonlinear equations).
• To speedup calculations, we precompute and store values on Riemann integrals as functions of the density and entropy. Two dimensional table lookup and bi-linear interpolation are used.
( ),Tρ
Brookhaven Science AssociatesU.S. Department of Energy 26
Influence of Atomic Processes on Temperature and Conductivity
( )3
3/ 2 0.059
9 3/ 2
1/ 2
9.675 10,
ln [ ] 0.54 [ ] 1/ 1
3.6 10where
e e i
e
e
mho
m T eV T eV f
T
n
σ ⊥ −
×⎡ ⎤=⎢ ⎥ Λ + −⎣ ⎦
⋅Λ =
Brookhaven Science AssociatesU.S. Department of Energy 27
Electron Energy Deposition
( , ') '( , )
z n r z dzu r z
τ+∞−∞
=∫( , ') '
( , )z
n r z dzu r z
τ
+∞
−∞
=∫
( )2 / 2q q uK u∞=[ ]
( )1
( , )( ) ( )
( ) / 4
q n r zq g u g u
g u uK u
τ∞
+ −∞
−∇ = +
=
In the cloud: On the pellet surface:
2
48 ln ( , , )e
e i
T
e n T fτ
π∞
∞∞
=Λ
Brookhaven Science AssociatesU.S. Department of Energy 28
Pellet charging model
€
σ⊥∇⊥2φ + σ ||
∂2φ
∂z2=
∂Jhot∂z
+ Bˆ z ⋅[∇ × (σ⊥u)] −∇⊥φ ⋅∇⊥σ⊥−∂φ
∂z
∂σ ||∂z
€
σ ||∂φ
∂z+ J||,sheath(φ)
⎛
⎝ ⎜
⎞
⎠ ⎟(z ⋅ ˆ n ) + σ⊥∇⊥φ − u × B( ) ⋅ ˆ n = 0
Brookhaven Science AssociatesU.S. Department of Energy 29
Physics Models for Pellet Studies :Surface Ablation
Features of the pellet ablation: • The pellet is effectively shielded from incoming electrons by its ablation cloud• Processes in the ablation cloud define the ablation rate, not details of the phase transition on the pellet surface• No need to couple to acoustic waves in the solid/liquid pellet• The pellet surface is in the super-critical state • As a result, there is not even well defined phase boundary, vapor pressure etc.
This justifies the use of a simplified model: • Mass flux is given by the energy balance (incoming electron flux) at constant temperature• Pressure on the surface is defined through the connection to interior states by the Riemann wave curve
• Density is found from the EOS
( ) ( )p p u u qu c c u c
t n t n zρ
∂ ∂ ∂ ∂ ∂⎛ ⎞+ − − + − = Γ⎜ ⎟∂ ∂ ∂ ∂ ∂⎝ ⎠
Brookhaven Science AssociatesU.S. Department of Energy 30
Spherically symmetric simulation
Normalized ablation gas profiles at 10 microseconds
Polytropic EOS Plasma EOS
Poly EOS Plasma EOS
Sonic radius 0.66 cm 0.45 cmTemperature 5.51 eV 1.07 eVPressure 20.0 bar 26.9 barAblation rate 112 g/s 106 g/s
• Excellent agreement with TF model and Ishizaki.• Verified scaling laws of the TF model
€
G ~ rp4 / 3
M∞ =5
γ=1.8898 for γ =
7
5
⎛
⎝ ⎜
⎞
⎠ ⎟
Brookhaven Science AssociatesU.S. Department of Energy 31
Axially Symmetric Hydrodynamic Simulation
Temperature, eV Pressure, bar Mach number
Distributions of temperature, pressure, and Mach number of the ablation flow near the pellet at 20 microseconds.
Clarified the role of directional electron beam heating on the ablation rate.
Brookhaven Science AssociatesU.S. Department of Energy 32
Performed first systematic studies of pellet ablation rates in magnetic fields
3 microseconds
5 microseconds
9 microseconds
1 microsecond
3 microseconds
Brookhaven Science AssociatesU.S. Department of Energy 33
• Revealed new propertied of the ablation flow: Supersonic rotation of the ablation channel
• Supersonic rotation widens the ablation channel, re-distributes density, and changes the ablation rate• Resolution of this phenomenon greatly improves the agreement with experiments
Cloud Rotation
Isosurfaces of the rotational Mach number in the pellet ablation flow
Brookhaven Science AssociatesU.S. Department of Energy 34
Critical observation:• Formation of the ablation channel and ablation rate strongly depends on plasma pedestal properties and pellet velocity
• Simulations suggest that novel pellet acceleration technique (laser or gyrotron driven) are necessary for ITER
Dependence on Pedestal Properties
Schematic of the plasma pedestal. Plasma pedestal provides critical influence to the pellet ablation rate
Brookhaven Science AssociatesU.S. Department of Energy 35
Striation instabilities: Experimental observation
(Courtesy MIT Fusion Group)
• Current work focuses on the study of striation instabilities
• Striation instabilities, observed in all experiments, are not well understood
• We believe that the key process causing striation instabilities is the supersonic channel rotation, observed in our simulations
Work in Progress
QuickTime™ and aYUV420 codec decompressor
are needed to see this picture.
Brookhaven Science AssociatesU.S. Department of Energy 36
Neutrino Factory / Muon Collider target
Simulation tasks:• Studies of the jet formation in the nozzle• Entrance of the jet into the magnetic field• Mercury jet - proton pulse interaction. Jet cavitation and disruption, stabilizing effect of the magnetic field
• Predictions for the CERN targetry experiment called MERIT (Fall of 2007)
Brookhaven Science AssociatesU.S. Department of Energy 37
Jet entering 15 T solenoid
Brookhaven Science AssociatesU.S. Department of Energy 38
Aspect ratio of the jet cross-section
B = 15 TV0 = 25 m/s
These studies has resulted in the change of MERIT design. The chamber was re-designed to allow much smaller angle with of the jet with the magnetic field.
Brookhaven Science AssociatesU.S. Department of Energy 39
Simulations predicted slightly smaller value of the jet width in different view ports.
Experimental data
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
V = 15 m/s, B = 10T V = 20 m/s, B = 10T
B = 15T B = 15T
Brookhaven Science AssociatesU.S. Department of Energy 40
Liquid jet cavitation
Brookhaven Science AssociatesU.S. Department of Energy 41
Interaction of the mercury jet target with proton pulses
3D FronTier simulations of the disruption of Hg jet interacting with a proton pulse.
Brookhaven Science AssociatesU.S. Department of Energy 42
Summary of Target Studies
Accomplishments• Modeling and simulation of the mercury jet target • Change design parameters of the MERIT experiments • Successful predictions for MERIT: jet flattening in high gradient field, jet disruption by proton pulses, stabilizing effect of the magnetic field
Significance• Neutrino Factory Collaboration reached the conclusion that liquid mercury jet targets can successfully work with proton beams up to 8 MW