(1)

Thrust Area 3: Global Modeling and Computational Electromagnetics

Ozlem Kilic, D.Sc., The University of Tennessee – Knoxville

Mongi Abidi, Ph.D., The University of Tennessee – Knoxville

Samir El-Ghazaly, Ph.D., University of Arkansas – Fayetteville

Ryan S. Glasby, Ph.D., The University of Tennessee – Knoxville

Greg Peterson, D.Sc., The University of Tennessee – Knoxville

(2)

Our Motivation for Thrust 3

(3)

Computational EMAG

Development

Professor Ryan S. Glasby

High Speed board processing

and Intelligent Systems

Professor Mongi Abidi

Performance Scaling for EM

Applications

Professor Greg Peterson

Project

Professor

Large Scale Computational

EM Problems

Professor Ozlem Kilic

Advanced simulations of

mm-wave devices

Professor Samir El-Ghazaly

Millimeter-wave and THz

semiconductor devices

Semiconductor-device

simulations

Electromagnetic-wave solutions

Computational EM

Remote sensing

Antenna systems

Computational acceleration and scaling,

HPC

Computational Fluid Dynamics

Implicit Methods, Finite element

discretization

linear/nonlinear PDE solver

Imaging

robotics

real-time processing

(4)

Lab Facilities & Research Capability• Supercomputing: Kraken, Nautilus, Keeneland,

Darter, and Beacon

• Anechoic Chamber

• RF test equipment

• Computational Mesh Generation

• Parallel Implicit PDE solver

• Quantum Computing

(5)

Sample of Projects and Sponsors

• Drone based monitoring and tracking/Techmah

• EM modeling and optimization of complex cylindrical structures/ONR

• Hardware accelerated full wave

model of Rotman lenses/ARO

(6)

Completed Project: Motion Tracking

Integrated scene and human activity for

fast and accurate EM modeling

Objective: Demonstrate

that various human

activities can be detected

remotely

Problem: Interactions of

complex human motions

with the scene and its effect

on retrieved data

New idea: Real life scenario

for simulation of different

human activity in variety of

surroundings for radar

applications

What is new here?

Deliverable: Hardware accelerated full wave EM

simulation tool

(7)

Completed Project: Vital Sign DetectionModeling

Demonstrate that

multiple subjects can

be monitored and

tracked for their vital

signatures remotely:

Objective: Develop a realistic simulation tool to configure

optimal hardware and signal processing techniques

Problem: Extend the capability to minor motions

such as heart beat and breathing

New idea: support development of hardware and

signal processing algorithms by creating a realistic

simulation tool for all human signatures

What is new here?

Deliverable:. A complete detection system with

advanced signal processing techniques validated

by EM simulation

(8)

Proposed Future Direction

SENSING/MONITORING(ENVIRONMENTAL)

HEALTH/MEDICINE

Major sources of funding:

(9)

We Propose: Hardware Accelerated Large Scale Electromagnetics Tools (e.g. MLFMA)

Objective:

State of Technology

Progress

(10)

We Propose: Hardware Accelerated Large Scale Electromagnetics Tools (e.g. MLFMA)

Objective:

State of Technology

Progress

(11)

Completed Project: Computational Fluid Dynamics

Higher order space and time SupercomputingNonlinear PDE solverUp-winding / Constraint enforcementNovel Discretization TechniqueStrong parallel supercomputing scalabilityImplicit methods with sparse matrix iterative solvers (GMRES+ preconditioning)

Objectives:

Problem: model flow over numerous civilian/military aircraft

New idea: Numerical software used to model flow over aircraftsCFD approach to computational EMAGImplicit methodsHigher order space/time methods for long/high frequency wave propagationNovel characteristic based BC’s for EMAG

What is new?

Deliverable DoD user base for CFD Numerical software used to model flow over numerous civilian/military aircraft

Develop fast code for supercomputers, and compare with ANSYS

(12)

We Propose 3D EMAG Software forSupercomputers FETD base

Application of novel CFD approach to computational EMAGImplicit methodsHigher order space/time methods for long/high frequency wave propagationNovel characteristic based BC’s for EMAG

:

Objective:

Problem:EMAG field characterization/scattering parameters for complex shapes (aircraft)New idea:Adjoint based design to optimize scatteringEMAG material characterizationExtend it to AC/DC EMAG for electric motors Applicable to Supercomputing and computational mesh generation

What is new here? fast optimization of Stealth

modified aircraft

Deliverable:.

Implicit FETD method for supercomputer Explore software design for emerging graphic card based supercomputers (C++/MPI/CUDA)Application to antenna design and scattering profiles

Many interested Government agencies interested in developed codes including Lockheed Martin (Ft. Worth), Boeing (Huntington Beach), Sandia National Lab, Carbon 3D3D time domain EMAG software Implicit FETD method for supercomputer Explore software design for emerging graphic card based super computers (C++/MPI/CUDA)

Application to antenna design and scattering profiles

(13)

Completed Projects: Supercomputers

Kraken: Kraken was a Cray XT5 supercomputer entered into full production mode on February 2, 2009. Kraken was decommissioned on April 30, 2014

Nautilus: Nautilus is intended for serial and parallel visualization and analysis applications that take advantage of large memories, multiple computing cores, and multiple graphics processors. Nautilus allows for both utilization of a large number of processors for distributed processing and the execution of legacy serial analysis algorithms for very large data processing by large numbers of users simultaneously.

Keeneland: It is composed of an HP SL-390 (Ariston) cluster with Intel Westmere hex-core CPUs, NVIDIA 6GB Fermi GPUs, and a Qlogic QDR InfiniBand interconnect. Each node has two hex-core CPUs and 3 GPUs, with a total of 120 nodes, 240 CPUs and 360 GPUs.

Darter: A Cray XC30 system with an Aries interconnect and a Lustre storage system, provide both high scalability and sustained performance. The Darter supercomputer has a peak performance of 240.9 Tflops(1012 floating point operations per second)

Beacon: an energy efficient cluster that utilizes Intel® Xeon Phi™ coprocessors. It is funded by NSF to port and optimize scientific codes to the coprocessors based on Intel's Many Integrated Core (MIC) architecture.

(14)

We propose: Performance Scaling for EM Applications

EM SimulationApplication

Vectorization (e.g., AVX, SSE, MMX)

GPU Accelerated (e.g., CUDA)

Shared Memory Parallelism (e.g., Open MP)

Distributed Memory Parallelism (e.g., MPI)

FDTD Code P1a P1b P1c P1d

OzlEM Code P2a P2b P2c P2d

MHD Code P3a P3b P3c P3d

DeliverableFor each code type, the activities will include documentation of prior work and implementations, code development, testing and validation, and release.

(15)

• Simulation packages with combined

nonlinear electron transport and

electromagnetic waves

• Broad-band device models

What is new here?

We Propose: semiconductor device simulations with combined transport and electromagnetic-wave effects

Deliverable: simulation tools and device

models for millimeter-wave devices

Problem: In millimeter-wave transistors, lateral dimensions

are large from the electromagnetic point of view. They act as

waveguides. Wave propagation effects need to be combined

with advanced electron transport physics.

New idea: Develop device simulation tools and models that

integrate EM waves with nonlinear electron transport

Objectives: (1) Identify physical limits of current simulation tools

(2) Clarify the type of equations suitable for each device and

numerical techniques capable of

handling the nonlinearities.

(3) Develop software packages

for different devices and configurations

Compression in y direction Compression in x direction

(16)

• Tune and adapt the analysis tools and

calibrate with measured data

• Analyze wave propagation effects, and

redesign electrodes, fabricate and test

• Develop de-embedding techniques;

optimize device layout to minimize

area and reduce effects of parasitic

elements

What is new here?

We Propose: optimization of millimeter-wave transistor performance by incorporating wave propagation effects

Deliverable: Millimeter-wave transistor

designs with and enhanced performance

Problem: To increase transistor power, wide electrodes are

needed. In the mm-wave band, electrode widths become

comparable to wave length. Wave propagation effects must be

considered.

New idea: Device electrode width can be increased beyond

established industry standard (< l/10) by redesigning the

electrodes taking wave-propagation effects into consideration.

Objectives: (1) develop suitable transistor models and equivalent

circuits that take electromagnetic-wave propagations into

consideration.

(2) Redesign the transistor electrodes and distribution pads to

increase the allowed width per device finger.

(3) Provide optimized transistor electrodes to meet specific

objectives

(4) Develop de-embedding techniques with EM wave effects

-40

-35

-30

-25

-20

-15

-10

-5

0

5

10

0.1 1 10

Outp

ut

po

wer

(dB

m)

width (mm)

hybrid mdoel

circuit model

(17)

What is new here?

• Integrated multi-physics models that

combine EM-wave, electron transport

and thermal conductivity

• Ability to analyze the interactions

between several physical phenomena.

• Device and circuit optimizations

We Propose: thermal and transport models for RF Devices

Deliverable: analysis of thermal management

issues in mm-wave integrated circuits

Problem: As the operating frequency increases, the device

efficiency usually decreases. More heat is dissipated and must be

extracted.

New solutions for analyzing and optimizing devices structures

are needed. Also, new device configurations should be explored.

New idea: Develop simulation tools that combines thermal

models with electron transport and wave effects . Explore new

device configurations

Objectives: (1) Improve thermal modeling of RF devices

(2) Explore new device configurations and heat extraction

techniques suitable for mm-wave

devices and integrated circuits

(3) Increase output power

and improve efficiency

(18)

Benefits to Industry: Revolutionary technologies impacted:

High-resolution security imaging systems, improved collision-

avoidance radar, communications networks with higher capacity, and

spectrometers that could detect potentially dangerous chemicals and

explosives with much greater sensitivity.

THz circuits will reduce the size, weight and power consumption of

current technology on atmospheric sensing, radio astronomy and

medical imaging systems while improving the range and portability of

these systems.

Deliverables from the Project: Ultrafast electronic circuits that can

tolerate harsh environments, a new era for photonics, and students

capable of developing the next generation electronic systems.

(19)

Benefits to Industry

• Future of CEM is exciting as it employs new platforms and incorporates multiple disciplines: biology, medicine, robotics, thermodynamics, etc.

• All these advances are enabling optimal solutions and accurate designs for multi-scale

problems, which involve trans-disciplinary research.

Team researchers have been pushing the limits of computational electromagnetics.Together they will:

• Develop new solutions for complex problems and multi-physics-based simulators

• Analyze millimeter-wave devices and circuits with EM wave propagations

• Analyze novel devices and develop adapted modeling and simulation tools

• Provide tested and debugged codes

• Educate and train students in numerical techniques and their applications to mm-wave devices and

circits (e.g., Maxwell-equations solvers, semiconductor transport physics, wave propagations, . . .)