Brookhaven National LaboratoryDOE Office of Science LDRD Program Review

Doon Gibbs

August 6, 2018

Brookhaven Lab at a Glance...

• Est. 1947

• One of 17 DOE Labs and 6 DOE Office of Science, multi-program Labs

− Only multi-program Lab in Northeast

• Managed by Brookhaven Science Associates

− Founded by Stony Brook University and Battelle Memorial Institute

• BSA was selected to manage BNL in 1998 and recompeted in 2015

• 2,600 employees => ~5000 jobs in NY State

− 400 Grad/Undergrad students (BNL payroll)

• ~$600M annual budget

• 5,322 acres with 316 buildings

• Major user facility for university and industry researchers

− Over 3,000 facility users and 2,100 visiting scientists per year

− Stony Brook University is Lab’s largest user (>600)

• Fundamental, basis research to innovation, development and commercialization of technologies: nuclear and high energy physics, energy S&T, big data, bio and environmental sciences, national security

2

Intro

• 7 Nobel Prizes

• 5 National Medal of ScienceWinners

• 2 National Medal ofTechnology

• 5 Fermi Awards

• 12 Lawrence Awards

• 2 Wolf Prizes

• 22 NAS/NAEMembers

1957 1976 1980 1988 2002 2003 2009

Dr.Esther Takeuchi2009 National Medal of Technology Award Winner

Research Leadership

3

Intro

Major BNL accomplishments of the last several years

• The very early universe was a ‘perfect liquid’ of quarks and gluons (RHIC)

• Primary origin of the proton spin: It’s the gluons! (RHIC)

• Structure/function of ion channels: (how cells communicate with each othersand coordinate bodily functions) 2003 Nobel Prize in Chemistry (NSLS)

• Structure/function of ribosome (“workhorses” of cells that produce cell proteins): 2009 Nobel Prize in Chemistry (Bio, NSLS)

• Electron spectroscopy of correlated electron systems: Understanding the ‘Pseudogap’ Phase in High-TC Superconductors (CMPMSD, NSLS)

• Discovery/application of core shell nano-particles: better and cheaper catalysts (CFN)

• Neutrinos: Measurement of sin22θ13 (Daya Bay); Discovery of solar neutrinos--2002 Nobel Prize in Physics (Homestake Mine)

• Host institution for US ATLAS: 2013 Nobel Prize in Physics for prediction of Higgs Boson observed at LHC

Research Leadership

4

Intro

Brookhaven National Laboratory

RHIC

NSRL

BLIP

BNL Scientific Data and

Computing Center

Interdisciplinary Energy

Science Building

CFR-I

ATF

CFN

NSLS-II

Long Island Solar Farm

10

5

Intro

Brookhaven National Laboratory -In the Coming Decade

Enabled by renewed infrastructure and

safe/efficient/secure operations

To be a leading U.S. DOE, multi-program laboratory with recognized impact on national science needs

• Leadership in nuclear physics, photon sciences, energy science, and data-driven discovery

• Leading programs in selected areas of HEP, BER, accelerator science and technology, and national security and nonproliferation

Utilize our world-class facilities and core expertise to:

• Advance energy and environment-related basic research and apply them to 21st

Century problems of critical importance to the Nation

• Advance fundamental research in nuclear and particle physics to gain a deeper understanding of matter, energy, space, and time

Position our major user facilities (NSLS-II, CFN, RHIC → eRHIC) and CSI for continued leadership roles

• Conduct interdisciplinary research that leverages the facilities to enable solutions to complex problems of national importance

VisionMission

Strategy

Intro

6

Our Science Initiatives are Transformative and Differentiate BNL

Six Scientific Initiatives Will Help

Realize the Vision for the Lab

Major Laboratory thrusts that:

• Align with the DOE Strategic Goals in

Science, Energy and National/Nuclear

Security

• Build on the Laboratory’s core strengths

and capabilities

Will continue to distinguish BNL by:

• Delivering transformative science,

technology, and engineering enabling

the Laboratory to make the world a

better place

BNL aspires to leadership roles

in Quantum Information Science

• In areas aligned with the Lab’s

recognized strengths in materials

science, computation, and high energy

physics

Intro

7

• The world’s highest energy machine for fundamental nuclear physics

− World-wide collaboration of more than 1,000 scientists, engineers, and students

• Unique, most powerful microscope to explore the mysterious world of the Strong Force inside the proton and 0.00001 sec after the birth of the universe

− 4,000,000,000,000K

− It is a Quark-Gluon Plasma and a “Perfect Liquid”!

• Strategy for the future

− Measure the extraordinary properties of the perfect liquid

− Transition from RHIC to eRHIC to learn what’s at the heart of all visible matter

− Applications of nuclear science

Relativistic Heavy Ion Collider (RHIC)

8

NP: From RHIC to eRHIC

EIC Science Pillars

9

The EIC will collide high-energy electrons with

high-energy protons or heavier atomic nuclei to

produce “freeze-frame” snapshots of their inner

structure, creating precise first-ever tomographic

images of the “ocean” of gluons within. These

images will tell us how gluons and quarks bind

each other to form the particles that lie at the

core of all atoms.

New experiments and advances in theory suggest

that protons, neutrons, and nuclei appear as dense

“walls” of gluons when probed at high energy,

creating what are conjectured the strongest fields

in nature. Discovering and studying this new form

of matter, the “color glass condensate,” in an EIC

will give us additional insight into why matter in

this sub-atomic realm is stable.

Precision

Discovery

… and much, much more! (see EIC White Paper)

Without gluons, there would be no protons, no atomic nuclei, and hence no visible matter in the Universe!

NP: From RHIC to eRHIC

Brookhaven Energy R&D: A CollaborativeApproach

Basic Research, Applied Research and Industry Working Together

NY State Consortia/Resources

Energy Challenges: New York and Beyond• Electric Systems• Sustainable Fuels

DOEAlignment/Leverage• DOE Priority ResearchDirections

• Energy Frontier Research Centers

BNL Resources

NSLS-II

CFN/

Nanoscience

ISB

LISF

BNLCluster

Collaborators/Joint Appointments

SYRACUSE

BN

LR

esearc

h

10

Materials & Chemical Sciences

• Brightest synchrotron in the world

− 10,000 times brighter than NSLS

− 1,300 users per year (3,000 by FY20)

− Running on low-cost NYPA hydropower – a significant factor in DOE decision to site NSLS-II at BNL

• Enabling solutions to pressing energy challenges, e.g.

− Advanced electrical storage

− High-temperature superconductors for the electric grid

− Fuel cells based on nanocatalysts

− Plant/environment interactions

• A strategic approach to Energy Science challenges

− Synergy with the CFN, core programs

− State-of-the-art integrated tools for studies under real world conditions

− Outreach to university and industry

Energy Storage High Tc Superconductors

Nanocatalysts for Fuel Cells

Plant Bioscience

Pt

NSLS-II: Enabling the Nanoscience Revolution

11

Materials & Chemical Sciences

BNL Data and Computing Statistics

• Largest scientific archive in the U.S., 3rd largest in the world (ECMWF, UKMO)*

• 99.5% service availability guaranteed

• 2017:

− >130 PB of catalogued data archived for long-term, frequent reuse (+30 PB in 2017)

− 500 PB of data analyzed (2016, 400 PB)

− ~4 PF HTC and HPC computing –CPU/GPU, KNL, Skylake

*http://www.hpss-collaboration.org/customersT.shtml

12

Making Sense of Data at Exabyte Scale & Beyond

2018 expected: 9 PB/month,110 PB/year Tape library

Enabling Scalable Quantum Computing

• Setting up North East Quantum Systems Center (NEQsys) with initial partners: Harvard, MIT, Princeton, Columbia, Tufts

− Joint: Seth Lloyd (MIT), Alan Aspuru-Guzik(Toronto), Peter Love (Tufts)

− Collaboration with: Margaret Martonosi(Princeton), Prineha Narang (Harvard)

• Building teams that leverage BNL and NEQsysstrengths

− QIS Programming Models

− QIS Machine Learning

− Quantum Chemistry

− Testbed Facility

• Hardware partnership – NIST, Raytheon

• Collaboration discussions with Google and IBM

Making Sense of Data at Exabyte Scale & Beyond

13

Seth Lloyd

Peter Love

Alan Aspuru-Guzik

Margaret Martonosi

Prineha Narang

HEP Strategy

• BNL is committed to ensuring success of the HEP mission with focus on the P5 priorities

• Focus on highest priority HEP programs

− US-ATLAS

− LBNF/DUNE

− LSST

− Belle II @ KEK

• Strengthen cross-cutting enablers

− Computing – including HPC and preparation for Exascale

− Instrumentation – for future experiments

• Fully utilize synergy with NP

− Accelerator R&D

− Superconducting magnets

− Lattice QCD

14

Anode plane with BNL cold electronics for the

protoDUNE detector at CERN

High Energy Physics: Beyond the Standard Model

Anode plane assembly

Cold electronics

Accelerator S&T: BNL’s Vision

Vision

• Drive transformative innovations for collider-based U.S. science

• Maintain leadership in providing high-brightness X-ray beams for users

• Utilize our expertise to enable new accelerator applications with broad societal impact

Support evolving capabilities for science, industry, and society

• Science User Facilities

• Medical Isotopes – MIRP

• Space Research – NSRL

• Advanced Accelerator Research – ATF

• Superconducting Magnets – SMD

• Industrial Support – Tandems

15

Ac-225 Treatment Sequence

Meeting Society’s Needs for Medical Isotopes• Regional Isotope Production• Targeted Needs for Key Isotopes Ac-225

Production

AS&T: From Innovation to Application

ATF: Transforming mid-IR Laser & Acceleration Capabilities

10 atm CO2 Laser Amplifier1st CO2 CPA System

Advances in Hadron Beam Cooling to Support Nuclear Physics Research

Coherent Electron CoolingLEReC

Growing BER-aligned Genomic Sciences Capabilities

Goal

• Develop predictive understanding of biological systems behavior with respect to bioenergy crops

16

BER Genomic Science

target group 1growth defect in low Fe nutrition

target group 2growth defect in low Zn nutrition

Growth in low Fe

Gro

wth

in

lo

w Z

n

Example of a mutant screen for growth under low Iron and Zinc

Approach

• Use plant genomic data, high-throughput analytical technologies, modeling and simulation

Partnerships

• Partner with Bioenergy Research Centers to develop improved bioenergy feedstocks with improved vegetative oil accumulation and cell wall digestibility

• Partner in Biosystems Design projects to provide foundational science to enable engineering by design

Sugarcane Duckweed

Supporting DOE/NNSA and State Department

− Policy and technical analysis to supportdiplomacy and treaties

− Training programs for nuclear and chemical safeguards and security

− Develop, improve, and deploy radiationdetectors

Strengthening IAEAsafeguards

− Manage the U.S. Support Program to IAEASafeguards

− Train IAEA, member state officials, and students

Preventing potential domestic nuclearthreats

− RadiologicalAssistance Program protects U.S.communities and high profile events

Supporting Nuclear Criticality Safety Program

− Hosts the National Nuclear Data Center, the nation’s nuclear data repository

Growing Strategic Intelligence Partnerships

− New programs with IC and DOD partners

− Exploring possibility of forensic studies at NSLS-II

− Establishing Field Intelligence Element

National Security and SIPP

National Security and SIPP Efforts

17

18

Ten-Year Campus Vision

Campus Vision

Significance of LDRD

• Creates S&T opportunities and capabilities

• Enables recruitment of world-class scientists and engineers

• Supports the education and training of the next generation of scientists

• Enables the Lab’s long-term strategy

− Nuclear Physics

− Materials & Chemical Sciences

− Computation

− High Energy Physics

− Accelerator Science and Technology

− Quantitative Plant Science

− Quantum Information Science

• Promotes discovery S&T

• Supports/enables the DOE mission

19

LDRD

Projects in FY18 Portfolio Are Already Having Impact

• Contributed to two successful Energy Frontier Research Centers led by Stony Brook/BNL joint appointees

• Led to new program growth

− Exascale Computing Project; SciDAC; EERE; NGA; NNSA; DARPA; DOE Early Career Award, NSF CAREER, and Stony Brook SEED proposals funded

− Many proposals still pending

• Contributed new directions to FWP renewals

• Supported numerous students and postdoctoral research associates

• Led to funding for two SBIRs

• Led to several open source software releases

• Fostered new internal collaborations

• Fostered/strengthened partnerships with universities, other Labs, industry, and utilities

Impacts reported by PIs at recent Annual Reviews

BNL’s Rob Pisarski (Nuclear Theory) andAlexei Tsvelik (Condensed Matter Theory)partner on a RHIC-related project

Simerjeet Gill built a teamwith NETL, PNNL, and LANLfor in situ studies at NSLS-II

20

LDRD

Preview

• Energy Storage

− Elucidating Mechanisms in Energy Storage Systems – Esther Takeuchi

• High Energy Physics → Synergies with Photon Sciences

− Good Timing – the Development of High Resolution 4D Detectors – Alessandro Tricoli

• Nuclear Physics: From RHIC to eRHIC

− Strong-Strong Beam-Beam Interaction Studies for a Ring-Ring Based Electron-Ion Collider – Ferdinand Willeke

• Making Sense of Data at Exabyte Scale and Beyond

− Machine Learning for Autonomous X-ray Scattering Experiments – Kevin Yager

21

Esther Takeuchi Alessandro Tricoli Kevin YagerFerdinand Willeke

LDRD

Questions?

22

Extras

23

24

Electric Grid Technology andCommercialization

• Northeast Solar Energy Research Center (NSERC)

• Test/evaluation facility to enable development and integration of reliable/resilient solar, storage and grid technologies in the NE

• Partner with NYSSGC, utilities, and industry

• Integrate PV and energy storage (plus load management) into electrical distributionsystem

• Design/control micro-gridarchitectures

• Test smart-grid technologies, e.g. inverters, sensors, control systems

• Modeling

• $1M NYS ESDC funding for NSERC build-out

• Use BNL micro-grid as a distribution lab

• Partner with NYSSGC/SBU; engaged OE

• NYS support for grid projects – e.g. $5M (BNL/SBU) SGRID3award

• Accelerate commercialization

• Partner with Columbia, SBU, and Cornellon Proof-of-Concept center – NYSERDA $5M

First Experiments

• NYSERDA-funded study of smart-grid inverters ($2 M proposed)

• Collaboration with EPRI, NYS Utilities

• Engineering Studies - FY14

• First Field Tests at BNL - FY15

25

Impactful Machine Learning

• Research Leaders in extreme scale, science specific new Machine Learning Methods

• Joint Research Center for Machine Learning @ Scale with Carnegie Mellon University

• Advanced analysis deployed at several NSLS-II beamlines (HXN, ISS, XPD, CMS) and CFN instruments

− Real time, object-based recognition and motion detection expertise also applied to national security applications

• ASCR-funded BNL Extreme-Scale Multi-Modal Learning Methods for Spatio-Temporal Data successfully applied to Alzheimer’s detection and prognosis

− Further application to VA and BER KBase

Making Sense of Data at Exabyte Scale & Beyond

26

Object detection in images of simulated nuclear facility

100% Alzheimer’s detection accuracy and 83% prediction accuracy for early-stage Alzheimer’s.

The algorithms were trained on magnetic resonance imaging and brain phenotyping clinical

data.

Original ETEM image U-Net Detection result

CFN – Real Time Particle Detection and Analysis

Plastic box

Plastic box

Plastic box

Yellowbox

Drum

Healthy Control Alzheimer’s Disease

Serving DOE-NE and NNSA Missions

Radiation Detector R&DNuclear Materials Research Vision

Secure, detached, and dedicated

synchrotron facility for non-destructive

imaging, spectroscopy and diffraction of

wide range of radioactive materials,

including forensic samples

Builds on existing NSUF Partner User

Agreement and expertise and methods

developed at NSLS-II

Advanced Instrumentation Testbed

Liquid Scintillator & Photodetectors

for remote reactor monitoring

Radiation Detection Systems

for X-rays, neutrons

Crystal Growth

Sensor Development

Microelectronics

Data Acquisition

Design Engineering

Component Fabrication

System Integration

27

Watchman project

Detectors & Nuclear Materials Research

Changes in structure of Westinghouse SiC

• RHIC is the world’s most

versatile facility for the

exploration of the phases

of QCD matter from high

temperature to high

baryon density

• RHIC is also the world’s

first and only polarized

proton collider and

explores properties of

the proton’s spin

• RHIC discovered the “perfect fluid” quark-gluon plasma (QGP) and is

now exploring its properties by measuring its effectson jets and heavy

quarks, collective flow phenomena, and its changes with system size.

RHIC’s versatility of collisionsystem and energy creates unique

advantages for the study of QCD matter

RHIC

RHIC: The World’s Most Versatile Collider

28