103
Exchange-Correlation Functional with Uncertainty Quantification Capabilities for Density Functional Theory Manuel Aldegunde [email protected] Warwick Centre of Predictive Modelling (WCPM) The University of Warwick October 27, 2015 http://www2.warwick.ac.uk/wcpm/ Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 1 / 51

Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

  • Upload
    others

  • View
    10

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Exchange-Correlation Functional with UncertaintyQuantification Capabilities for Density Functional Theory

Manuel Aldegunde

[email protected] Centre of Predictive Modelling (WCPM)

The University of Warwick

October 27, 2015

http://www2.warwick.ac.uk/wcpm/

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 1 / 51

Page 2: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Outline

1 Introduction

2 Bayesian Linear Regression

3 Exchange Model TrainingData setupNumerical results

4 Exchange Model TestingAtomisation EnergiesBulk Properties

5 Summary

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 2 / 51

Page 3: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

1 Introduction

2 Bayesian Linear Regression

3 Exchange Model TrainingData setupNumerical results

4 Exchange Model TestingAtomisation EnergiesBulk Properties

5 Summary

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 3 / 51

Page 4: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Introduction

Density Functional Theory (DFT) has become the most widespreadtechnique to study materials in a quantum-mehanical framework

It can provide a favourable trade-off between accuracy andcomputation

It is commonly implemented using approximations to make it moremanageable:

simplify physics, e. g., Born-Oppenheimer approximationnumerical approximations, e.g., pseudopotentials, PAW, ...

One approximation is necessary:

Exchange-Correlation Functional (unknown in general)

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 4 / 51

Page 5: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Introduction

Density Functional Theory (DFT) has become the most widespreadtechnique to study materials in a quantum-mehanical framework

It can provide a favourable trade-off between accuracy andcomputation

It is commonly implemented using approximations to make it moremanageable:

simplify physics, e. g., Born-Oppenheimer approximationnumerical approximations, e.g., pseudopotentials, PAW, ...

One approximation is necessary:

Exchange-Correlation Functional (unknown in general)

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 4 / 51

Page 6: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Introduction

Density Functional Theory (DFT) has become the most widespreadtechnique to study materials in a quantum-mehanical framework

It can provide a favourable trade-off between accuracy andcomputation

It is commonly implemented using approximations to make it moremanageable:

simplify physics, e. g., Born-Oppenheimer approximationnumerical approximations, e.g., pseudopotentials, PAW, ...

One approximation is necessary:

Exchange-Correlation Functional (unknown in general)

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 4 / 51

Page 7: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Introduction

Density Functional Theory (DFT) has become the most widespreadtechnique to study materials in a quantum-mehanical framework

It can provide a favourable trade-off between accuracy andcomputation

It is commonly implemented using approximations to make it moremanageable:

simplify physics, e. g., Born-Oppenheimer approximationnumerical approximations, e.g., pseudopotentials, PAW, ...

One approximation is necessary:

Exchange-Correlation Functional (unknown in general)

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 4 / 51

Page 8: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Density Functional Theory

Approximates the ground state energy of a material system withcharge density n.

Minimisation of the energy functional EDFT [n] for a given system

EDFT [n] =

∫n(r)v(r) dr + T0[n] + U[n] + E xc [n]

=Eb[n] + E xc [n] = Eb[n] + E x [n] + E c [n]

E xc [n] not known... Need to specify an approximation

1R. Jones et al. (1989), R. Jones (2015)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 5 / 51

Page 9: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Density Functional Theory

Approximates the ground state energy of a material system withcharge density n.

Minimisation of the energy functional EDFT [n] for a given system

EDFT [n] =

∫n(r)v(r) dr + T0[n] + U[n] + E xc [n]

=Eb[n] + E xc [n] = Eb[n] + E x [n] + E c [n]

E xc [n] not known... Need to specify an approximation

1R. Jones et al. (1989), R. Jones (2015)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 5 / 51

Page 10: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Density Functional Theory: Kohn-Sham method

Kohn and Sham (1965) introduced a methodology to solve theequations: most common formulation nowadays

Solve a self-consistent problem using independent electrons in aneffective potential:[

− 12∇

2 + veff (r)]ψi (r) = εiψi (r)

veff (r) = v(r) +∫ n(r′)|r−r′| dr′ + δE xc [n]

δn(r)

n(r) =∑

i |ψi (r)|2

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 6 / 51

Page 11: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Density Functional Theory: Kohn-Sham method

Kohn and Sham (1965) introduced a methodology to solve theequations: most common formulation nowadays

Solve a self-consistent problem using independent electrons in aneffective potential:[

− 12∇

2 + veff (r)]ψi (r) = εiψi (r)

veff (r) = v(r) +∫ n(r′)|r−r′| dr′ + δE xc [n]

δn(r)

n(r) =∑

i |ψi (r)|2

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 6 / 51

Page 12: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

DFT: Exchange-correlation energies

How to approximate E xc [n]?

We can write E xc [n] =∫nεxc (n; r) dr

nεxc (n; r): XC energy density

εxc (n; r) = εxc [n(r)]: LDAεxc (n; r) = εxc [n(r),∇n(r)]: GGAεxc (n; r) = εxc [n(r),∇n(r), τ(r)]: meta-GGA(τ(r) = 2

∑′

i12 |∇ψi (r)|2

)We can add exact exchange: E x [n] = −1

2

∑i

∫ ψ∗i (r)ψi (r′)

|r−r′| drdr′

But still need to approximate the correlation energy...

1J. P. Perdew et al. (2001)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 7 / 51

Page 13: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

DFT: Exchange-correlation energies

How to approximate E xc [n]?

We can write E xc [n] =∫nεxc (n; r) dr

nεxc (n; r): XC energy densityεxc (n; r) = εxc [n(r)]: LDA

εxc (n; r) = εxc [n(r),∇n(r)]: GGAεxc (n; r) = εxc [n(r),∇n(r), τ(r)]: meta-GGA(τ(r) = 2

∑′

i12 |∇ψi (r)|2

)We can add exact exchange: E x [n] = −1

2

∑i

∫ ψ∗i (r)ψi (r′)

|r−r′| drdr′

But still need to approximate the correlation energy...

1J. P. Perdew et al. (2001)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 7 / 51

Page 14: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

DFT: Exchange-correlation energies

How to approximate E xc [n]?

We can write E xc [n] =∫nεxc (n; r) dr

nεxc (n; r): XC energy densityεxc (n; r) = εxc [n(r)]: LDAεxc (n; r) = εxc [n(r),∇n(r)]: GGA

εxc (n; r) = εxc [n(r),∇n(r), τ(r)]: meta-GGA(τ(r) = 2

∑′

i12 |∇ψi (r)|2

)We can add exact exchange: E x [n] = −1

2

∑i

∫ ψ∗i (r)ψi (r′)

|r−r′| drdr′

But still need to approximate the correlation energy...

1J. P. Perdew et al. (2001)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 7 / 51

Page 15: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

DFT: Exchange-correlation energies

How to approximate E xc [n]?

We can write E xc [n] =∫nεxc (n; r) dr

nεxc (n; r): XC energy densityεxc (n; r) = εxc [n(r)]: LDAεxc (n; r) = εxc [n(r),∇n(r)]: GGAεxc (n; r) = εxc [n(r),∇n(r), τ(r)]: meta-GGA(τ(r) = 2

∑′

i12 |∇ψi (r)|2

)

We can add exact exchange: E x [n] = −12

∑i

∫ ψ∗i (r)ψi (r′)

|r−r′| drdr′

But still need to approximate the correlation energy...

1J. P. Perdew et al. (2001)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 7 / 51

Page 16: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

DFT: Exchange-correlation energies

How to approximate E xc [n]?

We can write E xc [n] =∫nεxc (n; r) dr

nεxc (n; r): XC energy densityεxc (n; r) = εxc [n(r)]: LDAεxc (n; r) = εxc [n(r),∇n(r)]: GGAεxc (n; r) = εxc [n(r),∇n(r), τ(r)]: meta-GGA(τ(r) = 2

∑′

i12 |∇ψi (r)|2

)We can add exact exchange: E x [n] = −1

2

∑i

∫ ψ∗i (r)ψi (r′)

|r−r′| drdr′

But still need to approximate the correlation energy...

1J. P. Perdew et al. (2001)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 7 / 51

Page 17: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

DFT: Exchange-correlation energies

The double integral in the exact exchange makes it much more costly

We chose the meta-GGA framework to build our approximation,

E xc [n] =

∫nεxc (n(r),∇n(r), τ(r)) dr

We will focus on exchange energy only,

E xc [n] = E c [n] +

∫nεx (n(r),∇n(r), τ(r)) dr

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 8 / 51

Page 18: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

DFT: Exchange energy

We can transform the dependence on ∇n(r) and τ(r) into twodimensionless parameters s and α:

s =|∇n|

2(3π2)1/3n4/3; α =

τ − τW

τUEG,

τW = |∇n|2 /8n: Weizsacker kinetic energy densityτUEG = 3

10 (3π2)2/3n5/3: UEG kinetic energy density

Also, we can group all non-local contributions in the exchangeenhancement factor F x (s, α),

E x [n] =

∫nεx (n,∇n, τ) dr =

∫nεx

UEG (n)F x (s, α) dr

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 9 / 51

Page 19: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Linear model for the enhancement factor

To specify a model for the exchange energy we just need to specify amodel for the enhancement factor

We specify a linear model

F x (s, α) =∑

i

ξxi φi (s, α) = (ξx )Tφ(s, α)

φi (s, α): basis functionsξx

i : linear model coefficients

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 10 / 51

Page 20: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Linear model for the enhancement factor

To specify a model for the exchange energy we just need to specify amodel for the enhancement factor

We specify a linear model

F x (s, α) =∑

i

ξxi φi (s, α) = (ξx )Tφ(s, α)

φi (s, α): basis functionsξx

i : linear model coefficients

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 10 / 51

Page 21: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Linear model for the exchange energy

Given this model, the exchange energy becomes a linear model

E x [n; ξx ] =M∑

i=1

ξxi

∫nεx

UEG (n)φi (s, α) dr

=M−1∑i=0

ξxi E

x [n; ei ] = (ξx )T Ex [n; e]

E x [n; ei ] =∫nεx

UEG (n)φi (s, α) dr is the “basis exchange energy”,which is obtained if we use ξx = ei , i.e., only basis φi with ξi = 1,

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 11 / 51

Page 22: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Linear model for the exchange energy

How do we choose the basis functions φi (s, α)?

Follow selection in Wellendorff et al.Physically based: inspired in previous non-empirical functionals(PBEsol, MS)Complete basis: 2D Legendre Polynomials

2D Legendre polynomials: argument in [-1, 1]

Rational transformations from s, α to the interval [-1, 1]

PBEsol → ts(s) =2s2

q + s2− 1

MS → tα(α) =(1− α2)3

1 + α3 + α6

1J. Wellendorff et al. (2014)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 12 / 51

Page 23: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Linear model for the exchange energy

How do we choose the basis functions φi (s, α)?

Follow selection in Wellendorff et al.Physically based: inspired in previous non-empirical functionals(PBEsol, MS)Complete basis: 2D Legendre Polynomials

2D Legendre polynomials: argument in [-1, 1]

Rational transformations from s, α to the interval [-1, 1]

PBEsol → ts(s) =2s2

q + s2− 1

MS → tα(α) =(1− α2)3

1 + α3 + α6

1J. Wellendorff et al. (2014)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 12 / 51

Page 24: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Linear model for the exchange energy

The final exchange enhancement model is

F x (s, α) =Ms∑i

Mα∑j

ξxijPi (ts(s))Pj (tα(α))

The final exchange energy model is therefore

E x [n; ξx ] =Ms∑i

Mα∑j

ξxij

∫nεx

UEG (n)Pi (ts(s))Pj (tα(α)) dr

How to obtain the coefficients?

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 13 / 51

Page 25: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Linear model for the exchange energy

The final exchange enhancement model is

F x (s, α) =Ms∑i

Mα∑j

ξxijPi (ts(s))Pj (tα(α))

The final exchange energy model is therefore

E x [n; ξx ] =Ms∑i

Mα∑j

ξxij

∫nεx

UEG (n)Pi (ts(s))Pj (tα(α)) dr

How to obtain the coefficients?

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 13 / 51

Page 26: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

1 Introduction

2 Bayesian Linear Regression

3 Exchange Model TrainingData setupNumerical results

4 Exchange Model TestingAtomisation EnergiesBulk Properties

5 Summary

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 14 / 51

Page 27: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Bayesian linear regression

We want to account for uncertainty in the model

Classical least squares fitting gives a point estimate, not appropriateA Bayesian model will give us probability distributions for thecoefficients

Uncertainty from a limited data set for the regressionUncertainty from an inadequate model

p(ξ, β | t) ∝ L(t | x, ξ,β)p(ξ, β)

0.0 0.5 1.0 1.5 2.0 2.5 3.0

1

0

1

2

Example: Bayesian lin-

ear regression and ordi-

nary least squares fit us-

ing a 10th order polyno-

mial

1C. Bishop (2006)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 15 / 51

Page 28: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Bayesian linear regression

We want to account for uncertainty in the modelClassical least squares fitting gives a point estimate, not appropriateA Bayesian model will give us probability distributions for thecoefficients

Uncertainty from a limited data set for the regressionUncertainty from an inadequate model

0.0 0.5 1.0 1.5 2.0 2.5 3.0

1

0

1

2

Example: Bayesian linear regression and ordinary least squares fit

using a 10th order polynomial

1C. Bishop (2006)

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 15 / 51

Page 29: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Some definitions

t = (t1, t2, . . . , tN)T : given data (experimental, simulation, mix)

n = (n1, n2, . . . , nN)T : input points (densities for DFT)

L(t | n, model): likelihood function

N (x | µ, v): normal distribution on x with mean µ and variance v

G(x | α, β): gamma distribution on x with parameters α and β

St(x | µ, λ, ν): Student t-distribution on x with parameters µ, λ andν

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 16 / 51

Page 30: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Assumptions

The observed data t follow on average our model and have a noise ε(includes model inaccuracy),

ti = (ξx )T Ex [n; e] + εi

The noise is assumed Gaussian with precision β = 1/v = 1/σ2 anduncorrelated, so that

ti ∼ N (t | (ξx )T Ex [n; e], β−1)

The likelihood function is, therefore,

L(t | n, ξ, β) =N∏

i=1

N (ti | ξT Ex [ni ; e], β−1)

We choose conjugate priors for ξ and β

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 17 / 51

Page 31: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Assumptions

The observed data t follow on average our model and have a noise ε(includes model inaccuracy),

ti = (ξx )T Ex [n; e] + εi

The noise is assumed Gaussian with precision β = 1/v = 1/σ2 anduncorrelated, so that

ti ∼ N (t | (ξx )T Ex [n; e], β−1)

The likelihood function is, therefore,

L(t | n, ξ, β) =N∏

i=1

N (ti | ξT Ex [ni ; e], β−1)

We choose conjugate priors for ξ and β

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 17 / 51

Page 32: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Assumptions

The observed data t follow on average our model and have a noise ε(includes model inaccuracy),

ti = (ξx )T Ex [n; e] + εi

The noise is assumed Gaussian with precision β = 1/v = 1/σ2 anduncorrelated, so that

ti ∼ N (t | (ξx )T Ex [n; e], β−1)

The likelihood function is, therefore,

L(t | n, ξ, β) =N∏

i=1

N (ti | ξT Ex [ni ; e], β−1)

We choose conjugate priors for ξ and β

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 17 / 51

Page 33: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Assumptions

The noise is assumed Gaussian with precision β = 1/v = 1/σ2 anduncorrelated, so that

ti ∼ N (t | (ξx )T Ex [n; e], β−1)

The likelihood function is, therefore,

L(t | n, ξ, β) =N∏

i=1

N (ti | ξT Ex [ni ; e], β−1)

We choose conjugate priors for ξ and β

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 17 / 51

Page 34: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Priors

Incorporate prior beliefs into the model

Depend on extra parameters: hyperparameters

Conjugate priors keep the posterior propability distribution in thesame family as the prior probability distribution

Prior on ξ: p(ξ | β,m0,S0) = N (ξ | m0, β−1S0)

Prior on β: p(β | a0, b0) = G(β | a0, b0)

Joint prior: p(ξ, β) = p(ξ | β)p(β) = N (ξ | m0, β−1S0)G(β | a0, b0)

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 18 / 51

Page 35: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Posterior

Probability of a set of parameters given the data

Proportional to the prior distribution of parameters

Proportional to the likelihood of the data

p(ξ, β | t) =L(t | x, ξ,β)p(ξ, β)∫L(t | x, ξ,β)p(ξ, β) dξ dβ

=N (ξ | mN , β−1SN)G(β | aN , bN)

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 19 / 51

Page 36: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Posterior

The parameters of the posterior depend on those of the prior and thedata,

S−1N = S−10 + ΦT Φ; mN = SN

[S−10 m0 + ΦT t

]aN = a0 + N/2

bN = b0 +1

2

(mT

0 S−10 m0 −mTN S−1N mN + tT t

)Φ is the design matrix

Φ =

E x [n∗1; e0] · · · E x [n∗1; eM−1]...

. . ....

E x [n∗N ; e0] · · · E x [n∗N ; eM−1]

=

Ex [n∗1; e]T

...Ex [n∗N ; e]T

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 20 / 51

Page 37: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Posterior

The parameters of the posterior depend on those of the prior and thedata,

Φ is the design matrix

Φ =

E x [n∗1; e0] · · · E x [n∗1; eM−1]...

. . ....

E x [n∗N ; e0] · · · E x [n∗N ; eM−1]

=

Ex [n∗1; e]T

...Ex [n∗N ; e]T

Rows: For a given data point, a vector with the “basis exchangeenergies”Columns: For a given basis function, its value for every data point

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 20 / 51

Page 38: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Predictive distribution

Once we have our probability distributions for model parameters,what can we say about new data points?

Prediction averaged over all possible parameters

Predictions given with probability distributions

p(t | n, t) =

∫p(t | n, ξ, β)p(ξ, β | t) dξ dβ

=

∫N (t | ξT Ex [n; e], β−1)N (ξ | mN , β

−1SN )G(β | aN , bN ) dξ dβ

= St(t | µ, λ, ν).

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 21 / 51

Page 39: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Predictive distribution

Once we have our probability distributions for model parameters,what can we say about new data points?

Prediction averaged over all possible parameters

Predictions given with probability distributions

p(t | n, t) =

∫p(t | n, ξ, β)p(ξ, β | t) dξ dβ

=

∫N (t | ξT Ex [n; e], β−1)N (ξ | mN , β

−1SN )G(β | aN , bN ) dξ dβ

= St(t | µ, λ, ν).

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 21 / 51

Page 40: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Predictive distribution

Once we have our probability distributions for model parameters,what can we say about new data points?

Prediction averaged over all possible parameters

Predictions given with probability distributions

p(t | n, t) =

∫p(t | n, ξ, β)p(ξ, β | t) dξ dβ

=

∫N (t | ξT Ex [n; e], β−1)N (ξ | mN , β

−1SN )G(β | aN , bN ) dξ dβ

= St(t | µ, λ, ν).

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 21 / 51

Page 41: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Predictive distribution

The Student t-distribution St(t | µ, λ, ν) has parameters

µ = Ex [n; e]T mN

λ =aN

bN

(1 + Ex [n; e]T SNEx [n; e]

)−1ν = 2aN .

Its mean, variance and mode are

E[t] = µ; ν > 1

cov[t] =ν

ν − 2λ−1 =

1 + Ex [n; e]T SNEx [n; e]

mode[β]; ν > 2

mode[t] = µ

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 22 / 51

Page 42: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Predictive distribution

Its mean, variance and mode are

E[t] = µ; ν > 1

cov[t] =ν

ν − 2λ−1 =

1 + Ex [n; e]T SNEx [n; e]

mode[β]; ν > 2

mode[t] = µ

The variance of the prediction depends on the data point

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 22 / 51

Page 43: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Predictive distribution

If we make several predictions, they are correlated,

p(t | n, t) =

∫p(t | n, ξ, β)p(ξ, β | t) dξ dβ = St(t | µ,Λ, ν)

The mean and covariance are

E[t] = ΦmN ; cov[t] =I + ΦSNΦ

T

mode[β]

Φ is analogous to the design matrix where the rows are the points ofthe predictions

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 23 / 51

Page 44: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Hyperparameters: Evidence approximation

One last point to be solved

How do we obtain the hyperparameters?

We chose the evidence approximation: maximise the log of themarginal likelihood (evidence function)

log p(t | m0,S0, a0, b0) =

=log

∫p(t | ξ, β,m0,S0, a0, b0)p(ξ, β | m0,S0, a0, b0)dξdβ

=E(m0,S0, a0, b0) =1

2log|SN ||S0|

− N

2log(2π) + log

Γ(aN)

Γ(a0)+

+ a0 log(b0)− aN log(bN)

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 24 / 51

Page 45: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Hyperparameters: Evidence approximation

One last point to be solved

How do we obtain the hyperparameters?

We chose the evidence approximation: maximise the log of themarginal likelihood (evidence function)

log p(t | m0,S0, a0, b0) =

=log

∫p(t | ξ, β,m0,S0, a0, b0)p(ξ, β | m0,S0, a0, b0)dξdβ

=E(m0,S0, a0, b0) =1

2log|SN ||S0|

− N

2log(2π) + log

Γ(aN)

Γ(a0)+

+ a0 log(b0)− aN log(bN)

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 24 / 51

Page 46: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Hyperparameters: Evidence approximation

For a model with M parameters, m0, S−10 , a0 and b0 have ∼ M2

parameters

Using m0 = 0 and S−10 = αI, we only have three hyperparametersand we can easily find a maximum of the evidence function (Bayesianridge regression)

Using S−10 = diag(α0, . . . , αM−1), we have M + 2 hyperparameters(Relevance Vector Machine)

Induces sparsity (some of the αi go to infinity)Only keeps relevant terms: automatic model selection

1M. E. Tipping (2001), C. Bishop (2006)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 25 / 51

Page 47: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Hyperparameters: Evidence approximation

For a model with M parameters, m0, S−10 , a0 and b0 have ∼ M2

parameters

Using m0 = 0 and S−10 = αI, we only have three hyperparametersand we can easily find a maximum of the evidence function (Bayesianridge regression)

Using S−10 = diag(α0, . . . , αM−1), we have M + 2 hyperparameters(Relevance Vector Machine)

Induces sparsity (some of the αi go to infinity)Only keeps relevant terms: automatic model selection

1M. E. Tipping (2001), C. Bishop (2006)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 25 / 51

Page 48: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Hyperparameters: Evidence approximation

For a model with M parameters, m0, S−10 , a0 and b0 have ∼ M2

parameters

Using m0 = 0 and S−10 = αI, we only have three hyperparametersand we can easily find a maximum of the evidence function (Bayesianridge regression)

Using S−10 = diag(α0, . . . , αM−1), we have M + 2 hyperparameters(Relevance Vector Machine)

Induces sparsity (some of the αi go to infinity)Only keeps relevant terms: automatic model selection

1M. E. Tipping (2001), C. Bishop (2006)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 25 / 51

Page 49: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Hyperparameters: Evidence approximation

Algorithm 1 Hyperparameter optimisation for the RVM.

1: S−10 = diag(α0, . . . , αM−1), m0 = 0.2: Initialize αi from random numbers r ∈ (0, 1010).3: repeat4: repeat5: for all i = 0, 1, . . . ,M − 1 do6: Update αi as αnew

i = 1[SN ]ii+

aNbN

[mN ]2i.

7: Update SN , mN .8: end for9: until ∆αi < 10−5% or αi > 1010

10: Update a0, b0 with a Newton iteration.11: Update SN , mN .12: until ∆α,∆a0,∆b0 < 10−4%

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 26 / 51

Page 50: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Relevance Vector Machine: Example

Generate data from f (x) = sin(2πx) + ε

ε ∼ N (ε | 0, 0.12)

Use 10 sine basis functions, sin(kπx); k = 0, 1, ..., 9

Fitted mN = [0, 0.003, 1.006,−0.016, 0, 0, 0, 0, 0, 0],mode[σN ] = 0.097

Only three coefficients remain

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 27 / 51

Page 51: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Relevance Vector Machine: Example

Generate data from f (x) = sin(2πx) + εε ∼ N (ε | 0, 0.12)

Use 10 sine basis functions, sin(kπx); k = 0, 1, ..., 9Fitted mN = [0, 0.003, 1.006,−0.016, 0, 0, 0, 0, 0, 0],mode[σN ] = 0.097

Only three coefficients remain

1 0 1 2 3 4 5 6 71.5

1.0

0.5

0.0

0.5

1.0

1.5

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 27 / 51

Page 52: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

1 Introduction

2 Bayesian Linear Regression

3 Exchange Model TrainingData setupNumerical results

4 Exchange Model TestingAtomisation EnergiesBulk Properties

5 Summary

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 28 / 51

Page 53: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

1 Introduction

2 Bayesian Linear Regression

3 Exchange Model TrainingData setupNumerical results

4 Exchange Model TestingAtomisation EnergiesBulk Properties

5 Summary

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 29 / 51

Page 54: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Training data

The exchange energy cannot be measured

Absolute energies cannot be measured

How to train the model?

Easy to get from DFT simulationsExperimentally available

Atomisation/cohesive energies

Given a system M = AnABnB

. . .,

Eat =1

N

(∑I

nIEI − EM

); I = A,B, . . .

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 30 / 51

Page 55: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Training data

The exchange energy cannot be measured

Absolute energies cannot be measured

How to train the model?

Easy to get from DFT simulationsExperimentally available

Atomisation/cohesive energies

Given a system M = AnABnB

. . .,

Eat =1

N

(∑I

nIEI − EM

); I = A,B, . . .

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 30 / 51

Page 56: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Atomisation energies

Decomposing energies into components...

Eat =1

N

(∑I

nI (EbI + E x

I + E cI )− (Eb

M + E xM + E c

M)

)= Eb

at + E xat + E c

at ,

Using our exchange energy model...

The design matrix becomes...

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 31 / 51

Page 57: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Atomisation energies

Decomposing energies into components...

Using our exchange energy model...

E xat = ξT 1

N

[∑I

nI Ex [ni ; e]− Ex [nM ; e]

]

The design matrix becomes...

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 31 / 51

Page 58: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Atomisation energies

Decomposing energies into components...

Using our exchange energy model...

The design matrix becomes...

Φ =

1N (∑

I∈s1nI E

x [ni ; e]− Ex [ns1 ; e])T

1N (∑

I∈s2nI E

x [ni ; e]− Ex [ns2 ; e])T

...1N (∑

I∈sNnI E

x [ni ; e]− Ex [nsN; e])T

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 31 / 51

Page 59: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Atomisation energies

What is my data vector t?

No access to exchange energy directly

But Ebat and E c

at do not depend on our model...

t =

E exp

at (s1)− Ebat [n1]− E c

at [n1]E exp

at (s2)− Ebat [n2]− E c

at [n2]...

E expat (sN)− Eb

at [nN ]− E cat [nN ]

We have all we need for the regression

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 32 / 51

Page 60: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Atomisation energies

What is my data vector t?

No access to exchange energy directly

But Ebat and E c

at do not depend on our model...

t =

E exp

at (s1)− Ebat [n1]− E c

at [n1]E exp

at (s2)− Ebat [n2]− E c

at [n2]...

E expat (sN)− Eb

at [nN ]− E cat [nN ]

We have all we need for the regression

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 32 / 51

Page 61: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Atomisation energies

What is my data vector t?

No access to exchange energy directly

But Ebat and E c

at do not depend on our model...

t =

E exp

at (s1)− Ebat [n1]− E c

at [n1]E exp

at (s2)− Ebat [n2]− E c

at [n2]...

E expat (sN)− Eb

at [nN ]− E cat [nN ]

We have all we need for the regression

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 32 / 51

Page 62: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Indirect measurements

What if we want to add other data?

Linear on the energy?

Not linear?

Example: equilibrium volume (V0), bulk modulus and pressurederivative (B0, B1) → E (V ) through equation of state

From experimental V0, B0, B1 we can also obtain cohesive energies ofthe strained material

1A. B. Alchagirov et al. (2001)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 33 / 51

Page 63: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Indirect measurements

What if we want to add other data?

Linear on the energy?

Not linear?

Example: equilibrium volume (V0), bulk modulus and pressurederivative (B0, B1) → E (V ) through equation of state

From experimental V0, B0, B1 we can also obtain cohesive energies ofthe strained material

1A. B. Alchagirov et al. (2001)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 33 / 51

Page 64: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Indirect measurements

What if we want to add other data?

Linear on the energy?

We can use it directly within our model

Not linear?

Example: equilibrium volume (V0), bulk modulus and pressurederivative (B0, B1) → E (V ) through equation of state

From experimental V0, B0, B1 we can also obtain cohesive energies ofthe strained material

1A. B. Alchagirov et al. (2001)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 33 / 51

Page 65: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Indirect measurements

What if we want to add other data?

Linear on the energy?

Not linear?

Example: equilibrium volume (V0), bulk modulus and pressurederivative (B0, B1) → E (V ) through equation of state

From experimental V0, B0, B1 we can also obtain cohesive energies ofthe strained material

1A. B. Alchagirov et al. (2001)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 33 / 51

Page 66: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Indirect measurements

What if we want to add other data?

Linear on the energy?

Not linear?

Transform into impact on energy if possibleNon-analytically tractable posterior otherwise

Example: equilibrium volume (V0), bulk modulus and pressurederivative (B0, B1) → E (V ) through equation of state

From experimental V0, B0, B1 we can also obtain cohesive energies ofthe strained material

1A. B. Alchagirov et al. (2001)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 33 / 51

Page 67: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Indirect measurements

What if we want to add other data?

Linear on the energy?

Not linear?

Example: equilibrium volume (V0), bulk modulus and pressurederivative (B0, B1) → E (V ) through equation of state

From experimental V0, B0, B1 we can also obtain cohesive energies ofthe strained material

1A. B. Alchagirov et al. (2001)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 33 / 51

Page 68: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Indirect measurements

Example: equilibrium volume (V0), bulk modulus and pressurederivative (B0, B1) → E (V ) through equation of state

E (V ) = a + bV

1/30

V 1/3+ c

V2/30

V 2/3+ d

V0

V= γTφ(V )

From experimental V0, B0, B1 we can also obtain cohesive energies ofthe strained material

1A. B. Alchagirov et al. (2001)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 33 / 51

Page 69: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Indirect measurements

Example: equilibrium volume (V0), bulk modulus and pressurederivative (B0, B1) → E (V ) through equation of state

E (V ) = a + bV

1/30

V 1/3+ c

V2/30

V 2/3+ d

V0

V= γTφ(V )

where 1 1 1 13 2 1 0

18 10 4 0108 50 16 0

γ =

−E0

09V0B0

27V0B0B1

From experimental V0, B0, B1 we can also obtain cohesive energies ofthe strained material

1A. B. Alchagirov et al. (2001)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 33 / 51

Page 70: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Indirect measurements

Example: equilibrium volume (V0), bulk modulus and pressurederivative (B0, B1) → E (V ) through equation of state

E (V ) = a + bV

1/30

V 1/3+ c

V2/30

V 2/3+ d

V0

V= γTφ(V )

From experimental V0, B0, B1 we can also obtain cohesive energies ofthe strained material

1A. B. Alchagirov et al. (2001)Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 33 / 51

Page 71: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

1 Introduction

2 Bayesian Linear Regression

3 Exchange Model TrainingData setupNumerical results

4 Exchange Model TestingAtomisation EnergiesBulk Properties

5 Summary

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 34 / 51

Page 72: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Data sets

Elementary solids

20 cubic solids: 13 training + 7 testingExtended using bulk properties (4 strains each)

Molecules

G2/97 data set (small molecules): 120 training + 28 testingLarger molecules from G3/99 only for testing

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 35 / 51

Page 73: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Data sets

Elementary solids

20 cubic solids: 13 training + 7 testingExtended using bulk properties (4 strains each)

Molecules

G2/97 data set (small molecules): 120 training + 28 testingLarger molecules from G3/99 only for testing

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 35 / 51

Page 74: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Data sets

Elementary solids

20 cubic solids: 13 training + 7 testingExtended using bulk properties (4 strains each)

Molecules

G2/97 data set (small molecules): 120 training + 28 testingLarger molecules from G3/99 only for testing

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 35 / 51

Page 75: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Model

Linear model with 10× 10 terms

F x (s, α) =9∑

i=0

9∑j=0

ξxijPi (ts(s))Pj (tα(α))

DFT simulations run

Using PBE functionalCut-off energy of 800 eVMonkhorst-Pack mesh (16× 16× 16)Relaxing with a maximum force criterion of 0.05 eV/A

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 36 / 51

Page 76: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Model

Linear model with 10× 10 terms

DFT simulations run

Using PBE functionalCut-off energy of 800 eVMonkhorst-Pack mesh (16× 16× 16)Relaxing with a maximum force criterion of 0.05 eV/A

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 36 / 51

Page 77: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Results

RVM kept 14 terms of the expansion

2 0 2 4 6 8 10Order in α

2

0

2

4

6

8

10

Ord

er

in s

0.00

0.15

0.30

0.45

0.60

0.75

0.90

1.05

1.20

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 37 / 51

Page 78: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Results

Enhancement factor with 1 and 2 σ intervals

0 1 2 3 4 5

s∝ |∇ |/n4/3

1.0

1.2

1.4

1.6

1.8

Fx(s,α

=1)

Lieb-Oxford bound

This workmBEEFMS0/PBEsolPBETPSSMVS

0 1 2 3 4 5

α=(τ−τW )/τUEG

0.80

0.85

0.90

0.95

1.00

1.05

1.10

1.15

1.20

Fx(s

=0,α)

This workmBEEFMS0TPSSMVS

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 38 / 51

Page 79: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

1 Introduction

2 Bayesian Linear Regression

3 Exchange Model TrainingData setupNumerical results

4 Exchange Model TestingAtomisation EnergiesBulk Properties

5 Summary

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 39 / 51

Page 80: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

1 Introduction

2 Bayesian Linear Regression

3 Exchange Model TrainingData setupNumerical results

4 Exchange Model TestingAtomisation EnergiesBulk Properties

5 Summary

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 40 / 51

Page 81: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Atomisation energies

Prediction of atomisation energies in the 7 test solids

K Ca V Cu C Al Fe-FM0

1

2

3

4

5

6

7

8

9C

ohesi

ve E

nerg

y [

eV

]

Error in predictions for solids and molecules

XC functional Error G2/97-test G2/97 EL20-test EL20

This workMAE 0.116 0.103 0.243 0.0975MARE 3.27 1.46 8.56 5.62

PBEMAE 0.703 0.238MARE 5.09 6.88

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 41 / 51

Page 82: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Atomisation energies

Prediction of atomisation energies in the 7 test solids

Error in predictions for solids and molecules

XC functional Error G2/97-test G2/97 EL20-test EL20

This workMAE 0.116 0.103 0.243 0.0975MARE 3.27 1.46 8.56 5.62

PBEMAE 0.703 0.238MARE 5.09 6.88

Table: Mean absolute error (in eV) and mean absolute relative error (in %)of the predictions of atomisation energies using the average model for thetraining sets containing molecules (G2/97) and solids (EL20).

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 41 / 51

Page 83: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Atomisation energies

Prediction of atomisation energies in the 7 test solids

Error in predictions for solids and molecules

XC functional Error G2/97-test G2/97 EL20-test EL20

This workMAE 0.116 0.103 0.243 0.0975MARE 3.27 1.46 8.56 5.62

PBEMAE 0.703 0.238MARE 5.09 6.88

G2/97 MAE better than TPSS (0.28 eV), BEEF-vdW (0.16 eV),B3LYP (0.14 eV) or PBE0 (0.21 eV)

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 41 / 51

Page 84: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Correlation functional

We assumed a fixed correlation energy functional

What’s the impact of our choice?

Errors:

C functional Error G2/97-test G2/97 EL20-test EL20

PBEMAE 0.116 0.103 0.243 0.0975MARE 3.27 1.46 8.56 5.62

PBEsolMAE 0.116 0.108 0.204 0.172MARE 2.91 1.55 6.12 4.98

vPBEMAE 0.110 0.107 0.226 0.184MARE 2.72 1.41 6.45 5.17

TPSSMAE 0.108 0.104 0.227 0.190MARE 2.68 1.42 6.85 5.53

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 42 / 51

Page 85: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Correlation functional

We assumed a fixed correlation energy functional

What’s the impact of our choice?

Errors:

C functional Error G2/97-test G2/97 EL20-test EL20

PBEMAE 0.116 0.103 0.243 0.0975MARE 3.27 1.46 8.56 5.62

PBEsolMAE 0.116 0.108 0.204 0.172MARE 2.91 1.55 6.12 4.98

vPBEMAE 0.110 0.107 0.226 0.184MARE 2.72 1.41 6.45 5.17

TPSSMAE 0.108 0.104 0.227 0.190MARE 2.68 1.42 6.85 5.53

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 42 / 51

Page 86: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Correlation functional

We assumed a fixed correlation energy functionalWhat’s the impact of our choice?Coefficients with PBEsol (left) and vPBE (right) correlations:

2 0 2 4 6 8 10Order in α

2

0

2

4

6

8

10

Ord

er

in s

0.00

0.15

0.30

0.45

0.60

0.75

0.90

1.05

1.20

1.35

2 0 2 4 6 8 10Order in α

2

0

2

4

6

8

10

Ord

er

in s

0.00

0.15

0.30

0.45

0.60

0.75

0.90

1.05

1.20

1.35

Errors:

C functional Error G2/97-test G2/97 EL20-test EL20

PBEMAE 0.116 0.103 0.243 0.0975MARE 3.27 1.46 8.56 5.62

PBEsolMAE 0.116 0.108 0.204 0.172MARE 2.91 1.55 6.12 4.98

vPBEMAE 0.110 0.107 0.226 0.184MARE 2.72 1.41 6.45 5.17

TPSSMAE 0.108 0.104 0.227 0.190MARE 2.68 1.42 6.85 5.53

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 42 / 51

Page 87: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Correlation functional

We assumed a fixed correlation energy functional

What’s the impact of our choice?

Errors:

C functional Error G2/97-test G2/97 EL20-test EL20

PBEMAE 0.116 0.103 0.243 0.0975MARE 3.27 1.46 8.56 5.62

PBEsolMAE 0.116 0.108 0.204 0.172MARE 2.91 1.55 6.12 4.98

vPBEMAE 0.110 0.107 0.226 0.184MARE 2.72 1.41 6.45 5.17

TPSSMAE 0.108 0.104 0.227 0.190MARE 2.68 1.42 6.85 5.53

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 42 / 51

Page 88: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

1 Introduction

2 Bayesian Linear Regression

3 Exchange Model TrainingData setupNumerical results

4 Exchange Model TestingAtomisation EnergiesBulk Properties

5 Summary

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 43 / 51

Page 89: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Test set

SL20 test set including

13 elemental solidsI-VII, II-VI, III-V and IV-IV compounds7 of them in the training set (elemental solids)

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 44 / 51

Page 90: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Uncertainty propagation from DFT

Bulk properties are not obtained directly from DFT simulations

How to propagate the uncertainty?

We use a nested Monte Carlo approach

Sample model coefficients from the posterior distributionFit the EOS to the values from this X energy (Bayesian fit)Sample coefficients from the fitting to calculate V0, B0, B1

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 45 / 51

Page 91: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Uncertainty propagation from DFT

Algorithm 2 Calculation of uncertainty for V0 and B0.

1: Input: system s with unit cell (x1, x2, x3).2: Input: Nmax

1 , Nmax2 , the maximum iterations.

3: for 5 strains 0.95 ≤ σi ≤ 1.05 do4: Strain unit cell by σi : xα → σi xα, α = 1, 2, 3.5: Self-consistent simulation of strained system.6: Keep the self-consistent electron density n∗i = n(σi ).7: end for8: N1 = 09: repeat

10: Sample ξN1, βN1

.11: Non self-consistent simulation with ξN1

, βN1and n∗i .

12: N2 = 013: repeat14: Sample γN2

.15: Calculate V0, B0.16: until N2 = Nmax

217: N1 = N1 + 118: until N1 = Nmax

119: Collect statistics on calculated V0, B0.

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 46 / 51

Page 92: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Results

Equilibrium lattice constants for SL20 materials

Li Na Ca Sr Ba Al Cu Rh Pd Ag C Si Ge SiC GaAs LiF LiCl NaF NaCl MgO3.0

3.5

4.0

4.5

5.0

5.5

6.0

6.5

Latt

ice c

onst

ant

[]

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 47 / 51

Page 93: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Results

Equilibrium bulk moduli for SL20 materials

Li Na Ca Sr Ba Al Cu Rh Pd Ag C Si Ge SiC GaAs LiF LiCl NaF NaCl MgO100

0

100

200

300

400

500

Bulk

modulu

s [G

Pa]

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 47 / 51

Page 94: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Results

What if the DFT results have another error sources?

For example, assume a numerical error with Gaussian distribution andstandard deviation 10 mV

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 48 / 51

Page 95: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Results

What if the DFT results have another error sources?

For example, assume a numerical error with Gaussian distribution andstandard deviation 10 mV

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 48 / 51

Page 96: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Results

Equilibrium lattice constants for SL20 materials

Li Na Ca Sr Ba Al Cu Rh Pd Ag C Si Ge SiC GaAs LiF LiCl NaF NaCl MgO3.0

3.5

4.0

4.5

5.0

5.5

6.0

6.5

Latt

ice c

onst

ant

[]

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 48 / 51

Page 97: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Results

Equilibrium bulk moduli for SL20 materials

Li Na Ca Sr Ba Al Cu Rh Pd Ag C Si Ge SiC GaAs LiF LiCl NaF NaCl MgO100

0

100

200

300

400

500

600

Bulk

modulu

s [G

Pa]

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 48 / 51

Page 98: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

1 Introduction

2 Bayesian Linear Regression

3 Exchange Model TrainingData setupNumerical results

4 Exchange Model TestingAtomisation EnergiesBulk Properties

5 Summary

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 49 / 51

Page 99: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Summary

Bayesian framework to obtain an exchange energy functional

Use of a linear modelCoefficients of the model are random variablesBasis functions are fixed

Use of a relevance vector machine to find hyperparameters

Obtained exchange energy from a simulation has an uncertainty

This uncertainty can be propagated to other derived quantities

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 50 / 51

Page 100: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Summary

Bayesian framework to obtain an exchange energy functional

Use of a relevance vector machine to find hyperparameters

Automatic selection of relevant basis functions (model selection)

Obtained exchange energy from a simulation has an uncertainty

This uncertainty can be propagated to other derived quantities

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 50 / 51

Page 101: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Summary

Bayesian framework to obtain an exchange energy functional

Use of a relevance vector machine to find hyperparameters

Obtained exchange energy from a simulation has an uncertainty

Limited data in the training (can be reduced to zero asymptoticallywith more data)Limited model space, meta-GGA (cannot be reduced to zeroasymptotically with more expansion terms)

This uncertainty can be propagated to other derived quantities

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 50 / 51

Page 102: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Summary

Bayesian framework to obtain an exchange energy functional

Use of a relevance vector machine to find hyperparameters

Obtained exchange energy from a simulation has an uncertainty

This uncertainty can be propagated to other derived quantities

Bulk properties (shown)Band diagrams, phonon properties, transport coefficients, enrgybarriers, etc.Further models based on DFT results (e.g., cluster expansion for alloymodelling)

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 50 / 51

Page 103: Exchange-Correlation Functional with Uncertainty Quanti cation ... · Exchange-Correlation Functional with Uncertainty Quanti cation Capabilities for Density Functional Theory Manuel

Acknowledgments

Thank you for your attention!

Acknowledgments

EPSRC Strategic Package Project EP/L027682/1 for research at WCPM

Manuel Aldegunde (WCPM) WCPM Seminar Series October 27, 2015 51 / 51