24
Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation Expansion Models Using Approximate Dynamic Programming Bryan Palmintier FERC: Technical Conference on Planning Models June 10th, 2010 Collaborators: Mort Webster, Ignacio Perez-Arriaga Pearl Donohoo, Nidhi Santen, Rhonda Jordan

Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Working Toward…Incorporating High Dimensional Uncertainty and Operational ConstraintsInto Long-Term Generation ExpansionModels Using Approximate Dynamic ProgrammingBryan PalmintierFERC: Technical Conference on Planning ModelsJune 10th, 2010

Collaborators:Mort Webster, Ignacio Perez-ArriagaPearl Donohoo, Nidhi Santen, Rhonda Jordan

Page 2: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Outline

What problem are we solving? Planning vs/+ Operations Stochastic Dynamic Problems (Approximate) DP Current Research in MIT-ESD

Caveat: More concepts than results (stay tuned…)

2Palmintier FERC Planning 2010-06-10

Page 3: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Capacity Planning is aHard Stochastic Dynamic Problem Stochastic Growth, Prices, Outages, Hydro Renewables, Demand Response, Policy,

Technology

Dynamic New information over time Sequential decision making (recourse)

Hard…

3Palmintier FERC Planning 2010-06-10

Page 4: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Electric Power Model Types

Palmintier FERC Planning 2010-06-10 4

Page 5: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

The short blanket problem

Need to approximate

5Palmintier FERC Planning 2010-06-10

InvestmentDecisions

OperationalDetails

Page 6: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Operations vs Planning

6Palmintier FERC Planning 2010-06-10

Page 7: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Operations vs Planning

7Palmintier FERC Planning 2010-06-10

Advanced Power Systems will require more detailed ops during planning Ramping, Startup, Min Storage: Sequential Correlations: Renewables & Load Dynamic Pricing etc

Page 8: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Stochastic Dynamic Modeling

Scenario Analysis (SA) Exogenous uncertainty

Stochastic Programming (SP) Fixed Scenario trees

(Stochastic) Dynamic Program. (DP) Backward Induction via Bellman’s

Approximate DP (ADP) Machine learning

8Palmintier FERC Planning 2010-06-10

Page 9: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Operations + Planning

9Palmintier FERC Planning 2010-06-10

Page 10: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Why Dynamic Programming Endogenous Uncertainty (vs SA) Get rid of crystal ball Actionable decision(s) Value for flexibility

Decision dependant uncertainty (vs SP) Generation depends on Transmission Efficiency investment Fuel costs (Economic equilibrium) Learning by doing Climate Change

10Palmintier FERC Planning 2010-06-10

Page 11: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

DP Challenges

Curse(s) of Dimensionality

Backward Induction assumes Markov Expensive sub-problem (Operations)

11Palmintier FERC Planning 2010-06-10

Page 12: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Heuristics within traditional DP

Still big/hard/slow

12Palmintier FERC Planning 2010-06-10

4E+30

Approximate Problem SizeSimple ERCOT Model

Page 13: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Introducing ADP

13Palmintier FERC Planning 2010-06-10

Simulation+AI+Optimization Forward Sampling Learning Ignore Dead Ends

Page 14: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

ADP: Approximating Values

Recursive Regression

Update nearby Scenarios

collapse to single value

Size: 700 -> 11

14Palmintier FERC Planning 2010-06-10

Value Function

Page 15: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Advantages of ADP

Complex, n-Dimensional Uncertainty Monte Carlo: fast (initial) convergence

Path Dependency (vs DP) Multi-objective for free Find environmental, political near-best

from the value space

Performance vs Dynamic Programming! vs Stochastic Programming??

15Palmintier FERC Planning 2010-06-10

Page 16: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

ADP challenges

Always an Approximation Heuristics require tuning Transparency?

16Palmintier FERC Planning 2010-06-10

Page 17: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

The operations sub-problem Do we need to run… All 8760? (x10?) Every scenario?

Sample of relevant periods Typical weeks? Joint Distribution of load & uncertainty

Iterative refinement (ADP learning) Start with improved LDC estimate Refine with sampled week of production cost Increase detail (SCUC) on later passes

17Palmintier FERC Planning 2010-06-10

Page 18: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

CURRENT RESEARCH

Mort Webster’s LabMIT’s Engineering Systems Division

18Palmintier FERC Planning 2010-06-10

Page 19: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Palmintier FERC Planning 2010-06-10

(My) Current Research:Unit Commitment in Planning

19

Designing Advanced Power Systems: Renewables, Active Demand, Storage

� Approx. Dynamic Program

� Sampling & Reuse of:⇐ Simple Heuristic

⇐ 7-day (Stochastic?) UC

⇐ With UC

Page 20: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Current Research: Technology Change

20

Integrating Policy-Induced Technology Change Dynamics into U.S. Electricity Generation Capacity PlanningNidhi R. SantenMain Objectives:1.Develop an integrated modeling approach for evaluating the effect of uncertain R&D-induced electricity technology improvements on optimal policy planning.2.Evaluate the trade-offs between “development-focused” and “adoption-focused” climate and technology policies, considering uncertainty in R&D returns.

Approach:1.Empirically characterize uncertainty in R&D returns for several supply- and demand-side electricity technologies using patent citation data. 2.Couple an induced technology change model with a national-scale capacity planning model using patent citations to calibrate novel relationships between R&D returns and generation technology costs, technology availability years, and demand growth.3.Use ADP to model sequential policy decisions under uncertain R&D returns, and study optimal near-term policies and associated electricity generation capacity evolutions.

Source: http://www.nmfs.noaa.govSource: http://www.usmc.mil

Palmintier FERC Planning 2010-06-10

Page 21: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Current Research: Transmission Planning

Heuristics for Dynamic, Long-term Transmission PlanningPearl DonohooState of the art planning is static or dynamic optimization of simplified systems without foresight and limited treatment of uncertainty beyond reliability analysisDimensionality precludes Transmission infrastructure is long lived, requiring robustness to variety of future generation and market configurationsRelationship between transmission development and generation development is persevered, despite restructuring which decouples the investment

21Palmintier FERC Planning 2010-06-10

Page 22: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Current Research: Electrification in Africa

Incorporating Demand Dynamics into Long-term Electrification Planning: the Case of TanzaniaRhonda JordanNational Goals in Tanzania:

Meet Existing & Future Electricity Demand Increase Access Improve/Maintain Quality of Service

Extreme poverty High sensitivity to price & service quality Demand MUST be endogenous

How should the Ministry meet targets? What production? New capacity? New grid & off-grid

connections? What subsidy should be offered?

22Palmintier FERC Planning 2010-06-10

Page 23: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Conclusions Approximation inherent in all methods Trade some ops detail for improved

stochastic planning models ADP shows promise Capture rich problem detail AI + Simulation + Optimization A custom trimmed loosely

woven blanket?

Looking for “real-world” partners

23Palmintier FERC Planning 2010-06-10

Page 24: Working Toward… Incorporating High Dimensional · 2010-06-11 · Working Toward… Incorporating High Dimensional Uncertainty and Operational Constraints Into Long-Term Generation

Questions?

Research Funded by:MIT (Mort Webster lab) & MIT-Portugal ProgramSpecial Thanks to:Mort Webster, Nidhi Santen, Pearl Donohoo, Rhonda JordanIgnacio Pérez-Arriaga, Richard de Neufville, Jim KirtleyElectricity Student Research GroupMichele & Shannon

24Palmintier FERC Planning 2010-06-10