Symons

Panel ChairKathleen Symons, Associate Director, CxP PP&C, NASA JSC

Panel MembersTom Coonce, Director, Cost Analysis Division, NASA HQJames Ortiz, Director, Independent Program Assessment Office (IPAO), NASA HQMark Saunders, Consultant, Dell Services (Retired NASA)

PM Challenge 2011 Panel: Getting Successfully Through Implementation KDP C

PM Challenge 2011: Informational Briefing Pre-Decisional 1

Panel Overview: Getting Successfully through Implementation KDP C

• KDP C is the “moment of truth” when the Agency decides whether a project will move forward to implementation, and makes cost and schedule commitments to its external stakeholders

• This panel will address updated Agency processes incorporated in NPR 7120.5E that are designed to more effectively ensure that a project is on track to accomplish its technical mission within its cost and schedule estimate at KDP C, and will discuss how these processes work together to help the Project Manager– Project development of the Integrated Technical, Cost, Schedule and Risk

Baseline for KDP C– Definition of Expected Maturity States to guide development and assessment

of the integrated baseline– Utilization of the JCL at KDP C to provide evidence of an executable,

integrated baseline– Independent SRB Checks and Balances– Utilization of the Decision Memorandum to document the approved

integrated baseline, formalize management approval and agreement to support the project, and establish external commitments

2PM Challenge 2011: Informational Briefing Pre-Decisional

Getting Successfully through KDP C

KDP B KDP CApproval for

Implementation

PDR

≤30 days

An integration of Project Baseline Development, Independent Checks and Balances, Approval to Proceed, and

Commitments

Prog

ram

mati

c Re

view

s Ap

prov

al &

Com

mitm

ent


Development of the Integrated Technical, Cost, Schedule and Risk Baseline for KDP C


Implementation

PDR

≤30 days

KDP B•System design•Risks and constraints

• Estimated cost (range)• Estimated schedule

(range)• Phased funding

requirements

Project Develops Integrated Baseline

KDP C•Preliminary design•Updated risks and constraints•Estimated cost and schedule•Phased funding requirements•Unallocated Future Expenses

Review Element Categories• Budget & Schedule• Resources other than Budget• Risk Management

• Agency Strategic Goals , Outcomes• Management Approach• Technical Approach PD

R Ex

pect

ed

Mat

urity

SDR

Expe

cted

M

atur

ity

Proj

ect P

rodu

cts

Prog

ram

mati

c Re

view

s Ap

prov

al &

Com

mitm

ent

Expe

cted

Mat

urity

Sta

te


JCL Provides Evidence of Executable, Integrated Baseline


Implementation

PDR

≤30 days

Review Element CategoriesPD

R Ex

pect

ed

Mat

urity

SDR

Expe

cted

M

atur

ity

Prog

ram

mati

c Re

view

s A

ppro

val &

Com

mitm

ent

Expe

cted

Mat

urity

Sta

te

• Budget & Schedule• Resources other than Budget• Risk Management

• Agency Strategic Goals , Outcomes• Management Approach• Technical Approach


KDP C•Preliminary design•Updated risks and constraints•Estimated cost and schedule•Phased funding requirements•Unallocated future expenses

JCL

Proj

ect P

rodu

cts




requirements


SRB Assesses Integrated Baseline and JCL


Implementation

PDR

≤30 days30-90 days

Readiness Assessment



JCL

Inde

pend

ent

Chec

ks &

Bal

ance

s


R Ex

pect

ed

Mat

urity

SDR

Expe

cted

M

atur

ity

Proj

ect P

rodu

cts

Prog

ram

mati

c Re

view

s A

ppro

val &

Com

mitm

ent

Expe

cted

Mat

urity

Sta

te



SRB Analyses, Assessments and Reports




requirements


Agency Commits to Project’s Integrated Baseline



JCLProject

Response

KDP B

KDP CPDR

≤30 days30-90 days

Readiness AssessmentABC

External Stakeholders

SRB Analyses, Assessments and Reports


R Ex

pect

ed

Mat

urity

SDR

Expe

cted

M

atur

ity

Inde

pend

ent

Chec

ks &

Bal

ance

s

Decision Memorandum

Management Agreement

Agency Baseline

Commitment (ABC)

Proj

ect P

rodu

cts

Prog

ram

mati

c Re

view

s A

ppro

val &

Com

mitm

ent

Expe

cted

Mat

urity

Sta

te






requirements


Backup


One Step PDR Life Cycle Review (NPR 7120.5E)

KDP-C KDP-C

PDR Readiness Assessment PDR-LCR

Technical Baseline with C/S/R and Integrated Assessment of Technical and Programmatic

Baseline

KDP-B KDP-B

Periodic SRB Involvement as Appropriate

P/pBrief

CenterBrief

MDBrief

Not To Scale

(30 Days)

Snapshot Report

(30- 90 days)

-Required prior to LCR-Report to DA for life cycle reviews preceding KDP B&C and during any major replan or rebaseline (3)

Programmatic Data Drops to SRB (includes JCL Model)

(2)

FOOTNOTES:1. A One Step Review may be used for any LCR2. The SRB Handbook provides information on the readiness

assessment, quick-look reports and checkpoints associated with life cycle reviews

3. For all other life cycle reviews report to DA if significant unresolvable disagreements

(2)

CheckPoint if needed.(2)


Two Step PDR Life Cycle Review (NPR 7120.5E)

Resolve Tech Issues/Risks, Update

Cost/Schedule Baseline

Independent Integrated PDR Assessment

PDR Readiness Assessment PDR

-Required prior to LCR-Report to DA for life cycle reviews preceding KDP B&C and during any major replan or rebaseline (3)

Technical Baseline with Cost,

Schedule, and Risk Information

Integrated Assessment of Technical and Programmatic

Baseline

KDP-B KDP-B

Periodic SRB Involvement as Appropriate

P/pBrief

CenterBrief

MDBrief

Not To Scale

(1-6 months) (30 Days)

Snapshot Report

(30-90 days)

PDR LCRKDP-C KDP-C

Snapshot Report

Programmatic Data Drops to SRB (includes JCL Model)

(2)

(2)(2)

FOOTNOTES:1. A Two Step Review may be used for any LCR2. The SRB Handbook provides information on the readiness

assessment, quick-look reports and checkpoints associated with life cycle reviews

3. For all other life cycle reviews report to DA if significant unresolvable disagreements

CheckPoint if needed.(2)


Expected Maturity State through the Project Life Cycle Leading to KDP B (NPR 7120.5E)


Expected Maturity StateExploded View (NPR 7120.5E)


Expected Maturity State through the Project Life Cycle Leading to KDP C (NPR 7120.5E)

KDP ReviewAssociated

Lifecycle Review

LCR Objectives

Expected Maturity State by Review ElementOveralll Expected Maturity State @

Next KDPAgency Strategic

Goals & Outcomes

Management Approach

Technical Approach

Budget and Schedule

Resources Other than Budget

Risk Management

KDP A MCR SRR

KDP B MDR SDR

KDP C PDR

To evaluate the completeness/consistency of the planning, technical & cost/schedule baselines developed during formulation; to assess compliance of the preliminary design with applicable requirements; to determine if the project is sufficiently mature to begin Phase C.

Project requirements and preliminary designs satisfy program requirements and constraints, mission needs and mission success criteria.

Project Plan is complete; external agreements and infrastructure business case are in place; and execution plans for the remaining phases are appropriate.

The preliminary design satisfactorily meets requirements and constraints with acceptable risk.

The integrated cost/schedule baseline has a sound basis and is consistent with driving assumptions; reflects risks; is fully supported by a documented BOE; fits within the available funding and schedule profile; and cost/schedule management tools/processes are in place.

Adequate agreements exist for staffing, essential infrastructure and additional resources, as appropriate, for remaining lifecycle phases.

Mission, development and safety risks are addressed in designs and operating concepts, a process and resources exist to effectively manage or mitigate them.

Overall KDP C Expected Maturity:

Preliminary design and

programmatic plans enable

Agency Baseline Commitment.


Project – Simplified Cost Agreements at KDP C (NPR 7120.5E)

Agency Baseline Commitment• External Commitments

This UFE is managed above the Project.

Management Agreement • Managed by Project Manager

UFE

Not to scale.

At KDP C and subsequent ABC rebaselines the ABC and the life cycle cost estimate are equal.


Project Life Cycle Cost Agreements and Commitments (NPR 7120.5E)

Management Agreements

LCC RangeUFE managed

above the project

Notional and Not to Scale

During ImplementationDuring Formulation KDP C

UFEActual Formulation

Costs

UFE managed by Project

Authorized Formulation

Cost

Life cycle cost estimate

At KDP C and subsequent Agency Baseline Commitment rebaselines the ABC and the life cycle cost estimate are equal

High Estimate

Low Estimate


Figure 2-3a The NASA Program Life Cycle (Uncoupled and Loosely Coupled) (NPR 7120.5E)

ACRONYMSASP—Acquisition Strategy Planning meetingASM—Acquisition Strategy MeetingFAD—Formulation Authorization DocumentKDP—Key Decision PointPCA—Program Commitment AgreementPIR—Program Implementation Review P/SDR—Program/System Definition ReviewP/SRR—Program/System Requirements ReviewSRB—Standing Review Board

Changes from original shown in red

NASA Life Cycle Phases

Approval for Implementation FORMULATION IMPLEMENTATION

KDP IIProgram Life Cycle Gates

KDP n

SRR

Program Life Cycle Reviews5&6

FAD

KDP 03

PCA1

Program Plan1

SDR

Start Project2

1, 2, 3, … Project m, m+1Project Starts

ProgramUpdates

Updated Program Plan

Updated PCA Start process again4

KDP I KDP III

PIR

PIRs are conducted as required by Decision Authority

FOOTNOTES1. Program Plans are baselined at SDR, and PCAs are baselined at KDP I. These are reviewed and

updated, as required, to ensure program content, cost, and budget remain consistent.

2. Projects, in some instances, may be approved for formulation prior to KDP I. Initial project pre-formulation generally occurs during program Formulation.

3. KDP 0 may be required by the Decision Authority to ensure major issues are understood and resolved prior to formal program approval at KDP I.

4. When programs evolve and/or require upgrades (e.g., new program capabilities), the life-cycle process will be restarted when warranted, i.e., the program’s upgrade will go through formulation and implementation steps.

5. Single-project programs will follow the Project lifecycle, but will include draft/ final PCAs at KDPs B & C respectively and draft/final Program Plans at SRR & SDR respectively.

6. Life Cycle Review (LCR) objectives and expected maturity states for these reviews and the attendant KDPs are contained in Table 2-6a.

ASMASPAgency Reviews

Approval forFormulation


Figure 2-3b The NASA Program Life Cycle (Tightly Coupled) (NPR 7120.5E)



KDP IProgram Life Cycle Gates

KDP IV KDP III

Program Life Cycle Reviews 3&7

FADDraft PCA

Draft Program

Plan Start Project2

1, 2, 3, … Project m, m+1Project Starts

ProgramUpdates

Updated Program Plan

Updated PCA Start process again6

KDP 05 KDP II

ASMASPAgency Reviews

SRR SDR FRR/MRB9 CDR SIR CERR PLARORR PIR4 DR

PCA1

Program Plan1

PDR

Project reviews/KDPs accompany Program reviews/KDPs4

PDR—Preliminary Design ReviewPFAR—Post-Flight Assessment ReviewPIR—Program Implementation Review PLAR—Post-Launch Assessment ReviewP/SDR—Program/System Definition ReviewP/SRR—Program/System Requirements ReviewSAR—System Acceptance ReviewSIR—System Integration ReviewSRB—Standing Review BoardSMSR—Safety and Mission Success Review

Update Program documentation and re-conduct lifecycle reviews with new capabilities6

LRR,SMSROther Reviews

PFAR

SAR8

KDP n


Changes from original shown in red

7. Life Cycle Review (LCR) objectives and expected maturity states for these reviews and the attendant KDPs are contained in Table 2-6b.

8. SAR only applies to Human Space Flight.9. The KDP E decision is made at the FRR for Human Space Flight and the MRB for Robotic Space Flight. The

FRR/MRB are part of a series of events shown in Appendix K leading to approval to launch.

ACRONYMSASP—Acquisition Strategy Planning meetingASM—Acquisition Strategy MeetingCDR—Critical Design ReviewCERR—Critical Events Readiness ReviewDR—Decommissioning ReviewFAD—Formulation Authorization DocumentFRR—Flight Readiness ReviewKDP—Key Decision PointLRR—Launch Readiness ReviewORR—Operational Readiness ReviewPCA—Program Commitment Agreement

FOOTNOTES1. Program Plans are baselined at SDR, and PCAs are baselined at KDP I. These are reviewed and

updated, as required, to ensure program content, cost, and budget remain consistent.

2. Projects are usually approved for formulation prior to KDP I.

3. Single-project programs will follow the Project lifecycle, but will include draft/ final PCAs at KDPs B & C respectively and draft/final Program Plans at SRR & SDR respectively.

4. Tightly-coupled program reviews generally differ from other program types because they are conducted to ensure the overall integration of all program elements (i.e., projects). Once in operations, PIRs are conducted as required by the Decision Authority.

5. KDP 0 may be required by the Decision Authority to ensure major issues are understood and resolved prior to formal program approval at KDP I.

6. When programs evolve and/or require upgrades (e.g., new program capabilities), the life-cycle process will be restarted when warranted, i.e., the program’s upgrade will go through formulation and implementation steps.


Figure 2-4 Project Life Cycle (NPR 7120.5E)

Project Pre - Phase A: Phase A: Phase B: Phase C:

KDP CProject

-

Phase E:

KDP A

Phase D:

KDP B

Phase F:

KDP F

SMSR, LRR (LV), FRR (LV)

KDP E

Peer Reviews, Sub - system PDRs, Sub - system CDRs, and System Reviews

DRPLARMDR 4

Robotic Mission Project Reviews 1

MCR SRR PDR CERR 3SIR FRRLaunch Readiness Reviews

SDR CDR / PRR 2

PDRMCR FRRSRR SIR CERR 3PLARSAR

Re - flights

DR(NAR )(PNAR )

Supporting Reviews

ORRInspections and Refurbishment

Re-enters appropriate life cycle phase if modifications are needed between flights

End of Flight

PFAR

ASP

ORR

ASM

ASM (NAR )(PNAR )

CDR / PRR 2


ProjectLife Cycle Phases

Pre-Phase A:Concept Studies

Phase A:Concept & Technology

Development

Phase B:Preliminary Design &

Technology Completion

Phase C:Final Design & Fabrication


KDP CProject Life Cycle Gates & Major Events

Phase E:Operations & Sustainment

KDP A

Launch

KDP D

Phase D:System Assembly, Int & Test, Launch & Checkout

KDP B

Phase F:Closeout

End of MissionFinal Archival

of Data

KDP F

SMSR, LRR (LV), FRR (LV)

KDP E7

Peer Reviews, Sub - system PDRs, Sub - system CDRs, and System Reviews

DRPLARMDR 4MCR SRR PDR CERR 3SIR MRB7

FADDraft Project Requirements

Other Reviews

SDR CDR / PRR 2

PDRMCR FRR7SRR SIR CERR 3PLAR

SAR8

-Re flights

DR

Supporting Reviews

ORRInspections and Refurbishment

Re-enters appropriate life cycle phase if modifications are needed between flights

End of Flight

PFAR

Preliminary Project Plan

Baseline Project

Plan

ASP

ORR

ASM

CDR / PRR 2

Agency Reviews

Human Space Flight Project Life Cycle Reviews 1,5&6

Robotic Mission Project Life Cycle Reviews 1,5&6

FOOTNOTES1. Flexibility is allowed to the timing, number and content of reviews as long as the equivalent information

is provided at each KDP and the approach is fully documented in the Project Plan.2. PRR needed for multiple system copies. Timing is notional.3. CERRs are established at the discretion of Program Offices.4. For robotic missions the SRR and the MDR may be combined.5. Single-project programs will follow the Project lifecycle, but will include draft/ final PCAs at KDPs B & C

respectively and draft/final Program Plans at SRR & SDR respectively.6. Life Cycle Review (LCR) objectives and expected maturity states for these reviews and the attendant

KDPs are contained in Table 2-7.7. The KDP E decision is made at the FRR for Human Space Flight and the MRB for Robotic Space Flight.

The FRR/MRB are part of a series of events shown in Appendix K leading to approval to launch.8. SAR only applies to Human Space Flight.


DRR

DRR

ACRONYMSASP - Acquisition Strategy Planning MeetingASM - Acquisition Strategy MeetingCDR - Critical Design ReviewCERR - Critical Events Readiness ReviewDR - Decommissioning ReviewDRR - Disposal Readiness ReviewFAD - Formulation Authorization DocumentFRR - Flight Readiness ReviewKDP - Key Decision PointLRR - Launch Readiness ReviewMCR - Mission Concept ReviewMDR - Mission Definition ReviewMRB - Mission Readiness Briefing

ORR - Operational Readiness ReviewPDR - Preliminary Design ReviewPFAR - Post-Flight Assessment ReviewPLAR - Post-Launch Assessment ReviewPRR - Production Readiness ReviewSAR - System Acceptance ReviewSDR - System Definition ReviewSIR - System Integration ReviewSMSR - Safety and Mission Success ReviewSRR - System Requirements Review
