77
1 06/20/22 03:57 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

Embed Size (px)

Citation preview

Page 1: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

1

04/19/23 12:15 PM

CxPO SE&IPeople, Products &

Processes (3Ps)Overview

SE&I Team LeadershipApril 13, 2006

Page 2: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

2

WWW.NASAWATCH.COM

SE&I Key Tenants & Challenges

1. Team organization is critical – One Team with strong SE Management

2. Standards development and disciplined compliance is a necessary asset

3. The organizing principle for complex systems is a layered architecture that aligns functions, requirements, and mission integration

4. Successful complex development requires the right overarching system engineering management – much more than design to specification

5. Complex systems engineering is significantly more challenging to execute and manage than conventional systems engineering

NASA Will Serve as Lead System Integrator (LSI)Complex Human Spaceflight system engineering & integration endeavor of

this scale and importance has not tackled within the Agency since early 60’s

Page 3: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

3

WWW.NASAWATCH.COM

CxPO SE&I 3P Overview

Agenda• People

– Organizational Overview– Current Leadership Profile

• Systems Integration Groups (SIGs)

– Agency-wide Staffing Situation• Products

– Near-Term Requirements-Focused Product Line• CxP-allocated NGOs, Level I-allocated Requirements, CARD, IRDs, IDDs, Invoked Standards,

Operational Concepts, FFBDs, FAMs, N2 Diagrams, Reference Architecture, Trade/Analyses results, SRDs, Requirements Achievability Assessments, Technical Performance Measures, Technical Risk Mitigation Plans, Traceability Reports

– Long-term Program-wide Technical Integration Foundation Products• Cx Program Plan, Policy, Process & Strategy Documents

• Processes– Requirements & Interface Management Processes– RAC, DAC & VAC – Analyses/Trades/Modeling & Sim Processes– Other SE Processes, Tools and Training– Emerging Program Boards, Panels & WGs Structure/Process

• CY06 Challenges & Schedule Ahead• Backup – Recommended May “Requirements Face-to-Face (F2F)” U/R

Page 4: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

4

WWW.NASAWATCH.COM

CxPO SE&I 3P Overview

Agenda• People

– Organizational Overview– Current Leadership Profile

• Systems Integration Groups (SIGs)

– Agency-wide Staffing Situation

Page 5: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

5

WWW.NASAWATCH.COM

Team Organization is Crucial

• System Engineering Management is the integrating factor

– Synchronize the team

– Integrate the team vertically and horizontally

• Coordinating the activities of multiple SE teams through just documentation, reporting, and ICD’s does not work effectively

• One systems engineering team

– Integrate a distributed virtual team using Top Down SE Management authority, integrated tasking, and clear accountability

– Support using common networked tools and processes that ensure communication of information and rapid issue resolution

– Team must deal with all levels of SE issues from the design through capabilities/mission integration (layered architecture)

• Integrate and train the SE Team

– Train to modern process standards – legacy won’t work for modern, complex SE development

• Must use up-to-date M&S/Software/Collabrative architectures and tools

Page 6: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

6

WWW.NASAWATCH.COM

Roselle

Hanson

(acting)

CEV Project

Office

(JSC)

Steve Cook

Launch

Vehicle

Project

Office

(MSFC)

Tip Talone

Ground

Operations

Project Office

(KSC)

(Vacant)

NASA Provided

Systems

Projects Office

(JSC)

Dennis Webb

Mission

Operations

Project Office

(JSC)

Program Planning &

Control

B. Waddell, Dir

C. Stegemoeller , Dep Dir

ZB

Test & Verification

W. Arceneaux , Acting Dir

Charlie Lundquist, Dep

Dir

ZC

Operations Integration

R. Castle, Acting DirS. Gahring , Dep Dir

ZD

Systems Engineering &

Integration

C. Hardcastle , Acting Dir

S. Meacham, Dep Dir

ZF

Safety, Reliability, &

Quality Assurance

L. Hansen, Dir

Jeff Williams Dep Dir

ZG

Advanced

Projects Office

Carlos Noriega

Lander

Project

Offie

“Resource & Process Police ”

Resource management ($)

Schedules (program)

Configuration Mgt

Business Management

IT

Program Communications (PAO)

Export Control

Action tracking

Programmatic risk assessment

“Verifier ”

Integrated verification planFlight test integration

Software test & verification

“User ”

Mission definition

Conops

“Technical Definition ”

Requirements/Interface Defn

System Analysis

Cross element subsystem leads

Effectiveness ( “-ilities ”)

TPMs/Technical Resource Mgt

Tools & Methods

Stephanie Castillo, LeadAdministrative Office

Admin

Travel

Training

Correspondence

Schedules (conference rooms)

Facilities (space)

IT (SRs)

Jeff Hanley

Program Manager

Mark Geyer

Deputy

Program Mgr

Tip Talone

Associate Program Mgr

KSC

Todd May

Associate Program Mgr

MSFC

Deb Neubek

Chief of Staff,

Technical

STAFF

“Incubator ”

Advanced Design through SDR

Launch & Entry Suit

Lander

Surface EVA suit

Surface systems

Future Common Systems

Integration with Tech Projects & RLEP

Flight ops

Risk Assessment

Safety Policy

Reliability

Quality Assurance Policy

CLV, CaLV, EDS Low Impact Docking Systems (LIDS)

Pyrotechnic Initiators

Flight Crew Equipment

Brenda Ward

Assistant Mgr,

Integration

ISS

Shuttle

Other Government Agencies

Mgr of level II function at KSC Mgr of level II function at MSFC

Note: Functional offices in projects are shown coded to

correspond with functional offices in Program

Marsha Ivins

Special Assistant,

Integration

Comm & Nav Project

Office (GSFC)

ARC, DRFC, GRC, LaRC, MSFC

ARC, GRC, LaRC, JSC, KSC, SSFC

Future

Constellation Program Office

Horizontal Integration

Ver

tical

Int

egra

tion

Page 7: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

7

WWW.NASAWATCH.COM

CxP Lvl II Systems Engineering and Integration (SE&I)

Requirements Management

Chief Of Staff - Tech

Program Technical Integration Interface

Management

Analyses, Trades & Architecture

Horizontal IntegrationSE&I Director

Deputy

Updated 4/2/06

Program Review Integration

Modeling & Simulation

Prime Focus: - Cross Element I/F Def. & Contrl - Internal to Program - External to ProgramPrime Products: - IDDs - IRDs - MOUs - Interface Context Diagram - Interface Control Plan (ICP)Forcing Function: - Interface Control Working Grp

Prime Focus: - Lvl I/II & III Requirements - Functional ArchitecturePrime Products: - CARD - Lvl II Standards - Product Tree - Lvl II/III Document Tree - Program Requirements Tree - Functional Analyses: FFBDs, FAMs & N2 Diagms - Reqmts Mgmt Plan (REMP) - Traceability ReportsForcing Function: - Reqmts Working Group

Prime Focus: - Integrated Capability/Functionality Across Subsystems, Projects & MissionsPrime Products: - Highest Quality Requirements - Each Lead Assigned a set of CARD, IRD & Invoked Standards Reqmts - Reqmts Achievability Assessments - Risk Mitigation Plans - TPM Id & profiling - Optimized Integrated Designs - Commonality/Interoperability/”ilities”Forcing Function: - System Integration Groups (SIGs)

Prime Focus: - Integrated Analyses & Physical ArchitecturePrime Products: - Integrated Analyses Plan - ADD & RAD - Lvl II Trades - Prioritize/Integr Trades List/Plan - Level II & III - Performance Assessments - Gap ID & Mitigation - Validated Requirements Set - Risk Analyses - Support to Ops & APOForcing Function: - Analyses WG

Prime Focus: - Documented ProcessesPrime Products: - SEMP - Reqmts Mgmt Database - RID Tool Rqmts - TPM Tool Rqmts - Risk Assessment Tool Reqmts - Engineering Database - SE Metrics StandardizationForcing Function: - Mandatory Training & Audits - Organized NARs

Prime Focus: - SRR success then all CxP reviewsPrime Products: - Coordinated Entry/Exit Criteria - Integrated agenda/products/tools - SRR Plan – Including Integrated Level II & III planForcing Function: - Drives product readiness through “Pre-Boards” - Virtual Tag-ups with Stakeholders

Prime Focus: -Driving Technical Excellence -Major urgent Technical Issues

Drive Integrated Perform./ Efficiency/Effectiveness Across SE&I, CxPO and Centers

Lvl 3 ProjectSE&I Leads & Agency

Center SE&I Focals

Chief of Staff – Organization

Prime Focus: -Meeting Efficiencies/Focus-Cost, Sched & Action/Trng Tracking-Coordination w/ PP&C

Secretary

PP&C – Scheduling: Configuration Mgmt: Human Resources:Business Mgmt: Risk Mgmt:

Programmatic Integration Support

Approved: // Chris L. Hardcastle 4/2/06 //

SE Process, Tools, Metrics and Training

Prime Focus: - Program-wide approach & implementation of M&SPrime Products: - M&S Plans - M&S Tools/Standards - Integr M&S Products - Level II & III - Support to SIGs, ATA, T&V, APO & OpsForcing Function: - M&S WG

Page 8: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

8

WWW.NASAWATCH.COM

CxP Lvl II SE&I Leadership (1 of 5)

Requirements Management

Chief Of Staff - Tech

Program Technical Integration Interface

Management

Analyses, Trades & Architecture

Horizontal Integration SE&I DirectorChris. L. Hardcastle

DeputySteve Meacham

Program Review Integration

Modeling & Simulation

Michele Digiuseppe ChiefDebbie Korth Deputy

Keith Williams ChiefTBD Deputy

Steve Fitzgerald ChiefMargarita Sampson Dep (A)

Neil Lemmons Chief (A)Dave Forrest Deputy

TBD ChiefTBD Deputy

Matt Leonard

Lee Graham

David Petri

Lvl 3 ProjectSE&I Leads & Agency

Center SE&I Focals

Chief of Staff – Organization

Jason Weeks (A)Tina Cobb

PP&C – Scheduling: Roger JonesConfiguration Mgmt: Deanna HackfeldHuman Resources: Curtis CollinsBusiness Mgmt: Jason WeeksRisk Mgmt: Pedro Curiel

Programmatic Integration Support

Approved: // Chris L. Hardcastle 4/2/06 //

SE Process, Tools, Metrics and Training

Don Monell Chief (A)TBD Deputy

Majority are Leaders off of Shuttle or ISS Programs with great attitudes & work ethic – Challenges remain in fully understanding, appreciating

and implementing the scale of SE&I required

Page 9: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

9

WWW.NASAWATCH.COM

Requirements Management

Chief Of Staff - Tech

Program Technical Integration Interface

Management

Analyses, Trades & Architecture

Horizontal Integration SE&I DirectorChris. L. Hardcastle

DeputySteve Meacham

Program Review Integration

Modeling & Simulation

Michele Digiuseppe ChiefDebbie Korth Deputy

Keith Williams ChiefTBD Deputy

Steve Fitzgerald ChiefMargarita Sampson Dep (A)

Neil Lemmons Chief (A)Dave Forrest Deputy

TBD ChiefTBD Deputy

Matt Leonard

Lee Graham

David Petri

Lvl 3 ProjectSE&I Leads & Agency

Center SE&I Focals

Chief of Staff –Organization

Jason Weeks (A)Tina Cobb

PP&C – Scheduling: Roger JonesConfiguration Mgmt: Deanna HackfeldHuman Resources: Curtis CollinsBusiness Mgmt: Jason WeeksRisk Mgmt: Pedro Curiel

Programmatic Integration Support

SE Process, Tools, Metrics and Training

Don Monell Chief (A)TBD Deputy

• Technical Integration Leaders (TIL) and Systems Integration Groups (SIGs) Established Around the Front-Face of “the Cube”

• Intended to Bring a Functional Focus to the System Engineering Efforts

• Technical Integration Leads are responsible for their Functional Area from “Cradle-to-Grave” and “Top-to-Bottom”

– Assigned specific LVl II CARD, IRD, IDD & Invoked Standards/ Requirements to “manage” through the life of the Program

• Driving Cross-Systems, Cross-Element, Cross-Mission Commonality, Interchangeability, Interoperability, Survivability, Supportability, Reliability, Maintainability, Affordability into the requirements & designs with the long term objectives in mind

– Stewards the Overarching System Engineering Guidance

• #1 Safety and Mission Success• #2 Programmatic Risk• #3 Extensibility and Flexibility• #4 Life Cycle Costs

Multi-Disciplined Systems Integration Groups Leveraging the Best of the Projects, the Agency & Contracting Teams

Functional Performance & Capability Elements

Acro

ss Missio

ns

Common Components, Systems & CSCIs

Power Systems

Propulsio

n Syste

ms

Co

mp

lem

enta

ry S

ys

Crew S

ystems

UG

V

UA

V

NL

OS

-L

S

IMS

Data & E

lectric. S

ystem

Thermal S

ystems

Automat. &

Robotic

System

ECLS Systems

Tra

inin

g a

nd

Lo

gis

tics

Sys

tem

s

Car

go

Lau

nch

Veh

icle

Cre

w L

aun

ch V

ehic

le

Cre

w M

od

ule

ED

S LS

AM

Lu

nar

Su

rfac

e E

lem

ents

Unique Components,

Systems, CSCIs

Ser

vice

Mo

du

le

Networked Comm /Interoperability

Networked Battle Command

Networked Lethality

Survivability

Sustainment

Transportability/ Deployability

Training

ManeuverMan Print

RAM -T

C3I Interoperability & Commonality

Affordability, Life Cycle Costs, CAIV

Flight Performance(Traj., Prop. Abort, Loads, Thermal, Mass)

Grnd & Mission Ops Operations & Training

Human Factors & Human Rating

Integr. Thermal (pass/active)& ECLS (CM, LSAM, Surf)

Environments (nat. & induced) and Constraints

Software & Avionics Interoperability & Reuse

Integrated Loads & Structure & Mechanisms

Structu

ral & M

ech System

Navigation and Tracking

Integrated Power Loads, Interop & Interchange.

Supportability/Log/Reliability & Maintainability

GN&C

LC

C &

MC

C

Fluids

Extravehicular Integration

CxP Lvl II SE&I Leadership - SIGs (2 of 5)

Page 10: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

10

WWW.NASAWATCH.COM

Legend

#’s only represent no. of CARD reqmts assigned – still have to carve up and allocate standards, IRD and other Level II reqmts across SIGs

Program Technical Integration Office

Chief, Steve FitzgeraldMargarita Sampson (A)

Program Technical Integration Office

Chief, Steve FitzgeraldMargarita Sampson (A)

SW & Avionics

Interop and ReuseMatt Barry (M), JPL

TBD

SW & Avionics

Interop and ReuseMatt Barry (M), JPL

TBD

Thermal (Active/Passive)And ECLS

Robyn Carrasquillo (M), MSFCJohn Lewis (M), JSC

Thermal (Active/Passive)And ECLS

Robyn Carrasquillo (M), MSFCJohn Lewis (M), JSC

Integrated Loads, Struct,and MechanismsEli Rayos (M), JSCScottHill (M), LaRC

Integrated Loads, Struct,and MechanismsEli Rayos (M), JSCScottHill (M), LaRC

Human Factors andHuman Rating

Jan Connolly (M), JSCTBD (M), MSFC

Human Factors andHuman Rating

Jan Connolly (M), JSCTBD (M), MSFC

Navigation and Tracking

Don Pearson (A), JSCMike Moreau (M), GSFC

Navigation and Tracking

Don Pearson (A), JSCMike Moreau (M), GSFC

Integrated Power LoadsInterchang/InteropJim Soeder (M), GRC

Tim Lawrence (M), JSC

Integrated Power LoadsInterchang/InteropJim Soeder (M), GRC

Tim Lawrence (M), JSC

Environments andConstraints

Dave Cheuvront (A), JSCJeff Anderson (M), MSFC

Environments andConstraints

Dave Cheuvront (A), JSCJeff Anderson (M), MSFC

EVA Integration

Jeff Davis (M), JSCLara Kearney (M), JSC

EVA Integration

Jeff Davis (M), JSCLara Kearney (M), JSC

Flight Performance

Doug Whitehead (A), JSCKaren Frank (M), JSC

Flight Performance

Doug Whitehead (A), JSCKaren Frank (M), JSC

C3I Commonality andInteroperability

Steve Rader (A), JSCJohn Curry (M), JSC

C3I Commonality andInteroperability

Steve Rader (A), JSCJohn Curry (M), JSC

Supportability&Logistics/Reliability&Maintainability

Kevin Watson (A), JSC1 ID’d (M), KSC

Supportability&Logistics/Reliability&Maintainability

Kevin Watson (A), JSC1 ID’d (M), KSC

Ground and MissionOperations/TrainingSteve Hirshorn (M), JSC

Phil Weber (M), KSC

Ground and MissionOperations/TrainingSteve Hirshorn (M), JSC

Phil Weber (M), KSC

Affordability, LCC, CAIVTBDTBD

Affordability, LCC, CAIVTBDTBD

79

5

13

64

35

2

35

13

114

51

51

71

6

CARD Rq

CxP Lvl II SE&I Leadership - SIGs (3 of 5)

Responsible for Maturation of Level II Requirements (CARD, Invoked Standards, Level II IRDs & Assigned Cx Program Plans)

Page 11: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

11

WWW.NASAWATCH.COM

Test andVerification

SR&QA

Verification Strategy/Methods

Recommendations

Risk Identification& Mitigation

Recommendations

CEV

CLV

MO, GO

ISS

APO (LSAM..)

Reqmts & InterfaceManagement

Ground Ops

Mission Ops

Test andVerification

SR&QA

Analyses, Trades, Arch. & M&S

Life Sciences

Sub

ject

Mat

ter

Exp

erts

Sys

tem

Exp

ertis

eB

ook

/Pla

n Le

ads

Contractors

Typical Membership As Needed

Engineering

Crew Office

Requirements Management

Chief Of Staff - Tech

Program Technical Integration Interface

Management

Analyses, Trades & Architecture

Horizontal IntegrationSE&I Director

Deputy

Program Review Integration

Modeling & Simulation

Prime Focus: - Cross Element I/F Def. & Contrl

- Internal to Program- External to Program

Prime Products: - IDDs- IRDs- MOUs- Interface Context Diagram- Interface Control Plan (ICP)

Forcing Function: - Interface Control Working Grp

Prime Focus: - Lvl I/II & III Requirements

- Functional ArchitecturePrime Products:

- CARD- Lvl II Standards- Product Tree- Lvl II/III Document Tree- Program Requirements Tree- Functional Analyses:

FFBDs, FAMs & N 2 Diagms- Reqmts Mgmt Plan (REMP)- Traceability Reports

Forcing Function: - Reqmts Working Group

Prime Focus: - Integrated Capability/Functionality

Across Subsystems, Projects & MissionsPrime Products:

- Highest Quality Requirements- Each Lead Assigned a set of CARD,

IRD & Invoked Standards Reqmts- Reqmts Achievability Assessments- Risk Mitigation Plans- TPM Id & profiling- Optimized Integrated Designs

- Commonality/Interoperability/ ”ilities ”Forcing Function:

- System Integration Groups (SIGs)

Prime Focus: - Integrated Analyses &

Physical ArchitecturePrime Products:

- Integrated Analyses Plan- ADD & RAD- Lvl II Trades- Prioritize/ Integr Trades List/Plan

- Level II & III- Performance Assessments

- Gap ID & Mitigation- Validated Requirements Set

- Risk Analyses- Support to Ops & APO

Forcing Function: - Analyses WG

Prime Focus: - Documented Processes

Prime Products: - SEMP- Reqmts Mgmt Database- RID Tool Rqmts- TPM Tool Rqmts- Risk Assessment Tool Reqmts- Engineering Database- SE Metrics Standardization

Forcing Function: - Mandatory Training & Audits- Organized NARs

Prime Focus: - SRR success then all CxP reviews

Prime Products: - Coordinated Entry/Exit Criteria- Integrated agenda/products/tools- SRR Plan – Including Integrated Level II & III plan

Forcing Function:- Drives product readiness through “ Pre- Boards”- Virtual Tag - ups with Stakeholders

Prime Focus: - Driving Technical Excellence - Major urgent Technical Issues

Drive Integrated Perform./ Efficiency/Effectiveness

Across SE&I, CxPO and Centers

Lvl 3 ProjectSE&I Leads & Agency

Center SE&I Focals

Chief of Staff –Organization

Prime Focus: - Meeting Efficiencies/Focus- Cost, Sched & Action/ Trng Tracking- Coordination w/ PP&C

Secretary

PP&C – Scheduling: Configuration Mgmt: Human Resources:Business Mgmt: Risk Mgmt:

Programmatic Integration Support

SE Process, Tools, Metrics and Training

Prime Focus: - Program -wide approach &implementation of M&S

Prime Products: - M&S Plans- M&S Tools/Standards- Integr M&S Products

- Level II & III- Support to SIGs, ATA,

T&V, APO & OpsForcing Function: - M&S WG

Enhance Technical Quality of: Ops Con, Functional AnalysesCARD & Invoked StandardsIRDsTrades/AnalysesPhysical Architecture DescriptionsM&S Tools/ArchitectureCRADLE & Eng. DatabasesCx Program Plan, Policy, Process, Strategy Docs

CxP Lvl II SE&I Leadership – SIGs (4 of 5)

CxSECB

Technical baselineRecommendations & Assessments

- Requirements Achievability Assessments- Key Driving Requirements/Mitigation Recommendations- Technical Performance Measures- Requirements Traceability- Issues/TBD/TBR Burndown Plans

Technical integration for vertical and horizontal alignment

Reference Architecture Functional Analyses

Products

NGOsVSE

IRDsIRDs

IRDsIRDs

IDDs

IRDsIRDs

IRDsIRDs

IDDs

IRDsIRDs

IRDsIRDs

ICDs

IRDsIRDs

IRDsIRDs

ICDs

DSNE

CEV SRDIRDs

IRDsIRDs

IRDsIRDs

IRDsIRDs

IRDsIRDs

IRDs

CARD

LSAM SRD

Commonality & Standards

Project/ElementRequirements

Constellation Interface

Requirements

EVA SRD

CLV SRD

CaLV SRD

MS SRD

Gnd Ops SRD

HSIR

C3ISpecification

Power Quality Spec

Fracture Control Requirements for

Constellation Hardware

MTV SRD

ESMD Level 0/I

OperationalConcepts/ DRMs

ESAS Results

It is all about “ownership” and enhancement of Level II Reqmts & Program Plans

FFBD/N2FAM

DRMs

CxP MarginsManagement

Plan

FEMA/CIL Methodology

CxP InterfaceControl

Plan

CxP MasterInt. & V er.

Plan

ICE/ WindChillImplementation

Plan

LCC Est.

Cx Life Cycle Cost Containment

Plan

Cx TechnicalPerformanceMeas Plan

CxP CommonGlossary andAcronym List

CxHuman

Rating Plan

CxP Tech.Development

Strategy

Cx SW Mgmt & Policies Plan

ProjectSDP ’s

Cx System

EngineeringManagement

Plan

CxPProject Plans

Cx SupportabilityStrategy

Cx ConfigurationMgmt Plan

Cx ConfigurationMgmt Plan

COTS & OtherSW Interoper .& Reuse Plan

COTS & OtherSW Interoper .& Reuse Plan

CxP ProbabilisticRisk Assess Plan

CxPManagement

Plan

CxPSR&QA Plan

CxRequirementsManagement

Plan

CRADLE Database andSchema Plan

CxP Systems Integrated

Analyses Plan

CxP RiskManagement Plan

CxPProduct

Tree

CxP Reqmts ,Specs and

Standards Tree

Cx ReferenceArchitectureDoc. (RAD)

CxOperational

Concepts

CxPIntegratedTest Plan

CxPV&V by

Analyses Plan

CxArchitecture Description

Document (ADD)

CxSW Ar ch Description

Doc. (SADD)

CxPR & M Plan

Cx SupportabilityConcept Document

CxP C31 Strategy Plan

Cx Integrated System Healthmonitor Plan

Cx BaselineMgmt Plan

Cx Data Mgmt Plan

Cx SW ConfigMgmt Plan

Cx SW QAPlan

Cx Phased SWIntegration Plan

Cx SWMeasurement

Plan

Hazards Analyses Methodology

ProjectOps Concepts

FunctionalAnalyses

Results

CxPIntegrated

FlightTest Plan

S/W V&VPlan

Project MasterVerifPlans

Significant Engineering Trees Here! Level I - IIII

CxPDocTree

CxP SRR/Review

Plan

ProjectIAPs

ProjectS/W V&V Plans

Cx BusinessMgmt Plan

Cx Acquisition Plan

SE&I

T&V

OpsIntegration

SR&QAPP&C

Project APO

CxP M&S Implementation

Plan

CxP IntegratedM&S

Requirements

CxP M&SSupport

Plan

ESMD IM&SMgt. Policy

NGOs

Cx IntegratedSR&QA Requirements

PRACA Methodology

PRACA Sys. Reqts.

Cx SWClassification

Matrix

Page 12: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

12

WWW.NASAWATCH.COM

Basics to Adhere to – shared with the SIG Leadership in 3/28/06 “Offsite”

CxP Lvl II SE&I Leadership – SIGs (5 of 5) CxPO SE&I Near-Term Needs from each SIG

• Recognize the efficiencies in all SIG doing certain aspects of “the job” the same way– Leveraging off the same SE&I/CxPO Infrastructure– Using the same processes for repetitive tasks– Using similar/same tools

• Recognize not all SIGs will “look” the same– Sizing/Staffing will vary widely (should be dictated by the defined scope of work)– Some SIGs will get most of the answers from the Projects and simply integrate while other may

be needing to generate a substantial amount of data/products at Level II• Recognize SIGs MUST talk to on another

– There are natural synergies/dependencies• Recognize we ARE NOT here to DO Level III’s Job

– Focus on your set of Level II requirements, Cross Project Interfaces and the Long-Term Objectives of the Program as it relates to minimizing life cycle costs while maximizing our collective survivability, reliability, maintainability, interchangeability, interoperability, supportability, commonality, reusability, produceability, extensibility and flexibility

• Recognize NOT all requirements are Created equal or Mature at the same pace– Some requirements carry more “weight” than others…so you can’t rely on qty count alone– APO is Chartered to work the “out year” requirements until they reach a certain maturity and will

be passed on to the appropriate SIG - I use to call this bucket of “future” requirements the “Growth SIG). We MUST strike a balance how APO matures these requirements while leveraging and staying Integrated with the appropriate SIGs

• Recognize not all SIGs are at the same level of maturity and Key Training ahead is essential for our collective success – TPMs, CART, ARM, CRADLE, …

• BEGIN PRODUCING RESULTS with ICPR!!!!!!!!!

Page 13: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

13

WWW.NASAWATCH.COM

SIG Example Metrics

CARD IRD Standards Total QC'd Rationale TBDs/TBRs Verification Traced Prioritized Stakeholders Total % Total %

C3I 71 46 0 117

Flight Performance 103 65 0 168

Navigation and Tracking 33 5 0 38

Integrated Loads, Struc, and Mech 11 52 0 63

Integrated Thermal and ECLS 5 34 0 39

Environments and Constraints 34 51 0 85

Human Factors and Human Rating 61 11 0 72

Software and Avionics Interop and Reuse 84 22 0 106

Ground/Mission Operations and Training 63 12 0 75

Supp/Logistics/Reliability/Maint 44 7 0 51

Affordability and Producability 13 1 0 14

EVA Integration 12 0 0 12

Int Power, Loads, Interop, and Inter 3 21 0 24

Requirements Quality Clean Complete

CARD IRD Standards Total Driving Unassessed Watch TPM TPM ID'd ManageRMP

Complete

C3I 71 46 117 51 0 0 0 0 0Flight Performance 103 65 168 114

Navigation and Tracking 33 5 38 35Integrated Loads, Struc, and Mech 11 52 63 13

Integrated Thermal and ECLS 5 34 39 5Environments and Constraints 34 51 85 35

Human Factors and Human Rating 61 11 72 64

Software and Avionics Interop and Reuse 84 22 106 79

Ground/Mission Operations and Training 63 12 75 71

Supp/Logistics/Reliability/Maint 44 7 51 51Affordability and Producability 13 1 14 6

EVA Integration 12 0 12 13Int Power, Loads, Interop, and Inter 3 21 24 2

Requirements Achievability Risk Management

Compliance Level

Page 14: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

14

WWW.NASAWATCH.COM

SE&I Center Guidelines

LII SE&I

MSFC

DFRCGRCSSCGSFC

JPL

ARC

JSC

KSCLaRC

325.5

362.4

396.7

363.9

399.3

359.5

0

50

100

150

200

250

300

350

400

450

FY06 FY07 FY08 FY09 FY10 FY11

FTE + WYE

Agency-wide SE&I Task MappingStatus as of 31 Mar 06

• Over 140 EOIs submitted to SE&I• JSC/Non-JSC Ratio: (Preliminary)

– Including LII SE&I: 45:55• Significant responsibilities emerging for non-JSC

Centers– Technical Integration Leads

• LaRC – Structures (SIG Co-Lead)• GSFC – Navigation (SIG Co-Lead)• JPL – Software & Avionics (SIG Lead)• MSFC - Thermal and ECLS (SIG Co-Lead)• MSFC – Environments (SIG Co-Lead)• GRC – Integrated Power (SIG Co-Lead)• KSC - Supportability – (SIG Co-Lead)• KSC – Ground/Mission Ops – (SIG Co-Lead)

– IRD Book Managers– LaRC - TPM Lead

• Gaps– Additional Technical Integration Leads

• Human Rating/Human Factors – looking to MSFC

• Affordability, LCC, CAIV – MSFC/WYE• Supportability & Logistics – looking to KSC

– SRD Book Managers• CLV SRD – looking to MSFC• CaLV SRD – looking to MSFC• Ground Operations SRD – looking to KSC• CEV SRD – looking to JSC• Mission Operations SRD – looking to JSC• EVA SRD – looking to JSC

• Aggressive Forward Plan– Completed first iteration of SE&I Center

allocations (4/10)– Document SE&I FY06 funding at each Center

(ECD 4/14)– Finalize FY06 SE&I Center allocations in ITA

(ECD 4/21)– Update SE&I Integrated Master Schedule with

negotiate FY06 tasks (ECD 4/25)– Negotiate and document FY07-FY11 SE&I Center

allocations in ITA (ECD 6/2)

Note: The SE&I Nationwide Leadership Team Meets Daily @ 0730 CST on this and other Priorities as part of our now established “Battle-Rhythm”

Page 15: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

15

WWW.NASAWATCH.COM

SE&I Center GuidelinesPreliminary as of 12 April 06

FY07 Total FTE/WYE Guidelines

LII SE&I22.5%

SSC0.6%

MSFC14.2%

LaRC9.3% KSC

0.8%

JSC23.1%

JPL9.6%

GSFC7.1%

GRC8.4%

ARC4.8%

DFRC0.4%

Page 16: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

16

WWW.NASAWATCH.COM

SE&I Center GuidelinesPreliminary as of 12 April 06

SE&I Center Guidelines

LII SE&I

MSFC

DFRCGRCSSCGSFC

JPL

ARC

JSC

KSCLaRC

325.5

362.4

396.7

363.9

399.3

359.5

0

50

100

150

200

250

300

350

400

450

FY06 FY07 FY08 FY09 FY10 FY11

FTE + WYE

Will continue to synergize our forecasts with the Projects via

the May POP Follow-on TIM

Page 17: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

17

WWW.NASAWATCH.COM

CxPO SE&I Staffing Actuals vs NeedsIncluding Projections for balance of CY06

Summary totals for plotting FTE/Matrix

Allocation

FTE

Onboard

FTE

Pending

FTE

Vacant

Matrix

Onboard

Matrix

Pending

Matrix

Vacant

WYE

Allocation

WYE

Onboard

WYE

Vacant

Director Staff 5 3 1 0 1 0 0 2 0 2

Program Review Integration (PRI) 4 1 0 2 0 0 1 4 4 0

Modeling and Simulation (M&S) 0 0 0 0 1 0 0 0 0 0

Program Technical Integration (PTI) 129 2 5 3 23 4 24 119 1 0

Requirements Management Office (RMO) 13 5 0 6 3 1 9 15 11 4

Interface Management Office (IMO) 19 4 3 2 2 0 4 10 3 6

Analysis, Trades and Architecture (ATA) 15 2 0 5 7 1 0 5 3 3

Processes, Tools and Metrics (PTM) 10 1 0 7 4 0 0 10 3 5

Totals 195 18 9 25 41 6 38 165 25 20

Page 18: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

18

WWW.NASAWATCH.COM

SIG Staffing Status

ID'd Need Total ID'd Need Total ID'd Need Total ID'd Need Total ID'd Need Total ID'd Need Total ID'd Need Total ID'd Need Total ID'd Need Total ID'd Need Total

SIG

Total

C3I11.5 5.6 17.1 2.7 9.55 12.3 0 1 1 7.5 0.25 7.75 13.2 16.1 29.3 2 6.5 8.5 0 2 2 8.1 4.5 12.6 90.4

Flight Performance 2 5.5 7.5 0.5 2.5 3 1 1 3 1 2.5 3.5 1 0 1 1 1.5 2.5 1 0.5 1.5 22

Navigation and Tracking 1 2.9 3.9 1 2.4 3.4 1 2.6 3.6 10.9

Integrated Loads, Struc, and Mech 1 6 7 0 2.8 2.8 1 3.2 4.2 14

Integrated Thermal and ECLS 2.5 2.75 5.25 4.25 1 5.25 2 0 2 0.5 0 0.5 0 0.5 0.5 13.5

Environments and Constraints 1.7 4.3 6 14.4 0 14.4 0 0.2 0.2 0.3 0 0.3 20.9

Human Factors and Human Rating 20.2 0 20.2 2 0 2 2.1 0 2.1 1 0 1 25.3

Software and Avionics Interop and Reuse 1.2 0 1.2 2.4 0 2.4 3.6 0 3.6 3.6 0 3.6 6 0 6 7.2 0 7.2 24

Ground/Mission Operations and Training 1 5 6 0 3 3 1 2 3 0 2 2 14

Supp/Logistics/Reliability/Maint1.5 5.5 7 0 2 2 0.5 2.5 3 0.1 0 0.1 12.1

Affordability and Producability 7 3 10

EVA Integration 9.9 0 9.9 1 0 1 10.9

Int Power, Loads, Interop, and Inter 1.5 0 1.5 0 1 1 9.5 0 9.5 0 1 1 1 0 1 14

Center Totals 55 37.6 99.5 26.3 18.9 45.1 5.6 5.2 14.8 16.2 5.75 22 1 0 1 21.2 20.2 41.4 14 7 21 0 2 2 1.5 5.5 7 18.7 9.6 28.3

JPLKSCSSC GSFC GRC DFRCJSC MSFC LaRC ARC

Page 19: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

19

WWW.NASAWATCH.COM

CxPO SE&I 3P Overview

Agenda

• Products– Near-Term Requirements-Focused Product Line

• CxP-allocated NGOs, Level I-allocated Requirements, CARD, IRDs, IDDs, Invoked Standards, Operational Concepts, FFBDs, FAMs, N2 Diagrams, Reference Architecture, Trade/Analyses results, SRDs, Requirements Achievability Assessments, Technical Performance Measures, Technical Risk Mitigation Plans, Traceability Reports

– Long-term Program-wide Technical Integration Foundation Products• Cx Program Plan, Policy, Process & Strategy Documents

Page 20: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

20

WWW.NASAWATCH.COM

Reference Architecture Functional Analyses

Products

NGOsVSE

IRDsIRDs

IRDsIRDs

IDDs

IRDsIRDs

IRDsIRDs

ICDs

Requirements Tree – Top Level Summary

DSNE

CEV SRDIRDs

IRDsIRDs

IRDsIRDs

CARD

LSAM SRD

Commonality & Standards

Project/ElementRequirements

Constellation Interface

Requirements

EVA SRD

CLV SRD

CaLV SRD

MS SRD

Gnd Ops SRD

HSIR

C3ISpecification

Power Quality Spec

Fracture Control Requirements for

Constellation Hardware

MTV SRD

ESMD Level 0/I

OperationalConcepts/DRMs

ESAS Results

CxP Requirements Tree is one of the RID-able Items for ICPR

= Partial SIG Ownership working w/ Projects= Full SIG Ownership working w/ Projects

Page 21: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

21

WWW.NASAWATCH.COMLevel III vs Level II Lead Roles in Interface Management

IRDs/IDDs/ICDs , Between Elements a/o Programs

CEV

CLVLSAM CaLVEDS

MTV

ISS

EVA MSGO

APAS

LIDS

etc…

IRDs/IDDs/ICDs , w/in Element CEV

etc…

IRDs/IDDs/ICDs , w/in ElementCLV

etc…

IRDs/IDDs/ICDs , w/in Element CaLV

etc…

IRDs/IDDs/ICDs , w/in Element etc…

CxICWGManaged

Project Managed

CM LM LAS SA

FS US Eng

SRB CS CSE

IRDs/IDDs/ICDs , Between Elements a/o Programs

CEV

CLVLSAM CaLVEDS

MTV

ISS

EVA MSGO

APAS

LIDS

etc…

IRDs/IDDs/ICDs , w/in Element CEV

etc…

IRDs/IDDs/ICDs , w/in ElementCLV

etc…

IRDs/IDDs/ICDs , w/in Element CaLV

etc…

IRDs/IDDs/ICDs , w/in Element etc…

CxICWGManaged

Project Managed

CM LM LAS SA

FS US Eng

SRB CS CSE

Focus relative to Interface Management and lines of Responsibility

= Full SIG Ownership working with Projects= Lower Priority

**

*

*

PE

MTV

*

Page 22: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

22

WWW.NASAWATCH.COM

LSAM/CEVIRD

LSAM/CEVICD

EVA/CEVIRD

EVA/CEVICD

MTV/CEVIRD

MTV/CEVICD

CLV/CEVIRD

CLV/CEVICD

LIDSIDD

CaLV/Mission Systems

IRD

CaLV/Mission Systems

ICD

Mission Systems/CEV IRD

Mission Systems/CEV ICD

Ground Operations/CEV

IRD

GroundOperations/CEV

ICD

LSAM/EVAIRD

LSAM/EVAICD

LSAM/CaLVIRD

LSAM/CaLVICD

LSAM/EDSIRD

LSAM/EDSICD

LSAM/Mission Systems IRD

LSAM/Mission Systems ICD

LSAM/GroundOperations IRD

LSAM/GroundOperations ICD

CLV/Mission Systems IRD

CLV/Mission Systems ICD

CLV/Ground Operations IRD

CLV/Ground Operations ICD

CaLV/Ground Operations

IRD

CaLV/Ground Operations

ICD

CEV/ISSIRD

CEV/ISSICD

CEV/Portable Equipment

IRD

CEV/Portable Equipment

ICD

LSAM/PortableEquipment IRD

LSAM/PortableEquipment ICD

CEV/EDSIRD

CEV/EDSICD

Mission Systems/Ground Ops IRD

Mission Systems/Ground Ops ICD

APASIDD

ConstellationInterface Requirements

Constellation Interface Requirements

Need to work these in Priority Order to Support “Lunar

Sortie” CxP SRR and

subsequent Project SRRs

Need Project Support in setting Priority Order by Book and Within each Book

EVA/Ground Ops IRD

EDS/MS IRD

EVA/Mission Systems IRD

EVA/Mission Systems ICD

EVA/Ground Ops ICD

EDS/MS ICD

EDS//Ground Ops IRD

EDS/Ground Ops ICD

EDS//CaLV IRD

EDS/CaLV ICD

CriticalPriority for Lunar Sortie CxP SRR

High

Medium

Low/Not Required

Page 23: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

23

WWW.NASAWATCH.COM

Example: CEV & CLV Legs of the Requirements Tree

CEVLAS Subsytem

Specifications

CEVCM Subsytem

Specifications

CEVSM Subsytem

Specifications

CEV SystemRequirements

Document

CEV CM to LAS IRD

CEV Spacecraft Internal ICD

CEV CM to SM IRD

CEV Spacecraft Internal ICD

CEVLaunch Abort

SystemSpecification

CEV Spacecraft

Specification

CEV Command

ModuleSpecification

CEV Service

ModuleSpecification

CEV GSESpecification

CEVSM Subsytem

Specifications

CEV Spacecraft

AdapterSpecification

CEV SM to SA IRD

CEV Spacecraft Internal ICD

CEV Cockpit Design

Requirements

CLV SystemRequirements

Document

CLV First Stage /Upper Stage IRD

CLV First Stage /Upper Stage ICD

CLV Upper Stage /Engine IRD

CLV Upper Stage /Engine IRD

CLV First Stage Requirements

Document

CLV Upper Stage Requirements

Document

CLV Engine Requirements

Document

CLV Subsystems

Electromagnetic Characteristics

Requirements

SubsytemSpecifications

SubsytemSpecifications

SubsytemSpecifications

Requirements Tree Covers Level II through Level III

Page 24: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

24

WWW.NASAWATCH.COMCurrent CARD Requirements Count & Distribution

NUMBER OF REQUIRMENTS ICPR

Kickoff4-Apr-06

CARDSection

134 3.2 Constellation Architecture Requirements8 3.3 Design and Construction

28 3.4 Interfaces0 3.5 Physical Characteristics0 3.6 Reserved

127 3.7.1 CEV109 3.7.2 CLV

44 3.7.3 LSAM25 3.7.4 CaLV/EDS24 3.7.5 Ground Operations18 3.7.6 Mission Systems

1 3.7.7 Mars Transfer Vehicle (MTV)1 3.7.8 DAV0 3.7.9 EVA0 4 Verification

519 CARD Total

CEV SRDSection

355 3.2 CEV

355 CEV SRD Total

CLV SRDSection

110 3.2 CLV 6 3.3 Design and Construction

60 3.7.1 1st Stage131 3.7.2 US50 3.7.3 USE

357 CLV SRD Total

CaLV SRDSection CaLV

141 3.2

141 CaLV SRD Total

Quality of the CARD needs focused improvement – While reformatting has been accomplished, breadth and depth of content as it relates to “Level II” requirements requires enhancements based in Systems Engineering results - This is our Focus

for the Next Four Months – Refer to Process & Plans Ahead For Details

= Full SIG Ownership working with Projects

Page 25: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

25

WWW.NASAWATCH.COM

Critical requirements withcompliance issues

(Performance, Schedule, Affordability)feeds appropriate risk management

processes

Tier III

Tier ITier II

Trace Reports

Affordability

PerformanceSchedule

CART Reports

Requirementassessment data

maintained inCradle

Trace / CART Reports Requirement ownership Requirement: Parent-Child linkages Requirement Criticality Requirement Achievability Status: technical performance, schedule, affordability TPMs

Watch List

ARM

Risk Management

Group

Program

InformedProactive

Management

Program and group level guidance

Trace Reports, CART Reports, TPMs and Hard-to-Achieve

Requirements Risk Mitigation Plans have yet to be implemented – But are a key focus of ICPR and the

plans through the summer

TPMs - Provide Quantifiable Assessment System

Constellation Analysis and Requirements Traceability (CART)Will facilitate id of “requirements-focused” risks, prioritized TPMs & mitigation plans

Continuous Assessment Focused on Critical/At Risk Requirements

= Full SIG Ownership working with Projects

Cradle

Requirements Documentation

ARM

Risk Management

System IntegrationGroups

Requirements Management

ARM

Program Level Risks

Page 26: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

26

WWW.NASAWATCH.COMCxPDocumentTree

FFBD/N2FAM

DRMs

CxP MarginsManagement

Plan

FEMA/CIL Methodology

CxP InterfaceControl

Plan

CxP MasterInt. & V er.

Plan

ICE/WindChillImplementation

Plan

LCC Est.

Cx Life Cycle Cost Containment

Plan

Cx TechnicalPerformanceMeas Plan

CxP CommonGlossary andAcronym List

CxHuman

Rating Plan

CxP Tech.Development

Strategy

Cx SW Mgmt & Policies Plan

ProjectSDP ’s

Cx System Engineering

Management Plan

CxPProject Plans

Cx SupportabilityStrategy

Cx ConfigurationMgmt Plan

Cx ConfigurationMgmt Plan

COTS & OtherSW Interoper .& Reuse Plan

COTS & OtherSW Interoper .& Reuse Plan

CxP ProbabilisticRisk Assess Plan

CxPManagement

Plan

CxPSR&QA Plan

CxRequirementsManagement

Plan

CRADLE Database andSchema Plan

CxP Systems Integrated

Analyses Plan

CxP RiskManagement Plan

CxPProduct

Tree

CxP Reqmts,Specs and

Standards Tree

Cx ReferenceArchitectureDoc. (RAD)

CxOperational

Concepts

CxPIntegratedTest Plan

CxPV&V by

Analyses Plan

CxArchitecture Description

Document (ADD)

CxSW Ar ch Description

Doc. (SADD)

CxPR & M Plan

Cx SupportabilityConcept Document

CxP C31 Strategy Plan

Cx Integrated System Healthmonitor Plan

Cx BaselineMgmt Plan

Cx Data Mgmt Plan

Cx SW ConfigMgmt Plan

Cx SW QAPlan

Cx Phased SWIntegration Plan

Cx SWMeasurement

Plan

Hazards Analyses Methodology

ProjectOps Concepts

FunctionalAnalysesResults

CxPIntegrated

FlightTest Plan

S/W V&VPlan

Project MasterVerifPlans

Significant Engineering Trees Here! Level I - IIII

CxPDocTree

CxPSRR/Review

Plan

ProjectIAPs

ProjectS/W V&V Plans

Cx BusinessMgmt Plan

Cx Acquisition Plan

SE&I

T&V

OpsIntegration

SR&QAPP&C

Project APO

CxP M&S Implementation

Plan

CxP IntegratedM&S

Requirements

CxP M&SSupport

Plan

ESMD IM&SMgt. Policy

NGOs

Cx IntegratedSR&QA Requirements

PRACA Methodology

PRACA Sys. Reqts.

Cx SWClassification

Matrix

Establishing proper

“foundation” for Cx Program to build on with

set of key Level II Program

Plans, Policies, Processes and Strategies – In

Addition to Maturing the

Requirements Set

Must Keep this as Simple as Possible….But no Simpler For a Virtually Distributed Multi B$, Multi-Decade Program

= Full SIG Ownership working with Projects

= Partial SIG Ownership working with Projects

Page 27: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

27

WWW.NASAWATCH.COM

CxPO SE&I 3P Overview

Agenda

• Processes– Requirements & Interface Management Processes– RAC, DAC & VAC – Analyses/Trades/Modeling & Sim Processes– Other SE Processes, Tools and Training– Emerging Program Boards, Panels & WGs Structure/Process

Page 28: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

28

WWW.NASAWATCH.COMStandards Development and Compliance is a Necessary Asset

• Documented, institutionalized and trained Standards lead to predictable outcomes that reduce risk

• Proprietary, outdated, noncompliant processes ultimately compromise team integration

• System engineering & project management standards have been updated to handle modern, complex problems

– NASA 7120.5C– NASA NPR 7123– ISO 15288 – product life cycle synchronization– ANSI/IEC 632 – system engineering and the Enterprise– IEEE 1471 – architecture development using multiple frameworks (eg. tailored for CS

collaborative systems engineering)• Compliant processes tend to integrate team operations

– Communication common across multiple organizations and suppliers – Common expectations of outcomes– Common validation standards– Common vocabulary

• Compliance requires vertically integrated SE management, diligence, and verification

Page 29: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

29

WWW.NASAWATCH.COMLayered Architectures Organize Complex Systems Engineering

•Requirements Management, Configuration Management, and Change Management quickly lose synchronization without a vertically integrating top-down organizing mechanism– Particularly after Prime Contractors have been selected

•Complex systems have a layered architecture that is the organizing principle for system engineering management– System breakdown structure– Architectures and flowdown functional analysis– Requirements derivation and flowdown– Mission and End Item integration

•Manage configurations and requirements by architecture level– Explicit links to functions, components and interfaces on own level (modeled

in the architecture)– Explicit links “up” to functions, components and interfaces on the next level –

derivation and realization are explicit

•Use architecture levels to construct schema for control in tools and construct products for reviews

Vertical integration

Horizontal integration

Page 30: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

30

WWW.NASAWATCH.COM

Us vs. Traditional System Engineering

CustomerReqmts

Config Unit/Item

Build

Config Unit/Item

Test

IntegrationIntegration

TestProduction

System Analysis

Rqmnts Analysis

• System Spec• Rqmnts Baseline• System Arch

Functional Analysis &

Decomp• Functional Arch• Functional Spec

Design Synthesis

• Physical Arch• Design Spec

CARD/IRDs/SRDs

Config Unit/Item

Build

Config Unit/Item

TestIntegration

Integration Test

Production

System Analysis

Rqmnts Analysis

• System Spec• Rqmnts Baseline• System Arch• Technical Arch

Functional Decomp & Allocation

Design Synthesis

• Physical Arch• Design Spec

Us

Traditional

• Single Major System• Serial approach

• Multiple Major Systems• Parallel approach

ConstellationTier 1

Tier 2

Tier N+1 products maturity/feasibility underpins Tier N products maturity/feasibility

TimeTime

Tier 3

Technical Management

Processes

System DesignProcesses

Product RealizationProcesses

Requirements Flow Down – e.g., fromNASA Headquarters/ESMD/SOMD

Realized Products and Feedback – e.g., toNASA Headquarters/ESMD/SOMD

Realized Productse.g., from Projects

Requirements Flow Downe.g., to Projects

System Design Processesapplied to each SBS Component

down and acrosssystem structure

Product Realization Processesapplied to each SBS Component

up and acrosssystem structure

On-GoingFeedback

1. Stakeholder ExpectationsDefinition

2. Technical RequirementsDefinition

3. Logical Decomposition

4. Physical Solution 5. Product Implementation

6. Product Integration

7. Product Verification

8. Product Validation

9. Product Transition

10. Technical Planning

11. Requirements Mgt.

12. Interface Mgt.

13. Tech. Risk Mgt.

18. Issues Mgt.

16. Technical Assessment

17. Decision Analysis

14. Configuration Mgt.

15. Tech. Data Mgt.

Concurrent Engineering is inherent to what we do on CxP

Page 31: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

31

WWW.NASAWATCH.COM

RAC 1

D J F M M J JA A S O N D J F

CxP

RAC 2

Cx SRR

RAC 3

FY06 FY07

Mid-term

DocSel PlanApproval

DAC 1

Cx ICPR

Sel Plan DocMid-termApproval

SRR

Doc

ICPR

CEV SRR

MS SRR

GO SRR

CLV SRR

EVA SRR

8For NASA Internal Use Only

High-level CxPO SE&I Expectations for CY06

CxP CY06 SRR Expectations:

? Operational concepts baselined? CARD and invoked standards and

requirements (HSIR, NEDD, NESD, Power Quality, Interoperability>..) baselined

? CxP Functional and performance allocations to systems complete to the extent SRDscan be baselined

? Intra- system interfaces described (IRDs, IDDs)

? Verification objectives and strategies documented (Master Verification Plan)

? Architecture Description Document (ADD) baselined

? Design concepts underway? Progressive Performance assessments

integrated and in sync? Engineering plans published (SEMP,

SDP, CMP, RMP,…… ) and training invoked

? Technical Baseline Sync’d with Cost and Schedule Baselines

? Risks identified with mitigation plans in place

ICPR SRR SDR CDR First Mission Set

PDR

VerificationVerification

SystemIntegrationVerification

SystemIntegrationVerification

SubsystemIntegrationVerification

SubsystemIntegrationVerification

ArmyOperationalValidation

ArmyOperationalValidation

ComponentVerificationComponentVerification

BuildBuild

ORD, O&O,ASR, SEP,CDD

ORD, O&O,ASR, SEP,CDD

Prime Item & CIDevelopment

Specs

PreliminaryDesign

CI / CSCIs

Verification

Multi-Element/Multi-MissionVerification

SystemIntegrationVerification

SystemIntegrationVerification

SubsystemIntegrationVerification

SubsystemIntegrationVerification

ArmyOperationalValidation

AgencyValidation

ComponentVerificationComponentVerification

BuildBuild

ORD, O&O,ASR, SEP,CDD

Lvl I ReqmtsESAS Results

Prime Item & CI

Specs & ICDs /IRSs/SRSs

PreliminaryDesign

CI / CSCIs

CARDElement-to-ElmmentI/Fs Reqmts

Integration & Verification

Requirements & Design

Notional Responsibilities:

Lvl 0/I

Lvl II

ONE Integrated Requirements Baseline

PreliminaryDesign

SRDs & Intra Element I/Fs Reqmts

Lvl III

Contracting Teams

Level II Requirements Enhancement Focus

2005 2006 2007

Currently our Eyes are on ICPR Results and the Path Forward to CxP

SRR & 1st Season of Project SRRs

Page 32: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

32

WWW.NASAWATCH.COM

Systems Engineering is More Than Design

•In a complex system, “design to spec and wait to verify” is insufficient– Critical design trades and reengineering occur after specifications

have been cut and contractors selected– Design-to-cost, design-to-risk, and integration across the family of

systems requires active SE role in managing the contractors

•Systems Engineering Management is the integrating factor– SE Dual ”VEE” Synchronization and Management– Drives design and development through common architecture,

integrated systems trades and higher level mission milestones– Process allows the interaction and integration at the complex

systems development and across program levels

Page 33: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

33

WWW.NASAWATCH.COM

Level II / Level III System Development Model

CS Level II Level III

, Analysis of User Requirements

Environment and Constraints

Functional Analysis and

Decomposition

Functional Allocation

Concept Design and Developme

nt

Verification of Subsystem Performance

Verification of Element Performance

Verification of Integrated System Performance

Selection and Validation of Preferred System Concept

Reorganization of requirements and V&V objectives by architecture organization and commonality

Allocation to subsystems

Allocation to Element

Concept Baseline

Decomposition Analysis of

Requirements and Determination of V

& V Objectives

Page 34: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

34

WWW.NASAWATCH.COM

Key Processes in these SE&I Areas

Requirements Management

Chief Of Staff - Tech

Program Technical Integration Interface

Management

Analyses, Trades & Architecture

Horizontal IntegrationSE&I Director

Deputy

Program Review Integration

Modeling & Simulation

Prime Focus: - Cross Element I/F Def. & Contrl - Internal to Program - External to ProgramPrime Products: - IDDs - IRDs - MOUs - Interface Context Diagram - Interface Control Plan (ICP)Forcing Function: - Interface Control Working Grp

Prime Focus: - Lvl I/II & III Requirements - Functional ArchitecturePrime Products: - CARD - Lvl II Standards - Product Tree - Lvl II/III Document Tree - Program Requirements Tree - Functional Analyses: FFBDs, FAMs & N2 Diagms - Reqmts Mgmt Plan (REMP) - Traceability ReportsForcing Function: - Reqmts Working Group

Prime Focus: - Integrated Capability/Functionality Across Subsystems, Projects & MissionsPrime Products: - Highest Quality Requirements - Each Lead Assigned a set of CARD, IRD & Invoked Standards Reqmts - Reqmts Achievability Assessments - Risk Mitigation Plans - TPM Id & profiling - Optimized Integrated Designs - Commonality/Interoperability/”ilities”Forcing Function: - System Integration Groups (SIGs)

Prime Focus: - Integrated Analyses & Physical ArchitecturePrime Products: - Integrated Analyses Plan - ADD & RAD - Lvl II Trades - Prioritize/Integr Trades List/Plan - Level II & III - Performance Assessments - Gap ID & Mitigation - Validated Requirements Set - Risk Analyses - Support to Ops & APOForcing Function: - Analyses WG

Prime Focus: - Documented ProcessesPrime Products: - SEMP - Reqmts Mgmt Database - RID Tool Rqmts - TPM Tool Rqmts - Risk Assessment Tool Reqmts - Engineering Database - SE Metrics StandardizationForcing Function: - Mandatory Training & Audits - Organized NARs

Prime Focus: - SRR success then all CxP reviewsPrime Products: - Coordinated Entry/Exit Criteria - Integrated agenda/products/tools - SRR Plan – Including Integrated Level II & III planForcing Function: - Drives product readiness through “Pre-Boards” - Virtual Tag-ups with Stakeholders

Prime Focus: -Driving Technical Excellence -Major urgent Technical Issues

Drive Integrated Perform./ Efficiency/Effectiveness Across SE&I, CxPO and Centers

Lvl 3 ProjectSE&I Leads & Agency

Center SE&I Focals

Chief of Staff – Organization

Prime Focus: -Meeting Efficiencies/Focus-Cost, Sched & Action/Trng Tracking-Coordination w/ PP&C

Secretary

PP&C – Scheduling: Configuration Mgmt: Human Resources:Business Mgmt: Risk Mgmt:

Programmatic Integration Support

Approved: // Chris L. Hardcastle 4/2/06 //

SE Process, Tools, Metrics and Training

Prime Focus: - Program-wide approach & implementation of M&SPrime Products: - M&S Plans - M&S Tools/Standards - Integr M&S Products - Level II & III - Support to SIGs, ATA, T&V, APO & OpsForcing Function: - M&S WG

Page 35: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

35

WWW.NASAWATCH.COMSE&I Requirements Maturation Process Flow

Disciplined and Integrated Approach to Maturing Our Requirements Set is

being Stoop Up

Define the Scope

Develop the Functional

Architecture

Develop the Requirements

Validate the Requirements

Stakeholder Feedback

Ma

na

ge

th

e R

eq

uire

me

nts

D

eve

lop

me

nt

Pro

cess

(R

WG

)

Analysis, Trade Studies, & Standards

SIGs & Projects integrated into the

development process

RAC 1

D J F M M J JA A S O N D J FD J F M M J JA A S O N D J F

2005 2006

CxP

RAC 2

2007

Cx SRR

DAC 1

FY06 FY07

Mid-term

DocSel PlanApproval

DAC 2

Cx ICPR

Sel Plan DocMid-termMid-termApprovalApproval

SRR

Doc

ICPR

CEV SRR

MS SRR

GO SRR

CLV SRR

EVA SRR

Define the Scope

Develop the Functional

Architecture

Develop the Requirements

Validate the Requirements

Stakeholder Feedback

Manage the Requirements Development Process (RWG)

Analysis, Trade Studies,

& Standards

TILs & Projects integrated into the

development process

Define the Scope

Develop the Functional

Architecture

Develop the Requirements

Validate the Requirements

Stakeholder Feedback

Manage the Requirements Development Process (RWG)

Analysis, Trade Studies,

& Standards

TILs & Projects integrated into the

development process

Process Step Process Deliverables

Define Design Pro blem Stakeholder List

Identify Stakeholder Needs Needs, Goals, and Objectives supplied by Constellation Program Management

Develop Operations Concept / DRMs Design Reference Missions and Operations Concept supplied by Ops. Integration Architecture Description Document

Identify System Boundaries Context Diagram

Develop Functional Architecture

Develop Functional Model —System Capabilities

? Functional Model to level sufficient todescribe Operations Concept and identify

System Functions ? F unctionalF lowB lockD ( )iagrams FFBDs

FAMs , and N2 , diagrams Linkage between operational concept and functions

Develop Physical Architecture [ ]Done by System Analysis Group Develop Requirements

Develop System Requirements Write System Requirements System Requirements Document Rationale System Requirements Rationale Link system Requirements to Parent Requirements

Trace between System Requirements and Parent Requirements

/ Link System functional performance requirements to Functional Model ( )System Capabilities

Trace between Element Originating Requirements and Element Functions

Develop Element Originating Requirements

Decompose System Requirements to Element Allocated Requirements

Element Originating Requirements

Document Rationale Element Originating Requir ements Rationale Link System Requirements to Parent Requirements

Trace between System Requirements and Element Originating Requirements

/ Link Element functional performance requirements to Functional M odel ( )Element Capabilities

Trace between Element Originating Requirements and Element Functions

Develop Inter- Element Requirements , IRDs ICDs– supplied by Interface Control Working Group

Produce Draft Documents & Draft CARD SRDs Manage Project Engineering Process Manage Issues ? Issues documented in PE Model

? , When applicable baseline configuration changes identified and submitted to the

( Configuration Management Process see3.10.3)

Manage Risks Risks ide ntified and managed using the Constellation Risk Management Process

= Partial SIG Ownership w/ with Projects & Other SE&I Direct Reports

Page 36: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

36

WWW.NASAWATCH.COM

Develop Requirements

3.1 Collect & document the Requirements

3.3 Document the rationale for each Rqmt

3.4 Decompose/Allocate Requirements

3.5 Link Requirements to Functional Model

3.6 Link Rqmt to Parent Requirements

3.7 Document how each Rqmt will be verified

3.8 QC Rqmts as they are developed

From Develop FA

Conduct Review

3.9 Maintain the Database and Document Tree

3.10 Produce Draft Document(s)

No All Done & Ready for Review?

Yes

3.2 Define & Capture Attributes for Rqmts

Process is designed to capture all of the data when the requirement

is being developed

Process is designed to capture all of the data when the requirement

is being developed

RMO Driving This Process

= Partial SIG Ownership w/ with Projects & Other SE&I Direct Reports

Page 37: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

37

WWW.NASAWATCH.COMRequirements Development

Interface

Management

Product

Developers

CxRWG

Stakeholders

CxATA

Rqmts Owners

Manage The Requirements

Define the ScopeDevelop the Functional

Architecture

Develop the Requirements

Validate the RequirementsNGO, Ops Con FFBD, FAM, N2 Draft Docs

Provide Scope Inputs

Provide Inputs

Provide Inputs

Manage the Functional

Architecture Development

Manage the Scope Development

Interface Requirements Development

Request Allocation Trade Allocation Trade Results

N2 Diagrams

Analysis ResultsRequest Analysis

Perform AnalysisPerform Analysis

Provide Candidate Requirements and

associated attributes

Manage the Requirements Development

Requirements Document

Provide Comments

Provide Comments

Provide Comments

Disposition Comments and Coordinate with

Originator

Coordinate Final Resolution

Coordinate & Integrate I /F with Element SRDs

B

ook

Man

ager

s

S

IGs

SE&I Requirements Maturation Across Stakeholders

Split of Roles Across SE&I Offices

SIG

Sup

por

t

Page 38: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

38

WWW.NASAWATCH.COM

• No undefined terms • Each RID is a single requirement (no duplication) – a single “shall” per statement• Requirement stands alone

– No undefined acronyms– Subject and verb for each requirement

• Requirement is quantified (can be yes or no) • Requirement is verifiable – see next page

– Performance parameter and value identified• Requirement context is appropriate to section / CxP level

– For section 3.2: “The CxP System shall …..”– For Section 3.7: “The (prime item name) shall …..”

• Parent defined and linked – 3.2 requirements linked to one or more NGOs requirements– 3.7 linked to a 3.2 parent; derived 3.7s link to their 3.2 parent

• Requirement is valid – appropriate in the immediate context of the Spec and derived from the required capabilities of the NGOs, Operational Concepts, Functional Analyses

– MUST have detailed rational behind the requirement in CRADLE– Do not “invent” requirements – they must earn their way in– CRADLE must also capture “Horizontal Linkages” to Functional Analyses Products

• All Derived requirements have appropriate Requirement Reference data• No open issues, TBDs or TBRs –without specific burndown plans that support

SE&I Requirements Quality – Top job for SIGs for “their” assigned requirements

Reference Architecture Functional Analyses

Products

NGOsVSE

IRDsIRDs

IRDsIRDs

IDDs

IRDsIRDs

IRDsIRDs

IDDs

IRDsIRDs

IRDsIRDs

ICDs

IRDsIRDs

IRDsIRDs

ICDs

DSNE

CEV SRDIRDs

IRDsIRDs

IRDsIRDs

IRDsIRDs

IRDsIRDs

IRDs

CARD

LSAM SRD

Commonality & Standards

Project/ElementRequirements

Constellation Interface

Requirements

EVA SRD

CLV SRD

CaLV SRD

MS SRD

Gnd Ops SRD

HSIR

C3ISpecification

Power Quality Spec

Fracture Control Requirements for

Constellation Hardware

MTV SRD

ESMD Level 0/I

OperationalConcepts/ DRMs

ESAS Results

= Partial SIG Ownership working w/ Projects= Full SIG Ownership working w/ Projects= Partial SIG Ownership working w/ Projects= Full SIG Ownership working w/ Projects

Must Maintain a disciplined configuration management of our requirements and all supporting data in CRADLE

Page 39: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

39

WWW.NASAWATCH.COM

SIGs Facilitate Allocation/Decomposition & Traceability for Level II to Level III Requirements

Level 0 , NGO , OpsConReqmts Analysis

3.2 3.3 3.4 3.5

Decomp

3.7.X CARD

Decomp

IRDsICDs

Allocated ReqmtsX.X

X.Y

SRDs

IRDs

Decomp

Specs

Decomp

Specs

Level 0/1

Level 2

Level 2

Level 3

Level 4

Level 5HQ

CxPO

Projects

Vendor/GFE

X X X XX X X X

X X X X

X X X X

X X X X

X X X X

X X X X

X X X X

X X X X

X X X X

Pre- SRR

Post -SRR

P = PrimeM = MonitorS = Support

ICDs

Element n (3 .7.n)

Draft ICPRB/L CxSRR

Draft CxSRRB/L PrjSRR

Architecture /Integrated Element Level Reqmts

CxPO Controlled

Project Controlled

Vendor or GFE Projects

Subsystems

SIGs, Reqmts Mgmt, I/F Mgmt working with Projects MUST ensure vertical & horizontal linkage requirement-by-requirement in CRADLE

X to be replaced with P, M or S

Page 40: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

40

WWW.NASAWATCH.COM

Coordinate Issues with

Reqm’t Owner

RWG

Proceed to Step 2 of

Verification Process DI-XXX

Measurable

Write SCN No

No

No

No

No

Yes

Yes

Yes

Yes

Yes

Review Requirement

For Verifiability (Step 1)

Concise

Shall Statement

Single Reqm't

ORD Intent

SIGs Ensure verifiability of Section 3 requirements and facilitate the writing of section 4 verification methods & strategies

Examples of Ambiguous Wordscapable shall be capable of ability acceptableas a guide shall have the ability normal approximatelyexcessive appropriate sufficient applicabledetrimental compatible with reasonable averageminimize user friendly maximize near termquick response not limited to cost effective adequate

Section 4sIRDs and CARD

IT&VImplementation Plans

IT&V ExecutionAnalysisModeling

SimulationDemonstration

Testing

ComplianceDocumentation

Customer

Section 3

SIGs with T&V Leadership Ensure Each “shall” statement

in verifiable

Page 41: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

41

WWW.NASAWATCH.COM

Simple Up-Front Filters to Determining an initial Verification Method(s)

Is Review of Lower

Level Data Sufficient?

Are Computations Using Lower Level Data

Req’d?

Are Simulations

Using Models/Tools

Required?

Is All Required HW / SW /

Sims Available?

Is Instrumentation

Required to CollectData?

Can Functionality Be Observed with Pass/Fail

Results?

Does Lower Level Data Need to Be

Reviewed for Compliance?

SoS Requirement

Desktop Analysis

Assessment Inspection

Collector Inspection

Can Requirement

Be Completely Closed Without

Additional Analysis?

Test

Demonstration

Can Requirement

Be Completely Closed Without

Additional Sim/DesktopAnalysis?

A

A

A

Yes

No

Yes Yes

No

No

No

No

Yes Yes

YesNo

Yes

No

Yes Yes

No

Is Test Cost Effective?

Is Demo Cost Effective?

No

Yes

ANo

A

Is Review of Lower

Level Data Sufficient?

Is Review of Lower

Level Data Sufficient?

Are Computations Using Lower Level Data

Req’d?

Are Computations Using Lower Level Data

Req’d?

Are Simulations

Using Models/Tools

Required?

Are Simulations

Using Models/Tools

Required?

Is All Required

Available?

Is All Required

Available?

Is Instrumentation

Required to CollectData?

Is Instrumentation

Required to CollectData?

Can Functionality Be Observed with Pass/Fail

Results?

Can Functionality Be Observed with Pass/Fail

Results?

Does Lower Level Data Need to Be

Reviewed for Compliance?

Does Lower Level Data Need to Be

Reviewed for Compliance?

SoS RequirementSoS Requirement

Simulation Analysis

Desktop AnalysisDesktop Analysis

Assessment Inspection

Assessment Inspection

Collector InspectionCollector

Inspection

Can Requirement

Be Completely Closed Without

Additional Analysis?

Can Requirement

Be Completely Closed Without

Additional Analysis?

TestTest

AA

AA

AA

Yes

No

Yes Yes

No

No

No

No

Yes Yes

YesNo

Yes

No

Yes Yes

No

Is Test Cost Effective?

Is Test Cost Effective?

Is Demo Cost Effective?

Is Demo Cost Effective?

No

Yes

YesAA

No

AA

Are

Simulations VV&A

For This Purpose?

Available

No

Are

Modify Sim?

Available to

No

Resources:$ and Time

Yes

Yes

Is Review of Lower

Level Data Sufficient?

Is Review of Lower

Level Data Sufficient?

Are Computations Using Lower Level Data

Req’d?

Are Computations Using Lower Level Data

Req’d?

Are Simulations

Using Models/Tools

Required?

Are Simulations

Using Models/Tools

Required?

Is All Required HW / SW /

Sims Available?

Is Instrumentation

Required to CollectData?

Is Instrumentation

Required to CollectData?

Can Functionality Be Observed with Pass/Fail

Results?

Can Functionality Be Observed with Pass/Fail

Results?

Does Lower Level Data Need to Be

Reviewed for Compliance?

Does Lower Level Data Need to Be

Reviewed for Compliance?

SoS RequirementSoS Requirement

Desktop AnalysisDesktop Analysis

Assessment Inspection

Assessment Inspection

Collector InspectionCollector

Inspection

Can Requirement

Be Completely Closed Without

Additional Analysis?

Can Requirement

Be Completely Closed Without

Additional Analysis?

TestTest

Demonstration

Can Requirement

Be Completely Closed Without

Additional Sim/DesktopAnalysis?

Can Requirement

Be Completely Closed Without

Additional Sim/DesktopAnalysis?

AA

AA

AA

Yes

No

Yes Yes

No

No

No

No

Yes Yes

YesNo

Yes

No

Yes Yes

No

Is Test Cost Effective?

Is Test Cost Effective?

Is Demo Cost Effective?

Is Demo Cost Effective?

No

Yes

AANo

AA

Is Review of Lower

Level Data Sufficient?

Is Review of Lower

Level Data Sufficient?

Are Computations Using Lower Level Data

Req’d?

Are Computations Using Lower Level Data

Req’d?

Are Simulations

Using Models/Tools

Required?

Are Simulations

Using Models/Tools

Required?

Is All Required

Available?

Is All Required

Available?

Is Instrumentation

Required to CollectData?

Is Instrumentation

Required to CollectData?

Can Functionality Be Observed with Pass/Fail

Results?

Can Functionality Be Observed with Pass/Fail

Results?

Does Lower Level Data Need to Be

Reviewed for Compliance?

Does Lower Level Data Need to Be

Reviewed for Compliance?

SoS RequirementSoS Requirement

Simulation Analysis

Desktop AnalysisDesktop Analysis

Assessment Inspection

Assessment Inspection

Collector InspectionCollector

Inspection

Can Requirement

Be Completely Closed Without

Additional Analysis?

Can Requirement

Be Completely Closed Without

Additional Analysis?

TestTest

AA

AA

AA

Yes

No

Yes Yes

No

No

No

No

Yes Yes

YesNo

Yes

No

Yes Yes

No

Is Test Cost Effective?

Is Test Cost Effective?

Is Demo Cost Effective?

Is Demo Cost Effective?

No

Yes

YesAA

No

AA

Are

Simulations VV&A

For This Purpose?

Available

No

Are

Modify Sim?

Available to

No

Resources:$ and Time

Yes

Yes

SIGs with T&V Leadership Ensure Each “shall” statement has initial

Verification Methods identified and captured in CRADLE

Section 4’s

Page 42: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

42

WWW.NASAWATCH.COM

VCNs

Sec 3 Sec 4

CARD

IRD

Sec 3 Sec 4

Sec 3 Sec 4

SRD(Element A)

Allocated Requirements

Sec 3 Sec 4

SRD(Element B)

Level 2

Level 2

Element AT&V Plans

Element AVCNs

Element BT&V Plans

Element B VCNs

JointVCNs

Bi-Lateral Integration Verif. Plans & BDEALS

Cx T&V Integration Verif. Plans

Level 3

Level 3

ICDs

VCNs

Level 2(Drawing

Level)

Level 2

SRD Sec. 3 call-outs to IRD

--

T

Joint

65

43

Side B Cradle

#

63

42

Side A Cradle

#

A

T

Verif. Method (Side B)

T

T

Verif. Method (Side A)

4.5.x

4.2.x

Side BSRD Ref.

4.3.x

4.1.x

Side ASRD Ref.

Verification Method & Implementation

60

40

Cradle Req. #

CEV and CLV Power Quality Interface

3.3.5.3

CEV and CLV Health and Status Data

3.3.4.1

Requirement Title/Subject

IRD Sec. 3 Paragraph

--

T

Joint

65

43

Side B Cradle

#

63

42

Side A Cradle

#

A

T

Verif. Method (Side B)

T

T

Verif. Method (Side A)

4.5.x

4.2.x

Side BSRD Ref.

4.3.x

4.1.x

Side ASRD Ref.

Verification Method & Implementation

60

40

Cradle Req. #

CEV and CLV Power Quality Interface

3.3.5.3

CEV and CLV Health and Status Data

3.3.4.1

Requirement Title/Subject

IRD Sec. 3 Paragraph

Level 2

IDD(Existing

System C)Level 2

Verification Methods & ImplementationRelative to CARD, IRDs, IDDs and SRDs

Verification Traceability, Methods and Data will

Reside in CRADLE

Page 43: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

43

WWW.NASAWATCH.COM

Interface Management

• The Interface Management Office:– Identifies necessary interface documentation

(IDD, IRD, etc.) for the element and/or module interface being discussed

– Assigns a Book Manager to manage the development of the requirements for that interface

• Work with the SIGs, Project Technical Experts and other groups to ensure the interface documentation is complete and accurate and that all interface issues are resolved

• Document and control the requirements and assure flow down to the various CxP and Project contractors and integrators

– Determines which interfaces are to be controlled at the CxP level through work with SIGs and other SE&I offices, along with the effected Projects.

• This includes assessment of cost impacts, risks, and benefits for either controlling or not controlling an interface

– Provides forum for interface requirements issue discussion, change evaluation and resolution via the ICWG

• Proposed interface changes may be identified by the Book Managers, the SIGs, interfacing Element technical experts, their respective contractors, and other Program participants

Key role of CxP SE&I is interface management across Projects

Generate Proposed Interface Document

Submit to ICWG Chair (with Interface Signatories signatures) for review / concurrence

Submit to Interface Signatories for review / concurrence

Incorporate ICWG approved IRN into initial release of interface document

Update interface document based on ICWG coordination recommendation

Submit issue to SECB for issue resolution

Submit ICWG approved document to SECB &/or CxCCB

Concurrence?

Resolution?

Update Required?

IRN?

2

Concurrence?

Conduct ICWG coordination with Interface Signatories (develop recommendation)

1

3

1

2

3

Yes

No

Against Baselined

Doc?

Yes

Yes

Yes

Yes Yes

No

No

No

No

No

Page 44: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

44

WWW.NASAWATCH.COM

Requirements Management

Chief Of Staff - Tech

Program Technical Integration Interface

Management

Analyses, Trades & Architecture

Horizontal IntegrationSE&I Director

Deputy

Program Review Integration

Modeling & Simulation

Prime Focus: - Cross Element I/F Def. & Contrl - Internal to Program - External to ProgramPrime Products: - IDDs - IRDs - MOUs - Interface Context Diagram - Interface Control Plan (ICP)Forcing Function: - Interface Control Working Grp

Prime Focus: - Lvl I/II & III Requirements - Functional ArchitecturePrime Products: - CARD - Lvl II Standards - Product Tree - Lvl II/III Document Tree - Program Requirements Tree - Functional Analyses: FFBDs, FAMs & N2 Diagms - Reqmts Mgmt Plan (REMP) - Traceability ReportsForcing Function: - Reqmts Working Group

Prime Focus: - Integrated Capability/Functionality Across Subsystems, Projects & MissionsPrime Products: - Highest Quality Requirements - Each Lead Assigned a set of CARD, IRD & Invoked Standards Reqmts - Reqmts Achievability Assessments - Risk Mitigation Plans - TPM Id & profiling - Optimized Integrated Designs - Commonality/Interoperability/”ilities”Forcing Function: - System Integration Groups (SIGs)

Prime Focus: - Integrated Analyses & Physical ArchitecturePrime Products: - Integrated Analyses Plan - ADD & RAD - Lvl II Trades - Prioritize/Integr Trades List/Plan - Level II & III - Performance Assessments - Gap ID & Mitigation - Validated Requirements Set - Risk Analyses - Support to Ops & APOForcing Function: - Analyses WG

Prime Focus: - Documented ProcessesPrime Products: - SEMP - Reqmts Mgmt Database - RID Tool Rqmts - TPM Tool Rqmts - Risk Assessment Tool Reqmts - Engineering Database - SE Metrics StandardizationForcing Function: - Mandatory Training & Audits - Organized NARs

Prime Focus: - SRR success then all CxP reviewsPrime Products: - Coordinated Entry/Exit Criteria - Integrated agenda/products/tools - SRR Plan – Including Integrated Level II & III planForcing Function: - Drives product readiness through “Pre-Boards” - Virtual Tag-ups with Stakeholders

Prime Focus: -Driving Technical Excellence -Major urgent Technical Issues

Drive Integrated Perform./ Efficiency/Effectiveness Across SE&I, CxPO and Centers

Lvl 3 ProjectSE&I Leads & Agency

Center SE&I Focals

Chief of Staff – Organization

Prime Focus: -Meeting Efficiencies/Focus-Cost, Sched & Action/Trng Tracking-Coordination w/ PP&C

Secretary

PP&C – Scheduling: Configuration Mgmt: Human Resources:Business Mgmt: Risk Mgmt:

Programmatic Integration Support

Approved: // Chris L. Hardcastle 4/2/06 //

SE Process, Tools, Metrics and Training

Prime Focus: - Program-wide approach & implementation of M&SPrime Products: - M&S Plans - M&S Tools/Standards - Integr M&S Products - Level II & III - Support to SIGs, ATA, T&V, APO & OpsForcing Function: - M&S WG

Key Processes in these SE&I Areas

Page 45: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

45

WWW.NASAWATCH.COM

Analysis Trades and Architecture (ATA)

•ATA manages the integrated analysis cycles and coordinates across Constellation program ensuring completeness of the requirements set

DAC PlanningAnalysis

Issue ResolutionDocumentation

Products•Master Analysis Plan & Schedule (MAPS)•Initialization Data List

Products•Analysis Reports & Master Summary (ARMS)•New Design Requirements•New Operations Scenarios

Products•Proposed Design or Operational Scenario Updates•Action Item Data Base•Integration Forum Minutes

Products•Analysis Results•Design Issues•Tool & Model Validation•Presentation of results

ReviewResults

DesignReferenceMissions

OperationsConcepts

SystemTechnicalBaseline

SystemRequirements

DAC Objectives

DAC PlanningProcurement

MasterAnalysis Plan

& Schedule(MAPS)

IntegratedSystem

PerformanceAssessments

IssueResolution

TradeStudies

Design Changes/

Ops Changes

DocumentResults

AnalysisProcurement

ReviewResults

DesignReferenceMissions

DesignReferenceMissions

OperationsConcepts

OperationsConcepts

SystemTechnicalBaseline

SystemTechnicalBaseline

SystemRequirements

SystemRequirements

DAC Objectives

DAC Objectives

DAC PlanningProcurementDAC PlanningProcurement

MasterAnalysis Plan

& Schedule(MAPS)

IntegratedSystem

PerformanceAssessments

IssueResolution

TradeStudies

Design Changes/

Ops Changes

DocumentResults

AnalysisProcurement

MCR/MDR SDR

PDR CDR

SRR

Mission DAC

Requirements DAC

SystemDAC

Preliminary

DAC #2Preliminary

DAC #1CriticalDAC #1

CriticalDAC #1

MCR/MDR SDR

PDR CDR

SRR

Mission DAC

Requirements DAC

SystemDAC

Preliminary

DAC #2Preliminary

DAC #1CriticalDAC #1

CriticalDAC #1

Analyses Working Group (AWG) Is “THE” integrating forcing function here – vertically Level 1 – 3 and horizontally (e.g. APO to SE&I)

Page 46: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

46

WWW.NASAWATCH.COM

Vertical and Horizontal Analysis Integration

ESMD

FPSIG

N&TSIG

SW&Avionics SIG

Thermal & ECLS SIG

∫ Power Loads… SIG

Environments & Constraints SIG

Supportability & Logistics, Reliability & Maintainability

Human Factors & Human Rating SIG

EVA Integration SIG

Gnd and Mssn Ops / Training SIG

Producability & Affordability SIG

C3I SIG

∫ Loads, Struct, Mech SIG

CE

V

CL

V

MS

GO

AP

O

OIG

T&

V

SR

&Q

A

EV

A

LS

AM

CxPO

The Constellation Analysis Working Group (CxAWG) integrates analysis efforts vertically from Level 1 to Level 3 and horizontally across Constellation

Page 47: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

47

WWW.NASAWATCH.COM

DAC/VAC Process

PlanningAnalysis &Model Val.

IssueResolution Documentation

Integration Forum - Horizontal Integration

TechnicalTeams

DAC/VACTeam

Generate &Coordinate

TDS’s

Perform Analysis(DAC/VAC)

Peer Reviews

Publish FinalReports

Publish Abstractsand Catalog

Final Reports

ValidateModels(VAC)

Perform Add’l.Analysis as

Necessary toResolve Issues

SubmitAnalysisAbstracts

Review &Coordinate TDS’s

Generate MasterAnalysis Plan &

Schedule (MAPS)Document

Review Analysisand Identify

Issues

ApproveModel/ToolCertification

CoordinateResolutionof Issues FRR

CoFR

VCNs

DAC/VAC Process

PlanningAnalysis &Model Val.

IssueResolution Documentation

Integration Forum - Horizontal Integration

TechnicalTeams

DAC/VACTeam

Generate &Coordinate

TDS’s

Perform Analysis(DAC/VAC)

Peer Reviews

Publish FinalReports

Publish Abstractsand Catalog

Final Reports

ValidateModels(VAC)

Perform Add’l.Analysis as

Necessary toResolve Issues

SubmitAnalysisAbstracts

Review &Coordinate TDS’s

Generate MasterAnalysis Plan &

Schedule (MAPS)Document

Review Analysisand Identify

Issues

ApproveModel/ToolCertification

CoordinateResolutionof Issues FRR

CoFR

VCNs

Analysis Trades and Architecture (ATA)

Analyses and Trades MUST be justifiable, prioritized, integrated and resourced such that Issues (TBDs, TBRs, etc.,) and Issues Resolution will be managed aggressively and efficiently

Page 48: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

48

WWW.NASAWATCH.COM

ATA Technical Issue Resolution Overview

Identify issueIdentify issue

•Design note

• Report

•Design note

• Report

Issue Resolution Documentation Type

• Assess• Categorize• Prioritize

• Assess• Categorize• Prioritize

Issue resolution database

Issue resolution database

IntegrationAWGAWG

IntegrationAWGAWG

Monitor progress via issue tracking database (metrics)Monitor progress via issue tracking database (metrics)

• TBD/TBR• Question• Problem• Decision• Definition• etc….

Issue resolution type

• Literature/expert search

• SME panel

• Analysis

• Trade study

Issue resolution type

• Literature/expert search

• SME panel

• Analysis

• Trade study

Assign resources &

Schedule

Assign resources &

Schedule

Executive ReviewsExecutive Reviews

Execute processExecute process

Tracking targeted in CradleTM

Baseline ChangeBaseline Change

Approval As Req’d:

SECB/CxCCBSECB/CxCCB

Approval As Req’d:

SECB/CxCCBSECB/CxCCB

“Not every issue” requires a big trade or analyses – All Need Burn-down Plans

Page 49: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

49

WWW.NASAWATCH.COM

Common TDS Format

• All Task Description Sheets (TDS) should be documented in the Constellation program’s format documented in the System Integration Analysis Plan (SIAP)

– This TDS format is being updated with “form date” and “priority”

• TDS will be numbered individually according to the organization with oversight

– Organization with oversight will place their acronym in front of their numbering system

– For example, CEV-[##], CLV-TS-[xx]-[###]

• TDS will be prioritized according to the following scheme,

Cx TDS Format

Page 50: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

50

WWW.NASAWATCH.COM

Integrated Modeling & Simulation

• Modeling and Simulations (M&S) are Integral to every aspect of the ESMD Program (Program > Projects > Elements)

– Planning – Requirements Definition– Technology Evaluation – Cost Analysis– Risk Assessments– Performance– Test and Verification– Training

• Effective Management of M&S has

several key Goals– Provide Timely Trusted Data for

Decision Makers– Reduce System Lifecycle Cost and

Risk• Better requirements, designs,

tests, training– Minimize Slips in Schedule

IM&S

–Spans All Phases of Analysis

Subjective Assessments• QFD• AHP• System Engineering Tools

Constructive Assessments• Cost – Complete Life-Cycle• Risk – Flight, Development, RMS• Conceptual / Prelim Engineering

Performance Capabilities

Operator in the Loop Assessments• Ground• Flight Sims• Crew• Data Rich Simulation & Visual

Hardware-in-the-Loop Assessments• Test Program Def & Refinement• Hardware & Software Testing• System Integration Modeling

In Service Operations Assessments• Operations Ramp-up Ramp-down• Upgrades and Improvements• Anomaly Resolution

Test

Operations

ManagementSystems Engineers

Systems EngineersSystem AnalystsOperators

Systems EngineersSystem AnalystsOperatorsDesignersManufacturers

Systems EngineersOperatorsDesignersManufacturersTest and Verification

Trades

Design

Analysis, Modeling and Simulation

support evolves throughout the

systems development life

cycle, supporting a wide range of

customers

IM&S

–Spans All Phases of Analysis

Subjective Assessments• QFD• AHP• System Engineering Tools

Constructive Assessments• Cost – Complete Life-Cycle• Risk – Flight, Development, RMS• Conceptual / Prelim Engineering

Performance Capabilities

Operator in the Loop Assessments• Ground• Flight Sims• Crew• Data Rich Simulation & Visual

Hardware-in-the-Loop Assessments• Test Program Def & Refinement• Hardware & Software Testing• System Integration Modeling

In Service Operations Assessments• Operations Ramp-up Ramp-down• Upgrades and Improvements• Anomaly Resolution

Test

Operations

ManagementSystems Engineers

Systems EngineersSystem AnalystsOperators

Systems EngineersSystem AnalystsOperatorsDesignersManufacturers

Systems EngineersOperatorsDesignersManufacturersTest and Verification

Trades

Design

Analysis, Modeling and Simulation

support evolves throughout the

systems development life

cycle, supporting a wide range of

customers

• Key Products:– Organizational “overlay” for M&S that provides integration function across CxPO (e.g.,

working groups, panels, etc.)– M&S Documentation (e.g., VV&A Policies, MSSPs, etc.)– M&S Standards (e.g., interoperability, data modeling, etc.)– M&S VV&A support– M&S Infrastructure:

• Modeling and Simulation Resource Repository

• Common Model Library• Vehicle Master Database

• Distributed simulation architecture (working w/ CIO)

– Data model definition and evolution– Integration of tools, models and simulations– Development of key “common” tools, models and simulations– Data presentation and visualization capabilities– Forum for addressing M&S interactions with contractors– M&S expertise for reviewing proposals, DPDs, etc.

Institutionalizing M&S Management Practices Early is Critical to long-term Success

Page 51: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

51

WWW.NASAWATCH.COMCxP IM&S Strategy Concept of Operation

IM&S Policy

IM&S VV&A Policy

IM&S Strategy

IM&S VV&AProcess

IM&SStrategy

:• Environments• Element Sims• Common SW Library• Common Component Sims (Thrusters, Engines, etc.)

IM&S SW & Tools are shared across entire ESMD Community

Systems Level IM&SSystems Level IM&S

IM&S Guidance -

CLV SIL SW & ToolsDevelopment, Management, & Use

CEV SIL SW & ToolsDevelopment, Management, & Use

iSIL SW & ToolsDevelopment, Management, & Use

GSS SIL SW & ToolsDevelopment, Management, & Use

Modeling & Simulation Resource Repository (MSRR)

IM&S Strategy [ Level - 1 ]

[ Level - 2 ]

[ Level - 3 ]Element Level IM&SElement Level IM&S

Centralized Guidance De-centralized IM&S Development, Use, & Execution

CEV IM&S

CLV IM&S

GSS IM&S

VV&A

VV&A

VV&A

IM&S Common Resource Repository

- Systems Engineering for Element-Level- SIL Development & Use- Engineering Analysis

ELEMENT STAKEHOLDERS

- Systems Engineering for Mission-Level

- Integrated SIL (iSIL) Development & Use

- Systems Analysis

SYSTEM STAKEHOLDERS

[ Level - 2 ]

M&SStandards

CEV M&SSupportPlan

CLV M&SSupportPlan

IM&SSupportPlan

[ Level - 1 ]- Architecture Trades- M&S Technology Development- M&S Tool Development

ESMD STAKEHOLDERSESMD IM&S

M&S and ToolsDevelopment, VV&A

GSS M&SSupportPlan

VV&A

IM&SSupportPlan

Page 52: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

52

WWW.NASAWATCH.COMIntegrated Modeling & Simulation FY05 Capabilities

GEOMETRY

AEROTHERMAL

TRAJECTORY

TPS

ANALYSIS DISCIPLINE

CEV Final Approach to Dock

CEV ProximityOperations

Risk ModelingCapability

GroundProcessingSimulations

Disciplinary Design/Analysis Capability

Page 53: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

53

WWW.NASAWATCH.COM

ESMD IM&SManagement

Policy

ESMDIM&S

Strategy

ESMDIM&S

Glossary

ESMDIM&S

ConOps

ESMD IM&SVV&A Policy

ESMD IM&SVV&A

Strategy

ESMD IM&S Accreditation Plan,

Report Process& Specification

ESMD IM&S VV&A V&V Plan &

Process SpecificationESMD MSRR

ImplementationPlan

ESMD IM&SImplementation

Plan

CS IM&SImplementation

Plan

CSMSSP

CS iSILConOps

CEV IM&SImplementation

Plan

CLV IM&SImplementation

Plan

CEVMSSP

CEV LASMSSP Annex

CEV CMMSSP Annex

CEV SMMSSP Annex

CEV Vehicle IntegrationMSSP Annex

CLVMSSP

CLV 1st StageMSSP Annex

CLV Upper StageMSSP Annex

CLV US EngineMSSP Annex

CLV Vehicle IntegrationMSSP Annex

ESMDRisk ManagementPlan IM&S Section

CSRisk ManagementPlan IM&S Section

CLVRisk ManagementPlan IM&S Section

ESMD IM&SMSSP

CEV SILConOps

CLV SILConOps

CEVRisk ManagementPlan IM&S Section

Development Responsibility Unknown

ESMD IM&SStrategy Executive

Summary

Level 1ESMD

Level 2ConstellationSystems (CS)

Level 3Elements

Level 4Subsystems

ESMD Risk Management

Plan

ESMD IM&S Requirements

Document

ESMD MSRRRequirements

Document

CEV SILRequirements

Document

CEV LASSIL Requirements

Document

CEV CMSIL Requirements

Document

CEV SMSIL Requirements

Document

CS iSILRequirements

Document

CLV SILRequirements

Document

CLV LASSIL Requirements

Document

CLV CMSIL Requirements

Document

CLV SMSIL Requirements

Document

CS IM&S Requirements

Document

CLV IM&S Requirements

Document

CEV IM&SRequirements

Document

IM&S Documentation Tree(Proposed and in coordination)

CxP MV&VI Plan& Child Doc.

Page 54: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

54

WWW.NASAWATCH.COM

IM&S Approach

• Establish a Unified Paradigm for the Management and Use of M&S throughout CxP based on Lessons Learned from DoD and industry– Centralized Guidance with Decentralized Execution to:

• Define Policies (M&S and VV&A) • Define Standards (e.g. interface, interoperability, data)

– Continue support to Chief Engineer’s effort in developing a NASA M&S Standard

• Develop M&S Management Roles/Responsibilities to be integrated with existing CxPO Management Structures

• Develop CxPO and Require Projects to Develop M&S Support Plans– Document the Use of M&S in support of Program and Project Level Activities– Identify M&S Gaps and Overlaps to support future development

needs/priorities– Mandate Risk Based VV&A Implementation – 3 Levels (High risk = significant

VV&A)• Facilitate Communication of M&S Capabilities across CxP through an M&S

Resource Repository (Metadata of accredited M&S)• Involve Program/Project Stakeholders in Establishing the IM&S Strategy

Establish Effective and Streamlined Management of M&S across CxP

Page 55: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

55

WWW.NASAWATCH.COM

IM&S Approach (Cont.)

• Establish a M&S Investment Strategy to maximize utility of M&S– Utilize common tools were appropriate

• Collaboration tools• Systems engineering tools• Data management tools• Data Presentation

– Minimize development of new capabilities and focus on integration of existing capabilities

• Modify existing capabilities when required• Development likely required in “-ilities” models• All development will be based upon explicit and documented requirements from

stakeholders– Utilize existing infrastructure and work with CIO on necessary fixes and improvements

• CEEs• NISN• Windchill• CRADLE

• Provide single conduit for M&S definition and interaction with CxPO and project contractors

Establish Effective and Streamlined Management of M&S across CxP

Page 56: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

56

WWW.NASAWATCH.COM

Constellation IM&SImplementing the Strategy

ESMD/Constellation

M&SDon Monell

Test and VerificationBill Arceneaux

Steering Group Outreach Panels/Boards Level 3

M&S Strategy

ModelsWGs

CLV CEV

External Relationships

Center Outreach

POCs

Up-Reach

Policy

Strategy

Implementation

IM&S Panel

SIL WG VV&A WG

Prog Tech IntSteve Fitzgerald

Reqmts MgmtKeith Williams

Interface MgmtM. Digiuseppe

Analyses, TradesArchitecture

Neil Lemmons

SE Process, Tools,Metrics, Training

TBD

SE&IC. Hardcastle/S. Meacham

M&S Policy

M&S StrategyM&S Strategy

Services Reqmts.

Strategy Implementation – NOT Services or Products Provided

M&S StrategyM&S Strategy

LMS …

Page 57: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

57

WWW.NASAWATCH.COM

Requirements Management

Chief Of Staff - Tech

Program Technical Integration Interface

Management

Analyses, Trades & Architecture

Horizontal IntegrationSE&I Director

Deputy

Program Review Integration

Modeling & Simulation

Prime Focus: - Cross Element I/F Def. & Contrl - Internal to Program - External to ProgramPrime Products: - IDDs - IRDs - MOUs - Interface Context Diagram - Interface Control Plan (ICP)Forcing Function: - Interface Control Working Grp

Prime Focus: - Lvl I/II & III Requirements - Functional ArchitecturePrime Products: - CARD - Lvl II Standards - Product Tree - Lvl II/III Document Tree - Program Requirements Tree - Functional Analyses: FFBDs, FAMs & N2 Diagms - Reqmts Mgmt Plan (REMP) - Traceability ReportsForcing Function: - Reqmts Working Group

Prime Focus: - Integrated Capability/Functionality Across Subsystems, Projects & MissionsPrime Products: - Highest Quality Requirements - Each Lead Assigned a set of CARD, IRD & Invoked Standards Reqmts - Reqmts Achievability Assessments - Risk Mitigation Plans - TPM Id & profiling - Optimized Integrated Designs - Commonality/Interoperability/”ilities”Forcing Function: - System Integration Groups (SIGs)

Prime Focus: - Integrated Analyses & Physical ArchitecturePrime Products: - Integrated Analyses Plan - ADD & RAD - Lvl II Trades - Prioritize/Integr Trades List/Plan - Level II & III - Performance Assessments - Gap ID & Mitigation - Validated Requirements Set - Risk Analyses - Support to Ops & APOForcing Function: - Analyses WG

Prime Focus: - Documented ProcessesPrime Products: - SEMP - Reqmts Mgmt Database - RID Tool Rqmts - TPM Tool Rqmts - Risk Assessment Tool Reqmts - Engineering Database - SE Metrics StandardizationForcing Function: - Mandatory Training & Audits - Organized NARs

Prime Focus: - SRR success then all CxP reviewsPrime Products: - Coordinated Entry/Exit Criteria - Integrated agenda/products/tools - SRR Plan – Including Integrated Level II & III planForcing Function: - Drives product readiness through “Pre-Boards” - Virtual Tag-ups with Stakeholders

Prime Focus: -Driving Technical Excellence -Major urgent Technical Issues

Drive Integrated Perform./ Efficiency/Effectiveness Across SE&I, CxPO and Centers

Lvl 3 ProjectSE&I Leads & Agency

Center SE&I Focals

Chief of Staff – Organization

Prime Focus: -Meeting Efficiencies/Focus-Cost, Sched & Action/Trng Tracking-Coordination w/ PP&C

Secretary

PP&C – Scheduling: Configuration Mgmt: Human Resources:Business Mgmt: Risk Mgmt:

Programmatic Integration Support

Approved: // Chris L. Hardcastle 4/2/06 //

SE Process, Tools, Metrics and Training

Prime Focus: - Program-wide approach & implementation of M&SPrime Products: - M&S Plans - M&S Tools/Standards - Integr M&S Products - Level II & III - Support to SIGs, ATA, T&V, APO & OpsForcing Function: - M&S WG

Key Processes in these SE&I Areas

Page 58: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

58

WWW.NASAWATCH.COM

CxPO Collaborative Environment

• SE Environment– Standards– Governance / Management– Training & Education

• SE Technical Development– Requirements Engineering– Functional Definition– Design Synthesis– Verification and Validation (V&V)

• SE Management– Program & Project Planning & Control– Cost & Schedule– Decision-making & Risk Management

• SE Information Management– Workflow Management– Configuration Management– Team Collaboration Support– Knowledge Management– Decision Analysis Support

Blue text shows shared responsibilities across CxPO

Systems Engineering

Technical Development

System Engineering

Management

CSE

Systems EngineeringInformation

Management

Collaboration SE Environment

(CxP

Cube )

T&V SRQ&A

CxP Program

CxP SE&I

SE &I Integrated

Master Schedule

SIGS

RM

IM

ATA

SEP

SIAP

SEMP

Integrated Information

Systems

CradleICE

Windchill

MISSION OPS APO

SE Management

SE Information Management

SE Technical Development

Enterprise Architecture

Business Management

Plan

RMP

ICP

ARMRID

TPM

SE&I needs to Lead Collaborative Technical Integration

Page 59: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

59

WWW.NASAWATCH.COM

Cradle CS SEI “Dual Vee” Process Model

Cx LogicalAnalysis

Cx Mission Requirements

Cx DesignSynthesis

Cx Functional analysis

ElementTestElement

Synthesis Element V&V

Cx SEManagement

Cx Analysis& Simulation

Cx Test

Cx Verification

Cx Validation

Cx Ops

Cx Process Control

CRADLE Schema and Design Key To Our Collective and Collaborative

Success

Page 60: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

60

WWW.NASAWATCH.COM

CxP SE&I Process, Methods, Tools & Environment (PMTE)

. ________

. ________

. ________

. ________

. ________

. ________

. ________

. ________

. ________

. ________

. ________

. ________

. ________

. ________ NASA Management

SE&I Team Level III Teams

& Contractors Suppliers Facilitators/

Subject Matter Experts (SMEs)

.

.

Management Mgmt Guides & Procedures

WBS, Plans Workflows Issues, Risk

Facilitated, Collaborative Execution – Facilitated, Collaborative Execution – Throughout CxP Program LifeCycleThroughout CxP Program LifeCycle

Integrated Integrated NASA IT NASA IT

OperationsOperations

Process

Coordination

Check Pts

EndStart

Start

Start

End

End

Process Process

Level IV

Level II SE & I

Level III SE&I

MonthWeek 3 10 17 24 1 8 15 22 29 5 12 19 26 3 10 17

1. Mgmt Innovation Report2. Initial Comm Events 3. Follow-on Comm Events 4. Deployment Readiness Comm Events 5. Training & Education Events

OctoberSeptember November DecemberMonthWeek 3 10 17 24 1 8 15 22 29 5 12 19 26 3 10 17

1. Mgmt Innovation Report2. Initial Comm Events 3. Follow-on Comm Events 4. Deployment Readiness Comm Events 5. Training & Education Events

OctoberSeptember November DecemberMonthWeek 3 10 17 24 1 8 15 22 29 5 12 19 26 3 10 17

1. Mgmt Innovation Report2. Initial Comm Events 3. Follow-on Comm Events 4. Deployment Readiness Comm Events 5. Training & Education Events

OctoberSeptember November December

MethodsMethods

Policies Guideline

s Template

s Checklists

ToolsTools Cradle / RM / PM /

S&MA Windchill PDM

& Workflow Apps Webinars Process Facilitation Webinar / Help Desk Self-Serve Support

Page 61: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

61

WWW.NASAWATCH.COM

Training & Education for SE&I Capability Build

Continuous Process Improvement Lessons-learned

improvements Progressive automation Expanded selection & scope

of applications Extension to include all

stakeholders

NASA Management

SE&I Team Level III &

Contractor Teams Process

Facilitators, SMEs, and Design & Management Help Desk Support

Web-Based Web-Based Training & Support Training & Support

NetworkNetwork. ________. ________. ________. ________. ________. ________. _______

Management Mgmt

Guides & Procedures

WBS, Plans Workflows Issues,

Risk

Process

Methods DatabaseMethods Database

Policies Guideline

s Template

s Checklist

s

Training Apps & Training Apps & Information ServersInformation Servers

Webinars Process

Materials Interactive

Help Desk Self-Serve

Training & Support

In-Process Facilitation, Training & Guidance Partnership of NASA &

subcontracted SE&I Process & functional experts

Expert / Apprentice based work assignments for cultivating NASA next-generation SE&I leadership & practitioners

Interactive Webinar and Self-Service Training & Performance Support Systems

On-Line, interactive system supported Help Desk

.

.

. ________

. ________

. ________

. ________

. ________

. ________

. ________

Page 62: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

62

WWW.NASAWATCH.COM

CxP Near-term SE&I Process Roadmap

Cradle/PM WindChill

PDM& Workflow Apps

Phase 2Web-automated process, methods, and infrastructure

NASA Management SE&I Team Level III Teams &

Contractors Facilitators/SMEs Manufacturing Suppliers Future Customers

Process Policies Guidelin

es Templat

es Checklis

ts

. ________. ________. ________. ________. ________. ________. ________

. ________. ________. ________. ________. ________. ________. ________

..

Management Mgmt Guides & Procedures

WBS, Plans

Workflows

Issues, Risk

Web automated Webinars and self-serve SE&I screening, training process facilitation – Build SE Profession

Phase 3 Web-Based Collaborative Design & Process Environment

Expanded access via portal to process, methods, tools; expansion of design, and process self-serve resources to expanding group of stakeholders in sync with expanding program scope & life cycle

Webinars Process Facilitation Webinar/Help Desk Self-Serve Support

. ________. ________. ________. ________. ________. ________. ________

. ________. ________. ________. ________. ________. ________. ________

New core systems & applications and legacy systems with workarounds for new process, methods, workflows, etc.

Policies Guideline

s Template

s Checklist

s

Phase 1 Quick-Start Process: Rapid methods, and infrastructure build

“Paper-based” methods for Initial program activities & pre-automation pilots (Cradle, WindChill & others

Pre-Web Automation: Training and work-sessions conducted for SE&I staffing, training & facilitation, and subject matter experts (SME) support activities; no Web based self serve yet!

Web-IntegratedHelpdesk with design andprocess support

Web-accessible portal for automated process, methods, workflows, & training

SRR SDR PDR

Page 63: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

63

WWW.NASAWATCH.COM

Constellation Analysis and Requirements Traceability (CART)Will facilitate id of “requirements-focused” risks, prioritized TPMs & mitigation plans

Major Objectives of CART:• Provide process and disciplined approach to assess, document, and trace

Constellation requirement achievability through the life of the program • Use existing processes and systems such as Cradle and ARM as basis to provide

visibility for requirement traceability, achievability, and risk management based on cost, schedule, and technical performance criteria

• Provide systematic means to account for the time sensitivity of Constellation requirement achievability and proactively manage program and group level risk

CART highlights technical performance achievability and impact of design compliance gaps / risks

Requirement Achievability AssessmentsBased on three Components: Structure, Criticality , Achievability

Links depicted in this diagram are for illustrative purposes only and may not represent permissible linkages

I.2 II.2III.2 PIDS

II.1

II.3

III.1

III.3

I.1

I.3

PIDS

PIDS

Constraints and Interfaces

SubOrbital

FT

I.4

From a requirements perspective, CART Achievability Analysis is based on:• Structure ( “requirements trace ” established in Cradle)

• Team effort led by SIG Leaders and integration groups • Criticality (focus on critical requirements in each trace)

• Criticality of high level requirements determined by appropriat e managers• Criticality of supporting requirements determined by TILs & supporting integration groups

• Achievability (Compliance Likelihood (low, medium, high) for Performance, Schedule, Affordability )

? Tier I Achievabilitybased on assessments of critical supporting Tier II requirements? Tier II achievabilitybased on assessments of critical supporting Tier III requirements

? Tier III achievabilitybased on assessments of critical supporting PIDS to include compliance with all constraints and interfaces

“Compliance Likelihood”Categories for Achieving Threshold Performance Specifications, On Schedule

and Budget

•Verified – Met or Exceeded Threshold Requirement

•Achievable - High Likelihood of Compliance > 80%

•Medium Likelihood of Compliance 50-80%

•Low Likelihood of Compliance < 50%

•Requirement is not feasible

3

Requirement is Unassessed "Gray"

Requirement has not yet been assessed (default Cradle value)

Requirement is Not Feasible "Black"

No technical solution exists X = 0%

Low Likelihood of Compliance "Red"

Requirement understanding, technology, or system integration issues will most likely impact delivery of

performance X < 50%

Medium Likelihood of Compliance "Yellow"

Requirement understanding, technology, or system integration issues may impact delivery of

performance 50 % < X < 80%

High Likelihood of Compliance "Green"

Requirement is well understood. Technology, schedule and budget are in place to meet

requirement performance 80 % < X < 100%

Requirement performance is Compliant: Tested and verified

"Blue"

Requirement has met or exceeded required performance levels X = 100%

Likelihood of Compliance Defined as probability of meeting requirement performance specification on schedule

and within budget

CART Methodology

• Requirement criticality derived from parent traces• Appropriate risk mitigation process based on likelihood of compliance and criticality

“Critical” Requirement Categories: From the programs perspective: C1: Unacceptable impact to Constellation Program C2: Potential major impact to the Constellation Program C3: Potential moderate impact to the Constellation Program C4: Potential minimal to no impact to the Constellation Program

Need to map these criticality categories to existing NASA processes if they exist and are appropriate

CONSEQUENCE

54321

1

2

3

4

5LIKELIHOOD

Risk Matrix

Reqmts Achievability

Page 64: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

64

WWW.NASAWATCH.COM

Update TPM Filter to ensure current TPMs are linked to and

driven primarily by requirements of either “High

Criticality” &/or “at risk relative to achievability” as determined via Achievability Assessment

process involving SIGs

Process filter used to establish need for Technical Performance Measures (TPMs)

Is the proposed TPM a SoSS, PIDS, CI, or PCD requirement?

Is there a performance, schedule or affordability risk

associated with this requirement; or the potential

to develop these risks exist?

Is the requirement quantifiable? a. Numerical thresholds exist andb. Method to incrementally measure

performance exist andc. Inputs are available and d. Can be updated monthly

Is requirement metric predictable and responsive to

design changes?

Yes

Begin TPM development

process

Yes

Yes

Should the functionality represented by this proposed

TPM result in a new SoSS requirement?

Place proposed functionality into

FD/FA process and create a new requirement.

Is this TPM required by management to monitor a

program management issue such as affordability?

Is the requirement mission critical or critical to program

success?

YesYes

Additional justificationrequired to

establish a TPM

Yes

No No No

No

No

No

Is the proposed TPM a SoSS, PIDS, CI, or PCD requirement?

Is there a performance, schedule or affordability risk

associated with this requirement; or the potential

to develop these risks exist?

Is the requirement quantifiable? a. Numerical thresholds exist andb. Method to incrementally measure

performance exist andc. Inputs are available and d. Can be updated monthly

Is requirement metric predictable and responsive to

design changes?

Yes

Begin TPM development

process

Yes

Yes

Should the functionality represented by this proposed

TPM result in a new SoSS requirement?

Place proposed functionality into

FD/FA process and create a new requirement.

Is this TPM required by management to monitor a

program management issue such as affordability?

Is the requirement mission critical or critical to program

success?

YesYes

Additional justificationrequired to

establish a TPM

Yes

No No No

No

No

No

CARD, SRD, IRD Requirement ?

Page 65: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

65

WWW.NASAWATCH.COM

Board and Working Group Structures (1 of 2)

ISS Mission

Management

Team (MMT)

ISS Mission Management

Team (MMT)

Cx System Engineering Control

Board

(CxSECB )

Cx System Engineering Control

Board

(CxSECB )

CxSoftware

Control Panel

(CxSCP )

CxSoftware

Control Panel

(CxSCP )

Constellation Program Control

Board(CxCB )

Constellation Program Control

Board(CxCB )

Range Safety

Panels(LCRSP &

ECRSP)

Range Safety

Panels(LCRSP &

ECRSP)

Daily Mission

Integration Control Board

(DMICB)

Integrated Safety

Engineering

Review Panel(ISERP)

Integrated Safety

Engineering

Review Panel(ISERP)

Cx Safety

and Mission Assurance

Panel

(Cx SMAP)

CxOperations

Panel(CxOP )

CxOperations

Panel(CxOP )

Joint SSP/ISS Cx Program

Requirements Control Board

(JPRCB)

Joint SSP/ISS Cx Program

Requirements Control Board

(JPRCB)

Joint ISS/ CxMission

Integration

Control Board(JMICB )

Joint ISS/ CxMission

Integration

Control Board(JMICB )

Flight Operations

Control

Board(FOCB)

Flight Operations

Control

Board(FOCB)

Figure 3.1 -3

Lvl IIIControl

Boards Relative to

Safety

Lvl IIIControl

Boards Relative to

Safety

If it drives

Requirements or Designs

Lvl IIIControl

Boards Relative to H/W & S/W

Lvl IIIControl

Boards Relative to H/W & S/W

Lvl IIIControl Boards

Relative to Operations

Lvl IIIControl Boards

Relative to Operations

SE&I

T&V

Ops Integration

SR&QA

PP&C

Project

APO

Apollo, Shuttle and ISS Boards, Panels and Working Groups Reviewed in developing this recommend approach – Note that Chief Engineers, by charter,

have been incorporated into the Control Boards

Page 66: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

66

WWW.NASAWATCH.COM

Software Interoperability

& ReuseSIG

Software Interoperability

& ReuseSIG

Software Interoperability

& ReuseSIG

Software Interoperability

& ReuseSIG

Software Interoperability

& ReuseSIG

SIGs

CxAnalyses Working Group

(CxAWG )

CxAnalyses Working Group

(CxAWG )

CxSECB CxSoftware Control Panel

(CxSCP)

CxConfiguration Mgt. Control

Working Group(CxCMCWG )

CxConfiguration Mgt. Control

Working Group(CxCMCWG )

Cx Interface Control Working Group

(CxICWG )

Cx Interface Control Working Group

(CxICWG )

CxRequirements

Working Group

(CxRWG )

CxRequirements

Working Group

(CxRWG )

Board and Working Group Structures (2 of 2)

SECB is intended to help facilitate control of the Technical BaselineHistory has shown “fluid” technical baselines on the front-end of large-scale

DDT&E Programs can be detrimental

Page 67: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

67

WWW.NASAWATCH.COM

Example Relationships for Level II Controlled Requirements

Joint SSP/ISS Cx Program

Requirements Control Board

(JPRCB)

Cx Requirements

Working Group

(CxRWG)

Cx Analyses Working Group

(CxAWG)

Cx Interface Control Working Group

(CxICWG)

Cx Interface Control Working Group

(CxICWG)

Co-Chair: Keith Williams (CxSE&I RMO)Co-Chair: Jonette Stecklein (CxT&V)Cx Operations IntegrationCx Safety, Reliability & Quality Assurance (SR&QA)Cx Advance Projects Office (APO)Cx Program Technical IntegrationCx ATACx IMOAstronaut OfficeISS ProgramCx ProjectsESMD HQ

Stakeholders & Recommendations from other Constellation Boards, Panels, and Working Groups

• Cx Operations Integration (CxOP)

• Cx Safety, Reliability & Quality Assurance (SR&QA)

• Cx Advance Projects Office (APO)

• Cx Program Technical Integration (SIGs)

• Astronaut Office• ISS Program• Cx Projects (Level 3 Control

Boards)• ESMD HQ

Interface is through established representatives already on the CxRWG

Stakeholders & Recommendations from other Constellation Boards, Panels, and Working Groups

• Cx Operations Integration (CxOP)

• Cx Safety, Reliability & Quality Assurance (SR&QA)

• Cx Advance Projects Office (APO)

• Cx Program Technical Integration (SIGs)

• Astronaut Office• ISS Program• Cx Projects (Level 3 Control

Boards)• ESMD HQ

Interface is through established representatives already on the CxRWG

• Proposed Rqmts changes• Impacts associated with Rqmts changes• Comments on Drafts

• Drafts for Comment• Proposed Rqmts changes

Analysis Requests

Analysis Requests

CARD/SRDs for I/F IntgCARD/SRDs impacts for I/F Intg

Rqmts Changes &Impacts

Technical DirectionChange Approval

Constellation Program

Control Board

(CxCB)

Cx Systems Engineering

Control Board

(CxSECB)

Rqmts Changes &Impacts

Technical DirectionChange Approval

Page 68: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

68

WWW.NASAWATCH.COM

CxPO SE&I 3P Overview

• CY06 Challenges & Schedule Ahead– Execute ICPR and apply results & Lessons Learned to Enhancing Product

Maturities in Priority Order to minimize Program risks at CxP SRR and subsequent Project SRRs

• Roughly 30 Engineering Artifacts (products) being reviewed as a part of ICPR• Roughly 87 Engineering Artifacts to be reviewed leading into and through CxP SRR• The 30 ICPR initial products plus the balance of 57 additional products are all being

looked at relative to:– Priority (based on potential impacts to Projects)– Maturity Required at CxP SRR

– Enhancing the Level II Requirements coming off of ICPR & Cx SECB Project-by-Project “Key Driving Requirements, Reqmts Quality & Gap” presentations in April

• RID/Comment disposition and factoring into May/June/July/August plan• Consolidating SECB findings to facilitate priority setting for work to CxP SRR• Initiating IDAC2 effort to address big issues, TBD & TBRs• Conducting May Functional Analyses Workshop #2 and incorporating results• Conduct intense 10 ten day continuous Requirements F2F session (May 30 – Jun 9)

– Emphasis on Quality of Requirements & Verification• Incorporating results of Follow-on Functional Analyses & IDAC2 Results into

Requirements Set Just-In-Time (JIT) for CxP SRR– Continuing to execute aggressively while staffing smartly

• Training this nation-wide virtual workforce on the tools (e.g., CRADLE, TPMs, ARM, CART, Primavera, Windchill/ICE) and the processes (SE&I, CM/DM, T&V, SR&QA) is crucial to our longer-term technical, cost and schedule performance

2

CxPO SE&I 3P Overview

Agenda• People

– Organizational Overview– Current Leadership Profile

• Systems Integration Groups (SIGs)

– Agency-wide Staffing Situation• Products

– Near-Term Requirements -Focused Product Line• CxP-allocated NGOs, Level I -allocated Requirements, CARD, IRDs , IDDs , Invoked Standards,

Operational Concepts, FFBDs , FAMs , N2 Diagrams, Reference Architecture, Trade/Analyses results, SRDs, Requirements Achievability Assessments, Technical Performance Measures, Technical Risk Mitigation Plans, Traceability Reports

– Long-term Program-wide Technical Integration Foundation Products• Cx Program Plan, Policy, Process & Strategy Documents

• Processes– Requirements & Interface Management Processes– RAC, DAC & VAC – Analyses/Trades Processes– Emerging Program Boards, Panels & WGs Structure/Process

• CY06 Challenges• Backup – Recommended May “Requirements Face-to-Face (F2F)”

Page 69: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

69

WWW.NASAWATCH.COM

RID-able products

ICPR Board(CxCB)

Pre-Board(SECB)

RRP ARP pTIP ICRP

CARD

MVIVP

REMP

NGO

RAD

SIAP

C3I Strategy Plan

DSNE

HSIR

Support Concept Document

Software Management

and Policies Plan

ICP

IRDs

SR&QARP

PP&CRP

SR&QA Plan

RMP

PRA

CMP

DMP

PMP

WBS

IMS

Process and Tools

CxOIP

MMP

SRR Annex 2

SEMP

Document Tree

CRADLE Database

Scheme Plan

Ops Con

C3I Interoperability

Plan

HRPRequirements

Tree

Glossary

SRD’s

Board or Panel

Available for Review

RID Disposition Teams & ICPR products

RID Disposition

Team

Base-lined Prior to SRR

30 Artifacts forming a subset of the 87 targeted for CxP SRR

Page 70: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

70

WWW.NASAWATCH.COM

ICPR Emerging Metrics

Page 71: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

71

WWW.NASAWATCH.COM

ICPR

KickOff Pgrm Doc’s under SE Control

April May June July Aug. Sept.

Baseline Doc # SRR

CARD, Invoked Standards, IRDs & SRDs Focus Flow

ICPR Board

Level II Requirements Enhancement Focus

ICPR Review Results

Projects ID “Key Driving” Requirements**Level II Post-ICPR Requirements Update + Functional

Analyses Workshop #2Level II “hosted” Requirements “Face-to-Face”Enhancement session – two weeks straight

** Note factoring in SMART Buyer for CEV – via Presentations to SECB Apr 6th

F2F Virtual Follow-on

Factor in IDAC2 Midterm& Functional Analysis WS #3

Factor in IDAC2 Final& Functional Analysis

F2F Homework

SE&I derived Integrated Schedule (~3000 line items) shows approximately a four week threat to this plan – one of the success

criteria for ICPR is to finalize/reconcile this schedule

Page 72: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

72

WWW.NASAWATCH.COM

High Level Requirements Development ScheduleW

K1

WK

2

WK

3

WK

4

Apr

WK

1

WK

2

WK

3

WK

4

May

WK

1

WK

2

WK

3

WK

4

Jun

WK

1

WK

2

WK

3

WK

4

Jul

WK

1

WK

2

WK

3

WK

4

Aug

WK

1

WK

2

WK

3

WK

4

Sep

WK

1

WK

2

WK

3

WK

4

Oct

WK

1

WK

2

WK

3

WK

4

Nov

WK

1

WK

2

WK

3

WK

4

Dec

Key

C

on

stel

lati

on

Mile

sto

nes

ICPR

IDAC 2

Driving Requirements

SRR

Req

uir

emen

tsD

evel

op

men

tF

un

ctio

nal

A

nal

ysis

Cycle 1 Arch

Vehicle

POP Results

Ops

Arch

Vehicle

Ops

F2F/Arch

Vehicle

Ops

Arch

Vehicle

Ops

Project SRRs

W/S #2 W/S #3

Page 73: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

73

WWW.NASAWATCH.COM

IDAC-2 Objectives

•The main goal of IDAC-2 is to provide necessary and sufficient analysis results to mature requirements and resolve technical issues necessary for a successful the Constellation Systems Requirements Review (SRR)

•IDAC-2 Objectives– Resolve TBD and TBR in the requirements documents– Determine feasibility and validity of the systems requirements– Develop requirements baseline that supports mission objectives

RAC 1

D J F M M J JA A S O N D J FD J F M M J JA A S O N D J F

Analysis Cycles to SRR2005 2006

CxP

2007

Cx SRRIPSRIPSR

FY06 FY07

IDAC -2

Doc

Sel Plan

Cx ICPR

Sel PlanApprovalApproval

SRR

Doc

ICPR

CEVNASA

Mgt Decisions

CRC 1 1A CEV RAC 2CRC 2

Mid -term

CEV RAC 2A

Doc CEV SRR

IDAC -3

CLV DAC -1 Doc CLV SRRCLV

Page 74: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

74

WWW.NASAWATCH.COM

Constellation IDAC-2 Scope

• Lunar Sortie (Excluding Surface Operations) Mission– Covers Lunar sortie missions through lunar landing and return – Excludes lunar surface operations– Includes: Crew Exploration Vehicle (CEV), Crew Launch Vehicle (CLV), Cargo Launch Vehicle

(CaLV), Lunar Surface Access Module (LSAM) (portions), lunar cargo carrier (portions), Extravehicular Activity (EVA) (portions), Ground Operations (portions), Mission Systems (portions)

• ISS Crew Rotation and Pressurized Cargo Mission– Covers ISS missions including crew rotation, pressurized cargo delivery, and pressurized

cargo return– Includes: Crew Exploration Vehicle (CEV), Crew Launch Vehicle (CLV), Cargo Launch Vehicle

(CaLV), Extravehicular Activity (EVA) (portions), Ground Operations (portions), Mission Systems (portions)

• Lunar Sortie (Full Surface Operations) Mission– Covers Lunar Sortie Missions including Sortie: surface operations, habitation, surface

transportation, science, and utilization– Includes: LSAM, lunar cargo carrier, lunar portions of Destination Surface Systems (DSS),

EVA (portions), Ground Ops, Mission Systems (MS) (portions), comm function (portions)

• Lunar Outpost Mission– Covers the Lunar Outpost Missions including Lunar Outpost: surface operations, habitation,

surface transportation, science, and utilization

• Mars Mission– Covers the Mars missions. – Includes: Mars CEV or equivalent, Mars Transfer Vehicle (MTV), Descent/Ascent Stage (for

Mars) (DAS), Mars portions of DSS, next generation heavy lifters, Mars portion of Command, Control, Communication and Information (C3I) function, EVA (portions), Ground Operations (portions), Mission Operations (portions), Martian habitation, Martian surface transportation, Martian infrastructure, science and utilization

Higher

Pri

ori

tyLower

Page 75: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

75

WWW.NASAWATCH.COM

Some Significant Analysis Topics for IDAC-2

•CEV Landing and Recovery– Water v. Land Landing Trade– Landing Environments & Recovery

•Ascent Aborts– North Atlantic Exclusion Zone

•CEV Docking System / ISS Adapter Delivery Trades•CEV / CLV Integrated Loads and Aerodynamics•Manual Control•LSAM / EDS on-orbit loiter time•CEV Emergency Egress Assessment•LOC / LOM refinement and allocation•Launch Probability / Availability•Comm data rates & ranges

Page 76: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

76

WWW.NASAWATCH.COM

CxPO SE&I 3P Overview

Closing Comments•Team is doing exceptional work in light of the staffing & aggressive work load

•Specific areas of SE&I Concern– Large-scale front-end SE&I, Software Engineering and Life Cycle Costs Agency expertise

• Seeking options for additional expertise from multiple potential sources– Booz Allen, Aerospace Corp., Draper, SAIC

– Staffing & Training– CM, DM and detailed integrated scheduling at all levels

• Must continue great dialogue with Projects to Minimize resources and synergize efforts while maintaining that healthy conflict/checks & balances

• Need to consider how to leverage the virtual nationwide experts (by name) to fill voids identified above

– Seven Critical Success Factors of Virtual Teams, from “Mastering Virtual Teams” by Deborah Duarte

• HR Policies, OTJ, Processes, IT, Organizational Culture, Leadership Vision/Support & Team Leader/Member Competencies

2

CxPO SE&I 3P Overview

Agenda• People

– Organizational Overview– Current Leadership Profile

• Systems Integration Groups (SIGs)

– Agency-wide Staffing Situation• Products

– Near-Term Requirements -Focused Product Line• CxP-allocated NGOs, Level I -allocated Requirements, CARD, IRDs , IDDs , Invoked Standards,

Operational Concepts, FFBDs , FAMs , N2 Diagrams, Reference Architecture, Trade/Analyses results, SRDs, Requirements Achievability Assessments, Technical Performance Measures, Technical Risk Mitigation Plans, Traceability Reports

– Long-term Program-wide Technical Integration Foundation Products• Cx Program Plan, Policy, Process & Strategy Documents

• Processes– Requirements & Interface Management Processes– RAC, DAC & VAC – Analyses/Trades Processes– Emerging Program Boards, Panels & WGs Structure/Process

• CY06 Challenges• Backup – Recommended May “Requirements Face-to-Face (F2F)”

Must reflect our work to go in one integrated, resourced schedule – and manage to it

Page 77: 1 9/5/2015 12:11:11 PM CxPO SE&I People, Products & Processes (3Ps) Overview SE&I Team Leadership April 13, 2006

77

WWW.NASAWATCH.COM

BACKUP – More data on Requirements F2F in June - NOT READY FOR PRIME TIME