Department of Defense INSTRUCTION - Navy SBIR

Department of Defense INSTRUCTION

NUMBER 5000.02 January 7, 2015

USD(AT&L)

SUBJECT: Operation of the Defense Acquisition System References: See References 1. PURPOSE. This instruction: a. In accordance with the authority in DoD Directive 5000.01 (Reference (a)), reissues the interim DoD Instruction 5000.02 (Reference (b)) to update established policy for the management of all acquisition programs in accordance with Reference (a), the guidelines of Office of Management and Budget Circular A-11 (Reference (c)), and References (d) through (ce). b. Authorizes Milestone Decision Authorities (MDAs) to tailor the regulatory requirements and acquisition procedures in this instruction to more efficiently achieve program objectives, consistent with statutory requirements and Reference (a). 2. APPLICABILITY. This instruction applies to OSD, the Military Departments, the Office of the Chairman of the Joint Chiefs of Staff and the Joint Staff, the Combatant Commands, the Office of the Inspector General of the Department of Defense, the Defense Agencies, the DoD Field Activities, and all other organizational entities within the DoD (referred to collectively in this instruction as the “DoD Components”). 3. POLICY. The overarching management principles and mandatory policies that govern the Defense Acquisition System are described in Reference (a). This instruction provides the detailed procedures that guide the operation of the system. 4. RESPONSIBILITIES a. Defense Acquisition Executive (DAE). The DAE is the Under Secretary of Defense for Acquisition, Technology, and Logistics (USD(AT&L)). The DAE will act as the MDA for Major Defense Acquisition Programs (MDAPs) and Major Automated Information System (MAIS) programs. In accordance with Table 1 in Enclosure 1 of this instruction, the DAE may

DoDI 5000.02, January 7, 2015

2

delegate authority to act as the MDA to the head of a DoD Component, who may further delegate the authority to the Component Acquisition Executive (CAE). The DAE may also delegate MDA authority to another OSD official as the DAE considers appropriate. b. MDA. The MDA will establish procedures for assigned programs using this instruction as guidance. MDAs should limit mandatory procedures applicable to all assigned programs so as to not exceed the requirements for MDAPs or MAIS programs and other acquisition programs governed by this instruction or DoD Directive 5000.01 (Reference (a)). MDAs should tailor regulatory procedures in the document consistent with sound business practice and the risks associated with the product being acquired. c. Heads of the DoD Components. The DoD Component Head will implement the procedures in this instruction and Reference (a). Component-required procedures will not exceed those specified in this instruction. When necessary, waivers or requests for exceptions to the provisions of this instruction will be submitted to the DAE, the DoD Chief Information Officer, the Director, Operational Test and Evaluation (DOT&E), or the Director, Cost Assessment and Program Evaluation (DCAPE), via the CAE. Statutory requirements cannot be waived unless the statute permits. 5. PROCEDURES a. Overview (1) The statutes governing defense acquisition programs are complex, and the categories into which a program falls will impact acquisition procedures. The designation of a program as an MDAP, a MAIS program, or a Major Weapons System; and the determination that the program is an Information System, a Defense Business System, or responds to an urgent need affect program procedures and policies. (2) The structure of a DoD acquisition program and the procedures used should be tailored as much as possible to the characteristics of the product being acquired, and to the totality of circumstances associated with the program including operational urgency and risk factors. (a) MDAs will tailor program strategies and oversight, including program information, acquisition phase content, the timing and scope of decision reviews and decision levels, based on the specifics of the product being acquired, including complexity, risk factors, and required timelines to satisfy validated capability requirements. (b) When there is a strong threat-based or operationally driven need to field a capability solution in the shortest time, MDAs are authorized to implement streamlined procedures designed to accelerate acquisition system responsiveness. Statutory requirements will be complied with, unless waived in accordance with relevant provisions.

DoDI 5000.02, January 7, 2015

3

(3) Program Acquisition Categories (ACATs) and Types. All defense acquisition programs are designated by an ACAT (i.e., ACAT I through III) and type (e.g., MDAP, MAIS, or Major System). MDAPs are either estimated to achieve the statutorily defined MDAP cost threshold, or are designated as an MDAP by the DAE. Similarly, MAIS programs are either estimated to achieve the statutorily defined MAIS program cost threshold, or are designated a MAIS program by the DAE. MAIS programs are software intensive and typically have a lower investment level than MDAPs. A MAIS program that is estimated to attain the MDAP cost thresholds may be designated by the DAE as either an MDAP or a MAIS program. MDAP and MAIS program designations carry the greatest consequences in terms of management level, reporting requirements, and documentation and analysis to support program decisions. Enclosure 1 of this instruction identifies the information requirements associated with all standard program categories or types in tabular form. Table 1 in Enclosure 1 provides specific definitions, funding thresholds, and decision authorities. Some information systems are also designated as a National Security System or a Defense Business System. These designations are defined in statute and have procedural and policy consequences. Enclosure 11 addresses Information Technology, and Enclosure 12 describes Defense Business Systems. (4) Program Decision Reviews and Milestones. The purpose of the decision reviews embedded in the acquisition procedures described in this section is to carefully assess a program’s readiness to proceed to the next acquisition phase and to make a sound investment decision committing the Department’s financial resources. Consequently, reviews will be issue and data focused to facilitate an examination of relevant questions affecting the decisions under consideration and to allow the MDA to judge whether the program is ready to proceed. The following policies will guide decision reviews: (a) The MDA is the sole and final decision authority. Staff members and staff organizations support and facilitate the MDA's execution of that authority. (b) The Defense Acquisition Board (DAB) will advise the DAE on critical acquisition decisions when the DAE is the MDA. The DAE or designee will chair the DAB. An Acquisition Decision Memorandum (ADM) will document decisions resulting from reviews. Similar procedures will be established at the Component level for use by other MDAs. (c) Program Managers, under the supervision of Program Executive Officers (PEOs) and CAEs, are expected to design acquisition programs, prepare programs for decisions, and execute approved program plans. (d) Overarching Integrated Product Teams at the DoD level, and similar organizations within the DoD Components are expected to collectively assist the MDA in making sound investment decisions for the department, and to ensure programs are structured and resourced to succeed. These organizations are not decision bodies and they and their leaders do not supplant the authority of the Program Manager, PEO, CAE, or DAE. (e) Issues should be resolved at the lowest level possible. When an issue cannot be resolved quickly at a lower level, the issue will be submitted to the MDA with complete and objective data necessary to support a decision.

DoDI 5000.02, January 7, 2015

4

(f) The documents prepared in support of the decision process (e.g., Acquisition Strategy, Systems Engineering Plan (SEP), Test and Evaluation Master Plan (TEMP), Life-Cycle Sustainment Plan (LCSP)) should generally not be prepared solely for staff review and approval, but be intended primarily for use within the program as planning and management tools that are highly specific to the program and tailored to meet program needs. (g) Review preparation will be streamlined and efficient. Staff members will be provided with the data needed to support the review, but they will also work to minimize the overhead burden placed on the DoD Components, PEOs, program managers, and their staffs. b. Relationship Between Defense Acquisition, Requirements, and Budgeting Processes (1) Acquisition, requirements, and budgeting, are closely related and must operate simultaneously with full cooperation and in close coordination. Validated “Capability Requirements” provide the basis for defining the products that will be acquired through the acquisition system and the budgeting process determines Department priorities and resource allocations and provides the funds necessary to execute planned programs. Throughout a product’s life cycle, adjustments may have to be made to keep the three processes aligned. Capability requirements may have to be adjusted to conform to technical and fiscal reality. Acquisition programs may have to adjust to changing requirements and funding availability. Budgeted funds may have to be adjusted to make programs executable or to adapt to evolving validated capability requirements and priorities. Stable capability requirements and funding are important to successful program execution. Those responsible for the three processes at the DoD level and within the DoD Components must work closely together to adapt to changing circumstances as needed, and to identify and resolve issues as early as possible. (2) Capability Requirements Process (a) All acquisition programs respond to validated capability requirements. Figure 1 illustrates the interaction between the requirements process and the acquisition process. The Chairman of the Joint Chiefs of Staff, with the advice of the Joint Requirements Oversight Council (JROC), will assess and validate joint military requirements for MDAP and MAIS programs, and less-than-MDAP or MAIS programs designated either as “JROC Interest” or “Joint Capabilities Board Interest.” When JROC validation authority is delegated in accordance with the Joint Capabilities Integration and Development System (JCIDS) process in Chairman of the Joint Chiefs of Staff Instruction 3170.01H (Reference (d)), the DoD Components will use variations of the JCIDS to validate their requirements. The chair of the Investment Review Board is the validation authority for Defense Business System capability requirements. (b) Leadership of the acquisition and budget processes will be involved as advisors to the validation authority during consideration of initial or adjusted validation of capability requirements to ensure coordination across the three processes.

DoDI 5000.02, January 7, 2015

5

Figure 1. Illustration of the Interaction Between the Capability Requirements Process and the Acquisition Process

(c) The titles of capability requirements documents supported by JCIDS vary by the maturity of the capability gap to solution proposal and can vary by product classification. When the titles vary from the most typical Initial Capabilities Document (ICD), Capability Development Document (CDD), or Capability Production Document, the text will use the generic terms, “validated capability requirements document” or “equivalent requirements document.”- (d) Capability requirements are not expected to be static during the product life cycle. As knowledge and circumstances change, consideration of adjustments or changes may be requested by acquisition, budgeting, or requirements officials. Configuration Steering Boards (CSBs), as described in paragraph 5d(5)(b) in this section, will also be used to periodically review program progress and identify opportunities for adjustment. (3) Budgeting Process. The DoD budgeting process is based on the annual budget preparation cycle managed by the DCAPE and the Under Secretary of Defense (Comptroller) for the Deputy Secretary of Defense. This process produces a Future Years Defense Program (FYDP) that covers 5 years of spending. While individual program decisions fall under the DAE or designated MDA, DoD budget decisions are made separately at the Secretary or Deputy Secretary level, with the advice of the DAE and others. Within the DoD Components, MDAs will advise the Component budget authorities to ensure that acquisition programs are adequately funded and that program plans are consistent with programmed funding levels.

MaterielSolutionAnalysisPhase

Technology Maturation &Risk Reduction Phase

InitialCapabilitiesDocument*

Materiel DevelopmentDecision

Engineering & Manufacturing Development

Phase

B

Production &Deployment Phase

= Milestone Decision

= Decision Point

Legend

* Or Equivalent Approved/Validated Requirements Document.

DevelopmentRFP Release

DecisionPoint

C

Operations & Support Phase

= Requirements Document

= Requirements AuthorityReview

Disposal

CapabilityDevelopmentDocument*

CapabilityProductionDocument*

Draft Capability

DevelopmentDocument*

Requirements Authority Review of

AoA ResultsAA

DoDI 5000.02, January 7, 2015

6

c. Generic and DoD-Specific Acquisition Program Models, Decision Points, and Phase Activities (1) This section is structured in increasing layers of detail and complexity, beginning with a very generic description of acquisition phases and decision points that could apply to almost any product life cycle, DoD or otherwise, followed by more specific commonly used DoD program models, and concluding with a description of the procedures used in most DoD acquisition programs prior to any tailoring. DoD acquisition managers and staff should focus on the basics of sound acquisition planning, management, and decision making as discussed in this section as their primary responsibility—while also assuring compliance, as appropriate, with the specific requirements found in the tables that follow in Enclosures 1 and 13 and other applicable enclosures. (2) Generic Acquisition Program Structure and Decision Points (a) Generic Acquisition Program Structure. For reference, a generic product acquisition program would follow the structure depicted in Figure 2. Figure 2 illustrates the sequence of decision events in a generic program, which could be a Defense program or, except for the unique DoD terminology, a commercial product.

Figure 2. Generic Acquisition Phases and Decision Points

Risk Reduction Decision(DoD: Milestone A)

Technology Maturation and Risk Reduction

Development Contract Award(DoD: Milestone B)

Development

Disposal

Low-Rate Initial Production or Limited Deployment and Operational Test

Initial Production or Fielding (DoD: Milestone C)

Full-Rate Production/ Full Deployment

Production, Deployment, and Sustainment

Figure 2 illustrates the sequence of decision events in a generic program. It is not intended to reflect the time dedicated to associated phase activity.

Solution Analysis

Need Identification(DoD: Material Development Decision)

Requirements Decision Point(DoD: CDD Validation)

Development RFP ReleaseDevelopment Decisions

Production Decisions= Decision Point

Legend:

CDDRFP

= Capability Development Document = Request For Proposal

DoDI 5000.02, January 7, 2015

7

(b) Generic Acquisition Milestones and Decision Points 1. Need Identification, called the Materiel Development Decision by DoD, is the decision that a new product is needed and that activities to analyze alternative solutions will occur. 2. Risk Reduction Decision, called Milestone A by DoD, is an investment decision to pursue specific product or design concepts, and to commit the resources required to mature technology and/or reduce any risks that must be mitigated prior to decisions committing the resources needed for development leading to production and fielding. 3. The decision to commit resources to the development of a product for manufacturing and fielding, called Engineering and Manufacturing Development (EMD) by DoD, follows completion of any needed technology maturation and risk reduction. DoD breaks this commitment into three related decisions: (1) a requirements decision point (called the CDD Validation Decision by DoD); (2) a decision to release a solicitation for development to industry, called the Development Request for Proposals (RFP) Release Decision Point; and (3) a decision to award the contract(s) for development, called Milestone B by DoD. Formally, the development contract award authorized at DoD’s Milestone B is the critical decision point in an acquisition program because it commits the organization’s resources to a specific product, budget profile, choice of suppliers, contract terms, schedule, and sequence of events leading to production and fielding. In practice however, almost all of these decisions have to be made prior to the release of the RFP to industry in order to inform the bidders’ proposals. For DoD, the Development RFP Release Decision Point is the point at which plans for the program must be most carefully reviewed to ensure all risks are understood and under control, the program plan is sound, and that the program will be affordable and executable. a. Requirements Decision Point (CDD Validation Decision for DoD). The point at which the major cost and performance trades have been completed and enough risk reduction has been completed to support a decision to commit to the set of requirements that will be used for preliminary design activities, development, and production (subject to reconsideration and refinement as knowledge increases). b. Development RFP Release Decision. The point at which planning for development is complete and a decision can be made to release an RFP for development (and possibly initial production) to industry. c. Development Decision, called Milestone B by DoD. The development decision commits the resources (authorizes proceeding to award of the contract(s)) needed to conduct development leading to production and fielding of the product. 4. The decision to enter production follows development and testing. For DoD, the production decision is normally broken into two DoD decisions: (1) Low-Rate Initial Production (LRIP), called Milestone C by DoD, or Limited Deployment; and (2) the Full-Rate Production or Full Deployment Decision.

DoDI 5000.02, January 7, 2015

8

a. The Initial Production Decision. The production decision, based primarily on developmental testing results and usually also informed by an operational assessment, commits the resources (i.e., authorizes proceeding to award the contract(s)) required to enter production and begin deployment of the product. Evidence from testing that the product design is stable is the critical consideration for this decision. The commitment to enter production is very expensive and difficult to reverse. b. Full Rate Production or Full Deployment Decision. The decision, following completion of operational testing of representative initial production products, to scale up production and/or deployment. 5. While these generic decision points and milestones are standard, MDAs have full latitude to tailor programs in the most effective and efficient structure possible, to include eliminating phases and combining or eliminating milestones and decision points, unless constrained by statute. Paragraph 5d provides more detail about the standard structure, milestones, and decision points as they apply to most defense acquisition programs. Enclosure 1 includes tables of specific requirements for the various statutory and regulatory categories of programs. Enclosures 11 through 13 provide additional information about Information Technology programs (described in Enclosure 11), Defense Business Systems (described in Enclosure 12), and Urgent Needs (described in Enclosure 13). (3) Defense Acquisition Program Models (a) Paragraphs 5c(3)(b) through 5c(3)(e) describe four basic models that serve as examples of defense program structures tailored to the type of product being acquired or to the need for accelerated acquisition. Two additional hybrid models combine the features of multiple basic models. Each basic model is tailored to the dominant characteristics of the product being acquired (e.g., hardware intensive products such as most weapons systems). The hybrids are described because many products will require combining models, such as a weapons systems development that includes significant software development. Acquisition programs should use these models as a starting point in structuring a program to acquire a specific product. 1. The models provide baseline approaches. A specific program should be tailored to the unique character of the product being acquired. 2. All of the models contain requirements and product definition analysis, risk reduction, development, testing, production, deployment, and sustainment phases punctuated by major investment decisions at logical programmatic and contractual decision points. Progress through the acquisition management system as depicted in any of these models or in a tailored variation depends on obtaining sufficient knowledge about the capability to be provided and risks and costs remaining in the program to support a sound business decision to proceed to the next phase. 3. Figures and brief descriptions are provided for each model. The figures illustrate the typical sequence of events and activities. A dotted diagonal line and color blending imply overlapping activities.

DoDI 5000.02, January 7, 2015

9

(b) Model 1: Hardware Intensive Program. Figure 3 is a model of a hardware intensive development program such as a major weapons platform. This is the classic model that has existed in some form in all previous editions of this instruction. It is the starting point for most military weapon systems; however, these products almost always contain software development resulting in some form of Hybrid Model A (paragraph 5c(3)(f)1 describes Hybrid Model A).

Figure 3. Model 1: Hardware Intensive Program

BA C

= Milestone Decision = Decision PointLegend:

Materiel Development

Decision

CDD Validation

Full Rate Production (FRP) Decision

Development RFP

Release Decision

Initial Operational Capability (IOC)

Full Operational Capability (FOC)

Materiel Solution Analysis

Technology Maturation &

RiskReduction

Production & Deployment


Disposal

LRIP

Operational Test and Evaluation (OT&E)

Operations & Support

Sustainment

DoDI 5000.02, January 7, 2015

10

(c) Model 2: Defense Unique Software Intensive Program. Figure 4 is a model of a program that is dominated by the need to develop a complex, usually defense unique, software program that will not be fully deployed until several software builds have been completed. The central feature of this model is the planned software builds – a series of testable, integrated subsets of the overall capability – which together with clearly defined decision criteria, ensure adequate progress is being made before fully committing to subsequent builds. 1. Examples of this type of product include military unique command and control systems and significant upgrades to the combat systems found on major weapons systems such as surface combatants and tactical aircraft. 2. Several software builds are typically necessary to achieve a deployable capability. Each build has allocated requirements, resources, and scheduled testing to align dependencies with subsequent builds and to produce testable functionality to ensure that progress is being achieved. The build sequencing should be logically structured to flow the workforce from effort to effort smoothly and efficiently, while reducing overall cost and schedule risk for the program.

Figure 4. Model 2: Defense Unique Software Intensive Program

BA C

Full Deployment

Decision (FDD)

Full Deployment (FD)

MaterielSolutionAnalysis


Risk Reduction



Decision



Disposal

IOC

Build 1.1

Build 1.3Build 0.1

RiskReduction


CDD Validation

Build 1.5Build 2.1*

Integration

OT&E

LimitedDeployment

Sustainment

* The actual number and type of builds during the program will depend on system type.

Development RFP

Release Decision

Build 1.4

Build 1.2

DoDI 5000.02, January 7, 2015

11

(d) Model 3: Incrementally Deployed Software Intensive Program. Figure 5 is a model that has been adopted for many Defense Business Systems. It also applies to upgrades to some command and control systems or weapons systems software where deployment of the full capability will occur in multiple increments as new capability is developed and delivered, nominally in 1- to 2-year cycles. The period of each increment should not be arbitrarily constrained. The length of each increment and the number of deployable increments should be tailored and based on the logical progression of development and deployment for use in the field for the specific product being acquired.

Figure 5. Model 3: Incrementally Deployed Software Intensive Program 1. This model is distinguished from the previous model by the rapid delivery of capability through multiple acquisition increments, each of which provides part of the overall required program capability. Each increment may have several limited deployments; each deployment will result from a specific build and provide the user with a mature and tested sub-element of the overall incremental capability. Several builds and deployments will typically be necessary to satisfy approved requirements for an increment of capability. The identification and

BA

FDD


Risk Reduction

Development &Deployment


Decision

Build 1.1

Build 0

RiskReduction

Build

CDD Validation

OT&EBuild 1.n

Build 1.2

LimitedDeployment

Decisions

. . .

Sustainment

FDIOC


Build 2.1

OT&EBuild 2.n

Build 2.2 . . .Sustainment

FDDLimitedDeployment Decisions

FDIOC

B

Risk Reduction



Increment 2

Disposal

Build n.1

OT&EBuild n.n

Build n.2 . . .Sustainment

FDD FD

B

Risk Reduction



Increment n

= Milestone Decision

= Decision Point

Legend

Development RFP

Release Decision

Development RFPRelease Decision

Development RFPRelease Decision

IOCLimited

Deployment Decisions

DoDI 5000.02, January 7, 2015

12

development of technical solutions necessary for follow-on capability increments have some degree of concurrency, allowing subsequent increments to be initiated and executed more rapidly. 2. This model will apply in cases where commercial off-the-shelf software, such as commercial business systems with multiple modular capabilities, are acquired and adapted for DoD applications. An important caution in using this model is that it can be structured so that the program is overwhelmed with frequent milestone or deployment decision points and associated approval reviews. To avoid this, multiple activities or build phases may be approved at any given milestone or decision point, subject to adequate planning, well-defined exit criteria, and demonstrated progress. An early decision to select the content for each follow-on increment (2 through N) will permit initiation of activity associated with those increments. Several increments will typically be necessary to achieve the required capability.

DoDI 5000.02, January 7, 2015

13

(e) Model 4: Accelerated Acquisition Program. Figure 6 is a model that applies when schedule considerations dominate over cost and technical risk considerations. This model compresses or eliminates phases of the process and accepts the potential for inefficiencies in order to achieve a deployed capability on a compressed schedule. The model shows one example of tailoring for accelerated acquisition and many others are possible. This type of structure is used when technological surprise by a potential adversary necessitates a higher-risk acquisition program. Procedures applicable to urgent needs that can be fulfilled in less than 2 years are a subset of this model and are discussed in Enclosure 13.

Figure 6. Model 4: Accelerated Acquisition Program

A/B

Materiel SolutionAnalysis

Concurrent Technology Maturation, Risk Reduction

and Development


Decision

PreliminaryDesignReview

ConcurrentProduction and

Deployment


C

FOCIOC

Sustainment Disposal


OT&E

DoDI 5000.02, January 7, 2015

14

(f) Hybrid Acquisition Programs 1. Figure 7 is a model depicting how a major weapons system combines hardware development as the basic structure with a software intensive development that is occurring simultaneously with the hardware development program. In a hardware intensive development, the design, fabrication, and testing of physical prototypes may determine overall schedule, decision points, and milestones, but software development will often dictate the pace of program execution and must be tightly integrated and coordinated with hardware development decision points.

Figure 7. Model 5: Hybrid Program A (Hardware Dominant) 2. In the hybrid “A” model, software development should be organized into a series of testable software builds, as depicted in Figure 7. These builds should lead up to the full capability needed to satisfy program requirements and Initial Operational Capability (IOC). Software builds should be structured so that the timing of content delivery is synchronized with the need for integration, developmental and operational testing in hardware prototypes. The Milestone B decision to enter EMD and the Milestone C decision to enter Production and Deployment (P&D) should include software functional capability development maturity criteria as well as demonstrated technical performance exit criteria.

BA C

FRPFOC



Risk Reduction



Decision

Operations & SupportDisposal

IOC

Build 1.1Build 1.2

Build 1.3Build 1.4

Build 0.1


CDD Validation

Build 1.5 Build 2.1Integration

OT&E

LRIP

Build 3.1Build 3.2*


Sustainment

* The actual number and type of builds during the program will depend on system type.

Development RFP

Release Decision

DoDI 5000.02, January 7, 2015

15

3. Figure 8, Model 6: Hybrid Model B (Software Dominant), depicts how a software intensive product development can include a mix of incrementally deployed software products or releases that include intermediate software builds. All of the comments about incremental software fielding associated with Model 3 in paragraph 5c(3)(d) apply to this model as well. This is a complex model to plan and execute successfully, but depending on the product it may be the most logical way to structure the acquisition program.

Figure 8. Model 6: Hybrid Program B (Software Dominant) (g) Risk Management in Hybrid Models. Highly integrated complex software and hardware development poses special risks to program cost and schedule performance. Technical, cost, and schedule risks associated with hardware and software development must be managed throughout the program’s life cycle and will be a topic of special interest at all decision points and milestones.

BA



Decision

Build 1.1.1

Build 1.0.1

CDD Validation FDD

OT&E

Build 1.1.2

Sustainment

FDIOC

Disposal

Build 2.1.1

OT&E

Build 2.1.2

Sustainment

FD

BIncrement 2



Operations & SupportTechnology Maturation &

RiskReduction

Build 1.1.3Build 1.2

Integration

Limited Deployment (LD)

Build 2.1.3

C

Build 1.3.1Build 1.3.2*



Operations & SupportTechnology Maturation &

RiskReduction

Build 2.2

Integration

CLD

Build 2.3.1Build 2.3.2


Development RFP

Release Decision

Development RFPRelease Decision FDD

IOC

DoDI 5000.02, January 7, 2015

16

d. Acquisition Process Decision Points and Phase Content. The procedures in subparagraphs 5d(1) through 5d(14) are general and are applicable to the acquisition program models previously described and to variations in them. Tailoring is always appropriate when it will produce a more efficient and effective acquisition approach for the specific product. Non-MDAP and non-MAIS programs will use analogous DoD Component processes. Additional or modified procedures applicable to Information Technology and to Defense Business System programs are described in Enclosures 11 and 12 of this instruction, respectively, and procedures applicable to urgent needs are described in Enclosure 13. (1) Materiel Development Decision (a) The Materiel Development Decision is based on a validated initial requirements document (an ICD or equivalent requirements document) and the completion of the Analysis of Alternatives (AoA) Study Guidance and the AoA Study Plan. This decision directs execution of the AoA, and authorizes the DoD Component to conduct the Materiel Solution Analysis Phase. This decision point is the entry point into the acquisition process for all defense acquisition products; however, an “acquisition program” is not formally initiated (with the accompanying statutory requirements) until Milestone B, or at Milestone C for those programs that enter directly at Milestone C. DoD Components may have conducted enough analysis to support preliminary conclusions about the desired product at this point. If so, that analysis may be used by the MDA to narrow the range of alternatives. If not, requirements are likely to be less well-defined or firm, and a wider range of alternatives will need to be considered. (b) At the Materiel Development Decision, the DCAPE, (or DoD Component equivalent) will present the AoA Study Guidance, and the AoA lead organization will present the AoA Study Plan. In addition, the Component will provide the plan to staff and fund the actions that will precede the next decision point (usually Milestone A) including, where appropriate, competitive concept definition studies by industry. (c) If the Materiel Development Decision is approved, the MDA will designate the lead DoD Component; determine the acquisition phase of entry; and identify the initial review milestone, usually, but not always, a specific milestone as described in one of the program models. MDA decisions will be documented in an ADM. The approved AoA Study Guidance and AoA Study Plan will be attached to the ADM. (2) Materiel Solution Analysis Phase (a) Purpose. The purpose of this phase is to conduct the analysis and other activities needed to choose the concept for the product that will be acquired, to begin translating validated capability gaps into system-specific requirements including the Key Performance Parameters (KPPs) and Key System Attributes (KSAs), and to conduct planning to support a decision on the acquisition strategy for the product. AoA solutions, key trades among cost, schedule, and performance, affordability analysis, risk analysis, and planning for risk mitigation are key activities in this phase.

DoDI 5000.02, January 7, 2015

17

(b) Phase Description 1. Minimum funding required for this phase is normally that needed to analyze and select an alternative for materiel development, and to complete the activities necessary to support a decision to proceed to the next phase; technology development and concept analysis and design efforts may also be funded in this phase. 2. The validated ICD and the AoA Study Plan will guide the AoA and Materiel Solution Analysis Phase activity. The analysis will be conducted in accordance with the procedures in Enclosure 9 of this instruction, and focus on identification and analysis of alternatives; measures of effectiveness; key trades between cost and capability; total life-cycle cost, including sustainment; schedule; concepts of operations; and overall risk. The AoA will inform and be informed by affordability analysis, cost analysis, sustainment considerations, early systems engineering analyses, threat projections, and market research. 3. Prior to the completion of this phase, the DoD Component combat developer will prepare a Concept of Operations/Operational Mode Summary/Mission Profile (CONOPS/OMS/MP) that will include the operational tasks, events, durations, frequency, operating conditions and environment in which the recommended materiel solution is to perform each mission and each phase of a mission. The CONOPS/OMS/MP will be provided to the Program Manager and will inform development of the plans for the next phase including: acquisition strategy, test planning, and capability requirements trades. It will be provided to industry as an attachment for the next acquisition phase RFP. 4. This phase ends when a DoD Component has completed the necessary analysis and the activities necessary to support a decision to proceed to the next decision point and desired phase in the acquisition process. The next phase can be Technology Maturation and Risk Reduction (TMRR), EMD, or P&D, depending on the actions needed to mature the product being acquired. Each of these phases has associated decision points to authorize entry: Milestone A, Development RFP Release and Milestone B, or Milestone C. Each decision point and phase has information requirements identified in Table 2 in Enclosure 1 of this instruction, and other criteria as defined in paragraphs 5d(3) through 5d(14) in this instruction. (c) Program Office Establishment and Next Phase Preparation. During the Materiel Solution Analysis Phase, the CAE will select a Program Manager and establish a Program Office to complete the necessary actions associated with planning the acquisition program with emphasis on the next phase. Prior to preparation and release of a final RFP for the planned next phase, the Program Manager should complete and submit the Acquisition Strategy and obtain MDA approval. An approved Acquisition Strategy will inform development of the final RFPs for the next phase of the program. (3) Milestone A (a) The Milestone A decision approves program entry into the TMRR Phase and release of final RFPs for TMRR activities. The responsible DoD Component may decide to perform technology maturation and risk reduction work in-house and/or award contracts

DoDI 5000.02, January 7, 2015

18

associated with the conduct of this phase. Competitive prototypes are part of this phase unless specifically waived by the MDA. Key considerations are: 1. The justification for the preferred materiel solution. 2. The affordability and feasibility of the planned materiel solution. 3. The scope of the capability requirements trade space and understanding of the priorities within that trade space. 4. The understanding of the technical, cost, and schedule risks of acquiring the materiel solution, and the adequacy of the plans and programmed funding to mitigate those risks prior to Milestone B. 5. The efficiency and effectiveness of the proposed acquisition strategy (including the contracting strategy and the intellectual property (IP) strategy) in light of the program risks and risk mitigation strategies. 6. The projected threat and its impact on the material solution. (b) At the Milestone A Review: 1. The Program Manager will present the approach for acquiring the preferred materiel solution including: the Acquisition Strategy, the business approach, framing assumptions, an assessment of program risk and how specific technology development and other risk mitigation activities will reduce the risk to acceptable levels, and appropriate “Should Cost” management targets. 2. The DoD Component will: a. Present an affordability analysis and proposed affordability goals based on the resources that are projected to be available to the DoD Component in the portfolio(s) or mission area(s) associated with the program under consideration. The analysis will be supported by a quantitative assessment of all of the programs in the prospective program’s portfolio or mission area that demonstrates the ability of the Component’s estimated budgets to fund the new program over its planned life cycle. Affordability analyses are not intended to produce rigid, long-range plans; their purpose is to inform current decisions about the reasonableness of embarking on long-term capital investments at specific capability levels. The affordability analysis will support the Component’s proposed affordability goals for unit production and sustainment costs for MDA approval and inclusion in the Milestone A ADM. Enclosure 8 details the policy for affordability analyses and constraints. b. Submit a DoD Component cost estimate for the preferred solution(s) identified by the AoA. Enclosure 10 covers cost estimating in greater detail.

DoDI 5000.02, January 7, 2015

19

c. Demonstrate that the program will be fully funded within the FYDP at Milestone A. 3. If Milestone A is approved, the MDA will make a determination on the materiel solution, the plan for the TMRR Phase, release of the final RFP, and specific exit criteria required to complete TMRR and enter EMD. The MDA will document these decisions in an ADM. (c) If substantive changes to the plan approved at Milestone A are required as a result of the source selection process, the DoD Component will notify the MDA who may, at his or her discretion, conduct an additional review prior to contract awards. (4) TMRR Phase (a) Purpose. The purpose of this phase is to reduce technology, engineering, integration, and life-cycle cost risk to the point that a decision to contract for EMD can be made with confidence in successful program execution for development, production, and sustainment. (b) Phase Description 1. This phase should include a mix of activities intended to reduce the specific risks associated with the product to be developed. This includes additional design trades and requirements trades necessary to ensure an affordable product and executable development and production programs. Capability requirements are matured and validated, and affordability caps are finalized during this phase. The TMRR Phase requires continuous and close collaboration between the program office and the requirements communities and authorities. During this phase, any realized Should Cost management savings should normally be used to further reduce program risk and future program costs. Enclosure 2 describes baseline cost control and the use of Should Cost management. 2. This phase normally includes competitive sources conducting technology maturation and risk reduction activities and preliminary design activities up to and including a Preliminary Design Review (PDR) prior to source selection for the EMD Phase. a. Risk reduction prototypes will be included if they will materially reduce engineering and manufacturing development risk at an acceptable cost. Risk reduction prototypes can be at the system level or can focus on sub-systems or components. b. A competitive prototype, or if this is not feasible, a single prototype or prototyping of critical subsystems prior to Milestone B is statutorily required to be part of the Acquisition Strategy for MDAPs and is a regulatory requirement for all other programs. The MDA may waive the competitive prototyping requirement at or prior to Milestone A if: I. The cost of producing competitive prototypes exceeds the expected life-cycle benefits (in constant dollars) of producing the prototypes, including the benefits of

DoDI 5000.02, January 7, 2015

20

improved performance and increased technological and design maturity that may be achieved through competitive prototyping; or II. The department would be unable to meet critical national security objectives without such a waiver. 3. There are a number of ways to structure this phase which should be tailored to reduce the specific risks associated with the product being acquired. Technology Readiness Levels, described in the Technology Readiness Assessment (TRA) Guidance (Reference (e)), should be used to benchmark technology risk during this phase; however, these indices are rough benchmarks, and not conclusive about the degree of risk mitigation needed prior to development. Deeper analysis of the actual risks associated with the preferred design and any recommended risk mitigation must be conducted and provided to the MDA. (c) The Acquisition Strategy will guide this phase. Multiple technology development demonstrations, defined in the acquisition strategy, may be necessary before the operational user and material developer can substantiate that a preferred solution is feasible, affordable, and supportable; satisfies validated capability requirements; and has acceptable technical risk. Critical program information will be identified during this phase and program protection measures to prevent disclosure of critical information will be implemented consistent with section 13 in Enclosure 3. Planning for EMD, production, developmental and operational test, and life-cycle sustainment of proposed products will occur during this phase. The government will update the program IP Strategy (see paragraph 6a(4) of Enclosure 2) to ensure the ability to compete future sustainment efforts consistent with the Acquisition Strategy to include competition for spares and depot repair. (d) During this phase, and timed to support CDD validation (or its equivalent), the Program Manager will conduct a systems engineering trade-off analysis showing how cost and capability vary as a function of the major design parameters. The analysis will support the assessment of refined KPPs/KSAs in the CDD. Capability requirements proposed in the CDD (or equivalent requirements document) should be consistent with program affordability goals. (e) Subsequent to CDD validation, the Program Manager will conduct additional requirements analysis including: requirements decomposition and allocation, definition of internal and external interfaces, and design activities leading to a PDR. Unless waived by the MDA, the PDR will occur prior to Milestone B. (f) Program Planning 1. During the TMRR Phase, the Program Manager will plan the balance of the program, prepare for subsequent decision points and phases, and submit an updated Acquisition Strategy for MDA approval. The updated Acquisition Strategy will describe the overall approach to acquiring the capability to include the program schedule, risks, funding, and the business strategy. The business strategy will describe the rationale for the contracting approach and how competition will be maintained throughout the program life cycle, and detail how contract incentives will be employed to support the Department’s goals.

DoDI 5000.02, January 7, 2015

21

2. To avoid re-planning and program disruptions, an updated Acquisition Strategy should be submitted to the MDA in time for approval prior to the preparation of the final RFPs for the next phase. (g) Life-Cycle Considerations During the TMRR Phase 1. Planning for the sustainment phase should begin in this phase, when requirements trades and early design decisions are still occurring. The Program Manager will finalize sustainment requirements and decompose them into more detailed requirements to support the PDR and for the following uses: a. Support system and product support package design trades. b. Support test and evaluation (T&E) planning. c. Provide performance metrics definition for product support contracts and organic support requirements. d. Provide logistics requirements, workload estimates, and logistics risk assessment. 2. The Program Manager will integrate the product support design into the overall design process, and assess enablers that improve supportability, such as diagnostics and prognostics, for inclusion in the system performance specification. As the design matures, the Program Manager will ensure that life-cycle affordability is a factor in engineering and sustainment trades. (5) CDD Validation and Configuration Steering Boards (CSBs) (a) CDD Validation 1. During the TMRR Phase, the requirements validation authority will validate the CDD (or equivalent requirements document) for the program. This action will precede the Development RFP Release Decision Point and provides a basis for preliminary design activities and the PDR that will occur prior to Milestone B unless waived by the MDA. Active engagement between acquisition leadership, including the MDA, and the requirements leadership, including the validation authority (the JROC for MDAP and MAIS programs), during the development and review of proposed requirements trades is essential to ensuring that the validated requirements associated with the program continue to address the priorities of the DoD Component and the joint force in a cost effective and affordable way. The MDA (and CAE when the MDA is the DAE) will participate in the validation authorities’ review and staffing of the CDD (or equivalent requirements document) prior to validation, to ensure that requirements are technically achievable, affordable, and testable, and that requirements trades are fully informed by systems engineering trade-off analyses completed by the Program Manager or the DoD Component.

DoDI 5000.02, January 7, 2015

22

2. The KPPs and KSAs included in the validated CDD, will guide the efforts leading up to PDR, and inform the Development RFP Release Decision Point. As conditions warrant, changes to KPPs and KSAs may be proposed to the applicable capability requirements validation authority. All non-KPP requirements (when delegated by the capability requirements validation authority) are subject to cost-performance trades and adjustments to meet affordability constraints. Cost performance trades (for non-KPP requirements) will be coordinated with the cognizant capability requirements validation authority. (b) CSBs. For ACAT I and ACAT IA programs, and following CDD Validation, the Acquisition Executive of each DoD Component will form and chair a CSB with broad executive membership including senior representatives from the Office of the USD(AT&L) (including the Assistant Secretary of Defense for Acquisition), the Joint Staff (Director of Force Structure, Resources, and Assessments, J-8), and the DoD Chief Information Officer; empowered representatives from the Service Chief of Staff and comptroller offices of the Military Department concerned; representatives from other Military Departments where appropriate; the Military Deputy to the CAE; the PEO; and other senior representatives from OSD and the DoD Component, as appropriate, in accordance with section 814 of Public Law (P.L.) 110-417 (Reference (f)). DoD Components should also form appropriate level and composition CSBs for lower ACAT programs. 1. The CSB will meet at least annually, and more frequently as capability requirements or content trades are needed, to review all requirements changes and any significant technical configuration changes for ACAT I and IA programs in development, production, and sustainment that have the potential to result in cost and schedule impacts to the program. The CSB will review potential capability requirements changes and propose to the requirements validation authority those changes that may be necessary to achieve affordability constraints on production and sustainment costs or that will result in a more cost-effective product. Changes that increase cost will not be approved unless funds are identified and schedule impacts are addressed. Program requirements will fall under the cognizance of the CSB upon receipt of a validated CDD or other validated requirements document, and before the Development RFP Release Decision Point. CSBs may also be formed earlier in the program at the discretion of the CAE. 2. The Program Manager, in consultation with the PEO and the requirements sponsor, will, on at least an annual basis, identify and propose to the CSB a set of recommended requirements changes to include descoping options that reduce program cost and/or moderate requirements and changes needed to respond to any threat developments. These options will be presented to the CSB with supporting rationale addressing operational implications. The chair of the CSB will recommend to the DoD Component requirements authority, the validation authority, and the DAE (if an ACAT ID or MAIS program and KPPs are affected) which of these options should be implemented. (6) Development RFP Release Decision Point (a) This decision point authorizes the release of RFPs for EMD and often for LRIP or Limited Deployment options. This review is the critical decision point in an acquisition

DoDI 5000.02, January 7, 2015

23

program. The program will either successfully lead to a fielded capability or fail, based on the soundness of the capability requirements, the affordability of the program, and the executability of the acquisition strategy. The acquisition strategy is put into execution at this decision point by asking industry for bids that comply with the strategy. Release of the RFP for EMD sets in motion all that will follow. This is the last point at which significant changes can be made without a major disruption. (b) The purpose of the Development RFP Release Decision Point is to ensure, prior to the release of the solicitation for EMD, that an executable and affordable program has been planned using a sound business and technical approach. One goal at this point is to avoid any major program delays at Milestone B, when source selection is already complete and award is imminent. Therefore, prior to release of final RFPs, there needs to be confidence that the program requirements to be bid against are firm and clearly stated; the risk of committing to development and presumably production has been or will be adequately reduced prior to contract award and/or option exercise; the program structure, content, schedule, and funding are executable; and the business approach and incentives are structured to both provide maximum value to the government and treat industry fairly and reasonably. (c) At the Development RFP Release Decision Point, the Program Manager will summarize TMRR Phase progress and results, and review the Acquisition Strategy for the EMD Phase. Specific attention will be given to overall affordability; the competition strategy and incentive structure; provisions for small business utilization; source selection criteria including any “best value” determination; framing assumptions; engineering and supportability trades and their relationship to validated capability requirements; the threat projections applicable to the system; Should Cost targets; risk management plans; and the basis for the program schedule. (d) Documents required for the Development RFP Release Decision Point will be submitted no later than 45 calendar days prior to the review. These documents may have to be updated for final approval by the appropriate authority prior to Milestone B and any associated EMD contract awards based on the results of the source selection. For programs for which the DAE is the MDA, appropriate sections of the EMD RFP and its attachments will be reviewed by relevant OSD staff personnel in support of this decision point, after obtaining specific authority in writing from the cognizant contracting officer. (e) For MDAPs and major systems, the MDA will determine the preliminary LRIP quantity (or the scope of limited deployment for MAIS programs) at the Development RFP Release Decision Point. LRIP quantities will be the minimum needed to provide production representative test articles for operational test and evaluation (OT&E) (as determined by DOT&E for MDAPS or special interest programs), to establish an initial production base for the system and provide efficient ramp up to full-rate production, and to maintain continuity in production pending completion of operational testing. The final LRIP quantity for an MDAP (with rationale for quantities exceeding 10 percent of the total production quantity documented in the Acquisition Strategy) must be included in the first Selected Acquisition Report submitted to Congress after quantity determination. Table 5 in Enclosure 1 provides details about the Selected Acquisition Report.

DoDI 5000.02, January 7, 2015

24

(f) For incrementally deployed software intensive programs, the MDA will determine the preliminary scope of limited deployment that will be adequate to evaluate fielding plan execution and support OT&E prior to a Full Deployment Decision for each capability increment. (g) Decisions resulting from the Development RFP Release Decision Point will be documented in an ADM. The ADM will document specific criteria required for Milestone C approval including needed test accomplishments, LRIP quantities, affordability requirements, and FYDP funding requirements. Table 2 in Enclosure 1 of this instruction identifies the requirements that must be satisfied at this review. (7) PDR. During the TMRR Phase, and unless waived by the MDA, a PDR will be conducted so that it occurs before Milestone B and prior to contract award for EMD. The timing of the PDR relative to the Development RFP Release Decision Point is at the discretion of the DoD Component. The Component should balance the need for more mature design information to support source selection with the costs of either: (1) extending multiple sources’ design activities from the PDR until award of the full EMD contract or (2) having a gap in development prior to EMD award. Unless waived by the MDA, PDR results will be assessed by the MDA prior to the MDA Certification pursuant to section 2366b of Title 10, U.S. Code (Reference (g)) and Milestone B approval for MDAPs (hereafter, U.S. Code citations are presented as [title #] U.S.C. [section #], e.g., “10 U.S.C. 2366b”). Table 6 in Enclosure 1 of this instruction lists required waiver documentation and actions. (8) Milestone B (a) This milestone provides authorization to enter into the EMD Phase and for the DoD Components to award contracts for EMD. It also commits the required investment resources to the program. Most requirements for this milestone should be satisfied at the Development RFP Release Decision Point; however, if any significant changes have occurred, or if additional information not available at the Development RFP Release Decision Point could impact this decision, it must be provided at the Milestone B. Milestone B requires final demonstration that all sources of risk have been adequately mitigated to support a commitment to design for production. This includes technology, engineering, integration, manufacturing, sustainment, and cost risks. Validated capability requirements, full funding in the FYDP, and compliance with affordability goals for production and sustainment, as demonstrated through an independent cost estimate (ICE), are required. The framing assumptions central to shaping the program’s cost, schedule, and performance expectations are also required. (b) Milestone B is normally the formal initiation of an acquisition program with the MDA’s approval of the Acquisition Program Baseline (APB). The APB is the agreement between the MDA and the Program Manager and his or her acquisition chain of command that will be used for tracking and reporting for the life of the program or program increment (see section 4 in Enclosure 1 of this instruction for additional policy regarding APBs). The APB will include the affordability caps for unit production and sustainment costs. Affordability caps are established as fixed cost requirements equivalent to KPPs. (c) At the milestone, the MDA will finalize the following, if not already completed:

DoDI 5000.02, January 7, 2015

25

1. The LRIP quantity or the scope of limited deployment, as applicable. 2. The specific technical event-based criteria for initiating production or making deployment decisions. 3. Document decisions in an ADM. (d) Table 2 in Enclosure 1 identifies the statutory and regulatory requirements for Milestone B. (9) EMD Phase (a) Purpose. The purpose of the EMD Phase is to develop, build, and test a product to verify that all operational and derived requirements have been met, and to support production or deployment decisions. (b) Phase Description 1. General. EMD completes all needed hardware and software detailed design; systemically retires any open risks; builds and tests prototypes or first articles to verify compliance with capability requirements; and prepares for production or deployment. It includes the establishment of the initial product baseline for all configuration items. a. Design. The system design effort usually includes a standard series of design reviews prior to test article fabrication and/or software build or increment coding. Multiple design iterations may be necessary to converge on a final design for production. The SEP, described in section 2 in Enclosure 3 of this instruction, provides the basis for design activities. b. Post-Milestone B PDR. If a PDR prior to Milestone B has been waived, the Program Manager will plan for a PDR as soon as feasible after program initiation. 2. Developmental Test and Evaluation (DT&E). Developmental testing and evaluation provides feedback to the Program Manager on the progress of the design process and on the product’s compliance with contractual requirements. DT&E activities also evaluate the ability of the system to provide effective combat capability, including its ability to meet its validated and derived capability requirements, including the verification of the ability of the system to achieve KPPs and KSAs, and that initial system production and deployment and OT&E can be supported. The effort requires completion of DT&E activities consistent with the TEMP. Successful completion of adequate testing with production or deployment representative prototype test articles will normally be the primary basis for entering LRIP or Limited Deployment. Enclosure 4 includes more detailed discussions of DT&E requirements. 3. Early OT&E Events. Independent operational assessments, conducted by the Component operational test organization, will normally also occur during EMD. These events

DoDI 5000.02, January 7, 2015

26

may take the form of independent evaluation of developmental test results or of separate dedicated test events such as Limited User Tests. Developmental and operational test activities should, to the extent feasible, be planned in conjunction with one another to provide as efficient an overall test program as possible. Enclosures 4 and 5 provide more detailed discussions of DT&E and OT&E. (c) Preparation for Production, Deployment, and Sustainment. During EMD, the Program Manager will finalize designs for product support elements and integrate them into a comprehensive product support package. Early in the EMD Phase, the Program Manager’s initial product support performance requirements allocations will be refined based on the results of engineering reviews. Later in this phase, programs will demonstrate product support performance through test, to ensure the system design and product support package meet the sustainment requirements within the affordability caps established at Milestone B. (d) EMD Phase Completion. The EMD Phase will end when: (1) the design is stable; (2) the system meets validated capability requirements demonstrated by developmental and initial operational testing as required in the TEMP; (3a) manufacturing processes have been effectively demonstrated and are under control; (3b) software sustainment processes are in place and functioning; (4) industrial production capabilities are reasonably available; and (5) the system has met or exceeds all directed EMD Phase exit criteria and Milestone C entrance criteria. EMD will often continue past the initial production or fielding decision until all EMD activities have been completed and all requirements have been tested and verified. (e) Concurrency Between EMD and Production. In most programs for hardware intensive products, there will be some degree of concurrency between initial production and the completion of developmental testing; and perhaps some design and development work, particularly completion of software, that will be scheduled to occur after the initial production decision. Concurrency between development and production can reduce the lead time to field a system, but it also can increase the risk of design changes and costly retrofits after production has started. Program planners and decision authorities should determine the acceptable or desirable degree of concurrency based on a range of factors. In general, however, there should be a reasonable expectation, based on developmental testing of full-scale EMD prototypes, that the design is stable and will not be subject to significant changes following the decision to enter production. At Milestone B, the specific technical event-based criteria for initiating production or fielding at Milestone C will be determined and included in the Milestone B ADM. (f) Release of the P&D RFP. If the strategy and associated business arrangements planned and approved at Milestone B have been changed as a result of EMD phase activity, or if the validated capability requirements have changed, an updated Acquisition Strategy will be submitted for MDA review and approval prior to the release of the RFP for competitive source selection or the initiation of sole source negotiations. In any event, an updated Acquisition Strategy will be submitted prior to Milestone C and contract award, consistent with the procedures specified in this document. Paragraph 6a in Enclosure 2 provides additional detail about the Acquisition Strategy.

DoDI 5000.02, January 7, 2015

27

(g) Additional EMD Phase Requirements 1. Inherently Government Functions and Lead System Integrators (LSI). Program managers will emphasize the importance of appropriate checks and balances when contractors perform acquisition-related activities and ensure that the government is singularly responsible for the performance of inherently governmental functions. If the Acquisition Strategy for a major system calls for the use of a LSI, a contract will not be awarded to an offeror that either has or is expected to acquire a direct financial interest in the development or construction of an individual system or an element of a system of systems within the major system under the LSI. Exceptions may be granted by the MDA, as provided in 10 U.S.C. 2410p (Reference (g)), that require certification to the Committees on Armed Services of the Senate and House of Representatives. Table 6 in Enclosure 1 of this instruction provides details about the exception reporting. 2. Advanced Procurement of Long Lead Production Items. The MDA may authorize long lead at any point during EMD or at the Development RFP Release Decision or Milestone B, subject to the availability of appropriations. These items are procured in advance of a Milestone C production decision in order to provide for a more efficient transition to production. The amount of long lead appropriate for a given program depends on the type of product being acquired. The product’s content dictates the need for early purchase of selected components or subsystems to implement a smooth production process. Long lead authorization will be documented in an ADM and limited in content (i.e., listed items) and/or dollar value within the authorizing ADM. (10) Milestone C (a) Milestone C and the Limited Deployment Decision are the points at which a program or increment of capability is reviewed for entrance into the P&D Phase or for Limited Deployment. Approval depends in part on specific criteria defined at Milestone B and included in the Milestone B ADM. The following general criteria will normally be applied: demonstration that the production/deployment design is stable and will meet stated and derived requirements based on acceptable performance in developmental test events; an operational assessment; mature software capability consistent with the software development schedule; no significant manufacturing risks; a validated Capability Production Document (CPD) or equivalent requirements document; demonstrated interoperability; demonstrated operational supportability; costs within affordability caps; full funding in the FYDP; properly phased production ramp up; and deployment support. 1. In making Milestone C and Limited Deployment decisions, the MDA will consider any new validated threat environments that were not included in the CPD and might affect operational effectiveness, and will consult with the requirements validation authority as part of the production decision making process to ensure that capability requirements are current. 2. MDA decisions at Milestone C and Limited Deployment Decisions will be documented in an ADM following the review. Table 2 in Enclosure 1 identifies the statutory and regulatory requirements that will be satisfied at Milestone C.

DoDI 5000.02, January 7, 2015

28

(b) High-Cost First Article Combined Milestone B and C Decisions. Some programs, notably spacecraft and ships, will not produce prototypes during EMD for use solely as test articles because of the very high cost of each article. In this case, the first articles produced will be tested and then fielded as operational assets. These programs may be tailored by measures such as combining the development and initial production investment commitments. When this is the case, a combined Milestone B and C will be conducted. Additional decision points with appropriate criteria may also be established for subsequent low rate production commitments that occur prior to OT&E and a Full-Rate Production Decision. (11) Production and Deployment (P&D) Phase (a) Purpose. The purpose of the P&D Phase is to produce and deliver requirements-compliant products to receiving military organizations. (b) Phase Description. In this phase, the product is produced and fielded for use by operational units. The phase encompasses several activities and events: LRIP, Limited Deployment, OT&E, and the Full-Rate Production Decision or the Full Deployment Decision followed by full-rate production or full deployment. In this phase, all system sustainment and support activities are initiated if they haven’t already commenced. During this phase the appropriate operational authority will declare IOC when the defined operational organization has been equipped and trained and is determined to be capable of conducting mission operations. During this phase Should Cost management and other techniques will be used continuously to control and reduce cost. 1. LRIP and Limited Deployment. LRIP establishes the initial production base for the system or capability increment, provides the OT&E test articles, provides an efficient ramp up to full-rate production, and maintains continuity in production pending OT&E completion. While this portion of the phase should be of limited duration so that efficient production rates can be accomplished as soon and as economically as possible, it should be of sufficient duration to permit identification and resolution of any deficiencies prior to full-rate production. Limited Deployment for software developments is principally intended to support OT&E and can, consistent with the program strategy, be used to provide tested early operational capability to the user prior to full deployment. 2. OT&E. The appropriate operational test organization will conduct operational testing in a realistic threat environment. The threat environment will be based on the program’s System Threat Assessment Report and appropriate scenarios. For MDAPs, MAIS programs, and other programs on the DOT&E Oversight List, the DOT&E will provide a report providing the opinion of the DOT&E as to whether the program is operationally effective, suitable, and survivable before the MDA makes a decision to proceed beyond LRIP. For programs on the DOT&E Oversight List, operational testing will be conducted in accordance with the approved TEMP and operational test plan. If LRIP is not conducted for programs on the DOT&E Oversight List, fully production-representative articles must nonetheless be provided for the conduct of the required operational testing. Enclosure 4 and Enclosure 5 provide details about developmental and operational testing and the TEMP.

DoDI 5000.02, January 7, 2015

29

(12) Full-Rate Production Decision or Full Deployment Decision. The MDA will conduct a review to assess the results of initial OT&E, initial manufacturing, and limited deployment, and determine whether or not to approve proceeding to Full-Rate Production or Full Deployment. Continuing into Full-Rate Production or Full Deployment requires demonstrated control of the manufacturing process, acceptable performance and reliability, and the establishment of adequate sustainment and support systems. (a) In making the Full-Rate Production Decision or the Full Deployment Decision, the MDA will consider any new validated threat environments that might affect operational effectiveness, and may consult with the requirements validation authority as part of the decision making process to ensure that capability requirements are current. (b) Except as specifically approved by the MDA, critical deficiencies identified in testing will be resolved prior to proceeding beyond LRIP or limited deployment. Remedial action will be verified in follow-on test and evaluation. (c) The decision to proceed into full-rate production or full deployment will be documented in an ADM. Table 2 in Enclosure 1 identifies the statutory and regulatory requirements associated with this decision. (13) Full-Rate Production or Full Deployment. In this part of the P&D Phase, the remaining production or deployment of the product is completed, leading to Full Operational Capability or Full Deployment. (14) Operations and Support (O&S) Phase (a) Purpose. The purpose of the O&S Phase is to execute the product support strategy, satisfy materiel readiness and operational support performance requirements, and sustain the system over its life cycle (to include disposal). The O&S Phase begins after the production or deployment decision and is based on an MDA-approved LCSP. Enclosure 6 includes a more detailed discussion of sustainment planning; Enclosure 7 addresses planning for human systems integration. (b) Phase Description. The phase has two major efforts, Sustainment and Disposal. The LCSP, prepared by the Program Manager and approved by the MDA, is the basis for the activities conducted during this phase. 1. Sustainment. During this phase, the Program Manager will deploy the product support package and monitor its performance according to the LCSP. The LCSP may include time-phased transitions between commercial, organic, and partnered product support providers. The Program Manager will ensure resources are programmed and necessary IP deliverables and associated license rights, tools, equipment, and facilities are acquired to support each of the levels of maintenance that will provide product support; and will establish necessary organic depot maintenance capability in compliance with statute and the LCSP.

DoDI 5000.02, January 7, 2015

30

a. A successful program meets the sustainment performance requirements, remains affordable, and continues to seek cost reductions by applying Should Cost management and other techniques throughout the O&S Phase. Doing so requires close coordination with the war-fighting sponsor (i.e., user), resource sponsors, and materiel enterprise stake holders, along with effective management of support arrangements and contracts. During O&S, the Program Manager will measure, assess, and report system readiness using sustainment metrics and implement corrective actions for trends diverging from the required performance outcomes defined in the APB and LCSP. b. Over the system life cycle, operational needs, technology advances, evolving threats, process improvements, fiscal constraints, plans for follow-on systems, or a combination of these influences and others may warrant revisions to the LCSP. When revising the LCSP, the Program Manager will revalidate the supportability analyses and review the most current product support requirements, senior leader guidance, and fiscal assumptions to evaluate product support changes or alternatives and determine best value. 2. Disposal. At the end of its useful life, a system will be demilitarized and disposed of in accordance with all legal and regulatory requirements and policy relating to safety (including explosives safety), security, and the environment. e. Additional Procedures and Guidance (1) The enclosures to this instruction contain additional acquisition policy and procedures that guide program planning. (a) Enclosure 1 details the programmatic requirements established by statute or regulation. It defines acquisition program categories and compliance requirements for those categories. (b) Enclosures 2 through 10 provide specific policy and procedures applicable in various functional areas across the life cycle of the acquired system. (c) Enclosure 11 provides specific policy applicable to programs containing information technology. (d) Enclosure 12 provides specific policy and procedures applicable to Defense Business Systems. (e) Enclosure 13 provides specific policy and procedures applicable to Urgent Needs. (2) Consistent with program requirements and subparagraphs 4b and 4c, MDAs may tailor the information requirements and procedures in this section of the instruction and in Enclosures 1 through 13. As stated in paragraph 4c, some exceptions to regulatory policy may require coordination with the cognizant authority. Statutory requirements will not be waived unless permitted by the statute.

DoDI 5000.02, January 7, 2015

31

6. RELEASABILITY. Cleared for public release. This instruction is available on the Internet from the DoD Issuances Website at http://www.dtic.mil/whs/directives. 7. EFFECTIVE DATE. This instruction is effective January 7, 2015. Frank Kendall J. Michael Gilmore Terry Halvorsen Under Secretary of Defense for Director, Operational Acting DoD Chief Acquisition, Technology, and Test and Evaluation Information Officer Logistics References Enclosures 1. Acquisition Program Categories and Compliance Requirements 2. Program Management 3. Systems Engineering 4. Developmental Test and Evaluation (DT&E) 5. Operational and Live Fire Test and Evaluation (OT&E and LFT&E) 6. Life-Cycle Sustainment 7. Human Systems Integration (HSI) 8. Affordability Analysis and Investment Constraints 9. Analysis of Alternatives (AoA) 10. Cost Estimating and Reporting 11. Requirements Applicable to All Programs Containing Information Technology (IT) 12. Defense Business Systems (DBS) 13. Rapid Fielding of Capabilities Glossary

DoDI 5000.02, January 7, 2015

CONTENTS 32

TABLE OF CONTENTS

PURPOSE ........................................................................................................................................1 APPLICABILITY ............................................................................................................................1 POLICY ...........................................................................................................................................1 RESPONSIBILITIES ......................................................................................................................1 Defense Acquisition Executive (DAE) ......................................................................................1 MDA ..........................................................................................................................................2 Heads of the DoD Components .................................................................................................2 PROCEDURES................................................................................................................................2 Overview ....................................................................................................................................2 Relationship Between Defense Acquisition, Requirements, and Budgeting Processes ............4 Generic and DoD-Specific Acquisition Program Models, Decision Points, and Phase Activities. ............................................................................................................6 Model 1: Hardware Intensive Program ...............................................................................9 Model 2: Defense Unique Software Intensive Program ...................................................10 Model 3: Incrementally .....................................................................................................11 Model 4: Accelerated Acquisition Program .....................................................................13 Hybrid Acquisition Programs ............................................................................................14 Acquisition Process Decision Points and Phase Content .........................................................16 Materiel Development Decision ........................................................................................16 Materiel Solution Analysis Phase ......................................................................................16 Milestone A ........................................................................................................................17 TMRR Phase ......................................................................................................................19 CDD Validation and Configuration Steering Boards (CSBs) ............................................21 Development RFP Release Decision Point ........................................................................22 PDR ....................................................................................................................................24 Milestone B ........................................................................................................................24 EMD Phase ........................................................................................................................25 Milestone C ........................................................................................................................27 Production and Deployment (P&D) Phase ........................................................................28 Full-Rate Production Decision or Full Deployment Decision ...........................................29 Full-Rate Production or Full Deployment .........................................................................29 Operations and Support (O&S) Phase ...............................................................................29 Additional Procedures and Guidance .......................................................................................30 RELEASABILITY ........................................................................................................................31 EFFECTIVE DATE .......................................................................................................................31 REFERENCES ..............................................................................................................................39 ENCLOSURE 1: ACQUISITION PROGRAM CATEGORIES AND COMPLIANCE REQUIREMENTS ...................................................................................................................43 PURPOSE ................................................................................................................................43 ACATS ....................................................................................................................................43 Categories ..........................................................................................................................43

DoDI 5000.02, January 7, 2015

CONTENTS 33

Designation of Programs That Qualify as Both a Major Automated Information System (MAIS) Program and a Major Defense Acquisition Program (MDAP) ......................43 Program Reclassification ...................................................................................................43 ACQUISITION PROGRAM INFORMATION REQUIREMENTS AT MILESTONES AND OTHER DECISION POINTS ..................................................................................45 APBS AND BASELINE BREACHES ....................................................................................59 REPORTING REQUIREMENTS ...........................................................................................62 CCA COMPLIANCE ..............................................................................................................72 ENCLOSURE 2: PROGRAM MANAGEMENT ........................................................................73 PURPOSE ................................................................................................................................73 ACQUISITION CHAIN OF COMMAND ..............................................................................73 ASSIGNMENT OF PEOS .......................................................................................................73 ASSIGNMENT OF PROGRAM MANAGERS .....................................................................74 PROGRAM OFFICE STRUCTURE AND ORGANIZATIONS ...........................................74 Program Office Structure ...................................................................................................74 Joint Program Office Organization ....................................................................................75 PROGRAM MANAGEMENT RESPONSIBILITIES ............................................................75 Acquisition Strategies ........................................................................................................75 Program Baseline Development and Management ............................................................77 Earned Value Management (EVM) ...................................................................................77 Risk Management ..............................................................................................................77 Cost Baseline Control and Use of “Should Cost” Management ........................................77 INTERNATIONAL ACQUISITION AND EXPORTABILITY ............................................78 International Acquisition and Exportability Considerations .............................................78 International Cooperative Program Management ..............................................................78 Waivers ..............................................................................................................................79 INDUSTRIAL BASE ANALYSIS AND CONSIDERATIONS ............................................79 LIFE-CYCLE MANAGEMENT OF INFORMATION AND DATA PROTECTION ..........80 ENCLOSURE 3: SYSTEMS ENGINEERING ............................................................................81 PURPOSE ................................................................................................................................81 SYSTEMS ENGINEERING PLAN ........................................................................................81 DEVELOPMENT PLANNING...............................................................................................82 SYSTEMS ENGINEERING TRADE-OFF ANALYSES.......................................................82 TECHNICAL RISK AND OPPORTUNITY MANAGEMENT ............................................83 TECHNICAL PERFORMANCE MEASURES AND METRICS ..........................................83 TECHNICAL REVIEWS ........................................................................................................83 CONFIGURATION MANAGEMENT ...................................................................................84 MODELING AND SIMULATION .........................................................................................84 MANUFACTURING AND PRODUCIBILITY .....................................................................84 SOFTWARE ............................................................................................................................84 RELIABILITY AND MAINTAINABILITY (R&M) .............................................................85 PROGRAM PROTECTION ....................................................................................................85 PPP .....................................................................................................................................86 Countermeasures ................................................................................................................86

DoDI 5000.02, January 7, 2015

CONTENTS 34

OPEN SYSTEMS ARCHITECTURES ..................................................................................86 CORROSION PREVENTION AND CONTROL ...................................................................87 ENVIRONMENT, SAFETY, AND OCCUPATIONAL HEALTH (ESOH) .........................87 PESHE ...............................................................................................................................87 NEPA/ E.O. 12114 .............................................................................................................87 Mishap Investigation Support ............................................................................................88 INSENSITIVE MUNITIONS ..................................................................................................88 ITEM UNIQUE IDENTIFICATION ......................................................................................88 SPECTRUM SUPPORTABILITY ..........................................................................................88 PROGRAM SUPPORT ASSESSMENTS (PSAS) .................................................................88 ENCLOSURE 4: DEVELOPMENTAL TEST AND EVALUATION (DT&E) .........................90 PURPOSE ................................................................................................................................90 OVERVIEW ............................................................................................................................90 T&E MANAGEMENT ............................................................................................................91 DT&E ACTIVITIES ................................................................................................................92 DT&E PLANNING CONSIDERATIONS..............................................................................93 DT&E EXECUTION, EVALUATION, AND REPORTING .................................................96 DT&E Execution ...............................................................................................................96 DASD(DT&E) Program Assessments ...............................................................................96 DT&E Reports and Data ....................................................................................................96 ENCLOSURE 5: OPERATIONAL AND LIVE FIRE TEST AND EVALUATION (OT&E AND LFT&E) .............................................................................................................98 OVERVIEW ............................................................................................................................98 APPLICABILITY ....................................................................................................................98 DOT&E OVERSIGHT LIST ...................................................................................................99 T&E PROGRAM MANAGEMENT .......................................................................................99 Early Engagement ..............................................................................................................99 Lead Operational Test Agency (OTA) ............................................................................100 Required Documentation .................................................................................................100 T&E PROGRAM PLANNING .............................................................................................100 OT&E ACTIVITIES ..............................................................................................................102 Operational Assessments (OAs) ......................................................................................102 RFPs .................................................................................................................................103 OT&E for Reliability and Maintainability .......................................................................103 Use of Modeling and Simulation .....................................................................................103 OT&E FOR SOFTWARE .....................................................................................................104 CYBERSECURITY ...............................................................................................................105 LFT&E ...................................................................................................................................105 RESOURCES AND SCHEDULE .........................................................................................106 OPERATIONAL AND LIVE FIRE T&E EXECUTION .....................................................107 Planning Test Events........................................................................................................107 Conducting Test Events ...................................................................................................109 Data Management, Evaluation, and Reporting ................................................................110 OPERATIONAL TEST READINESS ..................................................................................111

DoDI 5000.02, January 7, 2015

CONTENTS 35

CERTIFICATIONS ...............................................................................................................111 TEMP EVOLUTION THROUGH THE ACQUISITION MILESTONES ...........................111 ENCLOSURE 6: LIFE-CYCLE SUSTAINMENT ....................................................................112 PURPOSE ..............................................................................................................................112 SUSTAINMENT ACROSS THE LIFE CYCLE ..................................................................112 LIFE-CYCLE SUSTAINMENT PLAN (LCSP) ...................................................................114 SUSTAINMENT METRICS .................................................................................................116 Materiel Reliability ..........................................................................................................116 O&S Cost .........................................................................................................................116 Mean Down Time ............................................................................................................116 Other Metrics ...................................................................................................................117 PRODUCT SUPPORT REVIEWS .......................................................................................117 ENCLOSURE 7: HUMAN SYSTEMS INTEGRATION (HSI)................................................118 PURPOSE ..............................................................................................................................118 GENERAL .............................................................................................................................118 HSI PLANNING ....................................................................................................................118 Human Factors Engineering ............................................................................................118 Personnel ..........................................................................................................................118 Habitability ......................................................................................................................118 Manpower ........................................................................................................................119 Training ............................................................................................................................119 Safety and Occupational Health.......................................................................................119 Force Protection and Survivability ..................................................................................119 ENCLOSURE 8: AFFORDABILITY ANALYSIS AND INVESTMENT CONSTRAINTS...120 PURPOSE ..............................................................................................................................120 OVERVIEW ..........................................................................................................................120 LIFE- CYCLE AFFORDABILITY ANALYSIS ..................................................................121 A Product Life Cycle, Component Portfolio Analysis (30 to 40 Years Nominal) ..........121 Future Budget.............................................................................................................122 Time Horizon .............................................................................................................122 Consistency ................................................................................................................122 Fiscal Guidance ..........................................................................................................122 Inflators ......................................................................................................................122 Portfolios ....................................................................................................................122 Other Portfolio Plans..................................................................................................122 Affordability Analysis Updates .................................................................................122 Affordability Analysis Output Format .............................................................................123 Data Format ...............................................................................................................123 Data Requirements for Programs ...............................................................................123 Timing of Affordability Analysis ....................................................................................123 Importance of AoAs to Affordability ..............................................................................123 Affordability Constraints: Goals and Caps .....................................................................123 At MDD .....................................................................................................................124

DoDI 5000.02, January 7, 2015

CONTENTS 36

At Milestone A ...........................................................................................................124 At the Development RFP Release Decision Point, Milestone B, and Beyond ..........124 Monitoring and Reporting................................................................................................124 LOWER ACAT PROGRAMS ..............................................................................................124 ENCLOSURE 9: ANALYSIS OF ALTERNATIVES (AOA) ...................................................125 PURPOSE ..............................................................................................................................125 AOA PROCEDURES ............................................................................................................125 ENCLOSURE 10: COST ESTIMATING AND REPORTING .................................................127 PURPOSE ..............................................................................................................................127 COST ESTIMATION ............................................................................................................127 COST ANALYSIS REQUIREMENTS DESCRIPTION (CARD) .......................................130 COST REPORTING ..............................................................................................................130 DCAPE PROCEDURES .......................................................................................................131 MULTI-YEAR PROCUREMENT—COST ANALYSIS REQUIREMENTS .....................132 General .............................................................................................................................132 CAPE Role and Requirements .........................................................................................132 Additional Requirements .................................................................................................133 ENCLOSURE 11: REQUIREMENTS APPLICABLE TO ALL PROGRAMS CONTAINING INFORMATION TECHNOLOGY (IT) ................................................134 PURPOSE ..............................................................................................................................134 APPLICABILITY ..................................................................................................................134 CLINGER-COHEN ACT (CCA) COMPLIANCE ...............................................................134 POST IMPLEMENTATION REVIEW (PIR).......................................................................135 DOD INFORMATION ENTERPRISE ARCHITECTURE ..................................................135 CYBERSECURITY ...............................................................................................................136 Cybersecurity Risk Management Framework (RMF) .....................................................136 Cybersecurity Strategy .....................................................................................................136 TRUSTED SYSTEMS AND NETWORKS (TSN) ..............................................................136 LIMITED DEPLOYMENT FOR A MAJOR AUTOMATED INFORMATION SYSTEM (MAIS) PROGRAM ........................................................................................................137 CLOUD COMPUTING .........................................................................................................137 DOD ENTERPRISE SOFTWARE INITIATIVE (ESI)........................................................137 DOD DATA CENTER CONSOLIDATION.........................................................................137 IT, INCLUDING NSS, INTEROPERABILITY ...................................................................138 DATA PROTECTION...........................................................................................................138 SECTION 508 - ACCESSIBILITY OF ELECTRONIC AND INFORMATION TECHNOLOGY FOR INDIVIDUALS WITH DISABILITIES ...................................138 ENCLOSURE 12: DEFENSE BUSINESS SYSTEMS (DBS) ..................................................139 PURPOSE ..............................................................................................................................139 DBS ........................................................................................................................................139 DBS GOVERNANCE ...........................................................................................................139 Defense Business Systems Management Committee (DBSMC).....................................139

DoDI 5000.02, January 7, 2015

CONTENTS 37

Investment Review Board (IRB) .....................................................................................140 Functional Sponsors .........................................................................................................140 DoD Component Pre-Certification Authority ..................................................................141 DoD Component Head and Acquisition Executive .........................................................142 DBS PROBLEM STATEMENT ...........................................................................................142 ENCLOSURE 13: RAPID FIELDING OF CAPABILITIES ....................................................143 PURPOSE ..............................................................................................................................143 URGENT OPERATIONAL NEEDS AND OTHER QUICK REACTION CAPABILITIES ...............................................................................................................143 PROCEDURES......................................................................................................................144 RAPID ACQUISITION ACTIVITIES ..................................................................................145 Pre-Development .............................................................................................................145 Development Milestone ...................................................................................................147 Development Activities ...................................................................................................149 P&D Milestone ................................................................................................................149 O&S .................................................................................................................................150 ADDITIONAL INFORMATION REQUIREMENTS ..........................................................151 GLOSSARY ................................................................................................................................153 TABLES

1. Description and Decision Authority for ACAT I – III Programs .......................................44 2. Milestone and Phase Information Requirements ................................................................47 3. APBs ...................................................................................................................................60 4. Statutory Program Breach and Change Definitions ............................................................61 5. Recurring Program Reports ................................................................................................63 6. Exceptions, Waivers, and Alternative Management and Reporting Requirements ............65 7. CSDR System Requirements ..............................................................................................70 8. EVM Requirements ............................................................................................................71 9. CCA Compliance ................................................................................................................72 10. Information Requirements Unique to the Urgent Needs Rapid Acquisition Process .....152

FIGURES 1. Illustration of the Interaction Between the Capability Requirements Process and the Acquisition Process ..................................................................................................5 2. Generic Acquisition Phases and Decision Points .................................................................6 3. Model 1: Hardware Intensive Program ................................................................................9 4. Model 2: Defense Unique Software Intensive Program ....................................................10 5. Model 3: Incrementally Deployed Software Intensive Program .......................................11 6. Model 4: Accelerated Acquisition Program ......................................................................13 7. Model 5: Hybrid Program A (Hardware Dominant) ..........................................................14 8. Model 6: Hybrid Program B (Software Dominant) ...........................................................15

DoDI 5000.02, January 7, 2015

CONTENTS 38

9. Operational or Major Live Fire Test Event: Planning, Approval, Execution, and Reporting....................................................................................................................107 10. Rapid Fielding of Capabilities ........................................................................................145

DoDI 5000.02, January 7, 2015

REFERENCES 39

REFERENCES (a) DoD Directive 5000.01, “The Defense Acquisition System,” May 12, 2003 (b) Interim DoD Instruction 5000.02, “Operation of the Defense Acquisition System,”

November 26, 2013 (hereby cancelled) (c) Office of Management and Budget Circular A-11, “Preparing, Submitting, and Executing

the Budget,” current edition (d) Chairman of the Joint Chiefs of Staff Instruction 3170.01H, “Joint Capabilities Integration

and Development System,” January 10, 2012 (e) Assistant Secretary of Defense for Research and Engineering Guide, “Technology

Readiness Assessment (TRA) Guidance,” April 2011, as amended1 (f) Public Law 110-417, “The Duncan Hunter National Defense Authorization Act for Fiscal

Year 2009,” October 14, 2008 (g) Title 10, United States Code (h) Enclosure 9 of DoD Instruction 5000.02, “Acquisition of Services,” December 8, 2008 (i) Public Law 107-314, “Bob Stump National Defense Authorization Act for Fiscal Year

2003,” December 2, 2002 (j) Title 15, United States Code (k) Public Law 109-364, “John Warner National Defense Authorization Act for Fiscal Year

2007,” October 17, 2006 (l) Public Law 112-239, “National Defense Authorization Act for Fiscal Year 2013,” January 2, 2013 (m) Public Law 111-383, “Ike Skelton National Defense Authorization Act for Fiscal Year

2011,” January 7, 2011 (n) Public Law 101-576, “Chief Financial Officers Act of 1990,” November 15, 1990 (o) Statement of Federal Financial Accounting Standards (SFFAS) No. 23, “Eliminating the

Category National Defense Property, Plant, and Equipment,” May 8, 2003 (p) Title 40, United States Code (q) Public Law 106-398, “Floyd D. Spence National Defense Authorization Act for Fiscal Year

2001,” October 30, 2000 (r) Joint Capabilities Integration and Development System (JCIDS) Manual “Manual for the

Operation of the Joint Capabilities Integration and Development System,” current edition2 (s) Chairman of the Joint Chiefs of Staff Instruction 6212.01F, “Net Ready Key Performance

Parameter (NR KPP),” March 21, 2012 (t) Defense Intelligence Agency Directive 5000.200, “Intelligence Threat Support for Major

Defense Acquisition Programs,” February 1, 20133

_____________________________________ 1https://acc.dau.mil/CommunityBrowser.aspx?id=18545 2https://www.intelink.gov/inteldocs/action.php?kt_path_info=ktcore.actions.document.view&fDocumentId=1517681 3This is a controlled document. The office of primary responsibility is the Defense Intelligence Agency, (202) 231-0678

DoDI 5000.02, January 7, 2015

REFERENCES 40

(u) Defense Intelligence Agency Instruction 5000.002, “Intelligence Threat Support for Major Defense Acquisition Programs,” February 1, 20134

(v) Public Law 112-81, “National Defense Authorization Act for Fiscal Year 2012,” December 31, 2011

(w) DoD 5000.4-M, “Cost Analysis Guidance and Procedures,” December 11, 1992 (x) DoD Instruction 8500.01, “Cybersecurity,” March 14, 2014 (y) DoD Instruction 7041.3, “Economic Analysis for Decisionmaking,” November 7, 1995 (z) Public Law 102-538, “The National Telecommunications and Information Organization

Act,” October 27, 1992 (aa) Title 47, United States Code (ab) DoD Instruction 8330.01, “Interoperability of Information Technology (IT), Including

National Security Systems (NSS),” May 21, 2014 (ac) DoD Instruction 8320.02, “Sharing Data, Information, and Information Technology (IT)

Services in the Department of Defense,” August 5, 2013 (ad) DoD Instruction 8410.03, “Network Management (NM),” August 29, 2012 (ae) DoD Instruction 8320.04, “Item Unique Identification (IUID) Standards for Tangible

Personal Property,” June 16, 2008 (af) DoD Directive 5250.01, “Management of Intelligence Mission Data (IMD) in DoD

Acquisition,” January 22, 2013 (ag) Section 4321, Title 42, United States Code (ah) Executive Order 12114, “Environmental Effects Abroad of Major Federal Actions,”

January 4, 1979 (ai) DoD Instruction 5200.39, “Critical Program Information (CPI) Protection Within the

Department of Defense,” July 16, 2008 (aj) DoD Instruction 5200.44, “Protection of Mission Critical Functions to Achieve Trusted

Systems and Networks (TSN),” November 5, 2012 (ak) Federal Acquisition Regulation, current edition (al) Defense Federal Acquisition Regulation Supplement, current edition (am) DoD Instruction 4650.01, “Policy and Procedures for Management and Use of the

Electromagnetic Spectrum,” January 9, 2009 (an) Public Law 111-23, “Weapon Systems Acquisition Reform Act of 2009,” May 22, 2009 (ao) DoD Instruction O-5240.24, “Counterintelligence (CI) Activities Supporting Research,

Development, and Acquisition (RDA),” June 8, 20115 (ap) DoD Instruction 4630.09, “Wireless Communications Waveform Development and

Management,” November 3, 2008 (aq) Public Law 109-163, “National Defense Authorization Act for Fiscal Year 2006,”

January 6, 2006 (ar) Memorandum of Agreement between the Director of National Intelligence and the

Secretary of Defense concerning the Management of Acquisition Programs Executed at the Department of Defense Intelligence Community Elements, March 25, 20086

_____________________________________ 4This is a controlled document. The office of primary responsibility is the Defense Intelligence Agency, (202) 231-0678 5This is a controlled document. The office of primary responsibility is Under Secretary of Defense (Intelligence), [email protected]. Access requires a DoD PKI Certificate. 6www.fas.org/irp/dni/moa.pdf

DoDI 5000.02, January 7, 2015

REFERENCES 41

(as) Intelligence Community Policy Guidance 801.1, “Acquisition,” July 12, 20077 (at) DoD 5000.04-M-1, “Cost and Software Data Reporting (CSDR) Manual,”

November 4, 2011 (au) American National Standards Institute (ANSI)/Electronic Industries Alliance (EIA) 748,

March 2013 (av) Data Item Management-81861, “Data Item Description: Integrated Program Management

Report (IPMR),” June 20, 2012 (aw) Title 44, United States Code (ax) DoD Instruction 5000.66, “Operation of the Defense Acquisition, Technology, and

Logistics Workforce Education, Training, and Career Development Program,” December 21, 2005

(ay) Under Secretary of Defense for Acquisition, Technology, and Logistics Policy Memorandum, “Key Leadership Positions and Qualification Criteria,” November 8, 2013

(az) DoD Instruction 2040.02, “International Transfers of Technology, Articles, and Services,” March 27, 2014

(ba) DoD Instruction 2010.06, “Materiel Interoperability and Standardization with Allies and Coalition Partners,” July 29, 2009

(bb) Defense Security Cooperation Agency Manual, “Security Assistance Management Manual (SAMM),” current version8

(bc) DoD 5015.02-STD, “Electronic Records Management Software Applications Design Criteria Standard,” April 25, 2007

(bd) Military-Standard 882E, “DoD Standard Practice for System Safety,” May 11, 2012 (be) DoD Instruction 5134.17, “Deputy Assistant Secretary of Defense for Developmental Test

and Evaluation (DASD(DT&E)),” October 25, 2011 (bf) Chairman of the Joint Chiefs of Staff Instruction 6510.01F, “Information Assurance (IA)

and Support to Computer Network Defense (CND),” February 9, 2011, as amended (bg) DoD Instruction 8510.01, “Risk Management Framework (RMF) for DoD Information

Technology (IT),” March 12, 2014 (bh) DoD Instruction 5000.61, “DoD Modeling and Simulation (M&S) Verification, Validation,

and Accreditation (VV&A),” December 9, 2009 (bi) DoD Instruction 4151.22, “Condition Based Maintenance Plus (CBM+) for Materiel

Maintenance,” October 16, 2012 (bj) Public Law 113-66, “National Defense Authorization Act for Fiscal Year 2014,”

December 26, 2013 (bk) DoD Manual 4160.28, Volume 1, “Defense Demilitarization: Program Administration,”

June 7, 2011 (bl) DoD Instruction 5000.67, “Prevention and Mitigation of Corrosion on DoD Military

Equipment and Infrastructure,” February 1, 2010 (bm) DoD Instruction 1100.22, “Policy and Procedures for Determining Workforce Mix,”

April 12, 2010 ______________________________________ 7http://www.dni.gov/files/documents/ICPG/ICPG_801_1.pdf 8http://www.samm.dsca.mil/

DoDI 5000.02, January 7, 2015

REFERENCES 42

(bn) DoD Instruction 7041.04, “Estimating and Comparing the Full Costs of Civilian and Active Duty Military Manpower and Contract Support,” July 3, 2013

(bo) DoD Directive 1322.18, “Military Training,” January 13, 2009 (bp) DoD Directive 5105.84, “Director of Cost Assessment and Program Evaluation (DCAPE),”

May 11, 2012 (bq) Office of the Secretary of Defense, Cost Assessment and Program Evaluation, “Operating

and Support Cost-Estimating Guide,” March 2014 (br) Global Information Grid (GIG) Technical Guidance Federation (GTGF)9 (bs) Office of Management and Budget Memorandum M-03-14, “Reducing Cost and Improving

Quality in Federal Purchases of Commercial Software,” June 2, 2003 (bt) Office of Management and Budget Memorandum M-04-08, “Maximizing Use of SmartBuy

and Avoiding Duplication of Agency Activities with the President’s 24 E-Gov Initiatives,” February 25, 2004

(bu) Office of Management and Budget Memorandum M-04-16, “Software Acquisition,” July 1, 2004

(bv) Office of Management and Budget Memorandum M-05-25, “SmartBUY Agreement with Oracle,” August 25, 2005

(bw) DoD Directive 5400.11, “DoD Privacy Program,” May 8, 2007 (bx) DoD 5400.11-R, “Department of Defense Privacy Program,” May 14, 2007 (by) DoD Instruction 5400.16, “DoD Privacy Impact Assessment (PIA) Guidance,”

February 12, 2009 (bz) DoD Instruction 3200.12, “DoD Scientific and Technical Information Program (STIP),”

August 22, 2013 (ca) Section 794d of Title 29, United States Code (cb) DoD Manual 8400.01-M, “Procedures for Ensuring the Accessibility of Electronic and

Information Technology (E&IT) Procured by DoD Organizations,” June 3, 2011 (cc) DoD Directive 5000.71, “Rapid Fulfillment of Combatant Commander Urgent Operational

Needs,” August 24, 2012 (cd) Defense Acquisition University website10 (ce) Defense Acquisition University Glossary11 ______________________________________ 9http://www.disa.mil/Services/Enterprise-Engineering/IT-Standards 10http://www.dau.mil/default.aspx 11https://dap.dau.mil/glossary/Pages/Default.aspx

DoDI 5000.02, January 7, 2015

ENCLOSURE 1 43

ENCLOSURE 1

ACQUISITION PROGRAM CATEGORIES AND COMPLIANCE REQUIREMENTS 1. PURPOSE. This enclosure: a. Provides the definitions and dollar thresholds of acquisition categories (ACATs) and prescribes the policy for assignment of the cognizant Milestone Decision Authority (MDA). b. Lists the information requirements associated with the ACATs in tabular format. c. Provides the policy and procedure applicable to acquisition program baselines and acquisition program reporting. 2. ACATs a. Categories. An acquisition program will be categorized based on the criteria in Table 1 of this enclosure. Table 1 contains the description and decision authority for ACAT I through ACAT III programs. The Defense Acquisition Executive (DAE) or designee will review potential ACAT I and IA materiel solutions; the Component Acquisition Executive (CAE) or the individual designated by the CAE will review potential ACAT II and ACAT III materiel solutions. b. Designation of Programs That Qualify as Both a Major Automated Information System (MAIS) Program and a Major Defense Acquisition Program (MDAP). At the DAE’s discretion, a program that meets the definitions of both a MAIS program and an MDAP may be treated as an MDAP. Programs will comply with the statutory and regulatory requirements associated with the chosen designation. The DAE’s determination will be documented in an Acquisition Decision Memorandum (ADM) for the program. c. Program Reclassification (1) The CAE will notify the DAE when an increase or estimated increase in program cost or a change in acquisition strategy will result in a possible reclassification of a formerly lower ACAT program as an ACAT I or IA program. ACAT changes will be reported as soon as the DoD Component anticipates that the program’s cost is within 10 percent of the minimum cost threshold of the next ACAT level. ACAT reclassification will occur upon designation by the DAE. (2) The CAE may request reclassification of an ACAT I or IA program to a lower category. The request will identify the reasons for the reduction in category level. The category reduction will become effective upon approval of the request by the DAE.

DoDI 5000.02, January 7, 2015

ENCLOSURE 1 44

Table 1. Description and Decision Authority for ACAT I – III Programs

ACAT Reason for ACAT Designation Decision Authority

ACAT I

• MDAP (10 U.S.C. 2430 (Reference (g))) o Dollar value for all increments of the program: estimated by the DAE to require an

eventual total expenditure for research, development, and test and evaluation (RDT&E) of more than $480 million in Fiscal Year (FY) 2014 constant dollars or, for procurement, of more than $2.79 billion in FY 2014 constant dollars

o MDA designation • MDA designation as special interest1

ACAT ID: DAE or as delegated ACAT IC: Head of the DoD Component or, if delegated, the CAE (not further delegable)

ACAT IA2, 3

• MAIS (10 U.S.C. 2445a ( Reference (g))): A DoD acquisition program for an Automated Information System4 (AIS) (either as a product or a service5) that is either:

o Designated by the MDA as a MAIS program; or o Estimated to exceed: $40 million in FY 2014 constant dollars for all expenditures, for all increments,

regardless of the appropriation or fund source, directly related to the AIS definition, design, development, deployment, and sustainment, and incurred in any single fiscal year; or

$165 million in FY 2014 constant dollars for all expenditures, for all increments, regardless of the appropriation or fund source, directly related to the AIS definition, design, development, and deployment, and incurred from the beginning of the Materiel Solution Analysis Phase through deployment at all sites; or

$520 million in FY 2014 constant dollars for all expenditures, for all increments, regardless of the appropriation or fund source, directly related to the AIS definition, design, development, deployment, operations and maintenance, and incurred from the beginning of the Materiel Solution Analysis Phase through sustainment for the estimated useful life of the system. • MDA designation as special interest1

ACAT IAM: DAE or as delegated ACAT IAC: Head of the DoD Component or, if delegated, the CAE (not further delegable)

ACAT II

• Does not meet criteria for ACAT I or IA • Major system (10 U.S.C. 2302d ( Reference (g)))

o Dollar value: estimated by the DoD Component head to require an eventual total expenditure for RDT&E of more than $185 million in FY 2014 constant dollars, or for procurement of more than $835 million in FY 2014 constant dollars

o MDA designation5 (10 U.S.C. 2302 ( Reference (g)))

CAE or the individual designated by the CAE6

ACAT III • Does not meet criteria for ACAT II or above • An AIS program that is not a MAIS program Designated by the CAE6

1. The Special Interest designation is typically based on one or more of the following factors: technological complexity; congressional interest; a large commitment of resources; or the program is critical to the achievement of a capability or set of capabilities, part of a system of systems, or a joint program. Programs that already meet the MDAP and MAIS thresholds cannot be designated as Special Interest. 2. When a MAIS program also meets the definition of an MDAP, the DAE will be the MDA unless delegated to a DoD Component or other official. The DAE will designate the program as either a MAIS or an MDAP, and the Program Manager will manage the program consistent with the designation. 3. The MDA (either the DAE or, if delegated, the DoD Chief Information Officer (CIO) or another designee) will designate MAIS programs as ACAT IAM or ACAT IAC. MAIS programs will not be designated as ACAT II. 4. AIS: A system of computer hardware, computer software, data or telecommunications that performs functions such as collecting, processing, storing, transmitting, and displaying information. Excluded are computer resources, both hardware and software, that are an integral part of a weapon or weapon system; used for highly sensitive classified programs (as determined by the Secretary of Defense); used for other highly sensitive information technology (IT) programs (as determined by the DoD CIO); or determined by the DAE or designee to be better overseen as a non-AIS program (e.g., a program with a low ratio of RDT&E funding to total program acquisition costs or that requires significant hardware development). 5. When determined by the USD(AT&L) (or designee), IT services programs that achieve the MAIS threshold will follow the procedures applicable to MAIS programs specified in this instruction. All other acquisitions of services will comply with Enclosure 9 of DoD Instruction 5000.02 (Reference (h)) until cancelled by issuance of the new acquisition of services instruction. 6. As delegated by the Secretary of Defense or Secretary of the Military Department.

DoDI 5000.02, January 7, 2015

ENCLOSURE 1 45

(3) The DAE may reclassify an acquisition program at any time. The reclassification decision will be documented in an ADM. 3. ACQUISITION PROGRAM INFORMATION REQUIREMENTS AT MILESTONES AND OTHER DECISION POINTS a. Table 2 lists the statutory and regulatory requirements at each of the milestones and other decision points during the acquisition process. In consultation with the appropriate stakeholders, program managers may propose for MDA approval, tailoring of Regulatory program information. MDAs will document all information tailoring decisions. b. Each row identifies an information requirement and the source of the requirement. (Sources may refer to United States Code (U.S.C.), Public Law (P.L.), an Executive Order (E.O.), DoD Instructions (DoDIs), Directives (DoDDs), or other types of documentation. When available, the source will include paragraph (Para.), section (Sec.), or enclosure (Enc.) numbers and the reference (Ref.) identifier from the list of references in this instruction. STATUTORY items and sources appear in ALL CAPS; Regulatory items and sources appear in normal text. Requirements are in alphabetical order. (1) A dot (●) in a cell indicates the specific applicability of the requirement to program type and life-cycle event, and represents the initial submission of information. Moving right across a row, a checkmark () indicates the requirement for updated information, and another dot indicates submission of new information. (2) Notes accompany each row to explain the requirement, limit or extend the requirement’s applicability to program type and/or life-cycle event, or refer the reader to more detailed direction. c. Labels for the “Life-Cycle Event” columns represent the following events: (1) “MDD”—Materiel Development Decision. (2) “MS A”—Milestone A Decision Review. (3) “CDD Val”—Capability Development Document Validation. (4) “Dev RFP Rel”—The Development Request for Proposals (RFP) Release Decision Point conducted before Milestone B to authorize release of the RFP for the next phase. (5) “MS B”—Milestone B Decision Review. (6) “MS C”—Milestone C Decision Review. (7) FRP/FD Dec”—The Full-Rate Production (FRP) Decision or the Full Deployment (FD) Decision.

DoDI 5000.02, January 7, 2015

ENCLOSURE 1 46

(8) “Other”—An event other than the events listed above; the event will be identified in the notes associated with the row. d. Documentation for the identified events will be submitted at least 45 calendar days before the planned review. e. Information requirements that are finalized and approved by the responsible authority in support of the Development RFP Release Decision Point do not have to be re-submitted prior to Milestone B unless substantive changes have occurred. f. Final milestone documents for programs reviewed at the OSD level will be submitted to the Acquisition Information Repository within 5 business days of document approval. g. In Table 2, when applied to requirements associated with the Development RFP Release Decision Point, the modifier “draft” will mean a Program Manager-, Program Executive Officer- (PEO), and CAE-approved draft subject to change based on results of the source selection process and pre-Milestone B Component and OSD staff coordination. h. The Program Manager may submit a document prepared to satisfy the information requirements of multiple programs (instead of a program-specific document). Such substitution will require written permission from the approving authority. i. When there is a logical relationship between required documents, e.g., the Acquisition Strategy and the Life-Cycle Sustainment Plan, and consequent coordination can be streamlined, the MDA may approve combining requirements.

DoDI 5000.02, January 7, 2015

ENCLOSURE 1 47

Table 2. Milestone and Phase Information Requirements

INFORMATION REQUIREMENT PROGRAM TYPE1 LIFE-CYCLE EVENT1,2,3

SOURCE APPROVAL AUTHORITY MDAP MAIS

ACAT MDD MS

A CDD Val

Dev RFP Rel

MS B5

MS C

FRP/FD Dec OTHER

II ≤ III

2366a/b CERTIFICATION MEMORANDUM ● ● ● ● 10 U.S.C. 2366a (Ref. (g)) 10 U.S.C. 2366b (Ref. (g)) This instruction

MDA

STATUTORY for MDAPs at Milestones A and B. The MDA does not have authority to delegate this requirement. A memorandum similar to that required at Milestone B is a Regulatory requirement at Milestone C if “C” is program initiation.

Acquisition Decision Memorandum (ADM) ● ● ● ● ● ● ● ● ● ● ● This instruction MDA Regulatory. Documents MDA decisions and direction.

ACQUISITION PROGRAM BASELINE (APB) ● ● ● ● ● 10 U.S.C. 2435 (Ref. (g)) 10 U.S.C. 2433a (Ref. (g)) DoDD 5000.01 (Ref. (a))

MDA

STATUTORY for MDAPs at Milestones B and C and the FRP decision; a Regulatory requirement at all other Program Type/Event combinations, including the required draft4 at Development RFP Release. The APB is not approved by the MDA until Milestone B, however. See section 4 in this enclosure for requirements at other than the identified decision points.

ACQUISITION STRATEGY ● ● ● ● ● ● SEC. 803, P.L. 107-314 (Ref. (i)) Para. 6a of Enc. 2 of this instruction MDA

STATUTORY for MDAPs at Milestone A; Regulatory for all other program types at all marked events including MDAPs after Milestone A. The Acquisition Strategy will include STATUTORY and Regulatory information. Major changes to the plan reflected in the Acquisition Strategy require MDA approval. The following STATUTORY requirements will be satisfied in the Acquisition Strategy: • BENEFIT ANALYSIS AND DETERMINATION: STATUTORY; applies to bundled acquisitions only. Includes MARKET RESEARCH to determine whether consolidation of the requirements is necessary and justified. Required at

Milestone C if there was no Milestone B; an update is not required at the FRP/FD decision point. 15 U.S.C. 632 (Reference (j)) defines a bundled contract as a contract that is entered into to meet requirements that are consolidated in a bundling of contract requirements. The term "bundling of contract requirements" means consolidating two or more procurement requirements for goods or services previously provided or performed under separate smaller contracts into a solicitation of offers for a single contract that is likely to be unsuitable for award to a small-business concern. SOURCE(S): 15 U.S.C. 644(e) (Ref. (j)), 15 U.S.C. 657q (Ref. (j))

• CONSIDERATION OF TECHNOLOGY ISSUES: STATUTORY. Promotes, monitors, and evaluates programs for the communication and exchange of technological data. Not required below ACAT II nor after the Development RFP Release. For urgent needs, expedited consideration of technology issues will be reviewed during the COURSE OF ACTION ANALYSIS. SOURCE(S): 10 U.S.C. 2364 (Ref. (g))

• CONTRACT-TYPE DETERMINATION: STATUTORY. Satisfied when the MDA approves the Acquisition Strategy with specified contract types. Only required for MDAPs at Development RFP Release and Milestones B and C. The MDA for an MDAP may conditionally approve the contract type selected for a development program at the Development RFP Release Decision Point, and give final approval at the time of Milestone B approval. The development contract type must be consistent with the level of program risk and may be either a fixed price or cost type contract. If selecting a cost-type contract, the MDA must comply with the conditions and reporting requirements listed in Table 6 in this enclosure. The DoD MAY NOT enter into cost-type contracts for production of an MDAP unless compliant with the conditions and notifications listed in Table 6. SOURCE(S): SEC. 818, P.L. 109-364 (Ref. (k)), SEC. 811, P.L. 112-239 (Ref. (l))

• COOPERATIVE OPPORTUNITIES: STATUTORY. Only due at the first program milestone review. The requirement for a Cooperative Opportunities Document will be satisfied via the International Involvement section in the Acquisition Strategy outline. For programs responding to urgent needs, proven capabilities will be assessed during the COURSE OF ACTION ANALYSIS. SOURCE(S) : 10 U.S.C. 2350a (Ref. (g)), SEC. 243, P.L. 111-383 (Ref. (m))

(continued, next page…)

DoDI 5000.02, January 7, 2015

ENCLOSURE 1 48

Table 2. Milestone and Phase Information Requirements, continued



ACAT MDD MS

A CDD Val

Dev RFP Rel

MS B5

MS C

FRP/FD Dec OTHER

II ≤ III

ACQUISITION STRATEGY, continued • GENERAL EQUIPMENT VALUATION: STATUTORY; a program description that identifies contract-deliverable military equipment, non-military equipment, and other deliverable items; includes plan(s) to ensure that all deliverable

equipment requiring capitalization is serially identified and valued. Only required at Milestone C; updated as necessary for the FRP/FD Decision. The capitalization thresholds are unit costs at or above $1 million for Air Force and Navy general fund assets, and unit costs at or above $250 thousand for all internal use software and for other equipment assets for all other general and working capital funds. SOURCE(S): P.L. 101-576 (Ref. (n)), Statement of Federal Financial Accounting Standards 23 (Ref. (o))

• INDUSTRIAL BASE CAPABILITIES CONSIDERATIONS: STATUTORY for MDAPs; Regulatory for others. Summarizes the results of the industrial base capabilities’ analysis. SOURCE(S): 10 U.S.C. 2440 (Ref. (g)) • INTELLECTUAL PROPERTY (IP) STRATEGY: STATUTORY for major weapon systems and subsystems; Regulatory for other program types. The IP Strategy must be updated as appropriate to support and account for evolving IP

considerations associated with the award and administration of all contracts throughout the system life cycle. Becomes part of the Life-Cycle Sustainment Plan (LCSP) during Operations and Support (O&S). For programs responding to urgent needs, due at the Development Milestone. SOURCE(S): 10 U.S.C. 2320 (Ref. (g)), Para. 6a(4) of Enclosure 2 of this instruction

• MARKET RESEARCH: STATUTORY. A stand-alone, Regulatory requirement at MDD. STATUTORY updates (as part of the ACQUISITION STRATEGY) required at Milestone A and the Development RFP release point; not required thereafter. Conducted to reduce the duplication of existing technologies and products, and to understand potential materiel solutions, technology maturity, and potential sources, to assure maximum participation of small business concerns, and possible strategies to acquire them. For programs responding to urgent needs, included in the Course of Action Approach at the Development Milestone. SOURCE(S): 10 U.S.C. 2377 (Ref. (g)), 15 U.S.C. 644(e)(2) (Ref. (j)), This instruction

• SMALL BUSINESS INNOVATION RESEARCH (SBIR)/SMALL BUSINESS TECHNOLOGY TRANSFER (STTR) PROGRAM TECHNOLOGIES: STATUTORY. Program managers will establish goals for applying SBIR and STTR technologies in programs of record and incentivize primes to meet those goals. For contracts with a value at or above $100 million, program managers will establish goals for the transition of Phase III technologies in subcontracting plans and require primes to report the number and dollar amount of Phase III SBIR or STTR contracts. Not required at Milestone B. SOURCE(S): 15 U.S.C. 638 (Ref. (j))

• TERMINATION LIABILITY ESTIMATE: STATUTORY. Only for MDAPs. Must be documented in the ACQUISITION STRATEGY for any contract for the development or production of an MDAP for which potential termination liability could reasonably be expected to exceed $100 million. Updates may therefore be required at other than the marked events. The estimate must include how such termination liability is likely to increase or decrease over the period of performance. The Program Manager must consider the estimate before making recommendations on decisions to enter into or terminate such contracts. SOURCE(S): SEC. 812, P.L. 112–239 (Ref. (l))

Affordability Analysis ● ● ● ● ● Section 3 of Enc. 8 of this instruction MDA Regulatory. Prior to the MDD, the analysis will yield tentative cost goals and inventory goals; for Milestone A, the analysis will yield affordability goals; and for the Development RFP Release Decision Point, Milestone B, and beyond, the analysis will yield binding affordability caps.

Table Notes: 1. A dot (●) in a cell indicates the specific applicability of the requirement to program type and life-cycle

event, and represents the initial submission requirement. Moving right across a row, a checkmark () indicates the requirement for updated information.

2. All of the “Life-Cycle Events” will not necessarily apply to all “Program Types.” 3. Unless otherwise specified when discussed in this instruction, documentation for identified events will

be submitted no later than 45 calendar days before the planned review.

4. Requires a Program Manager-, PEO-, and CAE-approved draft. 5. Information requirements that have been finalized and approved by the responsible authority in support of the Development

RFP Release Decision Point do not have to be re-submitted prior to Milestone B unless changes have occurred. In that case, updated documents will be provided.

6. Incrementally Deployed Software Intensive Programs (Model #3) do not have a Milestone C and consequently are not required to satisfy the Table 2 requirements associated with that milestone.

DoDI 5000.02, January 7, 2015

ENCLOSURE 1 49




ACAT MDD MS

A CDD Val

Dev RFP Rel

MS B5

MS C

FRP/FD Dec OTHER

II ≤ III

ANALYSIS OF ALTERNATIVES (AoA) ● ● ● ● ● 40 U.S.C. 11312 (Ref. (p)) SEC. 811, P.L. 106-398 (Ref. (q)) 10 U.S.C. 2366a (Ref. (g))

MDA (DCAPE assesses AoAs for ACAT ID/IAM only)

STATUTORY for MDAPs, MAIS programs, and all AIS programs, including National Security Systems (NSSs), at Milestone A. STATUTORY updates required through Milestone C (or Milestone B if there is no Milestone C) for MAIS programs, and all AIS programs. Regulatory for all other specified Program Type/Event combinations. A DoD Component is responsible for conduct and approval of the AoA. The distinct assessment and approval roles of the Director of Cost Assessment and Program Evaluation (DCAPE) and the MDA associated with the AoA and the selection of the materiel solution(s) are detailed in section 2 of Enclosure 9 of this instruction.

AoA Study Guidance and AoA Study Plan ● ● ● ● ● Para. 5d(1)(b) of this instruction DCAPE or DoD Component Equivalent

Regulatory requirements to guide the AoA. AoA Study Guidance informs the preparation of the AoA Study Plan. The AoA Study Guidance must be provided to DoD Component(s) for development of the AoA Study Plan prior to the MDD. Consistent with the AoA Study Guidance, the lead DoD Component will prepare the AoA Study Plan and present it at the MDD.

BANDWIDTH REQUIREMENTS REVIEW ● ● ● ● ● SEC. 1047, P.L. 110-417 (Ref. (f)) This Instruction DoD CIO

STATUTORY for MDAPs and major weapon systems; Regulatory for all other programs. Bandwidth requirements data will be documented in the Information Support Plan (ISP). If the ISP is waived for a program, conformance with bandwidth review will be based on data provided in the Capability Development Document (CDD), consistent with Net-Ready Key Performance Parameter (NR-KPP) guidance in the Manual for the Operation of the Joint Capabilities Integration and Development System (JCIDS) (Reference (r)) and Chairman of the Joint Chiefs of Staff Instruction (CJCSI) 6212.01F (Reference (s)).

Capability Development Document (CDD) ● ● ● ● ● CJCSI 3170.01 (Ref.(d)) JCIDS Manual (Ref. (r))

JROC, JCB, or Component Validation

Regulatory. A draft CDD is required at Milestone A; a validated CDD is required at the Development RFP Release Decision Point and informs Milestone B. If there are no changes, a revalidated CDD may be submitted for the Capability Production Document (CPD) required at Milestone C. An equivalent DoD Component-validated requirements document will satisfy this requirement for certain information systems. For approval authorities, JROC is Joint Requirements Oversight Council; JCB is Joint Capabilities Board.

Capability Production Document (CPD) ● ● ● ● ● CJCSI 3170.01 (Ref.(d)) JCIDS Manual (Ref. (r))


Regulatory. If there are no changes, a revalidated CDD may satisfy this information requirement. An equivalent DoD Component-validated requirements document will satisfy this requirement for certain information systems; the equivalent documents are finalized after Milestone B, to support deployment.








DoDI 5000.02, January 7, 2015

ENCLOSURE 1 50




ACAT MDD MS

A CDD Val

Dev RFP Rel

MS B5

MS C

FRP/FD Dec OTHER

II ≤ III

Capstone Threat Assessment ● ● ● ● ● DIA Directive 5000.200 (Ref. (t)) DIA Instruction 5000.002 (Ref. (u))

Validated by Defense Intelligence Agency

(DIA) Regulatory. Capstone Threat Assessments are maintained by the responsible production center and are required to be updated every 2 years, independent of acquisition decision events. Capstone Threat Assessments serve as the analytical foundation for System Threat Assessment Reports (STARs) and maintain projections of technology and adversary capability trends over the next 20 years.

CLINGER-COHEN ACT (CCA) COMPLIANCE ● ● ● ● ● ● ● ● SUBTITLE III, TITLE 40 (Ref. (p)) SEC. 811, P.L. 106-398 (Ref. (q))

MDA and Component CIO or designee

STATUTORY for all programs that acquire information technology (IT); Regulatory for other programs. See section 3 in Enclosure 11 for amplifying guidance. A summary of required actions is in Table 9 in this enclosure. The Program Manager will report CCA compliance to the MDA and the Component CIO or designee. For IT programs employing an incremental development model (i.e., Model 3), the Program Manager will report CCA compliance at each Limited Deployment Decision Point.

Concept of Operations/Operational Mode Summary/Mission Profile (CONOPS/OMS/MP) ● ● ● ● ● JCIDS Manual (Ref. (r)) DoD Component

Regulatory. The CONOPS/OMS/MP is a Component approved acquisition document that is derived from and consistent with the validated/approved capability requirements document. The CONOPS/OMS/MP describes the operational tasks, events, durations, frequency and environment in which the materiel solution is expected to perform each mission and each phase of the mission. The CONOPS/OMS/MP will be provided to the MDA at the specified decision events and normally provided to industry as part of the RFP.

CORE LOGISTICS DETERMINATION / CORE LOGISTICS AND SUSTAINING WORKLOADS ESTIMATE

● ● ● ● ● ●

10 U.S.C. 2464 (Ref. (g)) 10 U.S.C. 2366a & 2366b (Ref. (g)) SEC. 801, P.L. 112-81 (Ref. (v)) Para. 3d(2) of Enc. 6 of this instruction

MDA/DoD Component

STATUTORY. Only the CORE LOGISTICS DETERMINATION is required at Milestone A. Required at Milestone C if there was no Milestone B. Documented in the LCSP. Not required for AIS programs.

Cost Analysis Requirements Description (CARD) ● ● ● ● Sec. 3 of Enc. 10 of this instruction DoD 5000.4-M (Ref. (w)) DoD Component

Regulatory. Due any time an INDEPENDENT COST ESTIMATE (ICE) or an ECONOMIC ANALYSIS is required. Procedures are specified in section 3 of Enclosure 10 of this instruction.








DoDI 5000.02, January 7, 2015

ENCLOSURE 1 51




ACAT MDD MS

A CDD Val

Dev RFP Rel

MS B5

MS C

FRP/FD Dec OTHER

II ≤ III

CYBERSECURITY STRATEGY ● ● ● ● ● SEC. 811, P.L. 106-398 (Ref. (q)) 40 U.S.C. 11312 (Ref. (p)) DoDI 8500.01E (Ref. (x))

DoD CIO; Component CIO

STATUTORY for mission critical or mission essential IT systems. Regulatory for all other programs containing IT, including NSS. See section 6 of Enclosure 11. The CYBERSECURITY STRATEGY is an appendix to the Program Protection Plan (PPP). A draft4 update is due for the Development RFP Release and is approved at Milestone B. May include the approved DoD Risk Management Framework Security Plan for urgent needs. The DoD CIO is approval authority for ACAT ID and all ACAT IA programs; the Component CIO is approval authority for all other ACATs.

Development RFP Release Cost Assessment ● ● ● Para. 2a(5) of Enc. 10 of this instruction CAPE

Regulatory. Requirements and procedures for this assessment are specified in paragraph 2a(5) in Enclosure 10 of this instruction.

DoD Component Cost Estimate ● ● ● ● ● ● ● Para. 5d(3)(b)2b of this instruction Sec. 2 of Enc. 10 of this instruction DoD Component

Regulatory. See the direction in section 2 of Enclosure 10 of this instruction. The DoD Component will determine the cost estimating requirements for ACAT II and III programs.

DoD Component Cost Position ● ● ● ● ● ● ● Para. 2e of Enc. 10 of this instruction DoD Component

Regulatory. Mandatory for MDAPs and MAIS programs; documented DoD Component Cost Position must be signed by the appropriate DoD Component Deputy Assistant Secretary for Cost and Economics.

DoD Component Live Fire Test and Evaluation (LFT&E) Report ● ● ● ● ● This instruction CAE

Regulatory. Programs on the Director, Operational Test and Evaluation (DOT&E) Oversight List for LFT&E oversight only; due upon completion of LFT&E.








DoDI 5000.02, January 7, 2015

ENCLOSURE 1 52




ACAT MDD MS

A CDD Val

Dev RFP Rel

MS B5

MS C

FRP/FD Dec OTHER

II ≤ III

DOT&E REPORT ON INITIAL OPERATIONAL TEST AND EVALUATION (IOT&E) ● ● ● ● ● 10 U.S.C. 2399 (Ref. (g))

10 U.S.C. 139 (Ref. (g)) DOT&E

STATUTORY; required for DOT&E Oversight List programs only. The DOT&E publishes an online list of programs under operational test and evaluation (OT&E) and LFT&E oversight at https://extranet.dote.osd.mil/oversight/ (requires login with a Common Access Card). A final decision to proceed beyond Low-Rate Initial Production (LRIP) or beyond Limited Deployment may not be made until the DOT&E has submitted the IOT&E Report to the Secretary of Defense, and the congressional defense committees have received that report. If DoD decides to proceed to operational use of the program or to make procurement funds available for the program before the MDA’s FRP/FD decision, the DOT&E's report will be submitted as soon as practicable after the DoD decision to proceed.

ECONOMIC ANALYSIS ● ● ● ● ● ● SEC. 811, P.L. 106-398 (Ref. (q)) DoDI 7041.3 (Ref. (y)) DoD Component

STATUTORY for MAIS. May be combined with the AoA at Milestone A. Also required at any review that is the equivalent of Milestone B or the FD Decision.

Exit Criteria ● ● ● ● ● ● ● This instruction MDA Regulatory. Exit criteria are specific events and accomplishments that must be achieved before a program can proceed to the designated acquisition phase covered by the criteria. Documented in the ADM.

FREQUENCY ALLOCATION APPLICATION (DD FORM 1494) ● ● ● ● ● ● ● SEC. 104, P.L. 102-538 (Ref. (z))

47 U.S.C. 305, 901-904 (Ref. (aa))

National Telecommunications

and Information Administration

STATUTORY for all systems/equipment that use the electromagnetic spectrum while operating in the United States and its possessions. The DD Form 1494, Application for Equipment Frequency Allocation, is available from http://www.dtic.mil/whs/directives/infomgt/forms/dd/ddforms1000-1499.htm. The STATUTORY requirement for milestone decisions is met when DD Form 1494 is submitted by the Program Manager to the appropriate reviewing and approving agencies. Generally not applicable to Defense Business System (DBS) programs.

Full Funding Certification Memorandum ● ● ● ● ● ● Para. 2f of Enc. 10 of this instruction MDA/CAPE

Regulatory. See paragraph 2f of Enclosure 10 to this instruction. Must be signed by the CAE and the Component Chief Financial Officer.








DoDI 5000.02, January 7, 2015

ENCLOSURE 1 53




ACAT MDD MS

A CDD Val

Dev RFP Rel

MS B5

MS C

FRP/FD Dec OTHER

II ≤ III

INDEPENDENT COST ESTIMATE (ICE) ● ● ● ● ● ● ● 10 U.S.C. 2434 (Ref. (g)) 10 U.S.C. 2334 (Ref. (g))

DCAPE or DoD Component

STATUTORY. Section 2 in Enclosure 10 provides detailed instructions for MDAPs and MAIS programs. The Milestone C requirement only applies when the milestone decision authorizes LRIP. The DCAPE will be the approval authority for ACAT ID and IAM programs; the Component will approve ACAT IC programs following review by DCAPE.

INDEPENDENT LOGISTICS ASSESSMENT (ILA) ● ● ● ● SEC. 832, P.L. 112-81 (Ref. (v)) Sec. 5 of Enc. 6 of this instruction CAE

STATUTORY for weapon system MDAPs only. For the FRP assessment, required if the decision is more than 4 years after Milestone C. Assessments after FRP will be accomplished at a minimum interval of every 5 years after Initial Operational Capability (IOC).

Information Support Plan (ISP) ● ● ● ● ● DoDI 8330.01 (Ref. (ab)) DoDI 8320.02 (Ref. (ac)) DoDI 8410.03 (Ref. (ad))

DoD Component or as delegated

Regulatory. Applicable to all IT, including NSS. A draft4 is due for Development RFP Release; approved at Milestone B. Unless waived, updated at the Critical Design Review. The ISP of record is due prior to Milestone C; an updated ISP of record may be required during O&S. Enter data on-line at https://gtg.csd.disa.mil/; requires an account and login with a Common Access Card.

Information Technology (IT) and National Security System (NSS) Interoperability Certification ● ● ● ● ● DoDI 8330.01 (Ref. (ab)) JITC or

DoD Component Regulatory. Applicable to all IT, including NSS. Testing completed before or during OT&E. The Joint Interoperability Test Command (JITC) certifies interoperability of IT with joint, multinational, and/or interagency interoperability requirements. DoD Components certify all other IT. Certification must occur prior to deployment.

Initial Capabilities Document (ICD) ● ● ● ● ● CJCSI 3170.01 (Ref. (d)) JCIDS Manual (Ref. (r))


Regulatory. The ICD is the fundamental requirements document establishing validated capability requirements; required for the MDD. DBS programs will use Problem Statements for this purpose.

Initial Threat Environment Assessment ● ● ● ● ● DIA Directive 5000.200 (Ref. (t)) DIA Instruction 5000.002 (Ref. (u)) Validated by DIA

Regulatory for anticipated MDAP and MAIS programs; optional for all other programs at the discretion of the MDA and in consideration of Intelligence Community resources. Supports the MDD and the AoA. Forms the basis for the initial STAR at Milestone A, and is superseded by the Milestone A STAR. The Initial Threat Environment Assessment provides capability developers and program managers the ability to assess mission needs and capability gaps against likely adversary threat capabilities at IOC.








DoDI 5000.02, January 7, 2015

ENCLOSURE 1 54




ACAT MDD MS

A CDD Val

Dev RFP Rel

MS B5

MS C

FRP/FD Dec OTHER

II ≤ III

Item Unique Identification Implementation Plan ● ● ● ● ● DoDI 8320.04 (Ref. (ae)) CAE or as delegated Regulatory. Design considerations related to unique identification are included in the Systems Engineering Plan (SEP).

Life-Cycle Mission Data Plan ● ● ● ● ● DoDD 5250.01 (Ref. (af)) DoD Component Regulatory; only required if the system is dependent on Intelligence Mission Data. A draft4 update is due for Development RFP Release; approved at Milestone B.

Life-Cycle Sustainment Plan (LCSP) ● ● ● ● ● Sec. 3 in Enc. 6 of this instruction MDA or designee

Regulatory. A draft4 update is due for Development RFP Release; approved at Milestone B. The LCSP is reviewed by the CAE at least every 5 years after a system’s IOC. See Enclosure 6 of this instruction for details about the LCSP.

LFT&E REPORT ● ● ● ● ● 10 U.S.C. 2366 (Ref. (g)) DOT&E STATUTORY; Programs on the DOT&E Oversight List for LFT&E oversight only. Report is due as soon as practicable after testing is concluded. See related SURVIVABILITY AND LIVE FIRE TESTING STATUS REPORT in Table 6 in this enclosure.

LOW-RATE INITIAL PRODUCTION (LRIP) QUANTITY ● ● ● ● 10 U.S.C. 2400 (Ref. (g))

Para. 5d(6)(e) of this instruction MDA

STATUTORY for MDAPs and ACAT II programs; Regulatory for other programs. A preliminary quantity is determined at the Development RFP Release Decision Point; the final LRIP quantity is determined at Milestone B. The LRIP quantity will be documented in the ADM. For programs on the DOT&E Oversight List, LRIP quantities must equal or exceed the numbers required for testing as identified in the approved Test and Evaluation Master Plan (TEMP).

MANPOWER ESTIMATE ● ● 10 U.S.C. 2434 (Ref. (g)) DoD Component with OUSD(P&R) Review

STATUTORY. A draft4 is due for Development RFP Release; approved at Milestone B. The office of the Under Secretary of Defense for Personnel and Readiness (OUSD(P&R)) will review the MANPOWER ESTIMATE.

Operational Test Agency (OTA) Report of OT&E Results ● ● ● ● ● ● This instruction OTA

Regulatory. Required earlier than the FRP/FD decision if early operational assessments or operational assessments are conducted.








DoDI 5000.02, January 7, 2015

ENCLOSURE 1 55




ACAT MDD MS

A CDD Val

Dev RFP Rel

MS B5

MS C

FRP/FD Dec OTHER

II ≤ III

OPERATIONAL TEST PLAN (OTP) ● ● ● ● ● 10 U.S.C. 2399 (Ref. (g)) Para. 3e of Enc. 5 of this instruction

DOT&E or Component equivalent

STATUTORY/Regulatory. An OTP, approved before the start of OT&E, is mandatory for all programs. Approval by DOT&E is a STATUTORY requirement for programs on the DOT&E Oversight list. DoD Component-equivalent approval is a Regulatory requirement for all other programs.

PESHE AND NEPA/E.O. 12114 COMPLIANCE SCHEDULE ● ● ● ● ● 42 U.S.C. 4321-4347 (Ref. (ag))

E.O. 12114 (Ref. (ah)) CAE or as delegated

STATUTORY. The Programmatic Environment, Safety, and Occupational Health Evaluation (PESHE) and National Environmental Policy Act (NEPA) / Executive Order (E.O.) 12114 Compliance Schedule is approved by the CAE. Related design considerations must be included in the SEP; related operations or sustainment considerations after Milestone C will be included in the LCSP. Not required for software programs with no hardware component.

POST IMPLEMENTATION REVIEW (PIR) ● ● ● ● ● 40 U.S.C. 11313 (Ref. (p)) Functional sponsor STATUTORY. Responds to statute that requires Federal Agencies to compare actual program results with established performance objectives. The PIR is a process that aggregates information needed to successfully evaluate the degree to which a capability has been achieved. The preparation of the TEMP and the MDA’s decision to proceed with FRP satisfy the requirement for weapons systems. DoD Components will plan, conduct, and document the required review for IT systems and NSS post IOC (see section 4 in Enclosure 11 of this instruction). Approval by the Functional Sponsor will require coordination with the Component CIO.

PRESERVATION AND STORAGE OF UNIQUE TOOLING PLAN ● ● SEC. 815, P.L. 110-417 (Ref. (f)) MDA

STATUTORY. Part of the LCSP. The MDA must approve the plan prior to Milestone C approval; updated only as necessary, thereafter. The plan must identify any contract clauses, facilities, and funding required to preserve and to store the unique tooling associated with the production of the MDAP hardware through the end of the service life of the end item. See paragraph 3d(3) in Enclosure 6 for details.

Problem Statement ● ● ● ● Para. 4 in Enc. 1 of this instruction IRB Chair Regulatory; for DBS programs only. A stand-alone DBS requirements document to support the MDD, and later key decision events and milestones. The Problem Statement documents DBS requirements and is approved by the Investment Review Board (IRB) chair. It documents the business and supporting analysis, and evolves over time as those needs are refined. The Joint Staff (JS) (J-8) will review the initial Problem Statement to determine whether there is JS interest.








DoDI 5000.02, January 7, 2015

ENCLOSURE 1 56




ACAT MDD MS

A CDD Val

Dev RFP Rel

MS B5

MS C

FRP/FD Dec OTHER

II ≤ III

PROGRAM CERTIFICATION TO THE DEFENSE BUSINESS SYSTEMS MANAGEMENT COMMITTEE (DBSMC)

● ● ● ● ● 10 U.S.C. 2222 (Ref. (g)) DBSMC Chair

STATUTORY; for DBS programs only. Due prior to obligation of funds for any DBS that will have a total cost in excess of $1 million over the period of the current Future Years Defense Program.

Program Protection Plan (PPP) ● ● ● ● ● DoDI 5200.39 (Ref. (ai)) DoDI 5200.44 (Ref. (aj) Para. 13a in Enc. 3, this instruction

MDA

Regulatory. A draft4 update is due for the Development RFP Release decision and is approved at Milestone B. The PPP includes appropriate appendixes or links to required information. See section 13 in Enclosure 3 of this instruction.

REPLACED SYSTEM SUSTAINMENT PLAN ● ● ● 10 U.S.C. 2437 (Ref. (g)) DoD Component STATUTORY. May be submitted as early as Milestone A, but no later than Milestone B. Required when an MDAP replaces an existing system and the capability of the old system remains necessary and relevant during fielding of and transition to the new system. The plan must provide for the appropriate level of budgeting for sustainment of the old system, the schedule for developing and fielding the new system, and an analysis of the ability of the existing system to maintain mission capability against relevant threats.

Request for Proposal (RFP) ● ● ● ● ● ● ● ● Federal Acquisition Regulation Subpart 15.203 (Ref. (ak))

MDA is release authority

Regulatory. RFPs are issued as necessary; they include specifications and statement of work. See also Defense Federal Acquisition Regulation Supplement subpart 201.170 (Reference (al)) for the requirement for peer reviews.

Should Cost Target ● ● ● ● ● ● ● ● ● Para. 5d(3)(b)1 of this instruction MDA Regulatory. “Should Cost” is a regulatory tool designed to proactively target cost reduction and drive productivity improvement into programs. Paragraph 6e in Enclosure 2 of this instruction provides additional detail on “Should Cost.”

Spectrum Supportability Risk Assessment ● ● ● ● ● ● ● ● DoDI 4650.01 (Ref. (am)) Component CIO or designee

Regulatory. Applicable to all systems/equipment that use the electromagnetic spectrum in the United States and in other host nations. Due at milestone reviews and prior to requesting authorization to operate (for other than testing) in the United States or in host nations.








DoDI 5000.02, January 7, 2015

ENCLOSURE 1 57




ACAT MDD MS

A CDD Val

Dev RFP Rel

MS B5

MS C

FRP/FD Dec OTHER

II ≤ III

System Threat Assessment Report (STAR) ● ● ● ● ● This instruction DIA Directive 5000.200 (Ref. (t)) DIA Instruction 5000.002 (Ref. (u))

DIA or DoD Component

Regulatory. MDAP and MAIS programs require a unique, system-specific STAR. STARS are required for all other programs unless waived by the MDA. Programs on the DOT&E Oversight List require a unique, system-specific STAR, unless waived by both the MDA and the DOT&E. The STAR for an ACAT ID or IAM program is validated by DIA; for an ACAT IC or IAC program, and below, the STAR is validated by the DoD Component.

Systems Engineering Plan (SEP) ● ● ● ● ● Sec. 2 of Enc. 3 of this instruction DASD(SE) or

Component Head (or as delegated)

Regulatory. A draft4 update is due for the Development RFP Release Decision Point; approved at Milestone B. The Deputy Assistant Secretary of Defense (Systems Engineering) (DASD(SE)) is the approval authority for MDAPs and MAIS programs; the Component head or as delegated will approve the SEP for all other programs.

TECHNOLOGY READINESS ASSESSMENT (TRA) ● ● ● SEC. 205, P.L. 111-23 (Ref. (an)) ASD(R&E) STATUTORY. A preliminary assessment is due for the Development RFP Release Decision Point. The Assistant Secretary of Defense for Research and Engineering (ASD(R&E)) will conduct an independent review and assessment of the TRA conducted by the Program Manager and other factors to determine whether the technology in the program has been demonstrated in a relevant environment. The assessment will inform the 2366b CERTIFICATION MEMORANDUM at Milestone B (in accordance with 10 U.S.C. 2366b (Reference (g)). The TRA at Milestone C is a Regulatory requirement when Milestone C is Program Initiation.

Technology Targeting Risk Assessment ● ● ● ● ● This instruction DIA Directive 5000.200 (Ref. (t)) DIA Instruction 5000.002 (Ref. (u))

Validation by DIA or DoD Component

Regulatory. Prepared by the DoD Component Intelligence analytical centers per DoDI O-5240.24 (Reference (ao)) and DoDI 5200.39 (Reference (ai)). Forms the analytic foundation for Counterintelligence assessments in the associated PPP. DIA will validate the report for ACAT ID and IAM; for ACAT IC, IAC, and below, the DoD Component will be the validation authority.








DoDI 5000.02, January 7, 2015

ENCLOSURE 1 58




ACAT MDD MS

A CDD Val

Dev RFP Rel

MS B5

MS C

FRP/FD Dec OTHER

II ≤ III

Test and Evaluation Master Plan (TEMP) ● ● ● ● ● Enclosures 4 and 5 of this instruction See Notes for this row.

Regulatory. A draft4 update is due for the Development RFP Release Decision Point; approved at Milestone B. DOT&E will approve the TEMP for DOT&E Oversight programs (10 U.S.C. 2399 (Reference (g))); Deputy Assistant Secretary of Defense (Developmental Test and Evaluation) (DASD (DT&E)) will also approve the TEMP for MDAP, MAIS and Under Secretary of Defense for Acquisition, Technology, and Logistics (USD (AT&L)) designated special interest programs (10 U.S.C. 139b, Reference (g)); the DoD Component equivalent will approve the plan for other programs. TEMP outline guidance for OT&E is located at http://www.dote.osd.mil/temp-guidebook/index.html.

Waveform Assessment Application ● ● ● ● ● DoDI 4630.09 (Ref. (ap)) DoD CIO Regulatory. Application to the DoD CIO for approval of the development or modification of waveforms. Required at Milestone C if a waveform is added or modified after Milestone B.








DoDI 5000.02, January 7, 2015

ENCLOSURE 1 59

4. APBs AND BASELINE BREACHES a. The APB will describe the approved program. The APB represents the formal commitment of the Component and the acquisition chain of command to the MDA. Deviations from the approved APB will be immediately reported to the MDA. Deviations are specified default thresholds for schedule and cost of: (1) Objective schedule value plus 6 months. (2) Objective cost value plus ten percent. b. Table 3 in this enclosure provides acquisition program baseline policy, addressing Original Baselines, Current Baselines, Baseline Deviations, and Subprograms. c. Table 4 in this enclosure provides the statutory breach and change definitions for programs requiring APBs. (1) The MDAP definitions for significant and critical unit cost breaches are based on unit cost growth as defined in 10 U.S.C. 2433 (Reference (g)). (2) The MAIS program definitions for significant and critical changes are based on schedule, cost, or expected performance of the program as defined in 10 U.S.C. 2445c (Reference (g)). The section 2445c critical change definition also applies to programs that are designated as Pre-MAIS programs, and to any other AIS that are prior to a formal acquisition decision and are expected to exceed the MAIS program thresholds in Table 1, as prescribed by 10 U.S.C. 2445a. (3) The DBS additional criteria for a critical change are based on achieving IOC within constraints defined in section 811 of P.L. 109-364 (Reference (k)). d. The reporting requirements associated with breaches and changes are detailed in Table 6, this enclosure.

DoDI 5000.02, January 7, 2015

ENCLOSURE 1 60

Table 3. APBs

Original Baseline Description, Original APB, or Original Estimate

For all programs: • The first APB is approved by the MDA prior to a program entering Engineering and

Manufacturing Development, or at program initiation, whichever occurs later. • Serves as the current baseline description until a revised APB is approved. • Incorporates the Key Performance Parameters (KPPs) from the CDD or CPD (if program

initiation is at Milestone C). For MDAPs: • The cost/unit cost estimate parameters may be revised under 10 U.S.C. 2435 (Reference (g))

only if a breach occurs that exceeds the critical cost growth threshold for the program under 10 U.S.C. 2433 (Reference (g)).

For MAIS Programs: • The Original Estimate is the initial schedule, performance, cost baseline submitted to Congress

in a MAIS Annual Report (MAR), and can only be revised under 10 U.S.C. 2445c (Reference (g)) following a Critical Change Report to Congress. The Original Estimate is created from the objective schedule and cost values, and the

performance threshold values in the first APB approved by the MDA. The statutory term, “development cost,” will be treated the same as “total acquisition cost.”

Current Baseline Description or Current APB

• May be revised only: At milestone and FRP and FD decisions; As a result of a major program restructure that is fully funded and approved by the MDA; As a result of a program deviation (breach); or At the MDA’s discretion if fact of life program changes are so significant that managing to the

existing baseline is not practical. • Circumstances authorizing changes are limited; revisions to the current baseline estimate/APB

are not automatically authorized for program changes to cost, schedule, or performance parameters.

• Revisions to the current APB will not be authorized unless there is a significant change in program parameters.

• A revision to the current APB will not be authorized if proposed merely to avoid a reportable breach.

• The MDA determines whether to revise the APB.

Deviations

• The Program Manager will immediately notify the MDA when the Program Manager becomes aware of an impending deviation from any parameter (cost, schedule, performance, etc.).

• Within 30 business days of occurrence of the deviation, the Program Manager will submit a Program Deviation Report that informs the MDA of the reason for the deviation and planned actions.

• Within 90 business days of occurrence of the deviation: The Program Manager will bring the program back within APB parameters; or The Program Manager will submit information to the Overarching Integrated Product Team

(OIPT) to inform a recommendation to the MDA on whether it is appropriate to approve a revision to an APB.

• The MDA will decide, after considering the recommendation resulting from the OIPT or equivalent Component-level review, whether it is appropriate to approve a revision to an APB.

Subprograms (10 U.S.C. 2430a (Reference (g))

When an MDAP requires the delivery of two or more categories of end items that differ significantly in form and function, or the delivery of satellites in two or more increments or blocks, subprograms may be established for baselining and reporting purposes. Once one subprogram is designated, all remaining elements (increments or components) of the program will also be appropriately organized into one or more other subprograms.

DoDI 5000.02, January 7, 2015

ENCLOSURE 1 61

Table 4. Statutory Program Breach and Change Definitions

Significant Nunn-McCurdy Unit Cost Breaches (10 U.S.C. 2433 and 2433a (Reference (g))) Applicable to MDAPs only

• The cost growth threshold, as it relates to the current APB, is defined to be an increase of at least 15 percent over the program acquisition unit cost (PAUC) or average procurement unit cost (APUC) for the current program as shown in the current Baseline Estimate.

• The cost growth threshold, as it relates to the original APB, is defined to be an increase of at least 30 percent over the PAUC or APUC for the original program as shown in the original Baseline Estimate.

• Only the current APB will be revised.

Critical Nunn-McCurdy Unit Cost Breaches (10 U.S.C. 2433 (Reference (g))) Applicable to MDAPs only

• The cost growth threshold, as it relates to the current APB, is defined to be an increase of at least 25 percent over the PAUC or APUC for the program or subprogram as shown in the current Baseline Estimate/APB.

• The cost growth threshold, as it relates to the original APB, is defined to be an increase of at least 50 percent over the PAUC or APUC for the program or subprogram as shown in the original Baseline Estimate/APB for the program or subprogram.

• If the program or subprogram is certified rather than terminated, the most recent major milestone must be rescinded and a new milestone is required after certification. The program establishes a revised original Baseline Estimate/APB that reflects MDA certification and approval.

Significant Change (10 U.S.C. 2445c (Reference (g))) Applicable to MAIS programs only

As it relates to the original estimate (see definition in Table 3, this enclosure): • A schedule change that will cause a delay of more than 6 months but less than 1 year; • An increase in the estimated development cost or full life-cycle cost for the program by at least 15

percent, but less than 25 percent; or • A significant, adverse change in the expected performance of the MAIS to be acquired.

Critical Change (10 U.S.C. 2445c (Reference (g))) Applicable to MAIS programs and other major IT investment programs only

As it relates to the original estimate (see definition in Table 3, this enclosure): • The system has failed to achieve an FD Decision within 5 years after the Milestone A decision for

the program or, if there was no Milestone A, the date when the preferred alternative is selected for the program (excluding any time during which program activity is delayed as a result of a bid protest);

• A schedule change will cause a delay of 1 year or more; • The estimated development cost or full life-cycle cost for the program has increased 25 percent

or more; or • A change in expected performance will undermine the ability of the system to perform the

functions anticipated (i.e., the expected failure to meet a threshold KPP). • If a MAIS program is already baselined and the MAR shows a Milestone C event, and a Milestone

C is not conducted, a critical change will occur. Cost or Schedule Growth Notification for 2366a/b Certified Programs (10 U.S.C. 2366a and 2366b (Reference (g))) Applicable to MDAPs only

• Sec. 2366a: At any time prior to Milestone B approval, if the cost estimate exceeds the cost estimate for the program submitted at the time of the certification by at least 25 percent, or the program manager determines that the period of time required for the delivery of an IOC is likely to exceed the schedule objective established pursuant to 10 U.S.C. 181 (Reference (g)), paragraph (b)(5), by more than 25 percent, the Program Manager for the program concerned will notify the MDA.

• Sec. 2366b: The Program Manager for an MDAP that has received Milestone B certification will immediately notify the MDA of any changes to the program or a designated major subprogram of such program that alter the substantive basis for the certification of the milestone decision.

Additional Critical Change Applicable to All Defense Business Systems (Sec. 811 of P.L. 109-364 (Reference (k)))

• ANY DBS, regardless of ACAT, that has received Milestone A approval and has not achieved IOC within 5 years after the Milestone A decision will have experienced a critical change and will be subject to the evaluation and reporting required by 10 U.S.C. 2445c (Reference (g)), and the row identified as “MAIS ASSESSMENT AND CERTIFICATION OF A CRITICAL CHANGE TO THE DEFENSE COMMITTEES” in Table 6 in this enclosure.

NOTE: A DBS that is a MAIS program or other major IT investment program remains subject to the Significant and/or Critical Change rows above, if conditions warrant.

DoDI 5000.02, January 7, 2015

ENCLOSURE 1 62

5. REPORTING REQUIREMENTS a. Tables 5 through 8 of this enclosure summarize STATUTORY and Regulatory reporting requirements, and specify when the reports are due. (1) Table 5 presents recurring reporting requirements. (2) Table 6 lists the reporting requirements established for exceptions, waivers, and alternative reporting. (3) Table 7 summarizes Cost and Software Data Reporting (CSDR) System requirements. (4) Table 8 summarizes Earned Value Management (EVM) reporting requirements. b. In Tables 5 and 6 of this enclosure, each row identifies an information requirement and the source of the requirement. STATUTORY items and sources appear in ALL CAPS; Regulatory items and sources appear in normal text. A dot (●) in a cell indicates the applicability of the requirement to the program type for that column.

DoDI 5000.02, January 7, 2015

ENCLOSURE 1 63

(1) Table 5 summarizes STATUTORY and Regulatory recurring reporting requirements, and specifies when the reports are due.

Table 5. Recurring Program Reports

INFORMATION REQUIREMENT

PROGRAM TYPE WHEN REQUIRED SOURCE REPORTING

PROCEDURE MDAP MAIS ACAT

II ≤ III

Defense Acquisition Executive Summary (DAES)

● ●

For MDAPs, quarterly after initial Selected Acquisition Report (SAR) submission. For MAIS, quarterly after the program is baselined. Active programs that are 75 percent or more delivered through the production

phase (or 75 percent expended if RDT&E only) will submit only a Unit Cost Reporting DAES pursuant to 10 U.S.C. 2433 (Reference (g)).

For MDAPs, the DAES reporting requirement ceases after a termination SAR is submitted (90 percent of items delivered or 90 percent of funds are expended).

For MAIS, DAES reporting ceases after FD is declared and a Close-out DAES is submitted.

This instruction Program Manager

Regulatory. Identifies program issues that may impact program cost, schedule, or performance. The DAES provides a mechanism for the Department to meet Unit Cost Reporting requirements (see page 64 of this instruction) for MDAPs. Programs should begin input of basic program information, cost estimates, and any budget data into the automated DAES module of the Defense Automated Management Information Retrieval system upon submission of the Program Objective Memorandum or Budget Estimate Submission.

MAIS ANNUAL REPORT (MAR) TO CONGRESS

●

Annually for each MAIS program and each other major IT investment program for which funds are requested by the President in the budget.

This reporting requirement applies to baselined and unbaselined MAIS. Due 45 business days after the President’s Budget is submitted to Congress. Requirement terminates after FD is declared and a Close-out MAR is submitted.

10 U.S.C. 2445b (Ref. (g))

- Program Manager to Senior Officials (CAE, USD(AT&L)) - USD(AT&L) to Congress

STATUTORY. The MAR is the basis for the quarterly reports and reports on program changes required by 10 U.S.C. 2445c (Reference (g)). IT programs employing an incremental development model (i.e., Model 3) will initiate MAR reporting for each program increment and will identify the limited deployment associated with delivery of approximately 50% of that increment’s capability as a significant/breachable event.

MAIS QUARTERLY REPORT (MQR)

● Quarterly following the initial submission of a baselined MAR and not later than 5

years after Milestone A or MDA approval of the preferred alternative. MAIS Quarterly Report reporting ceases after FD is declared and a Close-out

MAIS Quarterly Report is submitted. 10 U.S.C. 2445c (Ref. (g))

Program Manager to Senior Officials (CAE, USD(AT&L)) USD(AT&L) to Congress

STATUTORY. This report will identify any projected variance from the Original Estimate (see Table 3 for a description of the Original Estimate). Reported via the electronic DAES submission process.

Note: A dot (●) in a cell indicates the specific applicability of the requirement to program type.

DoDI 5000.02, January 7, 2015

ENCLOSURE 1 64

Table 5. Recurring Program Reports, Continued

INFORMATION REQUIREMENT



II ≤ III

SELECTED ACQUISITION REPORT (SAR)

●

Program initiation (normally Milestone B except for some ship programs) or MDAP designation.

Annually (as of December) for all programs and quarterly (as of March, June, and September) on an exception basis when there is: (1) a 6-month or more schedule slip in the current estimate since the prior SAR; or (2) a unit cost increase of 15 percent or more to the current APB objective or 30 percent or more to the original APB objective.

SAR rebaselining after a major milestone decision (i.e., Milestone C or Milestones B and C for some ship programs).

SAR reporting requirement ceases after 90 percent of items are delivered or 90 percent of planned expenditures under the program or subprogram have been made.

10 U.S.C. 2432 (Ref. (g)) 10 U.S.C. 2433 (Ref. (g))

Submitted by Program Manager to CAE, USD(AT&L) Submitted by USD(AT&L) to Congress

STATUTORY. Provides the status of total program cost, schedule, and performance to Congress; provides program unit cost and unit cost breach information for a specific program.

UNIT COST REPORT (UCR) ●

Quarterly after initial SAR submission. Unit Cost Reporting ceases after a termination SAR is submitted (90 percent of

items delivered or 90 percent of funds are expended). 10 U.S.C. 2433 (Ref. (g))

Program Manager; CAE, USD(AT&L) (see Note, this row)

STATUTORY. Reported via the DAES submission process. The Program Manager provides the report quarterly to USD(AT&L) for the 3 quarters excluding the quarter with the annual SAR submission. The USD(AT&L) provides the report to Congress annually (included in SAR submission).


DoDI 5000.02, January 7, 2015

ENCLOSURE 1 65

(2) Table 6 summarizes STATUTORY and Regulatory requirements established for exceptions, waivers, and alternative management and reporting. The table specifies the conditions and point in time when each report is required.

Table 6. Exceptions, Waivers, and Alternative Management and Reporting Requirements

INFORMATION REQUIREMENT FOR WAIVER

OR EXCEPTION



II ≤ III

ALTERNATE LFT&E PLAN ● ● ●

A DoD Component-approved final draft plan is due 45 calendar days prior to the Development RFP Release decision. The final plan is required at Milestone B or as soon as practicable after program initiation.

10 U.S.C. 2366 (Ref. (g)) Program Manager to DOT&E

STATUTORY. Only required for programs on DOT&E oversight for LFT&E list with or requesting a waiver from full-up, system-level testing.

CONGRESSIONAL NOTIFICATION OF COMPETITIVE PROTOTYPING WAIVER

● Not later than 30 calendar days after MDA authorization. SEC. 203, P.L. 111-23 (Ref. (an)) Program Manager to MDA to Congress

STATUTORY. The MDA may waive the competitive prototyping requirements if: (1) The cost of producing competitive prototypes exceeds the expected life-cycle benefits (in constant dollars) of producing the prototypes, including the benefits of improved performance and increased technological and design maturity that may be achieved through competitive prototyping; or (2) The DoD would be unable to meet critical national security objectives without such a waiver.

If waived: (1) The MDA must require that a prototype be produced before Milestone B approval if: (a) The expected life-cycle benefits (in constant dollars) of producing the prototype exceed the cost. (b) Its production is consistent with achieving critical national security objectives. (2) If prototyping of the system is not feasible, the program will produce prototypes for critical subsystems. (3) The MDA must notify the congressional defense committees in writing not later than 30 calendar days after the waiver is authorized. The notification must include the rationale for the waiver and the plan, if any, for producing a prototype. (4) If the basis for the waiver is excessive cost, the MDA must also submit the notification of the waiver, together with the rationale, to the Comptroller General of the U.S. at the same time it is submitted to Congress.

CONGRESSIONAL NOTIFICATION OF CONDUCTING DT&E WITHOUT AN APPROVED TEMP

● Notification is required not later than 30 days after any decision is made for a lead DT&E Organization to conduct any developmental T&E activities for the MDAP without an approved TEMP.

SEC. 904, P.L. 112-239 (Ref. (l)) Program Manager to USD(AT&L) to Congress

STATUTORY. The Program Manager will prepare the notification and submit to USD(AT&L). The notification must include a written explanation of the basis for the decision and a timeline for getting an approved plan in place. A copy of the notification will be provided to DOT&E.


DoDI 5000.02, January 7, 2015

ENCLOSURE 1 66

Table 6. Exceptions, Waivers, and Alternative Management and Reporting Requirements, Continued


OR EXCEPTION



II ≤ III

CONGRESSIONAL NOTIFICATION OF CORE LOGISTICS COMMERCIAL ITEM EXCEPTION

● ● ● ● Due upon determination that the system or equipment is a commercial item. 10 U.S.C. 2464 (Ref. (g)) DAE to Congress

STATUTORY. The commercial item exception notice must include the justification for the determination.

CONGRESSIONAL NOTIFICATION OF CRITICAL COST BREACH

● STATUTORY. Due within 45 calendar days of a Program Deviation Report 10 U.S.C. 2433 (Ref. (g)) 10 U.S.C. 2433a (Ref. (g))

Service Secretary to Congress

CONGRESSIONAL NOTIFICATION OF MAIS CANCELLATION OR SIGNIFICANT REDUCTION IN SCOPE

● Due 60 calendar days prior to an MDA cancellation decision. SEC. 806, P.L. 109-163 (Ref. (aq)) USD(AT&L) to Congress

STATUTORY. Provides congressional notification of an MDA decision to cancel or significantly reduce the scope of a fielded or post-Milestone C MAIS program.

CONGRESSIONAL NOTIFICATION OF MDA WAIVER OF PRELIMINARY DESIGN REVIEW (PDR) BEFORE MILESTONE B

● Due no later than 30 calendar days after the waiver is authorized. 10 U.S.C. 2366b (Ref. (g)) Program Manager to MDA to Congress

STATUTORY. The MDA may waive the 10 U.S.C. 2366b, Milestone B certification requirement for PDR before Milestone B if the MDA determines that, but for such a waiver, the DoD would be unable to meet critical national security objectives.

If the MDA authorizes a waiver: (1) The waiver, the determination, and the reasons for the determination will be submitted in writing to the congressional defense committees within 30 calendar days

after the waiver is authorized. (2) The MDA will review the program not less often than annually to determine the extent to which the program otherwise satisfies the 10 U.S.C. 2366b Milestone B

certification components, until such time as the MDA determines that the program satisfies all of the certification components. (3) Any budget request, budget justification material, budget display, reprogramming request, SAR, or other budget documentation or performance report submitted by

the Secretary of Defense to the President regarding an MDAP receiving a waiver to 2366b certification will prominently and clearly indicate that such program has not fully satisfied the certification requirements for Milestone B, until such time that the MDA makes a determination that the program has satisfied all such certification requirements.


DoDI 5000.02, January 7, 2015

ENCLOSURE 1 67



OR EXCEPTION



II ≤ III

CONGRESSIONAL NOTIFICATION OF MDAP SUBPROGRAM DESIGNATION(S)

● Due not less than 30 calendar days before approval of a subprogram APB. 10 U.S.C. 2430a (Ref. (g)) DAE to Congress

STATUTORY. Reports the DAE’s determination that (1) different categories of end items in an MDAP, or (2) delivery increments or blocks of a satellite program warrant separate acquisition reporting and will be designated Major Subprograms. Table 3 in this enclosure provides additional policy regarding subprograms.

CONGRESSIONAL NOTIFICATION OF POST MILESTONE A CERTIFICATION PROGRAM DEVIATIONS

● Due within 30 calendar days of a Program Deviation Report. 10 U.S.C. 2366a (Ref. (g)) MDA to Congress

STATUTORY. Report will identify root causes of the growth, appropriate acquisition performance measures for the remainder of the development, and either a written certification or a plan for terminating the development or withdrawal of Milestone A approval.

CONGRESSIONAL NOTIFICATION OF PRESERVATION AND STORAGE OF UNIQUE PRODUCTION TOOLING WAIVER

● Due before Milestone C or at any time before the end of the item’s service life if the Secretary determines the waiver is in the best interest of the DoD. SEC. 815 of P.L. 110-417 (Ref. (f)) DAE to Congress

STATUTORY. Based on the Secretary’s written determination that such a waiver is in the best interest of the Department of Defense.

CONGRESSIONAL NOTIFICATION OF SIGNIFICANT COST BREACH

● STATUTORY. Due within 45 calendar days of a Program Deviation Report 10 U.S.C. 2433 (Ref. (g)) Service Secretary to Congress

COST-TYPE DEVELOPMENT CONTRACT DETERMINATION

● Due at the Development RFP Release Decision Point upon MDA conditional approval of a cost type contract selected for a development program. SEC. 818, P.L. 109-364 (Ref. (k)) MDA Written

Determination STATUTORY. The MDA may authorize the use of a cost-type contract for a development program only upon a written determination that: (1) the program is so complex and technically challenging that it would not be practicable to reduce program risk to a level that would permit the use of a fixed-price contract; and (2) the complexity and technical challenge of the program are not the result of a failure to meet the requirements of 10 U.S.C. 2366b (Reference (g)). The MDA’s written determination will include an explanation of the level of program risk, and, if the MDA determines that the program risk is high, the steps that have been taken to reduce program risk and the reasons for proceeding with Milestone B approval despite the high level of program risk. In considering program risk to determine whether a cost or fixed price engineering and manufacturing development contract meets the statutory requirement, the MDA will consider the following: the firmness of the capability requirements and maturity of the technology required; the experience level of potential offerors; and the capacity of industry to absorb potential overruns and the business case for industry to do so.


DoDI 5000.02, January 7, 2015

ENCLOSURE 1 68



OR EXCEPTION



II ≤ III

COST-TYPE PRODUCTION CONTRACT CERTIFICATION

● Applicable to contracts for the production of MDAPs: Entered into, on, or after October 1, 2014, and for which The USD(AT&L) has granted an exception to the prohibition against using a

cost-type contract for MDAP production. SEC. 811, P.L. 112-239 (Ref. (l)) USD(AT&L) to

Congress

STATUTORY. The USD(AT&L) may only grant the exception: (1) in the case of a particular cost-type contract; (2) if the USD(AT&L) provides written certification to the congressional defense committees that a cost-type contract is needed to provide a required capability in a timely and cost-effective manner; (3) the USD(AT&L) takes affirmative steps to make sure that the use of cost-type pricing is limited to only those line items or portions of the contract where such pricing is needed to achieve the purposes of the exception; and, (4) an explanation of the steps identified under clause (3), accompanies the written certification under clause (2).

DT&E EXCEPTION REPORTING

● Case 1: When an MDAP proceeds with implementing a TEMP that includes a developmental test plan disapproved by DASD(DT&E). Case 2: When an MDAP proceeds to IOT&E following an assessment by DASD(DT&E) that the program is not ready for operational testing.

SEC. 904, P.L. 112-239 (Ref. (l)) Program Manager to USD(AT&L) to Congress

STATUTORY The report due for Case 1 must include a description of the specific aspects of the DT&E plan determined to be inadequate; an explanation of why the program

disregarded the DASD(DT&E)’s recommendations; and identification of the steps taken to address the concerns of the DASD(DT&E). The report due for Case 2 must include an explanation of why the program proceeded to IOT&E despite the DASD(DT&E) findings; a description of the aspects of the

TEMP that had to be set aside to enable the program to proceed to IOT&E; a description of how the program addressed the specific areas of concern raised in the assessment of operational test readiness; and a statement of whether IOT&E identified any significant shortcomings in the program.

The USD(AT&L) will compile all such exception reports and annually, not later than 60 days after the end of each fiscal year through 2018, submit a report on each case to the congressional defense committees.

LEAD SYSTEM INTEGRATOR EXCEPTION CERTIFICATION

● ● ● Due if the MDA grants an exception. 10 U.S.C. 2410p (Ref. (g)) DAE to Congress STATUTORY. Satisfies the statutory restrictions applicable to exceptional use of a lead systems integrator (see paragraph 5d(9)(g)1 of this instruction for additional discussion).

LFT&E WAIVER FROM FULL-UP, SYSTEM-LEVEL TESTING

● ● ● Due at Milestone B or as soon as practicable after program initiation. 10 U.S.C. 2366 (Ref. (g)) DAE to Congress

STATUTORY. Only required for programs on the DOT&E Oversight List for LFT&E that are requesting a waiver from full-up, system-level testing.


DoDI 5000.02, January 7, 2015

ENCLOSURE 1 69



OR EXCEPTION



II ≤ III

MAIS CRITICAL CHANGE REPORT AND CERTIFICATION

● Not later than 60 calendar days after a MAIS Quarterly Report indicating a critical change is due to the Senior Official. 10 U.S.C. 2445c (Ref. (g))

Senior Official through OSD to Congress

STATUTORY. When the Senior Official is not an individual within OSD, the Critical Change Report will be signed by the Senior Official and provided to the cognizant OSD official for transmittal to Congress. The signed Critical Change Report should be provided to the appropriate OSD official with draft transmittal letters addressed to the congressional defense committees no later than 5 working days before expiration of the 60-day period.

MAIS SIGNIFICANT CHANGE NOTIFICATION

● Not later than 45 calendar days after a MAIS Quarterly Report indicating a significant change is due to the Senior Official. 10 U.S.C. 2445c (Ref. (g)) Senior Official to

Congress STATUTORY. The notification must be coordinated with the USD(AT&L), the Deputy Chief Management Officer, or the DoD CIO, as appropriate, before sending to Congress.

Management of Joint DoD and Director of National Intelligence (DNI) Programs

● ● ● ● When the DoD participates in a National Intelligence Program acquisition that is wholly or in the majority funded by the DNI. MoA, Ref. (ar) None

Joint DoD and DNI oversight of wholly and majority National Intelligence Program-funded acquisition programs will be conducted in accordance with Intelligence Community Policy Guidance 801.1 (Reference (as)) and the Memorandum of Agreement (MoA) between the DNI and the Secretary of Defense (Reference (ar)).

NUNN-MCCURDY ASSESSMENT AND CERTIFICATION

● When a Service Secretary has reported an increase in cost that equals or exceeds the critical cost growth threshold. 10 U.S.C. 2433a (Ref. (g)) USD(AT&L)

STATUTORY. The remedial actions required when a program or subprogram experiences critical cost growth.

Program Deviation Report ● ● ● ●

Regulatory. • Due within 30 business days of occurrence of the deviation. • Initial MDA notification is due immediately upon becoming aware of an

impending deviation.

Para. 4a of this enclosure Program Manager to MDA

SURVIVABILITY AND LIVE FIRE TESTING STATUS REPORT

● ● ● ● Due as soon as practicable after a decision to proceed to operational use or to make procurement funds available for a covered system is made prior to Milestone C approval.

10 U.S.C. 2366 (Ref. (g)) DOT&E to Congress

STATUTORY. DOT&E LFT&E Oversight programs only, including those that respond to urgent needs. Program also requires the LFT&E Report (see LFT&E Report row on page 54 of this enclosure).


DoDI 5000.02, January 7, 2015

ENCLOSURE 1 70

(3) Table 7 summarizes CSDR requirements, and specifies when the reports are due.

Table 7. CSDR System Requirements

REQUIRED REPORT WHEN REQUIRED SOURCE

Contractor Cost Data Report (CCDR)

• All major contracts1 and subcontracts, regardless of contract type, for ACAT I and IA programs and pre-MDAP and pre-MAIS programs subsequent to Milestone A approval, valued at more than $50 million2 (then-year dollars). Reporting is continued even if a program has been downgraded from an ACAT I or IA, unless waived by DCAPE.

• Not required for contracts priced below $20 million (then-year dollars). • The CCDR requirement on high-risk or high-technical-interest

contracts priced between $20 million and $50 million is left to the discretion of the DoD Program Manager and/or the Deputy Director, Cost Assessment (DDCA).

• Required for major components (i.e., government furnished equipment) of an ACAT I program that are managed by the Services as ACAT II or ACAT III, and if the contract value exceeds $50 million or if determined to be a high-risk or high-technical-interest contract priced between $20 million and $50 million by the Program Manager and/or the DDCA.

• Not required under the following conditions, provided the DoD Program Manager requests and obtains approval for a reporting waiver from the DDCA: procurement of commercial systems or procurement of non-commercial systems bought under competitively-awarded firm fixed-price contracts, as long as competitive conditions continue to exist.

DoD 5000.04-M-1 (Reference (at)) This instruction

Software Resources Data Report (SRDR)

• All major contracts1 and subcontracts, regardless of contract type, for contractors developing or producing software elements within ACAT I and IA programs and pre-MDAP and pre-MAIS programs subsequent to Milestone A approval for any software development element with a projected software effort greater than $20 million (then-year dollars).

• The SRDR requirement on high-risk or high-technical-interest contracts priced below $20 million is left to the discretion of the DoD Program Manager and/or the DDCA.

DoD 5000.04-M-1 This instruction

Contractor Business Data Report

• Required for all contractor business entities (e.g., plant, site, or business unit) responsible for contracts with CSDR requirements. DoD 5000.04-M-1

Contractor Sustainment Report

• All major contracts1 and subcontracts, regardless of contract type, valued at more than $50 million2 (then-year dollars).

SEC. 832 of P.L. 112-81 (Reference (v)) DoD 5000.04-M-1

Notes: 1. For CSDR purposes, the term “contract” (or “subcontract”) may refer to the entire standalone contract, to a specific task or delivery order, to a series of tasks or delivery orders, to a contract line item number, or to a series of line item numbers within a contract. The intent is to capture data on contractual efforts necessary for cost estimating purposes irrespective of the particular contract vehicle used. All contracts for the procurement of end items, software, or services to support the acquisition of MDAP and MAIS programs (or ACAT II and III programs which meet the above thresholds) must include the Data Item Descriptions (DIDs) and Contract Data Requirements Lists necessary for the reporting of CSDR data. 2. For CSDR purposes, contract value will represent the estimated price at contract completion (i.e., initial contract award plus all expected authorized contract changes) and be based on the assumption that all contract options will be exercised. 3. CSDR is further discussed in section 4 of Enclosure 10.

DoDI 5000.02, January 7, 2015

ENCLOSURE 1 71

(4) Table 8 summarizes EVM requirements. Paragraph 6 in Enclosure 2 provides an overview of EVM.

Table 8. EVM Requirements

REQUIREMENTS WHEN REQUIRED1 SOURCE

For Cost/Incentive Contracts2 ≥ $50 Million3

− Compliance with EVM system guidelines in ANSI/EIA-7484

At contract award and throughout contract performance

Part 7 of Office of Management and Budget (OMB) Circular A-11 (Reference (c)) This instruction

− EVM system formally validated and accepted by cognizant contracting officer


− Integrated Program Management Report (IPMR) (DI-MGMT-818615) Monthly

− Integrated Baseline Reviews Within 180 calendar days after contract award, exercise of options, and major modifications

For Cost/Incentive Contracts2 ≥ $20 Million3 but < $50 Million3

− Compliance with EVM system guidelines in ANSI/EIA-7484 (no formal EVM system validation)


Part 7 of OMB Circular A-11 This instruction − IPMR (DI-MGMT-818615)

(tailoring of formats recommended) Monthly

− Integrated Baseline Reviews Within 180 calendar days after contract award, exercise of options, and major modifications

For Cost/Incentive Contracts2 < $20 Million3

At the discretion of the Program Manager based on cost-benefit analysis Part 7 of OMB Circular A-11

This instruction − IPMR, Format 6 (DI-MGMT-818615) At the discretion of the Program Manager based

on Government requirements For Firm Fixed-Price Contracts2 regardless of dollar value

Limited Use–will be approved by the MDA based on a business case analysis Part 7 of OMB Circular A-11

This instruction − IPMR, Format 6 (DI-MGMT-818615) At the discretion of the Program Manager based

on Government requirements Notes: 1. EVM is required, as outlined in the table, unless the EVM requirement has been waived by the CAE per paragraph 6c in Enclosure 2. 2. The term, “Contracts,” includes contracts, subcontracts, intra-government work agreements, and other agreements. For Indefinite Delivery/Indefinite Quantity contracts, EVM will be applied to the individual task orders or group of related task orders in accordance with the requirements in this table. “Incentive” contracts include fixed-price incentive. EVM is required for Fixed-Price Incentive Fee development and integration contracts with measurable and discrete work scope. In cases where the work scope is not measurable and discrete, program offices should follow the process to obtain a DFARS deviation. 3. Application thresholds are in then-year dollars. 4. ANSI/EIA-748 = American National Standards Institute (ANSI)/Electronic Industries Alliance (EIA) Standard 748, Earned Value Management Systems (Reference (au)). 5. DI-MGMT-81861 = DID: Integrated Program Management Report (Reference (av)) a. If EVM is not required or a deviation is obtained, the IPMR should be used and tailored to obtain cost and/or schedule reporting when desired by the Government. For example, for full rate production contracts where EVM is not applicable, a tailored IPMR including a cost report showing actuals and a top-level schedule providing delivery dates of end products would be sufficient for Government management and oversight. b. Flow-down of the IPMR DID to the subcontractors is at the discretion of the program office.

DoDI 5000.02, January 7, 2015

ENCLOSURE 1 72

6. CCA COMPLIANCE. Table 9 summarizes the requirements levied on all programs that acquire IT, including NSS, at any ACAT level. Amplifying guidance for CCA compliance is detailed in section 3 of Enclosure 11.

Table 9. CCA Compliance

Actions Required to Comply With the CCA (Subtitle III of title 40 of U.S. Code (Reference (p)))1 Applicable Program Documentation2

1. Make a determination that the acquisition supports core, priority functions of the DoD.3

ICD, IS ICD, Problem Statement for a DBS, or urgent need requirements documents

2. Establish outcome-based performance measures linked to strategic goals.3, 4 ICD, IS ICD, CDD, CPD, AoA, APB 3. Redesign the processes that the system supports to reduce costs, improve effectiveness and maximize the use of commercial off-the-shelf technology.3, 4

ICD, IS ICD, Concept of Operations, AoA, Business Process Reengineering

4. Determine that no private sector or government source can better support the function.4, 5 Acquisition Strategy, AoA

5. Conduct an analysis of alternatives.4, 5 AoA 6. Conduct an economic analysis that includes a calculation of the return on investment; or for non-AIS programs, conduct a life-cycle cost estimate.4, 5

Component Cost Estimate, Program Economic Analysis for MAIS programs

7. Develop clearly established measures and accountability for program progress.4 Acquisition Strategy, APB, TEMP

8. Ensure that the acquisition is consistent with the DoD Information Enterprise policies and architecture, to include relevant standards.4 CDD NR-KPP, CPD NR-KPP, ISP

9. Ensure that the program has a Cybersecurity Strategy that is consistent with DoD policies, standards and architectures, to include relevant standards.4

Cybersecurity Strategy, Program Protection Plan, Risk Management Framework Security Plan

10. Ensure, to the maximum extent practicable, (1) modular contracting has been used, and (2) the program is being implemented in phased, successive increments, each of which meets part of the mission need and delivers measurable benefit, independent of future increments.4

Acquisition Strategy

11. Register Mission-Critical and Mission-Essential systems with the DoD CIO.4, 6 DoD Information Technology Portfolio Repository 1. Table 2 in this enclosure indicates when the program manager must report CCA compliance. 2. The system documents/information cited are examples of the most likely but not the only references for the required information. If other references are more appropriate, they may be used in addition to or instead of those cited. Include page(s) and paragraph(s), where appropriate. Urgent needs may cite the associated urgent needs documentation to demonstrate CCA compliance, e.g., the Course of Action and/or the network connection documentation. 3. These requirements are presumed to be satisfied for weapons systems with embedded IT and for Command and Control Systems that are not themselves IT systems. 4. These actions are also required to comply with section 811 of Public Law 106-398 (Reference (q)). 5. For NSS, these requirements apply to the extent practicable (40 U.S.C. 11103 (Reference (p)) discusses NSS). 6. Mission-Critical Information System. A system that meets the definitions of “information system” and “national security system” in the Clinger-Cohen Act (Subtitle III of title 40 of U.S. Code (Reference (p))), the loss of which would cause the stoppage of warfighter operations or direct mission support of warfighter operations. (The designation of mission critical will be made by a DoD Component head, a Combatant Commander, or their designee. A financial management IT system will be considered a mission-critical IT system as defined by the Under Secretary of Defense (Comptroller) (USD(C)).) A “Mission-Critical Information Technology System” has the same meaning as a “Mission-Critical Information System.” Mission-Essential Information System. A system that meets the definition of “information system” in 44 U.S.C. 3502 (Reference (aw)), that the acquiring DoD Component Head or designee determines is basic and necessary for the accomplishment of the organizational mission. (The designation of mission-essential will be made by a DoD Component head, a Combatant Commander, or their designee. A financial management IT system will be considered a mission-essential IT system as defined by the USD(C).) A “Mission-Essential Information Technology System” has the same meaning as a “Mission-Essential Information System.”

DoDI 5000.02, January 7, 2015

ENCLOSURE 2 73

ENCLOSURE 2

PROGRAM MANAGEMENT 1. PURPOSE. This enclosure describes policies applicable to Program Managers, Program Executive Officers (PEOs), and Component Acquisition Executives (CAEs) for defense acquisition programs. The enclosure also includes a range of applicable statutory and regulatory program management policies and responsibilities. 2. ACQUISITION CHAIN OF COMMAND. The chain of command for acquisition programs runs upward from the Program Manager, through the PEO to the CAE, and for Acquisition Category (ACAT) I and IA and other programs so designated, to the Defense Acquisition Executive (DAE). The responsibility and authority for program management, to include program planning and execution, is vested in these individuals. Staff and other organizations provide support to this chain of command. “Program Management” in this enclosure refers to this chain of command. 3. ASSIGNMENT OF PEOs a. CAEs will assign acquisition program responsibilities to a PEO for all ACAT I and IA and sensitive classified programs, or for any other program determined by the CAE to require dedicated executive management. b. A PEO must be experienced, qualified, and certified in program management, including having been a Program Manager for an ACAT I or IA program comparable to the programs he or she will be responsible for as PEO. c. The PEO will be dedicated to executive management of assigned programs and will not have other command responsibilities. d. The DAE may waive the provisions of paragraphs 3a, 3b, and/or 3c on a case-by-case basis. e. The CAE will make this assignment no later than program initiation, or within 3 months of program cost estimates reaching the dollar threshold for an ACAT I or IA program. CAEs may determine that a specific program manager will report directly, without being assigned to a PEO, whenever such direct reporting is appropriate due to program size or criticality. The CAE will notify the DAE of the decision to have a program manager report directly to the CAE, and request a waiver from the DAE of the requirement to appoint a PEO. f. Acquisition program responsibilities for programs not assigned to a PEO or a direct-reporting program manager may be assigned to a commander of a systems, logistics, or materiel command. A program may be transferred from a PEO or direct reporting program manager to a

DoDI 5000.02, January 7, 2015

ENCLOSURE 2 74

commander of a systems, logistics, or materiel command only after the program or increment of capability has passed Initial Operational Capability and has been approved for Full-Rate Production or Full Deployment. 4. ASSIGNMENT OF PROGRAM MANAGERS a. A program manager will be designated for each acquisition program by the appropriate CAE. This designation will be prior to Milestone A (as the Technology Maturation and Risk Reduction Phase is being planned) or the milestone associated with the entry phase specified by the Milestone Decision Authority (MDA) at the Materiel Development Decision. b. It is essential that program managers be defense acquisition professionals with experience managing relevant engineering development or technology efforts, and who have a deep knowledge of contracting, industry perspectives, and user needs. Unless a waiver is granted by the DAE or CAE, a program manager will be experienced in similar acquisition programs and Defense Acquisition Workforce Improvement Act Level III certified in program management. Waivers should be granted rarely. c. A Program Manager of an ACAT I or IA program should be assigned to the position during the period leading up to (approximately 6 months prior to) a major milestone or decision point initiating a phase of the acquisition process. The incoming program manager should lead the effort to have that phase approved and manage the execution of that phase. One measure of a program manager’s performance should be the successful execution of a phase of the program he or she planned and the MDA has approved. Program managers will be assigned for at least 4 years or until completion of the phase of the program that occurs closest in time to the date on which the person has served in the position for 4 years. d. Program managers for ACAT II and other significant non-major programs will be assigned for not less than 3 years. 5. PROGRAM OFFICE STRUCTURE AND ORGANIZATIONS a. Program Office Structure. It is program management’s responsibility to fully understand the skills and capacity required for successful program execution and for the CAE to provide those skills to ensure that the program executes successfully. For new starts, program managers will establish program offices as soon as possible after their selection. Program offices for Major Defense Acquisition Programs (MDAPs) and Major Automated Information System (MAIS) programs will be staffed in key leadership positions with military or DoD civilian employees qualified in accordance with DoD Instruction 5000.66 (Reference (ax)), as amended by the Under Secretary of Defense for Acquisition, Technology, and Logistics’ Policy Memorandum, Key Leadership Positions and Qualification Criteria, (Reference (ay)). Key leadership positions include the Program Manager and Deputy Program Manager, and the additional positions identified in Reference (ay).

DoDI 5000.02, January 7, 2015

ENCLOSURE 2 75

b. Joint Program Office Organization (1) A Joint Program Office will be established when a defense acquisition program involves the satisfaction of validated capability requirements from multiple DoD Components and/or international partners, and is funded by more than one Component or partner during any phase of the acquisition process In most joint programs, a lead Component will be designated to manage the acquisition process and act as the acquisition agent for the participating DoD Components. The participating Components, those with a requirement for the program’s products, support and participate with the lead DoD Component in managing the acquisition process. Joint programs will be managed in accordance with the provisions of a memorandum of agreement, and with the lead DoD Component’s acquisition procedures and acquisition chain of command, unless directed otherwise by the DAE. (2) DoD Components will neither terminate nor substantially reduce participation in joint MDAP and MAIS programs without capability requirements validation authority review and DAE approval. The DAE may require a DoD Component to continue some or all funding, as necessary, to sustain the joint program in an efficient manner, despite approving a request to terminate or reduce participation. Memorandums of agreement between DoD Components should address termination or reduced participation by any parties to the agreement. Substantial reduction will be determined by the MDA in coordination with the requirements validation authority, and is defined as a funding or quantity decrease that impacts the viability of the program and/or significantly increases the costs to the other participants in the program. 6. PROGRAM MANAGEMENT RESPONSIBILITIES. Program managers direct the development, production, and deployment of new defense systems. Management activities will be designed to achieve the cost, schedule, and performance parameters specified in the MDA-approved Acquisition Program Baseline (APB). The following tools will be used to facilitate effective program planning and execution. a. Acquisition Strategies (1) Overview. The Program Manager will develop and execute an approved Acquisition Strategy. This document is the Program Manager’s plan for program execution across the entire program life cycle. It is a comprehensive, integrated plan that identifies the acquisition approach and key framing assumptions, and describes the business, technical, and support strategies that the Program Manager plans to employ to manage program risks and meet program objectives. The strategy evolves over time and should continuously reflect the current status and desired goals of the program. The Acquisition Strategy defines the relationship between the acquisition phases and work efforts, and key program events such as decision points and reviews. The strategy must reflect the Program Manager’s understanding of the business environment; technical alternatives; small business strategy; costs, risks and risk mitigation approach; contract awards; the incentive structure; test activities; production lot or delivery quantities; operational deployment objectives; opportunities in the domestic and international markets; foreign disclosure, exportability, technology transfer, and security requirements; and the plan to support successful delivery of the capability at an affordable life-cycle price, on a realistic schedule.

DoDI 5000.02, January 7, 2015

ENCLOSURE 2 76

Acquisition Strategies are baseline plans for the execution of the program and should be prepared and submitted in time to obtain approval to support more detailed planning and the preparation of Requests for Proposal. The Acquisition Strategy is an approved plan; it is not a contract. Minor changes to the plan reflected in the Acquisition Strategy due to changed circumstances or increased knowledge are to be expected and do not require MDA pre-approval. Major changes, such as contract type or basic program structure, do require MDA approval prior to implementation. All changes should be noted and reflected in an update at the next program decision point or milestone. (2) Business Approach and Risk Management. The business approach detailed in the Acquisition Strategy should be designed to manage the risks associated with the product being acquired. It should fairly allocate risk between industry and the government. The approach will be based on a thorough understanding of the risks associated with the product being acquired and the steps that should be taken to reduce and manage that risk. The business approach should be based on market analysis that considers market capabilities and limitations. The contract type and incentive structure should be tailored to the program and designed to motivate industry to perform in a manner that rewards achievement of the government’s goals. The incentives in any contract strategy should be significant enough to clearly promote desired contractor behavior and outcomes the government values, while also being realistically attainable. (3) Competition. The Acquisition Strategy will address how program management will create and sustain a competitive environment, from program inception through sustainment. Program management should use both direct competition at various levels and indirect means to create competitive environments that encourage improved performance and cost control. Decisions made in the early phases of the acquisition process can either improve or reduce program management’s ability to maintain a competitive environment throughout the life cycle of a program. Strategies to be considered include: competitive prototyping, dual sourcing, open systems architectures that enable competition for upgrades, acquisition of complete technical data packages, and competition at the subsystem level. This also includes providing opportunities for small business and organizations employing the disabled. (4) Intellectual Property (IP) Strategy and Open Systems Architectures. Program management must establish and maintain an IP Strategy to identify and manage the full spectrum of IP and related issues (e.g., technical data and computer software deliverables, patented technologies, and appropriate license rights) from the inception of a program and throughout the life cycle. The IP Strategy will describe, at a minimum, how program management will assess program needs for, and acquire competitively whenever possible, the IP deliverables and associated license rights necessary for competitive and affordable acquisition and sustainment over the entire product life cycle, including by integrating, for all systems, the IP planning elements required by subpart 207.106 (S-70) of the Defense Federal Acquisition Regulation Supplement (Reference (al)) for major weapon systems and subsystems thereof. The IP Strategy will be updated throughout the entire product life cycle, initially as part of the Acquisition Strategy, and during the Operations and Support Phase as part of the Life-Cycle Sustainment Plan. Program management is also responsible for evaluating and implementing open systems architectures, where cost effective, and implementing a consistent IP Strategy. This approach integrates technical requirements with contracting mechanisms and legal considerations to

DoDI 5000.02, January 7, 2015

ENCLOSURE 2 77

support continuous availability of multiple competitive alternatives throughout the product life cycle. b. Program Baseline Development and Management. The Program Manager is responsible for developing the APB. The APB (see section 4 in Enclosure 1 of this instruction) is a summary of the program cost, schedule, and performance baselines, and is the fundamental binding agreement between the MDA, the CAE (if applicable), the PEO, and the Program Manager. The APB serves as the basis for reporting to the MDA through the DoD management information system. c. Earned Value Management (EVM). Program Managers will employ EVM unless its use is waived by the CAE. EVM is one of DoD’s and industry’s most powerful program planning and management tools. It is normally used in conjunction with cost plus and fixed-price incentive contracts. The purpose of EVM is to ensure sound planning and resourcing of all tasks required for contract performance. It promotes an environment where contract execution data is shared between project personnel and government oversight staff and in which emerging problems are identified, pinpointed, and acted upon as early as possible. EVM provides a disciplined, structured, objective, and quantitative method to integrate technical work scope, cost, and schedule objectives into a single cohesive contract baseline plan called a Performance Measurement Baseline for tracking contract performance. (Table 8 in Enclosure 2 summarizes EVM requirements.) d. Risk Management (1) The Program Manager is responsible for implementing effective risk management and tracking to include the identification of all known risks, key assumptions, probability of occurrence, consequences of occurrence (in terms of cost, schedule, and performance) if not mitigated, analysis of mitigation options, decisions about actions to mitigate risk, and execution of those actions. Risk management is proactive and should be focused on the actions that will be taken and resources that will be allocated to reduce both the likelihood and consequences of risks being realized. Effective risk management is not just risk identification and tracking. (2) Program Managers are responsible for prioritizing programmatic risks and mitigating them within program constraints. Most of program management is about the process of eliminating programmatic risk over the life of the program. Formal risk management is one tool to accomplish that objective. Top program risks and associated risk mitigation plans will be detailed in the program acquisition strategy and presented at all relevant decision points and milestones. e. Cost Baseline Control and Use of “Should Cost” Management (1) For MDAPs and MAIS programs, it is DoD policy to budget to the Director of Cost Assessment and Program Evaluation Independent Cost Estimate (ICE) unless an alternative estimate is specifically approved by the MDA. However, program managers will develop a Should Cost estimate as a management tool to control and reduce cost. Program managers should not allow the ICE to become a self-fulfilling prophecy. Should Cost is a management

DoDI 5000.02, January 7, 2015

ENCLOSURE 2 78

tool designed to proactively target cost reduction and drive productivity improvement into programs. Should Cost management challenges managers to identify and achieve savings below budgeted most-likely costs. Should Cost analysis can be used during contract negotiations (particularly for sole source procurements), and throughout program execution including sustainment. Program managers are to proactively seek out and eliminate low-value-added or unnecessary elements of program cost, to motivate better cost performance wherever possible, and to reward those that succeed in achieving those goals. Should Cost estimates used in contract negotiations will be based on the government’s reasonable expectation of successful contractor performance, consistent with the contractor’s previous experience and other relevant data. Realized Should Cost savings will be retained at the lowest organizational level possible and applied to priority needs. Should Cost applies to programs in all ACATs, in all phases of the product’s life cycle, and to all elements of program cost. (2) Program management will develop, own, track, and report against Should Cost targets. Estimates and results will be provided at milestone reviews and at specified decision points. For MDAPs and MAIS programs, program managers will report progress against Should Cost goals at Defense Acquisition Executive Summary reviews. 7. INTERNATIONAL ACQUISITION AND EXPORTABILITY a. International Acquisition and Exportability Considerations. Program management is responsible for integrating international acquisition and exportability considerations into the program’s Acquisition Strategy at each major milestone or decision point. Program management will consider the potential demand and likelihood of cooperative development or production, Direct Commercial Sales, or Foreign Military Sales early in the acquisition planning process; and consider U.S. export control laws, regulations, and DoD policy for international transfers when formulating and implementing the acquisition strategy; in accordance with DoD Instruction 2040.02 (Reference (az)). Where appropriate, program managers will pursue cooperative opportunities and international involvement throughout the acquisition life cycle to enhance international cooperation and improve interoperability in accordance with DoD Instruction 2010.06 (Reference (ba)). b. International Cooperative Program Management (1) An international cooperative program (ICP) is any acquisition program or technology project that includes participation by the U.S. and one or more foreign nations, through an international agreement, during any phase of a system’s life cycle. When applicable, program staff members are encouraged to use streamlined agreement procedures. All ICPs will consider applicable U.S.-ratified materiel international standardization agreements in accordance with Chairman of the Joint Chiefs of Staff Instruction 3170.01H (Reference (d)), and fully comply with applicable foreign disclosure, export control, technology transfer, program protection, and security requirements. Programs containing classified information will have a Delegation of Disclosure Authority Letter or other written authorization issued by the DoD Component’s cognizant foreign disclosure office prior to entering discussions with potential foreign partners.

DoDI 5000.02, January 7, 2015

ENCLOSURE 2 79

(2) DoD Components will notify and obtain the approval of the DAE for MDAP and MAIS programs before terminating or substantially reducing participation in ICPs under signed international agreements. The DAE may require the DoD Component to continue to provide some or all of the funding for that program. A substantial reduction is defined as a funding or quantity decrease that impacts the viability of the program and/or significantly increases the costs to the other participants in the program. c. Waivers. Any foreign military sales or direct commercial sales of major defense equipment prior to successful completion of operational test and evaluation require Under Secretary of Defense for Acquisition, Technology and Logistics approval (i.e., a Yockey Waiver). (Details of this requirement are found in paragraph C5.1.8.3. in the Security Assistance Management Manual (Reference (bb))). 8. INDUSTRIAL BASE ANALYSIS AND CONSIDERATIONS a. Industrial base analysis is a continuing process with two primary components, both of which rely in part on information from program management. The first gathers program specific industrial base information to create the appropriate acquisition strategy for a program; the second engages throughout the life cycle of the program to provide feedback and updates. The objective is to ensure that the Department can: (1) Identify and support economic and stable development and production rates. (2) Identify and mitigate industrial capabilities risks such as single points of failure and unreliable suppliers. (3) Avoid, to the maximum extent practicable, lock-in to sole and single source suppliers at any tier. (4) Support resilience of critical defense industrial base capabilities. (5) Support DoD’s management of defense procurement surges and contractions. b. Program management is responsible for incorporating industrial base analysis, to include capacity and capability considerations, into acquisition planning and execution. The industrial base considerations should be documented in the Acquisition Strategy and include identification of industrial capability problems (e.g., access to raw materials, export controls, production capabilities) that have the potential to impact the DoD near- and long-term, and identification of mitigation strategies that are within the scope of program management. Program management provided information is aggregated with other sources of information at CAE and DAE levels to inform Service and Department level industrial base decisions. 9. LIFE-CYCLE MANAGEMENT OF INFORMATION AND DATA PROTECTION. Program managers will ensure that all program office documents and records, regardless of

DoDI 5000.02, January 7, 2015

ENCLOSURE 2 80

media or security classification, are created, maintained, used, and disposed of or preserved in accordance with DoD 5015.02-STD (Reference (bc)).

DoDI 5000.02, January 7, 2015

ENCLOSURE 3 81

ENCLOSURE 3

SYSTEMS ENGINEERING

1. PURPOSE. This enclosure describes the policies and procedures regarding the application of systems engineering to defense acquisition. Systems engineering provides the integrating technical processes and design leadership to define and balance system performance, life-cycle cost, schedule, risk, and system security within and across individual systems and programs. The Program Manager, with support from the Lead Systems Engineer, will embed systems engineering in program planning and execution to support the entire system life cycle. 2. SYSTEMS ENGINEERING PLAN a. Program Managers will prepare a Systems Engineering Plan (SEP) as a management tool to guide the systems engineering activities on the program. The SEP will be submitted for approval for each milestone review, beginning with Milestone A. At each milestone and at the Development Request for Proposal (RFP) Release Decision Point, the SEP will support the acquisition strategy, including the program interdependencies, and communicate the overall technical approach to balance system performance, life-cycle cost, and risk in addressing warfighter needs. The SEP will describe the program’s overall technical approach, including key technical risks, processes, resources, organization, metrics, and design considerations. It will also detail the timing and criteria for the conduct of technical reviews. The use of mandatory tables in the SEP is intended to support more detailed technical planning during the system life cycle in order to provide effective management and control of the program’s technical progress and the execution of risk mitigation activities. The SEP will address system integration with existing and approved architectures and capabilities. Program managers will identify and manage risk of external dependencies which are outside their span of control in order to ensure timely design, development, deployment, and sustainment of the system. Program managers will document interface requirements and interface products to track interdependent program touch points. The technical planning documented in the SEP will guide the details in the program’s schedule. Program managers should include the SEP (either an approved Plan or a draft Plan) in the RFP as either guidance or a compliance document depending on the maturity of the plan and the acquisition strategy. b. The Deputy Assistant Secretary of Defense (Systems Engineering) (DASD(SE)) will review and approve the SEP for all Major Defense Acquisition Programs (MDAPs) and Major Automated Information System (MAIS) programs. (1) DoD Components will submit the SEPs to the DASD(SE) at least 45 calendar days before the scheduled Defense Acquisition Board milestone review. (2) For Milestone B, the DoD Component-approved draft SEP will be provided to the DASD(SE) 45 calendar days prior to the Development RFP Release Decision Point. If continuing engineering activities such as the Preliminary Design Review (PDR) create the need

DoDI 5000.02, January 7, 2015

ENCLOSURE 3 82

for substantive changes to the SEP, it will be revised and resubmitted for approval prior to Milestone B. Program managers will update the SEP as needed after contract award to reflect any changes due to the contractor’s technical approach and details not available prior to contract award. The updated SEP will be provided to the DASD(SE). 3. DEVELOPMENT PLANNING. The decisions to enter into the acquisition process, to mature technologies, and to begin system design must be based on early systems engineering analysis and assessments and a strong technical foundation. a. In preparation for the Materiel Development Decision, and to inform an Analysis of Alternatives (AoA), the DoD Components will conduct early systems engineering analyses and conduct an assessment of how the proposed candidate materiel solution approaches are technically feasible and have the potential to effectively address capability gaps, desired operational attributes, and associated external dependencies. b. During the Materiel Solution Analysis Phase, the Components will conduct early systems engineering analyses, informed by and in support of the AoA, to support selection of a preferred materiel solution and development of the draft Capability Development Document (or equivalent requirements document). c. In preparation for Milestone A, and to provide the technical basis for executing the Technology Maturation and Risk Reduction Phase, the Program Manager will conduct an early systems engineering assessment of technical risks and develop the technical approach for acquiring the product. This technical assessment will include software, integration, manufacturing, and reliability risks. The results will be incorporated in the SEP for Milestone A. 4. SYSTEMS ENGINEERING TRADE-OFF ANALYSES a. During the acquisition life cycle, the Program Manager will conduct systems engineering trade-off analyses to assess system affordability and technical feasibility to support requirements, investment, and acquisition decisions. Systems engineering trade-off analyses will depict the relationships between system life-cycle cost and the system’s performance requirements, design parameters, and delivery schedules. The analysis results should be reassessed over the life cycle as system requirements, design, manufacturing, test, and logistics activities evolve and mature. b. In support of the validation of the Capability Development Document (or equivalent requirements document), the Program Manager will conduct a systems engineering trade-off analysis showing how cost varies as a function of system requirements (including Key Performance Parameters), major design parameters, and schedule. The results will be provided to the MDA and will identify major affordability drivers and show how the program meets affordability constraints.

DoDI 5000.02, January 7, 2015

ENCLOSURE 3 83

5. TECHNICAL RISK AND OPPORTUNITY MANAGEMENT. Technical risk management should address risk identification, analysis, mitigation planning, mitigation implementation, and tracking. Technical risks should be quantified and implications reflected in the program’s Integrated Master Schedule and Integrated Master Plan. The Program Manager should also work with the applicable science and technology communities and Component acquisition leadership to influence technology investment planning. The goal is to both mitigate risks and create opportunities for technology development outcomes that could have a positive impact on meeting performance objectives as well as thresholds. Program risks, and opportunities as applicable, will be assessed at technical reviews and will include specific cost and schedule implications. 6. TECHNICAL PERFORMANCE MEASURES AND METRICS. The Program Manager will use technical performance measures and metrics to assess program progress. Analysis of technical performance measures and metrics, in terms of progress against established plans, will provide insight into the technical progress and risk of a program. 7. TECHNICAL REVIEWS. Program Managers will: a. Conduct technical reviews of program progress for systems in development as a basis for transitioning between phases within the development plan of work. Reviews will be event-driven and based on the review entrance criteria as documented in the SEP. b. Program Managers will plan for and conduct design reviews as needed to manage program planning and execution. Design review planning will be included in the SEP. Any program that is not initiated at Milestone C will include the following design reviews: (1) PDR. The PDR assesses the maturity of the preliminary design supported by the results of requirements trades, prototyping, and critical technology demonstrations. The PDR will establish the allocated baseline and confirm that the system under review is ready to proceed into detailed design (development of build-to drawings, software code-to documentation, and other fabrication documentation) with acceptable risk. For MDAPs and MAIS programs, a system-level PDR assessment will be conducted and provided to the MDA. For Acquisition Category (ACAT) ID and ACAT IAM programs, DASD(SE) will conduct the PDR assessment to inform the Milestone Decision Authority (MDA) of technical risks and the program’s readiness to proceed into detailed design. The Program Manager will make the program information needed for this assessment available and provide for DASD(SE) participation in the program's PDR process. For ACAT IC and ACAT IAC programs, the Component Acquisition Executive (CAE) will conduct the PDR assessment. (2) Critical Design Review (CDR). The CDR assesses design maturity, design build-to or code-to documentation, and remaining risks and establishes the initial product baseline. It will be used as the decision point that the system design is ready to begin developmental prototype hardware fabrication or software coding with acceptable risk. For MDAPs and MAIS programs, a system-level CDR assessment will be conducted and the results will be provided to the MDA.

DoDI 5000.02, January 7, 2015

ENCLOSURE 3 84

For ACAT ID and IAM programs, DASD(SE) will conduct the CDR assessment to inform the MDA of the program’s design maturity, technical risks, and the program’s readiness to begin developmental prototype hardware fabrication and/or software coding with acceptable risk. As the basis for preparation of a CDR assessment, the Program Manager will provide for DASD(SE) participation in the program’s CDRs and the Program Manager will make needed program artifacts and information available. For ACAT IC and IAC programs, the CAE will conduct the CDR assessment. 8. CONFIGURATION MANAGEMENT. The Program Manager will use a configuration management approach to establish and control product attributes and the technical baseline across the total system life cycle. This approach will identify, document, audit, and control the functional and physical characteristics of the system design; track any changes; provide an audit trail of program design decisions and design modifications; be integrated with the SEP and technical planning; and be consistent with the Intellectual Property Strategy. At completion of the system level CDR, the Program Manager will assume control of the initial product baseline, to the extent that the competitive environment permits. 9. MODELING AND SIMULATION. The Program Manager will integrate modeling and simulation activities into program planning and engineering efforts. These activities will support consistent analyses and decisions throughout the program’s life cycle. Models, data, and artifacts will be integrated, managed, and controlled to ensure that the products maintain consistency with the system and external program dependencies, provide a comprehensive view of the program, and increase efficiency and confidence throughout the program’s life cycle. 10. MANUFACTURING AND PRODUCIBILITY. The Program Manager will ensure manufacturing and producibility risks are identified and managed throughout the program’s life cycle. Beginning in the Materiel Solution Analysis Phase, manufacturing readiness and risk will be assessed and documented in the SEP. By the end of the Technology Maturation and Risk Reduction Phase, manufacturing processes will be assessed and demonstrated to the extent needed to verify that risk has been reduced to an acceptable level. During the Engineering and Manufacturing Development Phase, program managers will assess the maturity of critical manufacturing processes to ensure they are affordable and executable. Prior to a production decision, the Program Manager will ensure manufacturing and producibility risks are acceptable, supplier qualifications are completed, and any applicable manufacturing processes are or will be under statistical process control. 11. SOFTWARE. The development and sustainment of software can be a major portion of the total system life-cycle cost and should be considered at every decision point in the acquisition life cycle. A phased software development approach using testable software builds and/or fieldable software increments enables the developers to deliver capability in a series of manageable, intermediate products to gain user acceptance and feedback for the next build or increment, and reduce the overall level of risk. The SEP should address the following: software

DoDI 5000.02, January 7, 2015

ENCLOSURE 3 85

unique risks; inclusion of software in technical reviews; identification, tracking, and reporting of metrics for software technical performance, process, progress, and quality; software safety and security considerations; and software development resources. Software assurance vulnerabilities and risk based remediation strategies will be assessed, planned for, and included in the Program Protection Plan (PPP). 12. RELIABILITY AND MAINTAINABILITY (R&M) a. The Program Manager will formulate a comprehensive R&M program using an appropriate strategy to ensure reliability and maintainability requirements are achieved. The program will consist of engineering activities including for example: R&M allocations, block diagrams and predictions; failure definitions and scoring criteria; failure mode, effects and criticality analysis; maintainability and built-in test demonstrations; reliability testing at the system and subsystem level; and a failure reporting, analysis, and corrective action system maintained through design, development, production, and sustainment. The R&M program is an integral part of the systems engineering process. b. For MDAPs, the Program Manager will prepare a preliminary Reliability, Availability, Maintainability and Cost Rationale (RAM-C) Report in support of the Milestone A decision. This report provides a quantitative basis for reliability requirements, and improves cost estimates and program planning. This report will be attached to the SEP at Milestone A, and updated in support of the Development RFP Release Decision Point, Milestone B, and Milestone C. c. Reliability growth curves (RGCs) will reflect the reliability growth strategy and be employed to plan, illustrate, and report reliability growth. RGCs will be included in the SEP at Milestone A and updated in the draft SEP submitted at the Development RFP Release Decision Point and in the final approved SEP and Test and Evaluation Master Plan submitted at Milestone B. RGCs will be stated in a series of intermediate goals and tracked through fully integrated, system-level test and evaluation events at least until the reliability threshold is achieved. If a single curve is not adequate to describe overall system reliability, curves for critical subsystems should also be employed. d. Program offices, developmental test agencies, and operational test agencies will assess the reliability growth required for the system to achieve its reliability threshold during testing, and report the results of those assessments to the acquisition chain of command including the MDA. e. Reliability growth will be monitored and reported throughout the acquisition process. Program managers will report the status of R&M objectives and/or thresholds as part of the formal design review process, and during systems engineering technical reviews or other reviews. RGCs will be employed to report reliability growth status at Defense Acquisition Executive Summary reviews. 13. PROGRAM PROTECTION. Program protection is the integrating process for managing risks to DoD warfighting capability from foreign intelligence collection; from hardware,

DoDI 5000.02, January 7, 2015

ENCLOSURE 3 86

software, and cyber vulnerability or supply chain exploitation; and from battlefield loss throughout the system life cycle. Where a DoD capability advantage derives from a DoD-unique or critical technology, program protection manages and controls the risk that the enabling technology will be lost to an adversary. Where a DoD capability advantage derives from the integration of commercially available or custom-developed components, program protection manages the risk that design vulnerabilities or supply chains will be exploited to destroy, modify, or exfiltrate critical data, degrade system performance, or decrease confidence in a system. Program protection also supports international partnership building and cooperative opportunities objectives by enabling the export of capabilities without compromising underlying U.S. technology advantages. a. PPP. Program managers will employ system security engineering practices and prepare a PPP to guide their efforts and the actions of others to manage the risks to critical program information and mission-critical functions and components associated with the program. The PPP will be submitted for MDA approval at each milestone review, beginning with Milestone A. For programs with the Defense Acquisition Executive as the MDA, PPPs will be submitted to the DASD(SE) not less than 45 calendar days prior to the relevant review. For Milestone B, the DoD Component-approved draft PPP will be provided to the DASD(SE) 45 days prior to the Development RFP Release Decision Point. Program managers should include the PPP in RFPs, and prepare updates to the PPP after any contract award to reflect the contractor’s approved technical approach and the details or necessary changes that were not available or appropriate prior to contract award. b. Countermeasures. Program managers will describe in their PPP the program’s critical program information and mission-critical functions and components; the threats to and vulnerabilities of these items; the plan to apply countermeasures to mitigate associated risks; and planning for exportability and potential foreign involvement. Countermeasures should include anti-tamper, exportability features, security (including cybersecurity, operations security, information security, personnel security, and physical security), secure system design, supply chain risk management, software assurance, anti-counterfeit practices, procurement strategies, and other mitigations in accordance with DoD Instruction 5200.39 (Reference (ai)), DoD Instruction 5200.44 (Reference (aj)), and DoD Instruction 8500.01 (Reference (x)). Program managers will submit the program’s Cybersecurity Strategy as part of every PPP. Countermeasures should mitigate or remediate vulnerabilities throughout the product life cycle, including design, development, developmental and operational testing, operations, sustainment, and disposal. Program managers will incorporate automated software vulnerability analysis tools throughout the life cycle and ensure remediation of software vulnerabilities is addressed in PPPs, test plans, and contract requirements (as required by section 933 of P.L. 112-239, Reference (l)). 14. OPEN SYSTEMS ARCHITECTURES. Program managers are responsible for applying open systems approaches in product designs where feasible and cost-effective. Open systems and modular architectures provide valuable mechanisms for continuing competition and incremental upgrades, and to facilitate reuse across the joint force. Program management will use open systems architecture design principles to support an open business model (see paragraph 6a(4) in Enclosure 2 of this instruction).

DoDI 5000.02, January 7, 2015

ENCLOSURE 3 87

15. CORROSION PREVENTION AND CONTROL. The Program Manager will identify and evaluate corrosion considerations throughout the acquisition and sustainment phases that reduce, control, or mitigate corrosion in sustainment. The Program Manager will perform corrosion prevention and control planning and include corrosion control management and design considerations for corrosion prevention and control in the SEP and Life-Cycle Sustainment Plan. The Program Manager will ensure that corrosion control requirements are included in the design and verified as part of test and acceptance programs. 16. ENVIRONMENT, SAFETY, AND OCCUPATIONAL HEALTH (ESOH). The Program Manager will integrate ESOH risk management into the overall systems engineering process for all engineering activities throughout the system’s life cycle. As part of risk reduction, the Program Manager will eliminate ESOH hazards where possible, and manage ESOH risks where hazards cannot be eliminated. The Program Manager will use the methodology in MIL-STD-882E (Reference (bd)). Program Managers will assess the status of ESOH risks and acceptance decisions at technical reviews. Acquisition program reviews and fielding decisions will address the status of all high and serious risks. Prior to exposing people, equipment, or the environment to known system-related ESOH hazards, the Program Manager will document that the associated risks have been accepted by the following acceptance authorities: the CAE for high risks, Program Executive Officer-level for serious risks, and the Program Manager for medium and low risks. The user representative, as defined in MIL-STD-882E, must be part of this process throughout the life cycle and will provide formal concurrence prior to all serious- and high-risk acceptance decisions. For joint programs, the ESOH risk acceptance authorities reside within the lead DoD Component. Program managers will document the ESOH planning in the SEP and will document the results of the planning implementation in the Programmatic ESOH Evaluation (PESHE) and the compliance schedule required by the National Environmental Policy Act (NEPA) (Reference (ag)) and Executive Order (E.O.) 12114 (Reference (ah)) (NEPA/E.O. 12114). a. PESHE. The Program Manager, regardless of ACAT level, will prepare and maintain a PESHE to document data generated by ESOH analyses conducted in support of program execution. The PESHE will include at a minimum identification of ESOH risks and their status; and, identification of hazardous materials, wastes, and pollutants (discharges/emissions/noise) associated with the system and its support as well as the plans for minimization and/or safe disposal. b. NEPA/ E.O. 12114. The Program Manager will prepare and maintain a NEPA/E.O. 12114 Compliance Schedule that covers all known or projected system-related activities that may trigger compliance requirements including testing, fielding, and support of the system. The Compliance Schedule will incorporate the test schedules and locations identified in the Test and Evaluation Master Plan to enable consideration of potential impacts to the environment and completion of appropriate documentation in accordance with DoD Component implementing procedures. The Program Manager will conduct and document the NEPA/E.O. 12114 analyses for which the Program Manager is the action proponent, and provide system-specific analyses and data to support other organizations’ NEPA/E.O. 12114 analyses of system-related activities for which the Program Manager is not the proponent. The CAE (for joint programs, the CAE of

DoDI 5000.02, January 7, 2015

ENCLOSURE 3 88

the lead DoD Component) or designee, is the approval authority for system-related NEPA/E.O. 12114 documentation for which the Program Manager is the proponent. c. Mishap Investigation Support. The Program Manager will support system-related Class A and B mishap investigations by providing analyses of hazards that contributed to the mishap and recommendations for materiel risk mitigation measures, especially those that minimize human errors, as required by 10 U.S.C. 2255 (Reference (g)). 17. INSENSITIVE MUNITIONS. For all systems containing energetics, the Program Manager will comply with Insensitive Munitions requirements in accordance with the DoD and Component policy requirements (as required by 10 U.S.C. 2389 (Reference (g)). 18. ITEM UNIQUE IDENTIFICATION. The Program Manager will plan for and implement item unique identification to identify and track applicable major end items, configuration-controlled items, and government-furnished property to enhance life-cycle management of assets in systems acquisition and sustainment, and to provide more accurate asset valuation and property accountability. Item unique identification planning and implementation will be documented in an Item Unique Identification Implementation Plan linked to the program’s SEP. DoD Instruction 8320.04 (Reference (ae)) provides the standards for unique item identifiers. 19. SPECTRUM SUPPORTABILITY. Program managers are responsible for ensuring compliance of their programs with U.S. and host nation electromagnetic spectrum regulations, in accordance with 47 U.S.C. section 305 and sections 901 through 904 (Reference (aa)) and section 104 of P.L.102-538 (Reference (z)). Program managers will also submit written determinations to the Component Chief Information Officer (CIO) or equivalent that the electromagnetic spectrum necessary to support the operation of the system during its expected life cycle is or will be available in accordance with DoD Instruction 4650.01 (Reference (am)). These determinations will be the basis for recommendations provided to the MDA by the Component CIO or equivalent. 20. PROGRAM SUPPORT ASSESSMENTS (PSAs). The Office of the DASD(SE) will conduct independent, cross-functional PSAs of MDAPs’ and MAIS programs, and other program’s as directed by the DAE, to assess technical management and systems engineering progress and plans. PSAs are for the purpose of assisting program managers’ technical planning, and to improve execution by sharing best practices and lessons learned from other programs. Risk identification and risk mitigation assistance will be one focus of the PSAs. These reviews may also support acquisition milestones, decision reviews, or be conducted in response to technical issues on ACAT ID and IAM programs. These assessments are intended to help program managers shape their programs' technical planning and improve execution by providing actionable recommendations and identifying engineering and integration risks, as well as potential mitigation activities. The DoD Components will provide access to all program records and data including technical review artifacts and classified, unclassified, competition sensitive,

DoDI 5000.02, January 7, 2015

ENCLOSURE 3 89

and proprietary information that the DASD(SE) considers necessary to carry out these assessments in accordance with 10 U.S.C. 139 (Reference (g)).

DoDI 5000.02, January 7, 2015

ENCLOSURE 4 90

ENCLOSURE 4

DEVELOPMENTAL TEST AND EVALUATION (DT&E) 1. PURPOSE. This enclosure provides policy and procedure for developmental test and evaluation of defense acquisition programs. 2. OVERVIEW a. Program managers use DT&E activities to manage and mitigate risks during development, to verify that products are compliant with contractual and operational requirements, and to inform decision makers throughout the program life cycle. DT&E provides program engineers and decision makers with knowledge to measure progress, identify problems, and to characterize system capabilities and limitations, and manage technical and programmatic risks. DT&E results are also used as exit criteria to ensure adequate progress prior to investment commitments or initiation of phases of the program, and as the basis for contract incentives. b. DT&E starts with capability requirements and continues through product development, delivery, and acceptance; transition to operational test and evaluation (T&E); production; and operations and support. Consideration of developmental test and evaluation in the requirements and systems engineering processes ensures that capability requirements are measurable, testable, and achievable. Identifying and correcting deficiencies early is less costly than discovering system deficiencies late in the acquisition process. c. The Program Manager will use a Test and Evaluation Master Plan (TEMP) as the primary planning and management tool for the integrated test program. Whenever feasible, testing will be conducted in an integrated fashion to permit all stakeholders to use data in support of their respective functions. Integrated testing requires the collaborative planning and collaborative execution of test phases and events to provide shared data in support of independent analysis, evaluation, and reporting by all stakeholders, particularly the systems engineering, developmental (both contractor and government) and operational T&E communities. The Program Manager will establish an integrated test planning group consisting of empowered representatives of test data producers and consumers (to include all applicable stakeholders) to ensure collaboration and to develop a strategy for robust, efficient testing to support systems engineering, evaluations, and certifications throughout the acquisition life cycle. d. The Program Manager will identify the test resources needed to execute the DT&E program to acquire the data that will be used to understand program progress, identify issues, verify compliance, and balance cost and performance. Test resource requirements will be included in the TEMP. e. The Deputy Assistant Secretary of Defense for Developmental Test and Evaluation (DASD(DT&E)) will monitor the activities of Major Defense Acquisition Programs (MDAPs), Major Automated Information System (MAIS) programs, and Under Secretary of Defense for

DoDI 5000.02, January 7, 2015

ENCLOSURE 4 91

Acquisition, Technology and Logistics (USD(AT&L))-designated special interest programs as well as approve or disapprove the DT&E plans in the TEMP. For all other programs, the Component Acquisition Executive will designate, as desired, the DT&E organization that monitors DT&E activities and approves or disapproves the DT&E plans in the TEMP. DASD(DT&E) authorities, responsibilities, and functions are described in DoD Instruction 5134.17 (Reference (be)). 3. T&E MANAGEMENT a. Program managers for MDAPs and MAIS programs will designate a Chief Developmental Tester in accordance with 10 U.S.C. 139b and 1706 (Reference (g)). The Chief Developmental Tester will be responsible for coordinating the planning, management, and oversight of all DT&E activities; maintaining insight into contractor activities; overseeing the T&E activities of other participating government activities; and helping the Program Manager make technically informed, objective judgments about contractor and government T&E planning and results. The Chief Developmental Tester will chair the integrated test planning group. b. Program managers for MDAPs will designate a government test agency to serve as the lead DT&E organization in accordance with 10 U.S.C. 139b. The lead DT&E organization will be responsible for providing technical expertise on T&E issues to the Chief Developmental Tester; conducting DT&E activities as directed by the Chief Developmental Tester or his or her designee; supporting certification and accreditation activities when feasible; assisting the Chief Developmental Tester in providing oversight of contractors; and assisting the Chief Developmental Tester in reaching technically informed, objective judgments about contractor and government T&E planning and results. For all other programs, a lead DT&E organization should be used, when feasible, and identified in the TEMP. c. The designation of a Chief Developmental Tester and lead DT&E organization will be made as soon as practicable after the program office is established. d. The Program Manager will use the TEMP as the primary planning and management tool for all test activities starting at Milestone A. The Program Manager will prepare and update the TEMP as needed and to support acquisition milestones or decision points. For the Full-Rate Production Decision Review or the Full Deployment Decision and thereafter, the Milestone Decision Authority (MDA) may require TEMP updates or addendums to plan for additional testing. Section 5 in Enclosure 5 of this instruction has additional policy for the TEMP in the context of operational testing. e. Program managers for programs on DASD(DT&E) oversight will designate a T&E Working-level Integrated Product Team (WIPT) (also known as an Integrated Test Team), as soon as practicable after the Materiel Development Decision. The T&E WIPT develops and tracks the T&E program in all phases. The T&E WIPT will include empowered representatives of test data stakeholders such as Systems Engineering, DT&E, Operational T&E, Live Fire T&E, Product Support, the user, the intelligence community, and applicable certification authorities.

DoDI 5000.02, January 7, 2015

ENCLOSURE 4 92

f. The Program Manager will take full advantage of DoD ranges, labs, and other resources. Systems have become more complex and resource constraints often force tradeoffs in the type and scope of testing that can be performed. The DT&E budget and schedule must allow testing that adequately verifies performance to contractual requirements in a controlled environment and to operational requirements. 4. DT&E ACTIVITIES a. DT&E activities will start when requirements are being developed to ensure that key technical requirements are measurable, testable, and achievable. b. A robust DT&E program includes a number of key activities to provide the data and assessments for decision making. The DT&E program will: (1) Verify achievement of critical technical parameters and the ability to achieve key performance parameters, and assess progress toward achievement of critical operational issues. (2) Assess the system’s ability to achieve the thresholds prescribed in the capabilities documents. (3) Provide data to the Program Manager to enable root cause determination and to identify corrective actions. (4) Validate system functionality. (5) Provide information for cost, performance, and schedule tradeoffs. (6) Assess system specification compliance. (7) Report on program progress to plan for reliability growth and to assess reliability and maintainability performance for use during key reviews. (8) Identify system capabilities, limitations, and deficiencies. (9) Include T&E activities to detect cyber vulnerabilities within custom and commodity hardware and software. (10) Assess system safety. (11) Assess compatibility with legacy systems. (12) Stress the system within the intended operationally relevant mission environment. (13) Support cybersecurity assessments and authorization, including Risk Management Framework security controls.

DoDI 5000.02, January 7, 2015

ENCLOSURE 4 93

(14) Support the interoperability certification process. (15) Document achievement of contractual technical performance, and verify incremental improvements and system corrective actions. (16) Assess entry criteria for Initial Operational Test and Evaluation (IOT&E) and Follow-On Operational Test and Evaluation. (17) Provide DT&E data to validate parameters in models and simulations. (18) Assess the maturity of the chosen integrated technologies. 5. DT&E PLANNING CONSIDERATIONS a. The Program Manager will: (1) Use the TEMP as the primary test planning and management document. (2) The TEMP will: (a) Contain an integrated test program summary and master schedule of all major test events or test phases. (b) Include an event-driven testing schedule that will allow adequate time to support pre-test predictions; testing; post-test analysis, evaluation, and reporting; reconciliation of predictive models; and adequate time to support execution of corrective actions in response to discovered deficiencies. The schedule should allow sufficient time between DT&E and IOT&E for rework, reports, and analysis and developmental testing of critical design changes. (c) Be a source document when developing the request for proposals. (d) Guide how contractor proposals will address program test needs such as: test articles; T&E data rights; government access to the Failure Reporting, Analysis and Corrective Action System and other test outcome repositories; built-in test and embedded instrumentation data (including software log files); contractor verification requirements; government use of contractor-conducted T&E; government review and approval of contractor T&E plans; government witness of contractor test events; and government review of contractor evaluations. See section 5 in Enclosure 5 of this instruction for additional details. (e) Include identification of all contractor and government system level reliability testing needed to support initial reliability planning estimates. The Program Manager will include the reliability developmental evaluation methodology for reliability critical items. The military departments/program managers will collect and retain data from the T&E of the reliability and maintainability of major weapon systems to inform system design decisions,

DoDI 5000.02, January 7, 2015

ENCLOSURE 4 94

provide insight into sustainment costs, and inform estimates of operating and support costs for such systems. (f) Starting at Milestone B, include one or more reliability growth curves (RGCs). 1. If a single curve is not adequate to describe the overall system reliability, curves for critical subsystems with rationale for their selection will be provided. 2. For software (in any system), the TEMP will include projected and observed software maturity metrics. For hardware acquisitions, Milestone B RGCs will consist of observed (when available) and projected reliability. 3. RGCs will be stated in a series of intermediate goals tracked through fully integrated, system-level T&E events until the reliability threshold is achieved. (3) Use scientific test and analysis techniques to design an effective and efficient test program that will produce the required data to characterize system behavior across an appropriately selected set of factors and conditions. (4) Identify each developmental test phase or major developmental test event as a contractor or government DT&E. All programs will plan for the conduct of DT&E and/or integrated testing to provide confidence in the system design solution. Each major developmental test phase or event (including Test Readiness Reviews) will have test entrance and exit criteria. The developmental test completion criteria (customer needs) will dictate what data are required from the test event. (5) Ensure that all test infrastructure and/or tools (e.g., models, simulations, automated tools, synthetic environments) to support acquisition decisions will be verified, validated, and accredited (VV&A) by the intended user or appropriate agency. Test infrastructure, tools, and/or the VV&A strategy including the VV&A authority for each tool or test infrastructure asset will be documented in the TEMP. Program Managers will plan for the application and accreditation of any modeling and simulation tools supporting DT&E. (6) Develop complete resource estimates for T&E to include: test articles, test sites and instrumentation, test support equipment, threat representations and simulations, test targets and expendables, support for operational forces used in test (both friendly and threat), models and simulations, testbeds, joint mission environment, distributed test networks, funding, manpower and personnel, training, federal/state/local requirements, range requirements, and any special requirements (e.g., explosive ordnance disposal requirements or corrosion prevention and control). Resources will reflect the best estimate for conducting all test activities. Resources will be mapped against the developmental evaluation framework and schedule to ensure adequacy and availability. (7) Ensure that resource estimates identified in the TEMP are matched against the schedule and justified by analysis.

DoDI 5000.02, January 7, 2015

ENCLOSURE 4 95

(8) Resource and ensure threat-appropriate Red Team/Penetration testing to emulate the threat of hostile penetration of program information systems in the operational environment. Additional guidance on Red Team operations is included in Chairman of the Joint Chiefs of Staff Instruction 6510.01F (Reference (bf)). (9) Develop a strategy and budget resources for cybersecurity testing. The test program will include, as much as possible, activities to test and evaluate a system in a mission environment with a representative cyber-threat capability. (10) Ensure that each major developmental test phase or event in the planned test program has a well-defined description of the event, specific objectives, scope, appropriate use of modeling and simulation, and a developmental evaluation methodology. (11) Describe an developmental evaluation methodology in the TEMP starting at Milestone A that will provide essential information on programmatic and technical risks as well as information for major programmatic decisions. Starting at Milestone B, the developmental evaluation methodology will include a developmental evaluation framework to identify key data that will contribute to assessing progress toward achieving: key performance parameters, critical technical parameters, key system attributes, interoperability requirements, cybesecurity requirements, reliability growth, maintainability attributes, developmental test objectives, and others as needed. In addition, the developmental evaluation framework will show the correlation and mapping between test events, key resources, and the decision supported. The developmental evaluation methodology will support a Milestone B assessment of planning, schedule, and resources and a Milestone C assessment of performance, reliability, interoperability, and cybersecurity. (12) Develop a software test automation strategy to include when key test automation software components or services will be acquired and how those decisions will be made. b. Programs will use government T&E capabilities unless an exception can be justified as cost-effective to the government. Program managers will conduct a cost-benefit analysis for exceptions to this policy and obtain approval through the TEMP approval process before acquiring or using non-government, program unique test facilities or resources. c. In accordance with DoD Instruction 8510.01 (Reference (bg)), all programs must have security controls implemented consistent with their information and system categorization. Program managers will ensure appropriate testing to evaluate capability to protect information and information systems from unauthorized access, use, disclosure, disruption, modification, or destruction. The Defense Intelligence Agency, in coordination with the Program Manager, will determine the generation of the relevant operational threat environment based on the System Threat Assessment Report, the Multi-Service Force Deployment, the Joint Country Forces Assessment and scenario support products in accordance with DoD Instruction 5000.61 (Reference (bh)).

DoDI 5000.02, January 7, 2015

ENCLOSURE 4 96

d. Systems that operate as part of a system of systems may require deployment of additional test assets to evaluate end-to-end capabilities. Program managers will ensure that adequate testing of total system of systems performance is conducted as part of the DT&E program. e. For accelerated acquisition and urgent need programs, the levels of developmental testing required will be highly tailored to emphasize schedule over other considerations. Required testing to verify safety, capabilities, and limitations will be performed consistent with the urgency of fielding the capability. Responsibility for determining developmental testing requirements will be delegated to the lowest practical level. Urgent need programs will generally not be on an OSD DT&E Engagement list. If an Accelerated Acquisition program is on the DT&E Engagement list, complete developmental testing may be deferred so as not to impede early fielding; however, an operational assessment will typically be conducted. See paragraph 6a in Enclosure 5 of this instruction for a discussion of operational assessments, and Enclosure 13 for the policy and procedure regarding acquisition programs that respond to urgent needs. 6. DT&E EXECUTION, EVALUATION, AND REPORTING a. DT&E Execution. As the Program Manager executes the program’s strategy for the DT&E, the Program Manager and test team will develop detailed test plans for each developmental test event identified in the TEMP. Test plans must consider the potential impacts on personnel and the environment in accordance with 10 U.S.C. 4321-4347 (Reference (ag)) and Executive Order 12114 (Reference (ah)). The Program Manager, in concert with the user and T&E community, will provide safety releases (to include National Environmental Policy Act documentation, safety, and occupational health risk acceptance in accordance with section 16 in Enclosure 3 of this instruction) to testers prior to any test that may impact safety of personnel. A Test Readiness Review will be conducted for those events identified in the TEMP. b. DASD(DT&E) Program Assessments. For MDAPs, MAIS programs, and USD(AT&L)-designated special interest programs, the DASD(DT&E) will provide the MDA with a program assessment at the Development Request for Proposal Release Decision Point, Milestones B and C, and updated to support the Operational Test Readiness Review or as requested by the MDA or Program Manager. The program assessment will be based on the completed DT&E and any Operational T&E activities completed to date, and will address the adequacy of the program planning, the implications of testing results to date, and the risks to successfully meeting the goals of the remaining T&E events in the program. c. DT&E Reports and Data (1) The DASD(DT&E) and the acquisition chain of command (including the Program Manager) and their designated representatives will have full and prompt access to all ongoing developmental testing, and all developmental test records and reports, including but not limited to: data from all tests, system logs, execution logs, test director notes, certifications, and user/operator assessments and surveys. This applies to all government accessible data including

DoDI 5000.02, January 7, 2015

ENCLOSURE 4 97

classified, unclassified, and competition sensitive or proprietary data. Data may be preliminary and will be identified as such. (2) The Program Manager and test agencies for all programs will provide the Defense Technical Information Center (DTIC) with all reports and the supporting data for the test events in those reports. Paragraphs 11c(5) through 11c(7) in Enclosure 5 of this instruction include a more detailed discussion. (3) The DoD Components will collect and retain data from developmental test and evaluation, integrated testing, and operational test and evaluation on the reliability and maintainability of Acquisition Category I and II programs. (4) Tables 2 and 6 in Enclosure 1 identify statutory and regulatory reporting and notification requirements associated with the conduct of DT&E.

DoDI 5000.02, January 7, 2015

ENCLOSURE 5 98

ENCLOSURE 5

OPERATIONAL AND LIVE FIRE TEST AND EVALUATION (OT&E AND LFT&E) 1. OVERVIEW a. The fundamental purpose of test and evaluation (T&E) is to enable the DoD to acquire systems that work. To that end, T&E provides engineers and decision-makers with knowledge to assist in managing risks, to measure technical progress, and to characterize operational effectiveness, suitability, and survivability. This is done by planning and executing a robust and rigorous T&E program. b. The Program Manager is responsible for resourcing and executing the system’s approved T&E program. The Program Manager assembles a test team of empowered representatives of the various test data consumers. The team starts early (i.e., pre-Milestone A) to develop a robust, rigorous, and efficient test program that will be conducted in support of systems engineering, evaluations, and certifications throughout the program life cycle. The Program Manager documents the test program planning in the Test and Evaluation Master Plan (TEMP). All TEMPs will require DoD Component approval; TEMPs for programs under Director, Operational Test and Evaluation (DOT&E), oversight will also require DOT&E approval. The operational and select live fire test events in the TEMP must have approved test plans. Test plans are written and approved by the test organization responsible for the test. Operational test plans (OTPs) for programs under DOT&E OT&E oversight and live fire test plans (LFTPs) for programs under DOT&E LFT&E oversight will require DOT&E approval. c. For programs under DOT&E OT&E or LFT&E oversight, the DOT&E will provide the Milestone Decision Authority (MDA) with milestone assessments. DOT&E will submit a report to the Secretary of Defense and the congressional defense committees before programs under DOT&E OT&E or LFT&E oversight may proceed beyond Low-Rate Initial Production (LRIP), in accordance with 10 U.S.C. 2366 and 2399 (Reference (g)). 2. APPLICABILITY. This enclosure applies to all defense acquisition programs on OSD OT&E or LFT&E oversight. This enclosure is written to the Hardware Intensive Program model described in paragraph 5c(3)(b) of this instruction , with tailoring instructions for the software within those programs and the software-specific acquisition models. When there is no distinction between Defense Unique Software Intensive Programs (Model 2) and Incrementally Deployed Software Intensive Programs (Model 3), they are referenced herein as “Software Acquisitions.” Tailoring for any software, irrespective of acquisition model, is identified as being “for software in any system.” Tailoring for Accelerated Acquisition models will be considered on a case-by-case basis.

DoDI 5000.02, January 7, 2015

ENCLOSURE 5 99

3. DOT&E OVERSIGHT LIST a. DOT&E may place any program or system on the DOT&E Oversight List for OT&E or LFT&E oversight at any time. b. DOT&E maintains the DOT&E Oversight List continuously online at https://extranet.dote.osd.mil/oversight/ (requires login with a Common Access Card). c. The DOT&E Oversight List is unclassified. Classified and sensitive programs that are placed on DOT&E oversight will be identified directly to their MDAs. d. The DOT&E Oversight List is the list of Major Defense Acquisition Programs (MDAPs) on DOT&E oversight. MDAPs on DOT&E oversight include those programs that meet the statutory definition of 10 U.S.C. 2430 (Reference (g)), and those that are designated by the DOT&E as MDAPs for the purposes of OT&E under the authority of paragraph (a)(2)(B) of 10 U.S.C. 139 (Reference (g)). The latter programs are not MDAPs for any other purpose. e. Unless specifically waived, the test-related documentation that is required for MDAP programs will be required for all programs on the DOT&E Oversight List, including submission of Defense Intelligence Agency or DoD Component-validated System Threat Assessment Reports, TEMPs, OTPs, Live Fire Test Plans (LFTPs), and reporting of test results. f. Force protection equipment (including non-lethal weapons) will be subject to DOT&E oversight, as determined by DOT&E. The DOT&E will approve required LFTPs and/or live fire strategies for such systems. g. Capability upgrades, other alterations that materially change system performance, and alterations that pose substantial risk of degrading fielded military capabilities (if they fail) will be tested operationally. Product improvements or upgrades to system survivability will also be tested and evaluated. h. The DOT&E Oversight List will identify programs grouped for coordinated or synchronized testing. 4. T&E PROGRAM MANAGEMENT a. Early Engagement. Program managers for programs on DOT&E oversight will designate a T&E Working-level Integrated Product Team (WIPT) (also known as an Integrated Test Team), as soon as practicable after the Materiel Development Decision. The T&E WIPT develops and tracks the T&E program in all phases. The T&E WIPT will include empowered representatives of test data stakeholders such as Systems Engineering, Developmental Test and Evaluation (DT&E), OT&E, LFT&E, the user, Product Support, the intelligence community, and applicable certification authorities.

DoDI 5000.02, January 7, 2015

ENCLOSURE 5 100

b. Lead Operational Test Agency (OTA). The lead OTA is the responsible OTA for a program. When more than one OTA is responsible for a program, the responsible OTAs will jointly identify the lead OTA. c. Required Documentation. T&E program documentation that already exists in other acquisition documents may be provided by working links. Documentation that directly impacts the OT&E or LFT&E program will be included or linked in the applicable T&E documentation or else the documentation in question will be approved by DOT&E in addition to any other applicable approvals. DOT&E approval or disapproval of a document incorporating links constitutes approval or disapproval of the content applicable to operational testing in all of the links. Specifically, although DOT&E does not approve all the content of linked documents, DOT&E may require changes to linked content dealing specifically with operational or live-fire testing. 5. T&E PROGRAM PLANNING a. The TEMP is a signed contract among DOT&E, the Deputy Assistant Secretary of Defense (Developmental Test and Evaluation), senior DoD Component leadership, the lead OTA, and the Program Manager. b. The Program Manager and T&E WIPT will prepare and then update the TEMP to support the acquisition milestones. For the Full-Rate Production Decision Review or the Full Deployment Decision and thereafter (for DOT&E OT&E or LFT&E Oversight programs), DOT&E, the MDA, or the senior DoD Component leadership may require TEMP updates or addendums to address additional testing. c. Working through the T&E WIPT, program managers for DOT&E oversight programs will make draft TEMPs available to program stakeholders as early and as frequently as possible. DoD Component-approved TEMPs will be submitted to OSD for approval not later than 45 calendar days prior to the milestone decision. (1) A TEMP may be waived for select Accelerated or Urgent Acquisitions. In cases when DOT&E decides a TEMP is not needed, early briefings to DOT&E (in lieu of the TEMP) are recommended to facilitate subsequent DOT&E approval of the OTPs and LFTPs. DOT&E will approve the OTPs and LFTPs for accelerated acquisition (including capabilities acquired in response to an urgent need and acquisitions granted Rapid Acquisition Authority) if those acquisitions are on DOT&E OT&E or LFT&E oversight. If DOT&E has placed an Accelerated Acquisition on oversight, it is because DOT&E has determined that OT&E or LFT&E is required before fielding. Testing to verify safety, survivability, and operational performance will be conducted consistent with the urgency of deploying the capability. The Secretary of Defense may authorize the Rapid Acquisition Official to defer some testing until after fielding if he or she determines that the testing would unnecessarily impede the deployment of the needed capability. Testing should normally include user feedback to support design and operational use improvements.

DoDI 5000.02, January 7, 2015

ENCLOSURE 5 101

(2) Initial Operational Test and Evaluation (IOT&E) is required for all programs on DOT&E oversight in accordance with 10 U.S.C. 2399 (Reference (g)). The lead OTA will conduct an independent, dedicated phase of IOT&E before full-rate production or full deployment that provides objective test results free from potential conflicts of interest or bias. The primary purpose of IOT&E is to determine a system’s operational effectiveness and operational suitability. IOT&E can also be used to support system certification requirements and training requirements as long as the primary purpose is accomplished. d. The lead OTA for the program and the Program Manager will initiate coordinated planning for IOT&E as early as possible so that developing activities will be aware of expectations at IOT&E: (1) The lead OTA for the program will provide an assessment of the T&E implications of the initial concept of operations (CONOPS) provided by the user in the Milestone A TEMP. (2) Beginning at Milestone A, the lead OTA will provide a working link in the TEMP to a living document in which the DoD Component’s operational rationale for the requirements in the draft Capability Development Document (CDD) or equivalent requirements document will be tracked. (3) For software acquisitions, the lead OTA will conduct an analysis of operational risk to mission accomplishment covering all planned capabilities or features in the system (see paragraph 7d in this enclosure for additional details). The analysis will include commercial and non-developmental items. The initial analysis will be documented in the Milestone A TEMP and updated thereafter. (4) The TEMP will include evaluation of mission-level interoperability across key interfaces. Systems that provide capabilities for joint missions will be tested in the expected joint mission environment. e. Scientific test and analysis techniques (also referred to as Design of Experiments methodologies) should be employed to design an effective and efficient T&E program. The TEMP should document the test program that will produce the required data to characterize combat mission capability across an appropriately selected set of factors and conditions. (1) Starting at Milestone A, the TEMP should document T&E for phase completion (major test events required for milestone exit and entrance criteria). In addition, each major test phase or event should have test entrance and test completion criteria. (2) Each major test phase or event should have a synopsis of the intended analysis. A synopsis should indicate how the required data for test completion will contribute to one or more standard measures of program progress. These include the following terms: (a) Critical operational issues (also known as critical operational issues and criteria). (b) Key performance parameters.

DoDI 5000.02, January 7, 2015

ENCLOSURE 5 102

(c) Critical technical parameters. (d) Key system attributes. (3) Every TEMP will include a table of independent variables (or “conditions,” “parameters,” “factors,” etc.) that may have a significant effect on operational performance. Starting at Milestone B, the updated table of variables will include the anticipated effects on operational performance, the range of applicable values (or “levels,” “settings,” etc.), the overall priority of understanding the effects of the variable, and the intended method of controlling the variable during test (uncontrolled variation, hold constant, or controlled systematic test design). (4) Starting at Milestone B, every TEMP will include an evaluation overview. The overview will show how the major test events and test phases link together to form a systematic, rigorous, and structured approach to evaluating mission capability across the applicable values of the independent variables. Test resources will be derived from the evaluation overview (see section 10 in this enclosure). 6. OT&E ACTIVITIES a. Operational Assessments (OAs) (1) The lead OTA will prepare and report results of one or more early OAs (EOAs) as appropriate in support of one or more of the design phase life-cycle events (namely, the CDD Validation, the Development Request for Proposal (RFP) Release Decision Point, or Milestone B). An EOA is typically an analysis, conducted in accordance with an approved test plan, of the program’s progress in identifying operational design constraints, developing system capabilities, and mitigating program risks. For programs that enter development at Milestone B, the lead OTA will (as appropriate) prepare and report EOA results after program initiation and prior to the Critical Design Review. (2) An OA is a test event that is conducted before initial production units are available and which incorporates substantial operational realism. An OA is conducted by the lead OTA in accordance with a test plan approved by DOT&E for programs that are on OSD OT&E oversight. As a general criterion for proceeding through Milestone C, the lead OTA will conduct and report results of at least one OA. For an acquisition program employing the Incrementally Deployed Software Intensive Program model, a risk-appropriate OA is usually required in support of every limited deployment (see Model 3 at paragraph 5c(3)(d) in this instruction). An operational test, usually an OA, is required prior to deployment of accelerated or urgent acquisition programs that are on OSD OT&E or LFT&E oversight. An OA may be combined with training events (see paragraph 11a(9) in this enclosure). An OA is not required for programs that enter the acquisition system at Milestone C.

DoDI 5000.02, January 7, 2015

ENCLOSURE 5 103

b. RFPs. An up-to-date TEMP will be provided prior to release of RFPs for Milestone B and Milestone C. To the maximum extent feasible, RFPs should be consistent with the operational test program documented in the TEMP. c. OT&E for Reliability and Maintainability (1) The TEMP will include a plan (typically via working link to the Systems Engineering Plan) to allocate top-level reliability requirements down to the components and sub-components. Reliability allocations will include hardware and software, and will include commercial and non-development items. (2) Reliability Growth (a) Beginning at Milestone B, the TEMP will include T&E for reliability growth and reliability growth curves (RGCs) for the whole system and the reliability of critical systems, sub-systems, components, and sub-components. Reliability-critical items require test to mitigate risk resulting from the use of new technologies or from challenging operating environments. T&E for reliability growth will provide data on initial reliability (namely: identify the contractor and government reliability testing needed to achieve initial reliability) and reliability test events. RGCs will display planned initial reliability, the allocated reliability requirement, a curve showing reliability that is expected during each reliability test event, and points marking reliability test results to date. (b) For software (in any system) reliability growth will be measured by software maturity metrics (e.g., counts of high priority defects) at regular intervals. (c) Beginning at Milestone B, the TEMP will include a working link to the Failure Modes, Effects and Criticality Analysis (FMECA) of identified or anticipated system failure modes, the impacted components and sub-components, and the method of failure mode discovery. A software defect or failure tracking database(s) may replace the FMECA in software acquisitions. (3) Updated TEMPs at Milestone C will include updated RGCs that reflect test results to date, any updates to the planned T&E for reliability growth, and a working link to the updated FMECA. d. Use of Modeling and Simulation. Models or simulations that utilize or portray threat characteristics or parameters must have that portrayal accredited by the Defense Intelligence Agency. Every distinct use of a model or simulation in support of an operational evaluation will be accredited by an OTA, and, for programs under DOT&E Oversight, its use for the operational evaluation will be approved by DOT&E.

DoDI 5000.02, January 7, 2015

ENCLOSURE 5 104

7. OT&E FOR SOFTWARE a. Acquisition of software for any system will normally be supported by specialized models and early user involvement: (1) As feasible, testing of software for any system should be supported by a model (or emulated hardware or virtual machine) of the digital device(s) on which the software runs. (2) To the extent feasible, program managers should test prototype human interfaces with operational users. (3) Program managers for software acquisitions should develop process models of the time and effort needed to perform critical tasks and functions. Such models support operational test design and analysis of results as well as managerial needs such as sustainment cost projections and analysis of impacts of process changes. (4) Program managers must sustain an operationally realistic maintenance test environment in which software patches can be developed and upgrades of all kinds (developed or commercial) can be tested. The maintenance test environment is a model of the operational environment in that it should be able to replicate software defects found in the operational environment. b. Program managers for software acquisitions will provide plans at Milestone B indicating how system logs and system status records will interface with operational command and control. At IOT&E or a prior test event, program managers for software acquisitions will demonstrate performance monitoring of operational metrics to manage and operate each system capability (or the whole system, as appropriate). c. For software in any system, the evaluation of operational suitability will include a demonstrated capability to maintain the software. IOT&E or a prior test event will include an end-to-end demonstration of regression test, preferably automated, in the maintenance test environment. The demonstration will show how changes in requirements or discovered defects are mapped to lines of software that must be modified, and how modifications in software are mapped to the regression test scripts that will verify correct functioning of the modified software. d. Risk-Assessed Level of Operational Test for Software Acquisitions (Models 3, 4, and Hybrids) (1) OT&E for software acquisitions will be guided by the assessment of operational risks of mission failure. A significant operational risk of mission failure is a risk that is at least moderately likely to occur, and if the risk does occur then the impact will cause a degradation or elimination one or more operational capabilities. (2) At any level of risk, the lead OTA will coordinate with DOT&E on the required level of test and then observe the agreed-upon testing. At the lowest risk level, the lead OTA will review plans and observe developmental testing or developmental testing and integrated testing.

DoDI 5000.02, January 7, 2015

ENCLOSURE 5 105

At the highest risk level, the lead OTA will execute a full OT&E in accordance with the DOT&E-approved OTP. For intermediate risks, the lead OTA will coordinate with the responsible developmental testing organization to observe and execute some integrated developmental testing/operational testing in accordance with a DOT&E-approved OTP. (3) DOT&E will require an operational test or OA for every Limited Deployment in any acquisition model. The scope of the OT&E or OA will be guided by the risk of capability being fielded or deployed. (4) IOT&E is required for every increment, in any acquisition model (except as noted for urgent operational needs). IOT&E will normally occur prior to the Full Deployment Decision. IOT&E will be guided by an updated assessment of the operational risks in the capabilities and system interactions that have not been successfully evaluated in previous operational testing. 8. CYBERSECURITY a. Beginning at Milestone A, the TEMP will document a strategy and resources for cybersecurity T&E. At a minimum, software in all systems will be assessed for vulnerabilities. Mission critical systems or mission critical functions and components will also require penetration testing from an emulated threat in an operationally realistic environment during OT&E. b. Beginning at Milestone B, appropriate measures will be included in the TEMP and used to evaluate operational capability to protect, detect, react, and restore to sustain continuity of operation. The TEMP will document the threats to be used, which should be selected based on the best current information available from the intelligence community. c. The Program Manager, T&E subject matter experts, and applicable certification stakeholders will assist the user in writing testable measures for cybersecurity and interoperability. d. The Program Manager and OTA will conduct periodic cybersecurity risk assessments to determine the appropriate Blue/Green/Red Team, and operational impact test events in alignment with the overall test strategy for evaluating the program for real world effects. Defense business systems will undergo Theft/Fraud operational impact testing. 9. LFT&E. 10 U.S.C. 2366 (Reference (g)) mandates the LFT&E and formal LFT&E reporting for all covered systems, as determined by DOT&E, including Accelerated Acquisitions, survivability improvement, and kit programs to address urgent needs. DOT&E will require approval of LFT&E strategies and LFT&E test plans (including survivability test plans) for covered systems as defined in section 2366. The DOT&E will determine the quantity of test articles procured for all LFT&E test events for any system under DOT&E LFT&E oversight.

DoDI 5000.02, January 7, 2015

ENCLOSURE 5 106

10. RESOURCES AND SCHEDULE. All TEMPs will identify the resources needed to execute the planned T&E activities. Resource estimates will be matched against the schedule and justified by analysis in the TEMP. All TEMPs will contain an updated integrated test program summary and master schedule of all major test events or test phases, to include LFT&E events. a. Resource estimates (including but not limited to quantities of test articles, targets, expendables, threat simulations, operational forces, etc.) will be derived from defensible statistical measures of merit (power and confidence) associated with quantification of the differences among the factors affecting operational performance as well as the risk to the government of accepting a poorly performing system or incorrectly rejecting a system with acceptable performance. Specifically, the TEMP must discuss and display, or provide a reference to, the calculations done to derive the content of testing and to develop the associated resource estimates. b. The Program Manager and the Services or Defense Agencies will allocate the resources identified in the TEMP. Each TEMP update will include an updated and complete T&E resource estimate. c. Test infrastructure, resources (including threat representations), and tools to be used in operational tests must undergo verification by the developer, validation by the DoD Component, and accreditation by the OTA. Test infrastructure, resources, and tools, and their associated verification, validation, and accreditation strategies will be documented in the TEMP. d. In accordance with 10 U.S.C. 2399 (Reference (g)), DOT&E will approve the quantity of test articles required for all operational test events for any system under DOT&E oversight. The DoD Component OTA will determine the quantity for programs that are not under DOT&E oversight. e. The T&E schedule will be event-driven and allow adequate time to support pre-test predictions; testing; post-test analysis, evaluation, and reporting; reconciliation of predictive models; and adequate time to support execution of corrective actions in response to discovered deficiencies. f. For incremental software acquisitions employing limited deployments (see Model 3 at paragraph 5c(3)(d) in this instruction), the Milestone B TEMP will show a general schedule for the routine test sequence (developmental tests, certifications, integrated and operational tests) that will occur with every limited deployment within the allotted time for each limited deployment.

DoDI 5000.02, January 7, 2015

ENCLOSURE 5 107

11. OPERATIONAL AND LIVE FIRE T&E EXECUTION. The general process for planning, executing, and reporting on operational and major live fire test events is shown in Figure 9.

Figure 9. Operational or Major Live Fire Test Event: Planning, Approval, Execution, and Reporting

a. Planning Test Events (1) For all programs on DOT&E oversight, including Accelerated Acquisitions, DOT&E will approve OTPs and LFTPs prior to the corresponding operational or major live fire test events in accordance with 10 U.S.C. 2399. DOT&E will approve any LFTP for a major test event such as Full-up System Level test, Total Ship Survivability Trial, or Full Ship Shock Trials. The major live fire test events will be identified in the TEMP (or LFT&E strategy or equivalent document). Test plans are developed by a lead test organization (LTO). The LTO is the lead OTA for OT&E. The LTO varies for LFT&E. (2) For programs on DOT&E oversight, the appropriate LTO will brief the DOT&E on T&E concepts for the OTP or the major LFT&E as early as possible and not less than 180 calendar days prior to start of any such testing. DOT&E and DoD Component leads will be kept apprised of changes in test concept and progress on the OTP. The lead OTA will deliver the DoD Component-approved OTP for DOT&E review not later than 60 calendar days before test start. The LTO for major live fire events will deliver the DoD Component-approved LFTP for DOT&E review not later than 90 days before test start. (3) OTPs and major LFTPs will include the plans for data collection and management. (4) Integrated Testing (a) Integrated testing is the collaborative planning and collaborative execution of test phases and events to provide shared data in support of independent analysis, evaluation and reporting by all stakeholders particularly the developmental (both contractor and government) and operational test and evaluation communities. It requires the active participation of the lead OTA in planning the integrated tests with the program office so that the operational objectives are understood, the testing is conducted in an operationally realistic manner, and the resultant data is relevant for use in operational evaluations.

Repeat As Required

Execute Test ReportTest Plan

Test Concept

Brief

Operational Test

Readiness Review

DoDI 5000.02, January 7, 2015

ENCLOSURE 5 108

(b) For integrated test results to count for operational testing, the lead OTA must develop a plan for the integrated test to be approved by DOT&E before the start of testing that, at a minimum, details the required test realism and conditions, operational test objectives, operational test metrics and data collection requirements. Data collected outside an approved OTP or major LFTP can be used for a DOT&E operational or live fire evaluation if the data is approved by DOT&E. Depending on circumstances, DOT&E approval will not necessarily be possible in the TEMP and may require some other documentation. Data approval will be based on understanding of the realism of the test scenario(s) used and the pedigree (test conditions and methodologies) of the data. The data in question will typically come from operational exercises, certification events, and developmental test events conducted in operationally relevant environments. Data approval should be coordinated with the LTO and DOT&E prior to the start of testing. When advance coordination is not possible, the LTO will facilitate data re-use (in a DOT&E assessment or evaluation) through independent documentation of the test data pedigree (test conditions and methodologies). (5) In OT&E, typical users or units will operate and maintain the system or item under conditions simulating combat stress in accordance with 10 U.S.C. 139 (Reference (g)) and peacetime conditions, when applicable. The lead OTA, in consultation with the user and the Program Manager, will identify realistic operational scenarios based on the CONOPS (per paragraph 5d(1) in this enclosure) and mission threads derived from the Joint Mission Essential Task List or DoD Component-specific Mission Essential Task List. See paragraph 7d of this enclosure for risk-assessed OT&E of software acquisitions. (6) In accordance with 10 U.S.C. 2399 (Reference (g)), persons employed by the contractor for the system being developed may only participate in OT&E of systems on OSD OT&E oversight to the extent they are planned to be involved in the operation, maintenance, and other support of the system when deployed in combat. (a) A contractor that has participated (or is participating) in the development, production, or testing of a system for a DoD Component (or for another contractor of the DoD) may not be involved in any way in establishing criteria for data collection, performance assessment, or evaluation activities for OT&E. (b) These limitations do not apply to a contractor that has participated in such development, production, or testing, solely in test or test support on behalf of the DoD. (7) IOT&E for all programs will use production or production-representative test articles that, at a minimum, will incorporate the same parts and software items to be used in LRIP articles. Production-representative systems meet the following criteria: (a) The hardware and software must be as defined by the system-level critical design review, functional configuration audit, and system verification review, including correction of appropriate major deficiencies identified during prior testing.

DoDI 5000.02, January 7, 2015

ENCLOSURE 5 109

(b) For hardware acquisitions, production-representative articles should be assembled using the parts, tools, and manufacturing processes intended for use in full-rate production; utilize the intended production versions of software; and the operational logistics systems including mature drafts of maintenance manuals intended for use on the fielded system should be in place. The manufacturing processes to be used in full-rate production should be adhered to as closely as possible, and program managers for programs on DOT&E OT&E oversight will provide DOT&E a detailed description of any major manufacturing process changes. (c) For software acquisitions, a production-representative system consists of typical users performing operational tasks with the hardware and software intended for deployment, in an operationally realistic computing environment, with representative DoD information network operations and supporting cybersecurity capabilities. All manuals, training, helpdesk, continuity of operations, system upgrade and other life-cycle system support should be in place. (8) IOT&E will require more than an evaluation that is based exclusively on computer modeling, simulation, or an analysis of system requirements, engineering proposals, design specifications, or any other information contained in program documents in accordance with 10 U.S.C. sections 2399 and 2366 (Reference (g)). IOT&E will feature end-to-end testing of system capabilities including all interrelated systems needed to employ and support those capabilities. (9) Program managers for all programs (and particularly Accelerated Acquisitions) may, in coordination with the lead OTA, elect to perform integrated testing in conjunction with training, joint and operational exercises, or synchronized test events. Such testing is efficient, but inherently increases the risk that a significant problem will not be discovered. If no subsequent operational testing is conducted prior to fielding, then additional testing will typically be required subsequent to initial fielding. When subsequent testing is required, the plan for the T&E and reporting of results will be included in the applicable TEMP or other planning documentation. b. Conducting Test Events (1) Test plans must consider the potential impacts on personnel and the environment, in accordance with 42 U.S.C. 4321-4347 (Reference (ag)) and Executive Order 12114 (Reference (ah)). The Program Manager, working with the user and the T&E community, will provide safety releases (to include formal environment, safety, and occupational health risk acceptance in accordance with section 16 of Enclosure 3 of this instruction) to the developmental and operational testers prior to any test that may impact safety of personnel. (2) Barring significant unforeseen circumstances, all elements of an approved OTP or LFTP must be fully satisfied by the end of an operational or live fire test. If an approved plan cannot be fully executed, DOT&E concurrence with any changes must be obtained before revised test events are executed. Once testing has begun, deviations from approved elements of the test plan cannot be made prior to the beginning of their execution without consultation with the OTA commander (for OTP) or appropriate LTO (for LFTP) and the concurrence of DOT&E. DOT&E concurrence is not required when a need to change the execution of an element of the test plan arises in real time as its execution is underway. If DOT&E on-site representatives are

DoDI 5000.02, January 7, 2015

ENCLOSURE 5 110

not present and the test director concludes changes to the plan are warranted that would revise events yet to be conducted, the test director must contact the relevant DOT&E personnel to obtain concurrence with the proposed changes. If it is not possible to contact DOT&E personnel in a timely manner, the test director can proceed with execution of the revised test event but must inform DOT&E of the deviations from the test plan as soon as possible. (3) When the order of execution is identified in the TEMP as affecting the analysis of the data, test plans should include details on the order of test event execution and/or test point data collection. (4) Operating instructions (i.e., tactics, techniques and procedures, standard operating procedures, technical manuals, technical orders) should be considered for their impact on the test outcomes and included in OTPs when relevant. (5) Test plans must include the criteria to be used to make routine changes (delays for weather, test halts, etc.). (6) If required data for the test completion criteria are lost, corrupted, or not gathered, then the test is not complete unless the requirement is waived by DOT&E. c. Data Management, Evaluation, and Reporting (1) DOT&E, the Program Manager and their designated representatives who have been properly authorized access, will all have full and prompt access to all records, reports, and data, including but not limited to data from tests, system logs, execution logs, test director notes, and user and operator assessments and surveys. Data include but are not limited to classified, unclassified, and (when available) competition sensitive or proprietary data. Data may be preliminary and will be identified as such. (2) OTAs and other T&E agencies will record every OT&E and LFT&E event in some written form. Full reports will often contain multiple test events and will be accomplished in the most timely manner practicable. Interim summaries or catalogues of individual events will be prepared as results become available. (3) Significant problems will be reported promptly to senior DoD leadership when those problems are identified. OTAs will publish interim test event summaries as interim reports when the test events provide information of immediate importance to the program decision makers. This will occur particularly in support of accelerated acquisitions and time critical operational needs. Such reports should provide the most complete assessment possible based on the available data and should not be delayed. Such reports will be followed by the planned comprehensive reporting. (4) For DOT&E OT&E and LFT&E oversight programs, DOT&E will be kept informed of available program assets, assessments, test results and anticipated timelines for reporting throughout report preparation.

DoDI 5000.02, January 7, 2015

ENCLOSURE 5 111

(5) The Program Manager and test agencies for all programs will provide the Defense Technical Information Center (DTIC) with all reports, and the supporting data and metadata for the test events in those reports. If there are limitations in the data or metadata that can be provided to DTIC, those limitations will be documented in the TEMP starting at Milestone B. (6) Test agencies will provide the DoD Modeling and Simulation Coordination Office with a descriptive summary and metadata for all accredited models or simulations that can potentially be reused by other programs. (7) The Secretaries of the Military Departments, in coordination with the Defense Acquisition Executive, DOT&E, and the Under Secretary of Defense for Personnel and Readiness, will establish a common set of data for each major weapon system type to be collected on damage incurred during combat operations. This data will be stored in a single dedicated and accessible repository at DTIC. The lessons learned from analyzing this data will be included, as appropriate, in both the capability requirements process and the acquisition process for new acquisitions, modifications, and/or upgrades. 12. OPERATIONAL TEST READINESS. The DoD Components will each establish an Operational Test Readiness Review process to be executed for programs on DOT&E oversight prior to any Operational Test. Prior to IOT&E, the process will include a review of DT&E results, an assessment of the system’s progress against the key performance parameters, key system attributes, and critical technical parameters in the TEMP, an analysis of identified technical risks to verify that those risks have been retired or mitigated to the extent possible during DT&E and/or OT&E, a review of system certifications, and a review of the IOT&E entrance criteria specified in the TEMP. 13. CERTIFICATIONS. Testing in support of certifications should be planned in conjunction with all other testing. a. The Program Manager is responsible for determining what certifications are required; ensuring involvement of the representatives of applicable certifying authorities in the T&E WIPT; and satisfying the certification requirements. b. The Program Manager will provide the MDA, DOT&E, and the lead OTA with all data on certifications as requested. c. In accordance with DoD Instruction 8330.01 (Reference (ab)), the TEMP for all programs must reflect interoperability and supportability requirements, and serve as the basis for interoperability assessments and certifications. 14. TEMP EVOLUTION THROUGH THE ACQUISITION MILESTONES. The preceding policies are summarized together with associated DOT&E guidance and TEMP outlines at http://www.dote.osd.mil/temp-guidebook/index.html.

DoDI 5000.02, January 7, 2015

ENCLOSURE 6 112

ENCLOSURE 6

LIFE-CYCLE SUSTAINMENT 1. PURPOSE. This enclosure describes the application of life-cycle sustainment planning policies and procedures. The enclosure addresses sustainment across the life cycle, and the elements of the Life-Cycle Sustainment Plan (LCSP). 2. SUSTAINMENT ACROSS THE LIFE CYCLE. Sustainment planning, including the requirements in 10 U.S.C. 2337 (Reference (g)), and in Appendix E to Enclosure B of the Manual for the Operation of the Joint Capabilities Integration and Development System (Reference (r)), must be an integral element of the capability requirements and acquisition process from inception. a. The Program Manager, with the support of the Product Support Manager (PSM), will: (1) Develop and implement an affordable and effective performance-based product support strategy. The product support strategy will be the basis for all sustainment efforts and lead to a product support package to achieve and sustain warfighter requirements. (a) The product support strategy will address, at a minimum: 1. An integrated product support capability implementing the program’s mix of government and industry providers supported by appropriate analyses included in 10 U.S.C. 2337. 2. Sustainment metrics mapped to the sustainment key performance parameter and key system attributes to manage sustainment performance. 3. Implementation of a reliability improvement program based on Failure Modes, Effects and Critically Analysis (or defect tracking for software), other engineering data developed during the systems engineering process, system health information generated by applicable on-board and off-board technologies, and data sources in accordance with DoD Instruction 4151.22 (Reference (bi)). 4. Competition, or the option of competition, at the prime and subcontract levels for large and small businesses, and system and sub-system levels. 5. The necessary intellectual property (IP) deliverables and associated license rights, consistent with and integrated with the program IP Strategy. Paragraph 6a(4) in Enclosure 2 of this instruction details IP policy. 6. How and when computer software and computer software documentation (as defined in Defense Federal Acquisition Regulation Supplement (Reference (al)) section 252.227-

DoDI 5000.02, January 7, 2015

ENCLOSURE 6 113

7014) and other material and activities required to maintain and sustain the software after Initial Operational Capability (IOC) will be provided to the government for systems that require core logistics support or when depot level software maintenance is required. Paragraph 3d(2) in this enclosure addresses core logistics requirements. 7. The use of existing government owned inventory prior to use of product support arrangements as required in 10 U.S.C. 2337 (Reference (g)). 8. The government accountable property system that documents all government owned property whether it is held and managed by the government, contractor, or third party, in accordance with 40 U.S.C. 524 (Reference (p)). (b) Product support integrators and product support providers may be organic, commercial, or a combination. (2) Ensure identification of obsolete parts in specifications and develop plans for suitable replacements in accordance with P.L. 113-66, section 803 (Reference (bj)). (3) Employ effective performance-based logistics (PBL) planning, development, implementation, and management in developing a system’s product support arrangements. PBL is performance-based product support, where outcomes are acquired through performance-based arrangements that deliver warfighter requirements and incentivize product support providers to reduce costs through innovation. (4) Continually assess and refine the product support strategy based on projected and actual performance. (5) Employ a “Should-Cost” management and analysis approach to identify and implement system and enterprise sustainment cost reduction initiatives. Should-cost targets will be established and reviewed periodically based on analysis of acquisition sustainment costs and operations and support (O&S) cost element drivers. Program managers will capture product support metrics and cost data in DoD Component- and DoD-level information systems, and track performance against should-cost targets. (6) Continually monitor product support performance and correct trends that could negatively impact availability and cost. (7) Minimize unique automatic test equipment (ATE) by utilizing designated DoD automatic test system families for all ATE hardware and software in DoD field and depot operations. (8) Begin demilitarization and disposal planning, including demilitarization and controlled inventory item coding of system, subsystems, or components, as required by DoD Manual 4160.28-M (Reference (bk)), with sufficient lead time before the disposal or retirement of the first asset to reduce costs and risks and to ensure compliance with statutory and regulatory requirements.

DoDI 5000.02, January 7, 2015

ENCLOSURE 6 114

(9) Plan for corrosion prevention and control (CPC) in systems engineering and life cycle sustainment as required by DoD Instruction 5000.67 (Reference (bl)). Product support planning, especially maintenance planning and sustaining engineering, will incorporate appropriate mitigation of CPC risks inherent in the design to meet sustainment requirements. b. DoD Components will: (1) Ensure that sustainment factors are fully considered at all key life-cycle management decision points, and that appropriate measures are taken to reduce operating and support costs by influencing system design early in development, developing sound product support strategies, and addressing key drivers of cost. (2) Periodically assess product support performance and assist program managers, users, resource sponsors, and materiel enterprise stake holders to take corrective action to prevent degraded materiel readiness or O&S cost growth. (3) Initiate system modifications, as necessary, to improve performance and reduce ownership costs, consistent with the limitations prescribed in 10 U.S.C. 2244a (Reference (g)). 3. LIFE-CYCLE SUSTAINMENT PLAN (LCSP). Program managers for all programs are responsible for developing and maintaining an LCSP consistent with the product support strategy, beginning at Milestone A. The plan will describe sustainment influences on system design and the technical, business, and management activities to develop, implement, and deliver a product support package that maintains affordable system operational effectiveness over the system life cycle and seeks to reduce cost without sacrificing necessary levels of program support. The Acquisition Strategy will also include an overview of the product support strategy and sustainment-related contracts. a. The Under Secretary of Defense for Acquisition, Technology and Logistics (USD(AT&L)) (or as designated) will approve acquisition category (ACAT) ID, ACAT IAM, and USD(AT&L)-designated special interest program LCSPs. b. The Component Acquisition Executive (CAE), or designee, will approve LCSPs for ACAT IC, ACAT IAC, and ACAT II and below programs. c. The LCSP will be updated at each milestone and specified decision points to reflect the increased maturity of the product support strategy, any changes in the corresponding product support package, current risks, and any cost reduction activities. (1) At Milestone A, the LCSP will focus on development of sustainment metrics to influence design and the product support strategy, and on actions that can be taken prior to Milestone B to reduce future operating and support costs, including software sustainment. Planning will use factors and assumptions consistent with those used in the analysis of

DoDI 5000.02, January 7, 2015

ENCLOSURE 6 115

alternatives and affordability analysis, or justify any deviation from those factors and assumptions. (2) At the Development Request for Proposals Release Decision Point and Milestone B, the LCSP will focus on finalizing the sustainment metrics, integrating sustainment considerations with design and risk management activities, and refining the execution plan for the design, acquisition, fielding, and competition of sustainment activities. (3) At Milestone C, if applicable, the LCSP will focus on ensuring operational supportability and verifying performance. (4) At the Full-Rate Production Decision or Full Deployment Decision, the LCSP will focus on how sustainment performance is measured, managed, assessed, and reported; and the actions to adjust the product support package to ensure continued competition and cost control while meeting warfighter mission requirements. (5) After IOC, the LCSP is the principle document governing the system’s sustainment. Programs will update the plan whenever there are changes to the product support strategy, or every 5 years, whichever occurs first, supported by appropriate analyses, sustainment metrics, sustainment costs, system components or configuration (hardware and software), environmental requirements, and disposal plans or costs. d. The LCSP will include the following annexes: (1) Business Case Analyses. The Program Manager will attach relevant assumptions, constraints, and analyses used to develop the product support strategy to the LCSP. The Defense Logistics Agency will participate in supply support related business case analyses by developing and providing data for ACAT I, II, and III programs. PSMs will revalidate analyses based on changes to the assumptions, constraints, and operating environment, or every 5 years, whichever occurs first. (2) Core Logistics Analysis. By Milestone A, the DoD Component will document its determination of applicability of core depot-level maintenance and repair capability requirements in the LCSP in accordance with 10 U.S.C. 2366a (Reference (g)). For Milestone B, the Program Manager will attach the program's estimated requirements for maintenance, repair and associated logistics capabilities and workloads to the LCSP in accordance with 10 U.S.C. 2366b. The program's maintenance plan will ensure that core depot-level maintenance and repair capabilities and capacity are established not later than 4 years after IOC in accordance with 10 U.S.C. 2464. The Program Manager will ensure that a depot source of repair designation is made not later than 90 days after the Critical Design Review. Before entering into a contract for low rate initial production, supportability analysis must include detailed requirements for core depot-level maintenance and repair capabilities, and associated sustaining workloads required to support such requirements. (3) Preservation and Storage of Unique Tooling Plan. For Major Defense Acquisition Programs (MDAPs), the plan, as outlined and required by section 815 of P.L. 110-417

DoDI 5000.02, January 7, 2015

ENCLOSURE 6 116

(Reference (f)), is prepared to support Milestone C. It must include the review cycle for assessing tool retention across the life of the system. If a Milestone Decision Authority (MDA) (other than the Defense Acquisition Executive (DAE)) determines that preservation and storage of unique tooling is no longer required, a waiver will be submitted to the DAE for notification to Congress. (4) IP Strategy. The program’s IP Strategy will be included in the LCSP and updated appropriately during the O&S Phase (see paragraph 6a(4) in Enclosure 2 of this instruction for additional information). (5) Additional Annexes. Program Managers will consider including additional annexes, or reference other documents that integrate a program’s sustainment planning or product support strategy. e. Life-cycle sustainment for information systems may be provided via multiple approaches, including service level agreements, support agreements, performance work statements, and enterprise services. Where feasible and as approved by the MDA, programs may employ portfolio-level documents to satisfy their LCSP requirements. Commercial off-the-shelf and government off-the-shelf products used as intended will normally be supported via standard warranties and support agreements. Effective life-cycle sustainment requires continuous monitoring to ensure investments are maintained at the right size, cost, and condition, to include vulnerability management, to support warfighter and business missions and objectives. Information technology investment LCSPs will address Management-in-Use guidelines published in Office of Management and Budget Circular A-11 (Reference (c)). 4. SUSTAINMENT METRICS. The sustainment key performance parameter (KPP) (Availability) is as critical to a program’s success as cost, schedule, and performance. ACAT I and II program managers will use availability and sustainment cost metrics as triggers to conduct further investigation and analysis into drivers of those metrics, to develop Should Cost targets, and to develop strategies for improving reliability, availability, and maintainability of such systems at a reduced cost. The materiel availability portion of the KPP will be based on the entire system inventory and supported by the following sustainment metrics: a. Materiel Reliability. As required by the Manual for the Operation of the Joint Capabilities Integration and Development System (Reference (r)), materiel reliability is the design metric that has the most significant impact on the program’s operational availability and O&S cost. b. O&S Cost. DoD Components will ensure reliability and maintainability data from operational and developmental testing and evaluation and fielding informs estimates of O&S costs for major weapon systems. c. Mean Down Time. The average total downtime required to restore an asset to its operational capability, measures the effectiveness of the supply chain and support infrastructure (e.g., customer wait time, logistics response time, retrograde time). It is an important element in

DoDI 5000.02, January 7, 2015

ENCLOSURE 6 117

assessing a system’s affordability across its life cycle and identifies constraints and opportunities of a system's product support strategy and product support arrangements. d. Other Metrics. Outcome metrics to support sustainment elements included in capability requirements documentation or required by the DoD Component to manage the system development, product support package, and supply chain to develop and maintain the system. 5. PRODUCT SUPPORT REVIEWS a. The program’s PSM will assess logistics as a focused part of the program’s Program Support Assessments and technical reviews (e.g., systems engineering, test) to ensure the system design and product support package are integrated to achieve the sustainment metrics and inform applicable modeling and simulation tools. b. The DoD Components will conduct independent logistics assessments (ILAs) for all weapon system MDAPs prior to Milestones B and C and the Full-Rate Production Decision to assess the adequacy of the product support strategy, and to identify features that are likely to drive future operating and support costs, changes to system design that could reduce costs, and effective strategies for managing such costs. The reviews will focus on sustainment planning and execution, to include the core logistics analyses and establishment of organic capabilities. Each DoD Component will establish its criteria for independence, and will provide (1) guidance to ensure consistency within the respective Component and (2) the scope of the assessment for key acquisition decision points. At a minimum, these reviews will be chartered by the CAE and conducted by logistics, program management, and business experts from outside the program office. c. After IOC, the DoD Components will continue to conduct ILAs at a minimum interval of every 5 years. DoD Components will provide results to the Assistant Secretary of Defense for Logistics and Materiel Readiness. Assessments will focus on the weapon system-level product support performance in satisfying warfighter needs, meeting sustainment metrics, and providing best-value outcomes. They must specifically assess O&S costs to identify and address factors resulting in growth in O&S costs and adapt strategies to reduce such costs. Results will inform LCSP and analyses updates.

DoDI 5000.02, January 7, 2015

ENCLOSURE 7 118

ENCLOSURE 7

HUMAN SYSTEMS INTEGRATION (HSI) 1. PURPOSE. This enclosure describes the HSI policy and procedure applicable to defense acquisition programs. 2. GENERAL. The Program Manager will plan for and implement HSI beginning early in the acquisition process and throughout the product life cycle. The goal will be to optimize total system performance and total ownership costs, while ensuring that the system is designed, operated, and maintained to effectively provide the user with the ability to complete their mission. The Program Manager will ensure that HSI is considered at each program milestone during the program life cycle. 3. HSI PLANNING. HSI planning and implementation will address: a. Human Factors Engineering. The Program Manager will take steps (e.g., contract deliverables and government/contractor integrated product teams) to ensure ergonomics, human factors engineering, and cognitive engineering is employed during systems engineering over the life of the program to provide for effective human-machine interfaces and to meet human systems integration requirements. System designs will minimize or eliminate system characteristics that require excessive cognitive, physical, or sensory skills; entail extensive training or workload-intensive tasks; result in mission-critical errors; or produce safety or health hazards. b. Personnel. The Program Manager will, in conjunction with designated DoD Component HSI staff, define the human performance characteristics of the user population based on the system description, projected characteristics of target occupational specialties, and recruitment and retention trends. To the extent possible, systems will not require special cognitive, physical, or sensory skills beyond that found in the specified user population. For those programs that have skill requirements that exceed the knowledge, skills, and abilities of current military occupational specialties, or that require additional skill indicators or hard-to-fill military occupational specialties, the Program Manager will consult with personnel communities to mitigate readiness, personnel tempo, and funding issues. c. Habitability. The Program Manager will, in conjunction with designated DoD Component staff, establish requirements for the physical environment (e.g., adequate space and temperature control) and, if appropriate, requirements for personnel services (e.g., medical and mess) and living conditions (e.g., berthing and personal hygiene) for conditions that have a direct impact on meeting or sustaining system performance or that have such an adverse impact on quality of life and morale that recruitment or retention is degraded.

DoDI 5000.02, January 7, 2015

ENCLOSURE 7 119

d. Manpower. In advance of contracting for operational support services, the Program Manager will, in conjunction with the designated DoD Component HSI staff, determine the most efficient and cost-effective mix of DoD manpower and contract support. The mix of military, DoD civilian, and contract support necessary to operate, maintain, and support (to include providing training) the system will be determined based on the manpower mix criteria (see DoD Instruction 1100.22 (Reference (bm))) and will be reported in the Manpower Estimate. Economic analyses used to support workforce mix decisions will use costing tools, to include DoD Instruction 7041.04 (Reference (bn)), that account for fully loaded costs (i.e., all variable and fixed costs, compensation and non-compensation costs, current and deferred benefits, and cash and in-kind benefits) approved by the DoD Component manpower authority. The Manpower Estimate is approved by the DoD Component manpower authority and serves as the authoritative source for reporting manpower in other program documentation. e. Training. The Program Manager will, in conjunction with designated DoD Component staff, develop options for individual, collective, and joint training for operators, maintenance and support personnel, and, where appropriate, base training decisions on training effectiveness evaluations (which can be integrated with other test and evaluation). The major tasks identified in the job task analysis, training device document coordinating paper and training plans will support a comprehensive analysis with special emphasis on options that enhance user capabilities, maintain skill proficiencies, and reduce individual and collective training costs. The Program Manager will develop training system plans that consider the use of new learning techniques, simulation technology, embedded training and distributed learning, and instrumentation systems that provide “anytime, anyplace” training and reduce the demand on the training establishment. Where cost effective and practical, the Program Manager will use simulation-supported embedded training, and the training systems will fully support and mirror the interoperability of the operational system in accordance with DoD Directive 1322.18 (Reference (bo)). f. Safety and Occupational Health. The Program Manager will ensure that appropriate human systems integration and environmental, safety, and occupational health efforts are integrated across disciplines and into systems engineering to determine system design characteristics that can minimize the risks of acute or chronic illness, disability, or death or injury to operators and maintainers; and enhance job performance and productivity of the personnel who operate, maintain, or support the system. g. Force Protection and Survivability. The Program Manager will assess risks to personnel and address, in terms of system design, protection from direct threat events and accidents (such as chemical, biological, and nuclear threats). Design consideration will include primary and secondary effects from these events and consider any special equipment necessary for egress and survivability.

DoDI 5000.02, January 7, 2015

ENCLOSURE 8 120

ENCLOSURE 8

AFFORDABILITY ANALYSIS AND INVESTMENT CONSTRAINTS

1. PURPOSE. This enclosure establishes the fundamental concepts and approaches for developing and applying affordability constraints to acquisition programs as part of life-cycle investment analysis, decision making, and management. 2. OVERVIEW a. Affordability analysis is a DoD Component leadership responsibility that should involve the Component’s programming, resource planning, requirements, intelligence, and acquisition communities. The Department has a long history of starting programs that proved to be unaffordable. The result of this practice has been costly program cancelations and dramatic reductions in inventory objectives. Thus, the purpose of Affordability Analysis is to avoid starting or continuing programs that cannot be produced and supported within reasonable expectations for future budgets. Affordability constraints for procurement and sustainment will be derived early in program planning processes. These constraints will be used to ensure capability requirements prioritization and cost tradeoffs occur as early as possible and throughout the program’s life cycle. b. The intent of this policy is to require affordability analysis that addresses the total life cycle of the planned program, including beyond the Future Years Defense Program (FYDP). Program life-cycle affordability is a cornerstone of DoD acquisition planning as indicated in DoD Directive 5000.01 (Reference (a)). Affordability within the FYDP is part of the Milestone Decision Authority (MDA) certification and monitoring required by 10 U.S.C. 2366b (Reference (g)) for Major Defense Acquisition Programs (MDAPs) at and beyond Milestone B. Assessing life-cycle affordability of new and upgraded systems is also crucial for establishing fiscal feasibility of the program, informing Analyses of Alternatives (AoAs), guiding capability requirements and engineering tradeoffs, and setting realistic program baselines to control life-cycle costs and help instill more cost-conscious management in the DoD. Affordability analysis and management necessitates effective and ongoing communication with the requirements community on the cost and risk implications of capability requirements. c. Affordability analysis and constraints are not intended to produce rigid, long-term plans. Rather, they are tools to promote responsible and sustainable investment decisions by examining the likely long-range implications of today’s capability requirements choices and investment decisions based on reasonable projections of future force structure equipment needs—before substantial resources are committed to a program. d. Affordability analysis and affordability constraints are not synonymous with cost estimation and approaches for reducing costs. Constraints are determined in a top-down manner by the resources a DoD Component can allocate for a system, given inventory objectives and all other fiscal demands on the Component. Constraints then provide a threshold for procurement

DoDI 5000.02, January 7, 2015

ENCLOSURE 8 121

and sustainment costs that cannot be exceeded by the Program Manager. On the other hand, cost estimates are generated in a bottom-up or parametric manner and provide a forecast of what a product will cost for budgeting purposes. The difference between the affordability constraints and the cost estimates indicates whether actions must be taken to further reduce cost in order to remain within affordability constraints. Independent of affordability constraints or cost estimates, program managers should always be looking for ways to control or reduce cost. Proactive cost control is central to maximizing the buying power of the Department and should be an integral part of all phases and aspects of program management. Cost estimating approaches are discussed in Enclosure 10 of this instruction. e. When approved affordability constraints cannot be met—even with aggressive cost control and reduction approaches—then technical requirements, schedule, and required quantities must be revisited; this will be accomplished with support from the DoD Component’s Configuration Steering Board, and with any requirements reductions proposed to the validation authority. If constraints still cannot be met, and the Component cannot afford to raise the program’s affordability cap(s) by lowering constraints elsewhere and obtaining MDA approval, then the program will be cancelled. 3. LIFE- CYCLE AFFORDABILITY ANALYSIS. DoD Components are responsible for developing life-cycle affordability constraints for Acquisition Category (ACAT) I and IA acquisition programs for procurement unit cost and sustainment costs by conducting portfolio affordability analyses that contain a product life-cycle funding projection and supporting analysis. The basic procurement unit cost calculation is the annual estimated procurement budget divided by the number of items that should be procured each year to sustain the desired inventory. (As a simple example, if a Component plans to maintain an inventory of 200,000 trucks, and the trucks have an expected service life of 20 years, then an average of 10,000 trucks must be procured each year. If the Component can afford to spend an average of $1 billion per year on trucks, then the affordability constraint for procurement is $1 billion divided by 10,000, or $100,000 per truck. The Component’s requirements for a new truck must be restricted to those that can fit into a $100,000 package. Similar calculations will be made to derive sustainment affordability constraints.) If they are provided, Components will use office of the Under Secretary of Defense for Acquisition, Technology and Logistics standardized portfolios for their analysis. Portfolios can be based on mission areas or commodity types, and will define a collection of products or capabilities that can be managed together for investment analysis and oversight purposes. Components will normally make tradeoffs within portfolios, but if necessary, can and should make tradeoffs across portfolios to provide adequate resources for high-priority programs. a. A Product Life Cycle, Component Portfolio Analysis (30 to 40 Years Nominal). Component leadership—not the acquisition community or program management—conducts affordability analysis with support and inputs from their programming, resource planning, requirements, intelligence, and acquisition communities. Each Component determines the processes and analytic techniques they use for affordability analysis within the following basic constructs:

DoDI 5000.02, January 7, 2015

ENCLOSURE 8 122

(1) Future Budget. A future total budget projection for each DoD Component for affordability analysis provides the first-order economic estimate for allocation of future resources to each portfolio. This projection establishes a nominal rather than optimistic foundation for the future and covers all fiscal demands that compete for resources in the Component, including those outside acquisition and sustainment. (2) Time Horizon. Component level affordability analysis examines all programs and portfolios together, extending over enough years to reveal the life-cycle cost and inventory implications of planned program for the Component. The same analysis is used as individual programs come up for review. Nominally, affordability analysis covers 30 to 40 years into the future. (3) Consistency. The aggregation of portfolio cost estimates for each year, when combined with all other fiscal demands on the Component, may not exceed the Component’s reasonably anticipated future budget levels. (4) Fiscal Guidance. Absent specific Component-level guidance by the Director of Cost Assessment and Program Evaluation or the Defense Acquisition Executive, each Component projects its topline budget beyond the FYDP using the average of the last 2 years of the current FYDP and the OSD inflator provided by the Under Secretary of Defense (Comptroller) (USD(C)), resulting in zero real growth. (5) Inflators. Affordability analysis assumes constant purchasing power. Each Component uses the OSD inflator provided by USD(C) in the Component’s future total budget projection and to inflate their cost estimates for comparison against affordability constraints, assuming budgets will be adjusted later for any differential inflator issues. (6) Portfolios. Components will subdivide their accounts into portfolios to facilitate trade-off analysis; but when summed, the total cost for all portfolios and their elements cannot be above the Component’s future total budget projection. Components may use existing affordability portfolios, which will be stable between affordability analysis updates. When the analysis is presented for a specific program’s review, the Component will employ the relevant portfolio to facilitate understanding and discussion of life-cycle costs and inventories of related acquisition systems. (7) Other Portfolio Plans. The Component’s affordability analyses should be consistent with any relevant existing portfolio plans and strategies such as those required by statute (i.e., the 30-year plans required by 10 U.S.C. 231 (for ships) and 10 U.S.C. 231a (for aircraft) (Reference (g))). (8) Affordability Analysis Updates. Each Component maintains and updates its affordability analysis as needed at the Component or portfolio level to reflect significant changes such as large cost growths in portfolios and programs, changes in defense strategy, force structure changes, or major budgetary changes.

DoDI 5000.02, January 7, 2015

ENCLOSURE 8 123

b. Affordability Analysis Output Format. Each Component’s affordability analysis is presented within the governance framework to the MDA in preparation for major acquisition decisions in a format that demonstrates the affordability of the program within the Component and portfolio context, to ensure that the resulting affordability constraints are understood and consistent with the future total budget projection. Transparency ensures that the risk, cost implications, and alternatives of system acquisitions and sustainment are sufficiently understood by the Component leadership and the programming, resource planning, requirements, intelligence, and acquisition communities. (1) Data Format. At each major acquisition decision point or milestone, the DoD Component will provide stacked area charts (“sand charts”) and underlying spreadsheets. These provide the estimated allocations by year for each program and portfolio of the analysis—including all programs in all portfolios—against the future total budget projection equivalent to the DoD Component’s Total Obligation Authority. (2) Data Requirements for Programs. Affordability analysis must be consistent with the data in the Cost Analysis Requirements Description for a program under review, including the capability requirements, quantity, and schedule used in the analysis. Affordability analysis also provides data to support the procurement and sustainment constraints that will be documented in the acquisition decision memorandums (ADMs) resulting from the Materiel Development Decision (MDD), Milestone A, and Development Request for Proposals (RFP) Release Decision Point, and in the acquisition program baselines normally set at Milestone B and beyond. c. Timing of Affordability Analysis. Affordability analysis should be conducted as early as possible in a system’s life cycle so that it can inform early capability requirements trades and the selection of alternatives to be considered during the AoA. Affordability constraints are not required before the MDD; however, conducting some analysis before that point is beneficial. The best opportunity for ensuring that a program will be affordable is through tailoring capability requirements before and during the AoA(s) and early development. Thus, the Components will incorporate estimated funding streams for future programs within their affordability analyses at the earliest conceptual point and specify those estimates at the MDD and beyond to inform system design and alternative selection. d. Importance of AoAs to Affordability. Examination of key requirements cost-performance relationships, when merged with affordability analysis results during AoAs, provides the information needed to support sound material solution decisions about affordable products. e. Affordability Constraints: Goals and Caps (1) Affordability constraints are established to inform the capability requirements validation authority, Program Manager, and AoA team of the cost limitations dictated by the Component’s affordability analysis. Early in a program, affordability goals are set to inform capability requirements and major design tradeoffs needed to define the product being acquired. Once requirements and the product definition are firm (prior to Milestone B), affordability caps are established to provide fixed cost requirements that are functionally equivalent to Key

DoDI 5000.02, January 7, 2015

ENCLOSURE 8 124

Performance Parameters. Based on the Component’s affordability analysis and recommendations, the MDA will set and enforce affordability constraints as follows: (a) At MDD. Tentative affordability cost goals (e.g., total funding, annual funding profiles, unit procurement and/or sustainment costs, as appropriate) and inventory goals to help scope the AoA and provide targets around which to consider alternatives. (b) At Milestone A. Affordability goals for unit procurement and sustainment costs. (c) At the Development RFP Release Decision Point, Milestone B, and Beyond. Binding affordability caps. (2) These constraints will be documented in the ADMs for these decision points. At Milestone B and beyond, the affordability caps will be documented in the program’s Acquisition Program Baseline. Any programs that do not include a Milestone B decision will receive goals or caps commensurate with their position in the acquisition cycle and their level of maturity. (3) The metrics used for MDA-approved affordability constraints on procurement and sustainment costs may be tailored to the type of acquisition and the specific circumstances of a given program. In addition to capability requirements tradeoffs approved by the requirements validation authority; prudent investments in research, development, and test and evaluation; innovative acquisition strategies; and incentives to reduce costs can be used to ensure that affordability constraints are achieved. f. Monitoring and Reporting. The MDA will enforce affordability constraints throughout the life cycle of the program. If a program manager concludes that, despite efforts to control costs and reduce requirements, an affordability constraint will be exceeded, then the Program Manager will notify the Component Acquisition Executive (CAE) and the MDA to request assistance and resolution. Program managers will also report progress relative to affordability constraints at Defense Acquisition Executive Summary reviews. 4. LOWER ACAT PROGRAMS. Each CAE will develop and issue similar guidance to ensure life-cycle affordability for lower ACAT programs that have resource implications beyond the FYDP.

DoDI 5000.02, January 7, 2015

ENCLOSURE 9 125

ENCLOSURE 9

ANALYSIS OF ALTERNATIVES (AOA) 1. PURPOSE. The AoA assesses potential materiel solutions that could satisfy validated capability requirement(s) documented in the Initial Capabilities Document, and supports a decision on the most cost effective solution to meeting the validated capability requirement(s). In developing feasible alternatives, the AoA will identify a wide range of solutions that have a reasonable likelihood of providing the needed capability. 2. AOA PROCEDURES a. The Director of Cost Assessment and Program Evaluation (DCAPE) develops and approves study guidance for the AoA for potential and designated Acquisition Category (ACAT) I and IA programs and for each joint military or business requirement for which the Chairman of the Joint Requirements Oversight Council (JROC) or the Investment Review Board is the validation authority. In developing the guidance, the DCAPE solicits the advice of other DoD officials and ensures that the guidance requires, at a minimum: (1) Full consideration of possible tradeoffs among life-cycle cost, schedule, and performance objectives (including mandatory key performance parameters) for each alternative considered. (2) An assessment of whether the joint military requirement can be met in a manner consistent with the cost and schedule objectives recommended by the JROC or other requirements validation authority. (3) Consideration of affordability analysis results and affordability goals if established by the Milestone Decision Authority (MDA). b. The DCAPE provides the AoA Study Guidance to the DoD Component or organization designated by the MDA or, for ACAT IA programs, to the office of the principal staff assistant responsible for the mission area, prior to the Materiel Development Decision (MDD) and in sufficient time to permit preparation of the study plan prior to the decision event. The study plan will be coordinated with the MDA and approved by the DCAPE prior to the MDD. The designated DoD Component or other organization or the principal staff assistant will designate responsibility for completion of the study plan and the AoA. c. The final AoA will be provided to the DCAPE not later than 60 calendar days prior to the Milestone A review (or the next decision point or milestone as designated by the MDA). Not later than 15 business days prior to the Milestone A review, DCAPE evaluates the AoA and provides a memorandum to the MDA, with copies to the DoD Component head or other organization or principal staff assistant assessing whether the analysis was completed consistent

DoDI 5000.02, January 7, 2015

ENCLOSURE 9 126

with DCAPE study guidance and the DCAPE-approved study plan. In the memorandum, the DCAPE assesses: (1) The extent to which the AoA: (a) Examines sufficient feasible alternatives. (b) Considers tradeoffs among cost, schedule, sustainment, and required capabilities for each alternative considered. (c) Achieves the affordability goals established at the MDD and with what risks. (d) Uses sound methodology. (e) Discusses key assumptions and variables and sensitivity to changes in these. (f) Bases conclusions or recommendations, if any, on the results of the analysis. (g) Considers the fully burdened cost of energy (FBCE), where FBCE is a discriminator among alternatives. (2) Whether additional analysis is required. (3) How the AoA results will be used to influence the direction of the program. d. The final AoA will also be provided to and reviewed by the requirements validation authority prior to the Milestone A decision or the release of the request for proposals for the Technology Maturation and Risk Reduction Phase activities. The requirements validation authority will, at a minimum: (1) Assess how well the recommended alternative satisfies validated requirements in the most cost effective manner for the warfighter. (2) Identify any opportunities to adjust or align capability requirements for better synergy across the joint force capabilities. (3) In accordance with the responsibilities identified in title 10 of U.S. Code (Reference (g)), offer alternative recommendations to best meet the validated capability requirements.

DoDI 5000.02, January 7, 2015

ENCLOSURE 10 127

ENCLOSURE 10

COST ESTIMATING AND REPORTING

1. PURPOSE. This enclosure describes the primary tools and methods that the DoD uses to ensure that the most cost-effective solution to a validated capability need is chosen, budgets are adequate, and viable cost saving opportunities through multi-year contracting are exploited. 2. COST ESTIMATION a. Per 10 U.S.C. 2334 (Reference (g)) and DoD Directive 5105.84 (Reference (bp)), the Director of Cost Assessment and Program Evaluation (DCAPE) provides policies and procedures for the conduct of cost estimates and cost analyses for all DoD acquisition programs, including issuance of guidance relating to program life-cycle cost estimation and risk analysis; reviews cost estimates and cost analyses conducted in connection with Major Defense Acquisition Programs (MDAPs) and Major Automated Information System (MAIS) programs; and leads the development of DoD cost community training. The procedures associated with these policies are detailed in DoD Manual 5000.4-M (Reference (w)), DoD Manual 5000.04-M-1 (Reference (at)), and the Office of the Secretary of Defense, Cost Assessment and Program Evaluation, “Operating and Support Cost-Estimating Guide” (Reference (bq)). (1) The DCAPE conducts Independent Cost Estimates (ICEs) and cost analyses for MDAPs for which the Under Secretary of Defense for Acquisition, Technology and Logistics (USD(AT&L)) is the Milestone Decision Authority (MDA) and as requested by the MDA for other MDAPs: (a) In advance of any decision to enter LRIP or full-rate production. (b) In advance of any certification pursuant to sections 2366a, 2366b, or 2433a of title 10 U.S. Code. (c) At any other time considered appropriate by the DCAPE or upon the request of the MDA. (2) The DCAPE conducts ICEs and cost analyses for MAIS programs for which the USD(AT&L) is the MDA and as requested by the MDA for other MAIS programs in advance of: (a) Any report pursuant to paragraph (f) of 10 U.S.C. 2445c. (b) At any other time considered appropriate by the DCAPE or upon the request of the MDA.

DoDI 5000.02, January 7, 2015

ENCLOSURE 10 128

(3) The DCAPE prepares an ICE for Acquisition Category (ACAT) IC and IAC programs at any time considered appropriate by the DCAPE or upon the request of the USD(AT&L) or the MDA. (4) For MDAPs for which DCAPE does not develop an ICE, the ICE supporting a milestone review decision will be provided to the MDA by the applicable Service Cost Agency or defense agency equivalent following review and concurrence by DCAPE. (5) DCAPE representatives will meet with representatives from the Service Cost Agency and program office no later than 180 calendar days before the scheduled Development Request for Proposals (RFP) Release Decision Point to determine what cost analysis, if any, will be presented at the decision review and who will be responsible for preparing the cost analysis. Following the meeting, DCAPE will notify the MDA of the type of cost analysis that will be presented. The type of cost analysis will vary depending on the program and the information that is needed to support the decision to release the RFP. For some programs, no new cost analysis may be necessary, and the DCAPE representative will present the Milestone A ICE or an update to the Milestone A ICE. In other cases, the cost analysis may be a cost assessment or a complete ICE. (6) The DCAPE reviews all cost estimates and cost analyses conducted in connection with MDAPs and MAIS programs, including estimates of operating and support (O&S) costs for all major weapon systems. To facilitate the review of cost estimates, the DCAPE receives the results of all cost estimates and cost analyses and associated studies conducted by the DoD Components for MDAPs and MAIS programs. (7) The DCAPE, DoD Components, and Service Cost Agencies will be provided timely access to any records and data in the DoD (including the records and data of each military department and defense agency, to include classified, unclassified, and proprietary information) it considers necessary to review cost analyses and conduct the ICEs and cost analyses described in sections 2 and 3 of this enclosure. (8) For MDAP and MAIS programs, the DCAPE participates in the discussion of issues related to and/or differences between competing program cost estimates, comments on methodologies employed and the estimate preparation process, coordinates on the cost estimate used to support establishment of baselines and budgets, and participates in the consideration of any decision to request authorization of a multi-year procurement contract for an MDAP. (9) The documentation of each MDAP or MAIS program cost estimate prepared by DCAPE and/or Service or Agency includes the elements of program cost risk identified and accounted for, how they were evaluated, and possible mitigation measures. DCAPE then assesses the proposed program’s baseline and associated program budget’s ability to provide the necessary high degree of confidence that the program can be completed without the need for significant adjustment to future program budgets. If the MDAP or MAIS program baseline or budget determined by DCAPE as appropriately high confidence is not adopted by the MDA, the MDA will document the rationale for the decision. For MDAPs, the next Selected Acquisition Report prepared in compliance with 10 U.S.C. 2432 (Reference (g)), and for MAIS programs,

DoDI 5000.02, January 7, 2015

ENCLOSURE 10 129

the next quarterly report prepared in compliance with 10 U.S.C. 2445c will disclose the confidence level used in establishing the cost estimate for the MDAP or MAIS program and the rationale for selecting the confidence level. (10) In addition to O&S cost estimates included in the ICEs conducted at the reviews identified in paragraphs 2a(1) through 2a(4) of this enclosure, Military Departments must update estimates of O&S costs periodically throughout the life cycle of a major weapon system to determine whether preliminary information and assumptions remain relevant and accurate and to identify and record reasons for variances. Further, an independent review of O&S cost estimates must be conducted at post-Initial Operational Capability reviews. Each O&S cost estimate must be compared to earlier cost estimates and the program’s O&S affordability cap, and, as appropriate, this information will be used to update the life-cycle affordability analysis provided to the MDA and requirements validation authority. This comparison must identify the reasons for significant changes and categorize those reasons into external and internal factors. b. The MDA may request that the DCAPE, within the DCAPE’s discretion, develop cost assessments for any other program regardless of its ACAT. c. Per 10 U.S.C. 2434 (Reference (g)), the MDA may not approve the engineering and manufacturing development or the production and deployment of an MDAP unless an independent estimate of the full life-cycle cost of the program, prepared or approved by the DCAPE, has been considered by the MDA. d. The DoD Component will develop a DoD Component Cost Estimate that covers the entire life cycle of the program for all MDAPs prior to Milestone A, B, and C reviews and the Full-Rate Production Decision; and for all MAIS programs at any time an Economic Analysis is due. e. The DoD Component and the Service Cost Agency will establish a documented DoD Component Cost Position that covers the entire life cycle of the program for all MDAPs and MAIS programs prior to the Milestone A, B, and C reviews, and the Full-Rate Production Decision or Full Deployment Decision Review. The DoD Component Cost Position must be signed by the appropriate DoD Component Deputy Assistant Secretary for Cost and Economics (or defense agency equivalent) and must include a date of record. f. At the Milestone A, B, and C reviews and for the Full-Rate Production Decision or Full Deployment Decision review, the DoD Component must fully fund the program to the Component Cost Position in the current Future Years Defense Program (FYDP), or commit to full funding of the cost position in the next FYDP, with identification of specific offsets to address any funding shortfalls that may exist in the current FYDP. The Component Acquisition Executive and the DoD Component Chief Financial Officer must endorse and certify in the Full Funding Certification Memorandum that the FYDP fully funds, or will fully fund, the program consistent with the DoD Component Cost Position. If the program concept evolves after a milestone review, the Service Cost Agency may update the DoD Component Cost Position, and the DoD Component may fully fund the program in the FYDP to the updated DoD Component Cost Position.

DoDI 5000.02, January 7, 2015

ENCLOSURE 10 130

3. COST ANALYSIS REQUIREMENTS DESCRIPTION (CARD). The foundation of a sound and credible cost estimate is a well-defined program. The DCAPE requires use of the CARD and provides guidance on the content of the CARD in DoD 5000.4-M (Reference (w)) to provide that foundation. For ACAT I and IA programs, the Program Manager will prepare, and an authority no lower than the DoD Component Program Executive Officer (PEO) will approve, the CARD. For joint programs, the CARD will cover the common program as agreed to by all participating DoD Components, as well as any DoD Component-unique requirements. The DCAPE and the organization preparing the DoD Component Cost Estimate must receive a draft CARD 180 calendar days, and the final CARD 45 calendar days, prior to a planned Overarching Integrated Product Team (OIPT) or equivalent staff coordination body review or DoD Component review, unless DCAPE agrees to other due dates. The Program Manager and PEO will insure the draft and final CARDs are consistent with other final program documentation. a. Recognizing that program details are refined over time, with fewer details available for MDAPs and MAIS programs approaching Milestone A than Milestone B, DCAPE will provide CARD development guidance tailored to the specific review being conducted and the type of system being developed. However, all CARDs, no matter how tailored, will provide a program description that includes a summary of the acquisition approach, expected constraints, system characteristics, quantities, operational factors, operational support strategy, preliminary schedules, test programs, technology maturation and risk reduction plans, and appropriate system analogs. Additional content may be required as requested by DCAPE. b. When Milestone A occurs prior to release of the Technology Maturation and Risk Reduction Phase RFP, the DCAPE or DCAPE-approved DoD Component ICE will not be able to reflect information provided by the competing contractors in their proposals. Should the contractor proposed solutions entering the Technology Maturation and Risk Reduction Phase differ significantly from the design reflected in the Milestone A CARD, the Program Manager will report any differences that might alter the basis for the MDA’s Milestone A decision to DCAPE and the MDA. The MDA will determine whether an additional review is required prior to contract award. c. At the Development RFP Release Decision Point, the program described in the final CARD will reflect the Program Manager’s and PEO’s best estimate of the materiel solution that will be pursued following Milestone B. The final CARD will be updated to reflect all new program information prior to Milestone B. 4. COST REPORTING. Standardized cost data collection procedures and formats are essential for credible cost estimates for current and future programs. DCAPE establishes procedural guidance for cost data collection and monitoring systems. Table 7 in Enclosure 1 of this instruction provides detailed information on Cost and Software Data Reporting (CSDR) requirements. a. DoD has three primary cost data collection methods: CSDR, the Integrated Program Management Report, and the Visibility and Management of Operating and Support Costs (VAMOSC) systems. The CSDR and the Integrated Program Management Report instruments

DoDI 5000.02, January 7, 2015

ENCLOSURE 10 131

serve as the primary sources of acquisition cost data for major contracts and subcontracts associated with MDAPs and MAIS programs. DCAPE defines procedural and standard data formatting requirements for the CSDR system in DoD Manual 5000.04-M-1 (Reference (at)). Formats and reporting requirements for Integrated Program Management Reports are determined and managed by USD(AT&L). VAMOSC data systems are managed by each Military Department and collect historical O&S costs for major fielded weapon systems. DCAPE conducts annual reviews of VAMOSC systems to address data accessibility, completeness, timeliness, accuracy, and compliance with CAPE guidance. The annual reviews also assess the adequacy of each military department’s funding and resources for its VAMOSC systems. DoD Manual 5000.4-M (Reference (w)) provides the procedural and data reporting requirements for VAMOSC. b. The two components of the CSDR system are Contractor Cost Data Reporting and Software Resources Data Reporting. CSDR plans are developed pursuant to the requirements in DoD Manual 5000.04-M-1, and are required for each phase of program acquisition. Proposed CSDR plan(s) for ACAT I and IA programs must be approved by DCAPE prior to the issuance of a contract solicitation. The DCAPE has the authority to waive the information requirements of Table 7. Program managers will use the CSDR system to report data on contractor costs and resource usage incurred in performing DoD programs. c. In addition to the historic O&S cost data stored in VAMOSC systems, each program must also retain and submit to CAPE, DoD Component and Service Cost Agency O&S cost estimates developed at any time during the life cycle of a major weapon system, together with copies of reports, briefings, and other supporting documentation that were used to prepare the cost estimates. This includes documentation used to prepare cost estimates for acquisition milestones or other program reviews, as well as O&S cost estimates incorporated into Selected Acquisition Reports. 5. DCAPE PROCEDURES. The DoD Component responsible for acquisition of a system will provide the cost, programmatic, and technical information required for estimating costs and appraising programmatic risks to DCAPE. The DoD Component will also facilitate DCAPE staff visits to the program office, product centers, test centers, and system contractor(s) as DCAPE deems necessary to support development of its cost estimate or assessment. The process through which the ICE is prepared will be consistent with the policies set forth in DoD 5000.4-M (Reference (w)). The DCAPE’s current policies and procedures are as follows, but may be modified by DCAPE according to program needs: a. DCAPE representatives participate in integrated product team meetings (i.e., cost working-level integrated product teams). b. The DCAPE, DoD Components, and Program Manager: (1) Share data and use the same CARD. (2) Raise and resolve issues in a timely manner and at the lowest possible level.

DoDI 5000.02, January 7, 2015

ENCLOSURE 10 132

(3) Address differences between the ICE and the DoD Component cost estimate. c. The Program Manager will identify issues projected to be brought to the OIPT to the DCAPE in a timely manner. d. For joint programs: (1) The lead DoD Component or executive agent will prepare the DoD Component Cost Estimate. (2) All DoD Components involved must either jointly sign or individually submit a DoD Component Cost Position and Full Funding Certification Memorandum. 6. MULTI-YEAR PROCUREMENT—COST ANALYSIS REQUIREMENTS a. General. A multi-year procurement contract is a contract for the purchase of property for more than 1, but not more than 5, program years. Under 10 U.S.C. 2306b (Reference (g)), for multi-year contracts for defense acquisition programs that have specifically been authorized by law, the Secretary of Defense must certify in writing by March 1 of the year in which he or she requests legislative authority to enter into the multi-year contract that specified requirements will be met and must provide the basis for that determination to the congressional defense committees. A part of those conditions specified in section 2306b are: (1) The use of such a contract will result in substantial savings of the total anticipated costs of carrying out the program through annual contracts. (2) The minimum need for the property to be purchased is expected to remain substantially unchanged during the contemplated contract period in terms of production rate, procurement rate, and total quantities. (3) There is a reasonable expectation that throughout the contemplated contract period the head of the agency will request funding for the contract at the level required to avoid contract cancellation. (4) There is a stable design for the property to be acquired and the technical risks associated with such property are not excessive. (5) The estimates of both the cost of the contract and the anticipated cost avoidance through the use of a multi-year contract are realistic. (6) The use of such a contract will promote the national security of the United States. b. CAPE Role and Requirements. Prior to the Secretary’s determination under paragraph 6.a, DCAPE is required to complete a cost analysis and determine such analysis supports the

DoDI 5000.02, January 7, 2015

ENCLOSURE 10 133

Secretary’s findings above. In order for DCAPE to complete the cost analysis in a timely manner, the agency head must submit a list of multi-year procurement contract candidates and supporting information to DCAPE no later than October 1 of the fiscal year prior to the fiscal year in which the request for legislative authority, with accompanying certification, will be made. c. Additional Requirements. 10 U.S.C. 2306b (Reference (g)) sets forth several other requirements for multi-year contracts. Prior to requesting authority to enter into a multi-year contract, the program manager should consult with his or her agency’s counsel to confirm that the proposed multi-year contract complies with all relevant statutes and regulations.

DoDI 5000.02, January 7, 2015

ENCLOSURE 11 134

ENCLOSURE 11

REQUIREMENTS APPLICABLE TO ALL PROGRAMS CONTAINING INFORMATION TECHNOLOGY (IT)

1. PURPOSE. This enclosure identifies the additional policy and procedure that apply to all programs containing IT, including National Security Systems (NSS). 2. APPLICABILITY. This enclosure applies to: a. IT, as defined in title 40 of U.S. Code (Reference (p)), is any equipment or interconnected system or subsystem of equipment, used in the automatic acquisition, storage, analysis, evaluation, manipulation, management, movement, control, display, switching, interchange, transmission, or reception of data or information; includes computers, ancillary equipment (including imaging peripherals, input, output, and storage devices necessary for security and surveillance), peripheral equipment designed to be controlled by the central processing unit of a computer, software, firmware and similar procedures, services (including support services, and related resources). IT is equipment used by the DoD directly or is used by a contractor under a contract with the DoD that requires the use of that equipment. IT does not include any equipment acquired by a federal contractor incidental to a federal contract. b. NSS, as defined in the Federal Information Security Management Act of 2002, 44 U.S.C. 3541, et seq. (Reference (aw)), are telecommunications or information systems operated by or on behalf of the Federal Government, the function, operation, or use of which involves intelligence activities, cryptologic activities related to national security, command and control of military forces, equipment that is an integral part of a weapon or weapons system, or, is critical to the direct fulfillment of military or intelligence missions. NSS do not include systems that are used for routine administrative and business applications (including payroll, finance, and personnel management applications). c. Information systems, as defined in title 44 of U.S. Code (Reference (aw)), are a discrete set of information resources organized for the collection, processing, maintenance, use, sharing, dissemination, or disposition of information. 3. CLINGER-COHEN ACT (CCA) COMPLIANCE. Subtitle III of title 40 of U.S. Code (Reference (p)) (formerly known as Division E of CCA) (hereinafter referred to as “CCA”) applies to all IT investments, including NSS. a. For all programs that acquire IT, including NSS, at any acquisition category (ACAT) level, the Milestone Decision Authority (MDA) will not initiate a program nor an increment of a program, or approve entry into any phase of the acquisition process that requires formal acquisition milestone approval, and the DoD Component will not award a contract for the applicable acquisition phase until:

DoDI 5000.02, January 7, 2015

ENCLOSURE 11 135

(1) The sponsoring DoD Component or program manager has satisfied the applicable acquisition phase-specific requirements of the CCA as shown in Table 9 in Enclosure 1 of this instruction; and (2) The Program Manager has reported CCA compliance to the MDA and the DoD Component Chief Information Officer (CIO), or their designee. b. The Component CIO, or their designee, will record the CCA compliance in the DoD Information Technology Portfolio Repository upon program initiation and at subsequent major decision points, and in the Acquisition Information Repository, as required. c. Table 9 in Enclosure 1 of this instruction identifies the specific requirements for CCA compliance. These requirements will be satisfied to the maximum extent practicable through documentation developed under the Joint Capabilities Integration and Development System and the Defense Acquisition System. To report compliance, the Program Manager will prepare a table similar to Table 9 to indicate which documents demonstrate compliance with the CCA requirements. 4. POST IMPLEMENTATION REVIEW (PIR). The functional sponsor, in coordination with the Component CIO and Program Manager, is responsible for developing a plan and conducting a PIR for all fully deployed IT, including NSS. PIRs will report the degree to which doctrine, organization, training, materiel, leadership and education, personnel, facilities, and policy changes have achieved the established measures of effectiveness for the desired capability; evaluate systems to ensure positive return on investment and decide whether continuation, modification, or termination of the systems is necessary to meet mission requirements; and document lessons learned from the PIR. If the PIR overlaps with Follow-on Operational Test and Evaluation, the sponsor should coordinate planning of both events for efficiency. The preparation of the TEMP and the MDA’s decision to proceed with full-rate production satisfy the requirement for weapons systems. The post fielding assessment(s), the disposition assessment, and the disposition decision for an urgent need (as described in Enclosure 13), meet the requirement for a PIR. 5. DOD INFORMATION ENTERPRISE ARCHITECTURE. The DoD Information Enterprise Architecture will underpin all information architecture development to realize the Joint Information Environment. Program Managers must develop solution architectures that comply with the DoD Information Enterprise Architecture, applicable mission area and component architectures, and DoD Component architecture guidance. A program’s solution architecture should define capability and interoperability requirements, establish and enforce standards, and guide security and cybersecurity requirements. The standards used to form the Standard Viewpoints of integrated architectures will be selected from those contained in the current approved version of the DoD IT Standards Registry within the Global Information Grid Technical Guidance Federation service (Reference (br)). The IT will be tested to measures of performance derived from the solution architecture.

DoDI 5000.02, January 7, 2015

ENCLOSURE 11 136

6. CYBERSECURITY a. Cybersecurity Risk Management Framework (RMF). Cybersecurity RMF steps and activities, as described in DoD Instruction 8510.01 (Reference (bg)), should be initiated as early as possible and fully integrated into the DoD acquisition process including requirements management, systems engineering, and test and evaluation. Integration of the RMF in acquisition processes reduces required effort to achieve authorization to operate and subsequent management of security controls throughout the system life cycle. b. Cybersecurity Strategy. All acquisitions of systems containing IT, including NSS, will have a Cybersecurity Strategy. The Cybersecurity Strategy is an appendix to the Program Protection Plan (PPP) that satisfies the statutory requirement in section 811 of P.L. 106-398 (Reference (q)) for mission essential and mission critical IT systems. Beginning at Milestone A, the Program Manager will submit the Cybersecurity Strategy to the cognizant Component CIO for review and approval prior to milestone decisions or contract awards. (1) For ACAT ID, IAM, and IAC programs, the DoD CIO will review and approve the Cybersecurity Strategy prior to milestone decisions or contract awards. (2) CIOs will document the results of all reviews. (3) If contract award is authorized as part of an acquisition milestone decision, a separate review of the Cybersecurity Strategy prior to contract award is not required. (4) The approved Cybersecurity Strategy will be an appendix to the PPP. 7. TRUSTED SYSTEMS AND NETWORKS (TSN). Program managers of NSS; systems that have a high impact level for any of the three security objectives, Confidentiality, Integrity, or Availability; or other DoD information systems that the Component Acquisition Executive or Component CIO determines to be critical to the direct fulfillment of military or intelligence missions must identify and protect mission critical functions and components as required by DoD Instruction 5200.44 (Reference (aj)). TSN plans and implementation activities are documented in PPPs and relevant cybersecurity plans and documentation (see section 13 in Enclosure 3 of this instruction for additional details). Program managers will manage TSN risk by: a. Conducting a criticality analysis to identify mission critical functions and critical components and reducing the vulnerability of such functions and components through secure system design. b. Requesting threat analysis of suppliers of critical components (Supplier All Source Threat Analysis). c. Engaging the pertinent TSN focal point for guidance on managing identified risk.

DoDI 5000.02, January 7, 2015

ENCLOSURE 11 137

d. Applying TSN best practices, processes, techniques, and procurement tools prior to the acquisition of critical components or their integration into applicable systems. 8. LIMITED DEPLOYMENT FOR A MAJOR AUTOMATED INFORMATION SYSTEM (MAIS) PROGRAM. At Milestone C, the MDA for a MAIS program will approve, in coordination with the Director, Operational Test and Evaluation (DOT&E), the quantity and location of sites for a limited deployment of the system for Initial Operational Test and Evaluation. MDAs, in coordination with DOT&E, may also make this determination at Milestone B for incrementally deployed programs, consistent with the procedures in paragraph 5c(3)(d) in this instruction. 9. CLOUD COMPUTING. Cloud computing services can deliver more efficient IT than traditional acquisition approaches. Program managers will acquire DoD or non-DoD provided cloud computing services when the business case analysis determines that the approach meets affordability and security requirements. Program managers will ensure that cloud services are implemented in accordance with Defense Information Systems Agency (DISA) provided Cloud Computing Security Requirements Guidance; and will only use cloud services that have been issued both a DoD Provisional Authorization by DISA and an Authority to Operate by their Component's Authorizing Official. In addition, non-DoD cloud services used for Sensitive Data must be connected to customers through a Cloud Access Point that has been approved by the DoD CIO. Program managers report cloud service funding investments through the submission of the Office of Management of Budget (OMB) Exhibit 53 in accordance with OMB Circular A-11(Reference (c)). 10. DOD ENTERPRISE SOFTWARE INITIATIVE (ESI). When acquiring commercial IT, Program Managers must consider the DoD ESI, Federal Strategic Sourcing Initiative procurement vehicles, and Defense Component level Enterprise Software Licenses. The Defense Federal Acquisition Regulation Supplement subpart 208.74 (Reference (al)) and OMB Policy Memorandums M-03-14, M-04-08, M-04-16 and M-05-25 (References (bs) through (bv)) and the DoD ESI web site at http://www.esi.mil/ provide additional detail. 11. DOD DATA CENTER CONSOLIDATION. Any program manager who intends to obligate funds for data servers, data centers, or the information systems technology used therein, must obtain prior approval from the DoD CIO. The request must be signed by the Component CIO and include a completed request for the Authorization of Funds for Data Centers and Data Server Farms in accordance with section 2867 of P.L. 112-81 (Reference (v)). 12. IT, INCLUDING NSS, INTEROPERABILITY. To achieve the information superiority and interoperability goals of DoD Directive 5000.01 (Reference (a)), program managers will design, develop, test and evaluate systems to ensure IT interoperability requirements are achieved. At key decision points and acquisition milestones, interdependencies, dependencies, and

DoDI 5000.02, January 7, 2015

ENCLOSURE 11 138

synchronization with complementary systems must be addressed. The Program Manager will ensure that interoperability certification is achieved in accordance with DoD Instruction 8330.01 (Reference (ab)). 13. DATA PROTECTION. Program managers of DoD IT systems (including those supported through contracts with external sources) that collect, maintain, use, or disseminate data must protect against disclosure to non-approved sources while meeting the organization’s record keeping needs. a. Personally Identifiable Information (PII) must be managed in a manner that protects privacy. PII will be collected, maintained, disseminated, and used in accordance with DoD Directive 5400.11 (Reference (bw)) and DoD Regulation 5400.11-R (Reference (bx)). Privacy Impact Assessments will be managed in accordance with DoD Instruction 5400.16 (Reference (by)). b. Scientific and technical information must be managed to make scientific knowledge and technological innovations fully accessible to the research community, industry, the military operational community, and the general public within the boundaries of law, regulation, other directives, and executive requirements, in accordance with DoD Instruction 3200.12 (Reference (bz)). c. Program managers will comply with record-keeping responsibilities under the Federal Records Act for the information collected and retained in the form of electronic records (see DoD 5015.02-STD (Reference (bc)) for additional information on the DoD Records Management Program). Electronic record-keeping systems must preserve the information submitted, as required by 44 U.S.C. 3101 (Reference (aw)) and implementing regulations. Program managers will develop data archiving plans that delineate how records are collected, created, and stored within their systems. These plans must include processes for disposition of both temporary and permanent records. Program managers should work with Component records managers early and throughout the acquisition process. 14. SECTION 508 - ACCESSIBILITY OF ELECTRONIC AND INFORMATION TECHNOLOGY FOR INDIVIDUALS WITH DISABILITIES. Program managers will ensure that electronic and information technology developed, procured, maintained, and used by the DoD will allow persons with disabilities access to information comparable to that afforded persons without disabilities, in accordance with section 508 of the Rehabilitation Act (i.e., 29 U.S.C. 794d (Reference (ca))). For exceptions to section 508 compliance, refer to DoD Manual 8400.01-M (Reference (cb)).

DoDI 5000.02, January 7, 2015

ENCLOSURE 12 139

ENCLOSURE 12

DEFENSE BUSINESS SYSTEMS (DBS)

1. PURPOSE. This enclosure provides additional policy applicable to the acquisition of defense business systems that are expected to have a life-cycle cost in excess of $1 million over the current Future Years Defense Program. It is intended to be used in conjunction with the procedures in the core instruction, with statutorily specified governance, distinctive documentation as noted in Enclosure 1 of this instruction, and augmented review requirements. 2. DBS a. A DBS is an information system, other than a National Security System, operated by, for, or on behalf of the DoD, including financial systems, management information systems, financial data feeder systems, and the information technology and cybersecurity infrastructure used to support business activities, such as contracting, pay and personnel management systems, some logistics systems, financial planning and budgeting, installations management, and human resource management. The Component Chief Management Officer makes the determination that a program is a DBS. b. DBS will enter the acquisition process at the Materiel Development Decision (MDD) and follow the procedures described in paragraph 5d of this instruction. By statute, prior to approving Milestone A or initiating development of any increment of a DBS, the Milestone Decision Authority (MDA) must determine that the program will achieve Initial Operational Capability within 5 years (section 811 of P.L. 109-364 (Reference (k))). For a DBS that is a Major Automated Information System (MAIS) program, the requirements in Table 4 will apply. c. The policies in this enclosure apply to the development of all DBS. 3. DBS GOVERNANCE a. Defense Business Systems Management Committee (DBSMC) (1) The DBSMC, chaired by the Deputy Secretary of Defense, recommends policy and procedure to improve the acquisition of DBS. (2) The DBSMC is the approval authority for all statutorily required DBS certifications and will document such decisions. (3) A DBSMC certification approval is required prior to any obligation of funds for acquisition. Programs must be reviewed at least annually.

DoDI 5000.02, January 7, 2015

ENCLOSURE 12 140

(4) The MDA (when at the OSD or Military Department level) will serve as a member of the DBSMC. b. Investment Review Board (IRB) (1) The IRB will be established and chaired by the Deputy Chief Management Officer (DCMO). (2) The IRB serves as an advisory body to the chair and will assist the chair in: (a) Prioritizing DoD enterprise business system capability requirements and providing oversight of processes and procedures for business systems that support defense business operations and enable end-to-end process optimization. (b) Reviewing problem statements (approved by the IRB Chair) and investment certification requests (that are certified by the IRB Chair who recommends approval to the DBSMC). (c) Reviewing capability requirements and technical configuration changes that have the potential to impact cost and schedule for programs in development. (3) For DBS for which the MDA is at the DoD level, the IRB Chair will serve as a member of the Defense Acquisition Board. (4) The IRB Chair will ensure that the business need and recommended solution are consistent with portfolio priorities and are compliant with the Business Enterprise Architecture. (5) When an increment is fully deployed, the Program Manager will schedule a close-out review with the MDA and the IRB to determine whether the investment has achieved the outcomes defined in the Problem Statement. c. Functional Sponsors (1) Functional sponsors are the OSD or DoD Component executives responsible for: (a) Representing user community interests. (b) Ensuring DBS investments are funded. (c) Defining management capability. (d) Verifying that capability requirements are met prior to the Full Deployment Decision.

DoDI 5000.02, January 7, 2015

ENCLOSURE 12 141

(e) Developing the Problem Statement and the non-materiel portions of the Doctrine, Organization, Training, Materiel, Leadership and Education, Personnel, Facilities, and Policy (DOTMLPF-P) solution. (f) Supporting the Program Manager to develop the program acquisition strategy, accomplish effective business process re-engineering, and implement the DOTMLPF-P solution. (2) The Functional Sponsor will review the threshold capability requirements and, if refinement is required, propose changes to the IRB chair for approval prior to the Milestone or Decision Point. (3) Prior to the Development Request for Proposal (RFP) Release Decision Point, the Functional Sponsor will: (a) Define Full Deployment for the increment. (b) Ensure business process re-engineering is successfully completed. d. DoD Component Pre-Certification Authority (1) The DoD Component Pre-Certification Authority is the military Department Chief Management Officer, the Defense Agency Director, or a designee approved by the DoD DCMO. Prior to the MDD or any subsequent milestone decision, the DoD Component Pre-Certification Authority must determine that: (a) The DBS is in compliance with the enterprise architecture. (b) The business process supported by the DBS is or will be as streamlined and efficient as practicable. (c) The need to tailor commercial-off-the-shelf systems to meet or incorporate unique requirements or unique interfaces has been eliminated or reduced to the extent practical. (d) The DBS is necessary to: 1. Achieve a critical national security capability, or address a critical requirement in an area such as safety or security; or 2. Prevent a significant adverse effect on a project that is needed to achieve an essential capability, taking into consideration the alternative solutions for preventing such adverse effect. (2) The Pre-Certification authority’s determination will be documented in a memorandum and provided to the IRB as part of the certification review. The DBSMC must approve the IRB Certification prior to any action that would result in the obligation of funds.

DoDI 5000.02, January 7, 2015

ENCLOSURE 12 142

e. DoD Component Head and Acquisition Executive. The DoD Component head and the Component Acquisition Executive will provide oversight of a DBS program that does not meet the MAIS thresholds in Table 1, is not expected to exceed those thresholds, and has not been designated as special interest or Pre-MAIS. The requirements and acquisition processes and procedures for such programs will be consistent with applicable statute, regulation, and this instruction. 4. DBS PROBLEM STATEMENT. DBS generally do not employ Joint Capabilities Integration and Development System procedures for the development and validation of capability requirements documents. Instead functional sponsors will analyze a perceived business problem, capability gap, or opportunity and document the results in a Problem Statement. The Problem statement will include measurable business outcomes, a rough order of magnitude cost estimate and projected/anticipated financial return measures such as net present value, payback or return on investment. a. The DBS Problem Statement must be reviewed by the IRB and approved by the IRB chair. Analysis supporting the Problem Statement will be forwarded to the IRB and the Joint Staff for review. b. The Problem Statement will be refined over time to inform post-MDD decision making. The final Problem Statement will be reviewed by the IRB and approved by the IRB chair prior to the Development RFP Release Decision Point. c. Approved Problem Statements will be submitted to the MDA 30 days prior to the MDD and any subsequent decision point where they are required. d. The Joint Requirements Oversight Council (JROC), on advice of the J-8 and the Functional Capabilities Board, will have authority to review Problem Statements to determine if JROC interest exists.

DoDI 5000.02, January 7, 2015

ENCLOSURE 13 143

ENCLOSURE 13

RAPID FIELDING OF CAPABILITIES 1. PURPOSE. This enclosure provides policy and procedure for acquisition programs that provide capabilities to fulfill urgent operational needs and other quick reaction capabilities that can be fielded in less than 2 years and are below the cost thresholds of Acquisition Category (ACAT) I and IA programs. 2. URGENT OPERATIONAL NEEDS AND OTHER QUICK REACTION CAPABILITIES a. DoD’s highest priority is to provide warfighters involved in conflict or preparing for imminent contingency operations with the capabilities urgently needed to overcome unforeseen threats, achieve mission success, and reduce risk of casualties, as described in DoD Directive 5000.71 (Reference (cc)). The objective is to deliver capability quickly, within days or months. DoD Components will use all available authorities to expeditiously fund, develop, assess, produce, deploy, and sustain these capabilities for the duration of the urgent need, as determined by the requesting DoD Component. Approval authorities for each acquisition program covered by this enclosure will be delegated to a level that promotes rapid action. b. This enclosure applies to acquisition programs for the following types of quick reaction capabilities: (1) A validated Urgent Operational Need (UON). UONs include: (a) Joint Urgent Operational Needs (JUONs) and Joint Emergent Operational Needs (JEONs). These are either an urgent need identified by a Combatant Commander, the Chairman of the Joint Chiefs of Staff (CJCS), or the Vice Chairman of the Joint Chiefs of Staff (VCJCS) involved in an ongoing contingency operation (i.e. a JUON) or an emergent need identified by a Combatant Commander, CJCS, or VCJCS for an anticipated or pending contingency operation (i.e. a JEON). For JUONs and JEONs, the validation approval will be by the Joint Staff in accordance with the Joint Capability Integration Development System (JCIDS) detailed in the Chairman of the Joint Chiefs of Staff Instruction (CJCSI) 3170.01H (Reference (d)). Program execution for JUONs and JEONs will be assigned in accordance with DoD Directive 5000.71. The Milestone Decision Authority (MDA) for JUONs and JEONs will be determined at the DoD Component level except in very rare cases when the MDA will be designated in an Acquisition Decision Memorandum (ADM) by the Defense Acquisition Executive (DAE). (b) DoD Component-specific UON. These are defined in CJCSI 3170.01H and further discussed in DoD Directive 5000.71. Approval authorities for DoD Component UONs, including their validation, program execution, and the designation of the MDA, will be at the DoD Component level.

DoDI 5000.02, January 7, 2015

ENCLOSURE 13 144

(2) A Warfighter Senior Integration Group (SIG)-Identified Urgent Issue. This is a critical warfighter issue, e.g. materiel support to a coalition partner, identified by the Co-Chairs of the Warfighter SIG in accordance with DoD Directive 5000.71. The Co-Chairs of the Warfighter SIG will approve a critical warfighter issue statement and provide instructions to DoD Component(s) on program execution and management. (3) A Secretary of Defense Rapid Acquisition Authority (RAA) Determination. This is a Secretary of Defense signed determination that is made in response to a documented deficiency following consultation with the Joint Staff. RAA should be considered when, within certain limitations, a waiver of a law, policy, directive, or regulation will greatly accelerate the delivery of effective capability to the warfighter in accordance with section 806(c) of P.L. 107-314 (Reference (i)). 3. PROCEDURES a. MDAs and program managers will tailor and streamline program strategies and oversight. This includes program information, acquisition activity, and the timing and scope of decision reviews and decision levels. Tailoring and streamlining should be based on program complexity and the required timelines to meet urgent need capability requirements consistent with applicable laws and regulations. b. DoD Components will employ, to the extent possible, parallel rather than sequential processes to identify and refine capability requirements, identify resources, and execute acquisitions to expedite delivery of solutions. Formal milestone events may not be required. Acquisition decision making and associated activity will be tailored to expedite acquisition of the capability. Development will generally be limited, and the MDA can authorize production at the same time development is approved. c. DoD Components will ensure that financial, contracting, and other support organizations (e.g., Defense Contract Audit Agency, Defense Contract Management Agency, General Counsel) and prime and subcontractors involved with aspects of the acquisition program are fully aware of the urgency of the need and will ensure expedited action. d. Generally, funds will have to be reprioritized and/or reprogrammed to expedite the acquisition process. If a capability can be fielded within an acceptable timeline through the normal Planning, Programming, Budgeting, and Execution System, it would not be considered appropriate for rapid acquisition. e. Consistent with the emphasis on urgency, if the desired capability cannot be delivered within 2 years, the MDA will assess the suitability of partial or interim capabilities that can be fielded more rapidly. In those cases, the actions necessary to develop the desired solution may be initiated concurrent with the fielding of the interim solution. Critical warfighter issues identified by the Warfighter SIG, per DoD Directive 5000.71 (Reference (cc)), will be addressed as determined by the Co-Chairs of the Warfighter SIG.

DoDI 5000.02, January 7, 2015

ENCLOSURE 13 145

4. RAPID ACQUISITION ACTIVITIES. The following paragraphs describe the main activities associated with the Rapid Fielding of Capabilities: Pre-Development, Development, Production and Deployment (P&D), and Operations and Support (O&S). The activities detailed in this enclosure are not separate from or in addition to activities performed as part of the acquisition system but are a highly tailored version of those activities and are intended to expedite the fielding of capability by tailoring the documentation and reviews normally required as part of the deliberate acquisition process. Figure 10 depicts a representative acquisition.

Figure 10. Rapid Fielding of Capabilities a. Pre-Development (1) Purpose. The purpose of Pre-Development is to assess and select a course or courses of action to field a quick reaction capability and to develop an acquisition approach. (2) Initiation. Pre-Development begins upon receipt of either a validated UON, approval of a critical warfighter issue statement by the co-chairs of the Warfighter SIG per DoD Directive 5000.71, or a Secretary of Defense RAA determination document, where the associated

Development Milestone

Urgent Need Generation

Pre-Development (Days)

Development (Months)

Operations and Support (Months – Years)

Production and Deployment (Months)

(Disposition)

Production and Deployment Milestone

= Milestone

= ActivitiesLegend:

= Validation / Recommendation

= Parallel / Concurrent Processes

= Decision Point

Course of Action Decision Point

DoDI 5000.02, January 7, 2015

ENCLOSURE 13 146

documentation serves as the justification to continue the action until such time as the disposition action discussed in paragraph 4e(5) of this enclosure. (3) Pre-Development Activities (a) Upon Pre-Development initiation, the designated Component Acquisition Executive (CAE) will immediately appoint a Program Manager and an MDA. If the DAE has retained MDA authority, he or she will either appoint a Program Manager or task a CAE to do so. (b) The Program Manager in collaboration with the intended user and the requirements validation authority: 1. Assesses the required capability and any recommended non-materiel options and, if not adequately stated, determines the performance thresholds for the minimal set of performance parameters required to mitigate the capability gap. 2. Performs an analysis of potential courses of action, if not already performed, that considers: a. The range of feasible capabilities, near, mid, and/or long term, to include consideration of an existing domestic or foreign-made system. b. The acquisition risk (cost, schedule, and performance) and the operational risk of each solution. c. The operational risk to the requesting Commander if an effective solution is not deployed in the time specified by the Commander. 3. Presents a recommended course of action for review and approval by the MDA. 4. If the Program Manager is unable to identify an effective solution, the Program Manager will notify the MDA. The MDA will in turn notify the DoD Component validation authority. If it is a JUON or JEON, a critical warfighter issue identified by the Warfighter SIG, or a Secretary of Defense RAA Determination, the MDA will notify the DAE and the requirements validation authority through the Director, Joint Rapid Acquisition Cell (JRAC), and the Deputy Director of Requirements, Joint Staff. (c) The Program Manager will present the recommended course(s) of action to the MDA and the requirements validation authority. The selected course of action will be documented in an ADM. More than one course of action may be selected to provide the phased or incremental fielding of capabilities. (d) For each approved course of action, the Program Manager will develop a draft Acquisition Strategy and an abbreviated program baseline based on readily available

DoDI 5000.02, January 7, 2015

ENCLOSURE 13 147

information. In the context of this enclosure, the documentation requirement is for the minimal amount necessary to define and execute the program and obtain MDA approval. This documentation may take any appropriate, written form; will typically be coordinated only with directly affected stakeholders; and will evolve in parallel with rapid acquisition activities as additional information becomes available as a result of those activities. (e) The Acquisition Strategy will comply with the requirements in Table 10 of this enclosure and the items in Table 2 of Enclosure 1 that are required for ACAT II and III programs (unless modified by Table 10); however, a streamlined, highly tailored strategy consistent with the urgency of the need will be employed. Regulatory requirements will be tailored or waived. The tailored Acquisition Strategy should be relatively brief and contain only essential information, such as resourcing needs and sources, key deliverables, performance parameters, key risks and mitigation approaches, a production schedule, a contracting methodology and key terms, preliminary plans for assessment (which may or may not include test and evaluation (T&E)), deployment, training, and sustainment. Information technology (IT), including National Security Systems (NSS), provided in response to an urgent need require an Authority to Operate in accordance with DoD Instruction 8510.01 (Reference (bg)). A disposition decision should be made as early as feasible and decided upon at appropriate milestones or other decision points. (f) Funding for the acquisition program may be in increments over the program’s life cycle. The program life cycle begins upon Pre-Development initiation and ends upon completing the final disposition of the capability as described in the O&S portion of this enclosure. (g) When designing the Acquisition Strategy, the Program Manager, in collaboration with the requesting operational commander or sponsoring user representative will determine whether an operational prototype is necessary and include this determination in the Acquisition Strategy. (h) If the program has been placed on Director, Operational Test and Evaluation, (DOT&E) oversight, a plan for operational testing must be approved by the DOT&E. DOT&E will report the results of required testing to the Secretary of Defense and provide copies to Congress and the MDA. b. Development Milestone. Entry into Development is approved by the MDA. (1) The Program Manager will provide the Acquisition Strategy and Program Baseline to include the program requirements, schedule, activities, program funding, and the assessment approach and intermediate decision points and criteria as the basis for this decision. (2) The MDA will: (a) Determine the feasibility of fielding the capability within the required timelines to include consideration of the technical maturity of the preferred solution(s).

DoDI 5000.02, January 7, 2015

ENCLOSURE 13 148

(b) Review the Acquisition Strategy and Program Baseline and determine whether the preferred solution(s): 1. Can be fielded within 2 years. 2. Does not require substantial development effort. 3. Is based on technologies that are proven and available. 4. Can be acquired under a fixed price contract. (c) Provide any exceptions necessary pursuant to section 804 (b)(3) of P.L. 111-383 (Reference (m)), including exceptions to the requirements of paragraphs 4b(2)(b)1 through 4b(2)(b)4. (d) Approve initial quantities to be produced and assessed (to include required assessment and training articles). (e) Approve the tailored Acquisition Strategy and Acquisition Program Baseline. These documents will be based on available information to be updated over time as directed by the MDA. (f) Decide if RAA, in accordance with section 806(c) of P.L. 107-314 (Reference (i)), should be requested from the Secretary of Defense to expedite the fielding of the capability. (g) Approve the planned testing approach. A normal Test and Evaluation Master Plan (TEMP) is generally not necessary. TEMPs are usually not appropriate for rapid acquisitions when there is minimal development work and minimal T&E to execute. Some test planning is usually required, however. In collaborate with the supporting operational test organization, a highly tailored and abbreviated test plan may be required by the MDA. The abbreviated test plan will describe a performance assessment approach that will include schedule, test types and environment, and assets required. An Operational Test Plan for the required pre-deployment performance assessment is generally adequate. If the defense rapid acquisition program is on DOT&E oversight, a TEMP is also not normally required; however, the Program Manager should prepare a combined operational and live fire test plan for DOT&E approval. (h) Approve any appropriate waivers to statute or regulation. Specify any additional authority the Program Manager may use to modify the acquisition approach without the specific approval of the MDA. (i) Authorize release of the request for proposals and related documents for development and any other MDA approved actions. (j) Document these decisions in an ADM.

DoDI 5000.02, January 7, 2015

ENCLOSURE 13 149

c. Development Activities (1) Development includes an assessment of the performance, safety, suitability, and survivability of the capability, but does not require that all identified deficiencies including those related to safety be resolved prior to production or deployment. The MDA will, in consultation with the user and the requirements validation authority, determine which deficiencies must be resolved and what risks can be accepted. (2) IT, including NSS, fielded under this enclosure require an Authority to Operate in accordance with DoD Instruction 8510.01 (Reference (bg)). DoD Component Chief Information Officers will establish processes consistent with DoD Instruction 8510.01 for designated approval authorities to expeditiously make the certification determinations and to issue Interim Authorization to Test or Authority to Operate. d. P&D Milestone (1) Entry into P&D is approved by the MDA. (2) At the P&D Milestone review: (a) The Program Manager will summarize the results of Development activity and the program assessment to date. The Program Manager will present plans to transport, deploy, and sustain the capability; to conduct Post-Deployment Assessments; and to train maintenance and operating personnel. This information will be provided to the MDA for approval. (b) The MDA, in consultation with the supporting operational test organization, and with the concurrence of DOT&E for programs on DOT&E oversight, will determine: 1. Whether the capability has been adequately reviewed, performs satisfactorily, is supportable, and is ready for production and deployment. 2. When assessments of fielded capabilities are required. (c) The MDA decides whether to produce and, in coordination with the requester/user, deploy (field) the system, approves the updated Acquisition Strategy (which will include the sustainment plan) and Program Baseline, and documents the Production Decision in an ADM. (3) P&D Activities (a) During P&D the acquiring organization provides the warfighter with the needed capability, to include any required training, spares, technical data, computer software, support equipment, maintenance, or other logistics support necessary for operation.

DoDI 5000.02, January 7, 2015

ENCLOSURE 13 150

1. DoD Components will ensure that the capability and required support (e.g., field service representatives, training) are deployed by the most expeditious means possible and tracked through to their actual delivery to the user. 2. The DoD Components will coordinate with each other and the requiring activity to verify the total number of items required, considering necessary support and spares and training assets for deployed and/or pre-deployment training. (b) Upon deployment, the capability will enter O&S. e. O&S (1) The Program Manager will execute a support program that meets materiel readiness and operational support performance requirements, and sustains the capability in the most cost-effective manner over its anticipated total life cycle. Planning for O&S will begin during Pre-Development and will be documented in the Acquisition Strategy. (2) The capability is operated and supported consistent with the sustainment plan approved by the MDA at the Production Milestone. (3) The Program Manager or the user may propose urgently needed improvements to the capability. If within the scope of the initial requirements document, procedures in this enclosure may be used to acquire the improvements. If improvements are outside the scope of the validated or approved requirements document, a new or amended requirements document may be required. (4) In collaboration with the original requesting DoD Component, a post-deployment assessment will be conducted after deployment. If practical, this assessment will be conducted in the field by the supporting operational test organization. If not practical, the Program Manager may use alternate means for this assessment to include Program Manager or operational test agency assessment of user feedback or other DoD Component feedback. Post-deployment assessment approaches for all programs under DOT&E Oversight will be independently reviewed and approved by DOT&E. (5) Disposition Analysis. No later than 1 year after the program enters O&S (or earlier if directed by the DoD Component), the DoD Component will appoint an official to conduct a Disposition Analysis. Based on the analysis, the DoD Component head and the CAE will prepare a determination document for disposition of the system. The disposition analysis will consider the performance of the fielded system, long term operational needs, and the relationship of the capability to the Component’s current and planned inventory of equipment. The analysis will also consider the continuation of non-materiel initiatives, the extension of science and technology developments related to the fielded capability, and the completion of MDA-approved and funded materiel improvements. The disposition official will recommend one of the following options:

DoDI 5000.02, January 7, 2015

ENCLOSURE 13 151

(a) Termination: Demilitarization or Disposal. The system will be demilitarized and disposed of in accordance with all legal and regulatory requirements and policy related to safety (including explosive safety) and the environment. The recommendation will be coordinated with the DoD Component or, for JUONs and JEONs, the Combatant Commands. (b) Sustainment for Current Contingency. Operation and sustainment of the system will continue for the current contingency. Multiple sustainment decisions may be made should the system require operations and support longer than 2 years; however, such sustainment decisions will be made and re-documented at least every 2 years. The sustained system will continue to receive the same priority of action as the original acquisition program. This recommendation will be coordinated with the DoD Component validation authority. (c) Transition to Program of Record. If the system provides a needed, enduring capability, it may be transitioned to a program of record. The disposition official will recommend to the CAE the acquisition point of entry into the defense acquisition system, and whether the MDA should retain program authority or whether it should transition elsewhere. The requirements validation authority will specify the capability requirements documents required to support transition to a new or existing program of record. The disposition recommendation will be made to the DoD Component head for UONs, critical warfighter issues identified by the Warfighter SIG, or Secretary of Defense RAA determinations. (6) The DoD Component head and the CAE will review the disposition official’s recommendation and record the Component head’s transition decision in a Disposition Determination. The Determination will specify the requirements documents required by the validation authority to support the transition. Programs of record will follow the procedures for such programs described in this instruction. 5. ADDITIONAL INFORMATION REQUIREMENTS. Table 10 provides the Information Requirements that replace or are in addition to the statutory or regulatory requirements in Tables 2 and 6 in Enclosure 1 that are applicable to ACAT II and ACAT III programs. For rapid acquisition, the documentation procedures described in paragraph 4a(3)(d) will be applied to all information requirements unless otherwise prescribed in statute.

DoDI 5000.02, January 7, 2015

ENCLOSURE 13 152

Table 10. Information Requirements Unique to the Urgent Needs Rapid Acquisition Process

INFORMATION REQUIREMENT RAPID ACQUISITION DECISION EVENTS SOURCE

Development Production

STATUTORY REQUIREMENTS

ASSESSMENT APPROACH ● ● 10 U.S.C. 2366 (Ref. (g)) 10 U.S.C. 2399 (Ref. (g))

STATUTORY; only required for programs responding to urgent needs. - For programs on Director, Operational Test and Evaluation (DOT&E) oversight, combined operational and live fire test plans will be submitted to DOT&E at the Development Milestone, and post-deployment assessment plans at the Production and Deployment Milestone. DOT&E will ensure that testing is tailored to rapidly evaluate critical operational issues. - Programs not on DOT&E oversight are approved at the Service level; the program may require a rapid and focused operational assessment and live fire testing (if applicable) prior to deploying an urgent need solution. The Acquisition Approach will identify any requirements to evaluate health, safety, or operational effectiveness, suitability, and survivability.

COURSE OF ACTION ANALYSIS ● Meets the assessment requirements of Subtitle III, Title 40, United States Code (Reference (p)) (see Table 9 in Enclosure 1). (Ref. (p))

STATUTORY, replaces and serves as the AoA. Approved by the MDA. For JUONs, JEONs, critical warfighter issues identified by the Warfighter SIG, and Secretary of Defense RAA determinations, a copy is due to the Director, JRAC, within 3 business days of MDA approval.

RAPID ACQUISITION AUTHORITY (RAA) RECOMMENDATION ● SEC. 806, P.L. 107-314 (Ref. (i))

STATUTORY. Optional request to the Secretary of Defense for RAA. Considered as part of the development of the Acquisition Strategy. MDA approves the decision to request RAA at the Development Milestone.

REGULATORY REQUIREMENT

Disposition Authority’s Report to the DoD Component Head Para. 4e(5) of this enclosure

Regulatory. Based on the disposition official’s recommendation in the Disposition Analysis, the Component Head will determine and document the disposition of the initiative and process it in accordance with applicable Component and requirements authority procedures. Due within 1 year of entering the Operations and Support Phase (or earlier, if directed).

Table Notes: 1. A dot (●) in a cell indicates the specific applicability of the requirement to the life-cycle event 2. Documentation required for the identified events will be submitted no later than 45 calendar days before the planned review. 3. While these requirements are specific to programs responding to urgent needs, they are additive to the requirements identified in Tables 2 and 6 in Enclosure 1.

DoDI 5000.02, January 7, 2015

GLOSSARY 153

GLOSSARY A complete Glossary of acquisition terms and common acquisition acronyms is maintained on the Defense Acquisition University website (Reference (cd)). The DAU Glossary (Reference (ce)) may be found at https://dap.dau.mil/glossary/Pages/Default.aspx.

DoDI 5000.02, January 7, 2015

GLOSSARY 154

THIS PAGE INTENTIONALLY LEFT BLANK