LOG 103 Curriculum Review 07 Jan 2011 LOG 103 Reliability, Availability & Maintainability (RAM) Presented to the Life Cycle Logistics (LCL) Functional

LOG 103 Curriculum Review 07 Jan 2011

LOG 103 Reliability, Availability & Maintainability (RAM)

Presented to the

Life Cycle Logistics (LCL) Functional Integrated Product Team (FIPT)

Presented by

Patrick M. Dallosta, CPLPerformance Learning DirectorDefense Acquisition University

Curriculum Review

1


Agenda

• Key Personnel

• FY 13 LCL Certification Curriculum “Path Ahead”

• LCL Competency – DAU Curriculum Crosswalk

• Background

• Current Status

• Course Description

• Course Content / TLOs & ELOs / Course Outline

• MTM / Projected Throughput

• PLD Assessment / Impact on Training

• Questions & Answers2


LOG 103 Key Personnel

Course Manager (CM) Dr. Andre Murphy

Course Manager Regional Representatives (CMRR)

Capital and Northeast: John Sullivan

West: Andre Murphy

Midwest: Steve Putman

South: Bryan Hammond

Mid-Atlantic: Phil Littrell

GLTC Instructional Systems Specialist (ISS) Debra Moore

LCIC Performance Learning Director (PLD) Patrick Dallosta

LCIC Director for Logistics and Sustainment Bill Kobren

3


• Application/case based

• GS 9-12 & E7-O4

Level II Certification

LOG 201Intermediate Acquisition Logistics


35 hours, online



LOG 235Performance Based Life

Cycle Product Support

LOG 235Performance Based Life

Cycle Product Support

35 hours on-line

4.5 days classroom

P

LOG 211Supportability

Analysis

LOG 211Supportability

Analysis

4.5 days classroom

ACQ 202Intermediate

SystemsAcquisition

ACQ 202Intermediate

SystemsAcquisition

PACQ 203Intermediate

SystemsAcquisition

ACQ 203Intermediate

SystemsAcquisition

4.5 days classroom

LOG 206Intermediate

Systems Sustainment

LOG 206Intermediate

Systems Sustainment

40 hours, online

NOTE: There would still be NO

prerequisites for LOG235

xx hours on-line

P

• Case/scenario based

• GS 13-14 & E7-O5

Level IIICertification

P

PLOG 350

Enterprise Life Cycle Logistics Management

LOG 350Enterprise Life Cycle Logistics Management

LOG 340Performance Based

Life Cycle Sustainment

LOG 340Performance Based

Life Cycle Sustainment

8.5 days classroom

8.5 days classroom

Level II “Core Plus”Courses & CL Modules

(Includes LOG 204 CM Course& new LOG 2xx Tech Data Mgt Course)

Level II “Core Plus”Courses & CL Modules

(Includes LOG 204 CM Course& new LOG 2xx Tech Data Mgt Course)

P

25 hrs, on-line

Level I Certification

ACQ 101Fundamentals of Systems Acquisition

Management

ACQ 101Fundamentals of Systems Acquisition

Management

• Knowledge based

• GS 5-9 & E7-O3

26 hrs, on-line

30 hrs, on-line

P

2 Continuous Learning Modules:

PBL & Designing for Supportability

2 Continuous Learning Modules:

PBL & Designing for Supportability

LOG 103Reliability,

Availability & Maintainability

LOG 103Reliability,

Availability & Maintainability

LOG 102Systems

SustainmentManagement

LOG 102Systems

SustainmentManagement

1-3 hrs ea, on-line

LOG 101Acquisition Logistics

Fundamentals

LOG 101Acquisition Logistics

Fundamentals

28 hrs, on-line

P = Prerequisite

Level I “Core Plus”Courses & CL Modules

(See DAU catalog for details)

Level I “Core Plus”Courses & CL Modules


Level III “Core Plus”Courses & CL Modules


Level III “Core Plus”Courses & CL Modules


FY13 LCL Certification Curriculum

P

New Cert Courses

4


LCL Competency – DAU Curriculum Crosswalk

Competency/Course

LOG 101

LOG 102

LOG103

LOG200

LOG201

LOG 204

LOG 206

LOG 211

LOG 215

LOG235

LOG236

LOG340

LOG350

Logistics Design Influence

Integrated Logistics Support (ILS) Planning

Product Support and Sustainment

Configuration Management

Reliability & Maintainability Analysis

Technical/Product Data Management

Supportability Analysis

Principal course that addresses the competency Deployed course/significant upgrade in progress Courses where the competency is a major learning point New course in development/planning

Legend:

5

LOG 103 Curriculum Review 07 Jan 2011 6

LOG 103 COMPETENCY/PROFICIENCY

1. Historic Roots

2. Acquisition Reform

3 .KPP/KSA

4. Legislation/Policy

5. Life Cycle Product Spt

6. Warfighter Capability

7. Op/Contract Rqmts

8. System Design Model

9. Design for Reliability,

10. Test & Evaluation

11. Manufacturing/

LOGISTICS DESIGN INFLUENCE (Note 1)

Use analysis tools and techniques to influence logistics design. * * * * * * * *Apply Logistics Design Influences to include RAM, CBM/RCM, Supportability. * * * * * *Apply and relate diagnostics/prognostics and CBM to Design Influence. * * * * *Evaluate impacts on supportability based on changes in policy, procedures and tools. * * * * * *Evaluate Performance Metrics and relate them to Design Influence. * * * * *Incorporate Reliability Centered Maintenance (RCM) into systems Design * * * *Recognize shortfalls in program information and data * * * * * * * * * * *Perform data collection/analysis of failure data and supply rates * * * * * * *Recommend design changes to optimize sustainability/min Life cycle Cost/Footprint * * * *Ensure design incorporates sustainment-related design criteria * * * *Integrate supportability requirements into the systems engineering process * * * *Develop and implement product support strategies * * * * *Assess the impact of design changes on supportability * * * * * *Perform Maintenance Task Analysis, Level of Repair Analysis, Core Workload Assessment, Depot Source of Repair * * * * * *

LOG 103 Competency Analysis


LOG 103 Background

• Recent Legislation/updated DoD Policy has significantly strengthened DOD Reliability, Availability and Maintainability (RAM) Policy, Systems Engineering/Reliability/Test & Evaluation processes and organizations.

• Life Cycle Logistics DAWIA certification path reflects new course requirements in the area of RAM and Supportability– LOG 103, “Reliability, Availability and Maintainability”

• Upgrading of existing LOG 203– LOG 211, “Supportability Analysis”

• New curriculum development

• Expect great cross-functional interest as RAM / Supportability is reconstituted in program offices – a “pendulum swing” back to government resulting from the aftermath of Acquisition Reform

7


LOG 103 Current Status

• LOG Certification Course as of 1 October 2010 (FY 11)

• Prerequisite – ACQ 101 Fundamentals of Sys Acq Mgt

• Related Learning Assets: – CLL 008 – Designing for Supportability in DoD Weapon Systems

– CLL 012 – Supportability Analysis

– DAG Chapter 4, Systems Engineering / Chapter 5, Life Cycle Logistics

• DL / 5 Sections / 300 students / 135 avg. /No Wait Listing

• 15% failure rate / GREEN MTMs

• Instructor/Student Pilot 7-11 Mar 2011

• Delivery/Migration to DAU ATLAS 24 Mar 2011

8


LOG 103 Course Description

“Professionals who take this course will be able to understand the relationship between reliability, availability and maintainability (RAM) as a critical factor in design, performance, cost, and sustainment.

The course addresses the cross-disciplinary actions of Program Management, Systems Engineering, Test & Evaluation and both Acquisition and Sustainment Logistics to evaluate the impact of reliability and maintainability decisions.

Stressing a conceptual approach, the course presents basic reliability, availability and maintainability terminology and engineering practices.

It discusses current legislative and DoD policy that have invigorated systems engineering and logistics engineering processes to improve the requirements process, minimize risk through reliability growth programs and ensure effectiveness and suitability through developmental and operational test and evaluation.”

9


LOG 103 Course “Take-Aways”

• Relationship between Logistics and RAM• Impact of RAM on system design and product support• RAM activities within JCIDS / Systems Engineering / Test &

Evaluation and Sustainment processes• RAM concepts, terminology, engineering practices and

mathematical calculations• Legislation/OSD policy/Sustainment governance• Historical roots of RAM• Apply DAU Learning Assets to establish a collaborative

environment and facilitate insight into current events.

10


1. Historical Roots of Reliability, Availability & Maintainability

2. Impact of Acquisition Reform on Reliability, Availability & Maintainability

3. Origins of the Mandatory Sustainment Metrics KPP/KSAs

4. Impact of Legislation/ DoD Policy on RAM Initiatives

5. RAM as a Key Element of Life-Cycle Performance-Based Product Support

6. Impacts of RAM on Warfighter Capability

7. Operational and Contractual RAM Requirements

8. The Affordable Systems Operational Effectiveness Model (ASOE)

9. Providing Insight Into Designing for RAM

10. Risk Reduction Through Test and Evaluation

11. Impacts of RAM on Manufacturing

LOG 103 Lessons New LessonCurrent Lesson

11


Lesson 1: Historical Roots of Reliability, Availability, and Maintainability (RAM) TLO: Recognize historical roots of reliability, availability, and maintainability

(RAM)ELOs: • Identify significant events that transformed and improved reliability.• Indicate documentation used to write current RAM policy.• Identify how RAM impacts sustainment and cost.• Identify how developmental test and evaluation aids RAM achievement.• Indicate the role of RAM in the systems engineering process.• Identify how RAM aids supportability and impacts logistics.• Recognize how operational test and evaluation aids weapon system effectiveness

and suitability.

LOG 103 TLO/ELO - 1


Lesson 2: The Impact of Acquisition Reform on Reliability, Availability, and Maintainability (RAM) TLO: Recognize the impact of acquisition reform on Reliability, Availability, and Maintainability (RAM). ELOs: • Recall the scope and impact of the “Perry Memorandum”.• Indicate how the discontinuance of military standards and specifications impacted

RAM.• Identify how the loss of workforce and skilled personnel impacted RAM.• Recognize how the use of commercial-off-the-shelf items impacted RAM.• Indicate how poor RAM design and performance decreased effectiveness and

suitability, as identified during OT&E.• Identify how RAM and supportability affect early systems engineering activities and

sustainment planning.

LOG 103 TLO/ELO - 2


Lesson 3: Mandatory Sustainment Availability Key Performance Parameter (KPP) and Supporting Key System Attributes (KSA) of Materiel Reliability and Ownership Costs

TLO: Recognize how the availability KPP and the material reliability and

ownership costs KSAs strengthen Reliability, Availability, and Maintainability (RAM). ELOs:• Identify the origin of the availability KPP, the material reliability KSA, and the

ownership cost KSA.• Identify the impact of the availability KPP/KSA on the Joint Capabilities Integration

and Development System (JCIDS) process.• Indicate the role of the combat developer in the refinement of the KPP/KSAs within

the JCIDS process.• Recall how the Reliability, Availability, Maintainability – Cost Rationale Report

Handbook is used to calculate the availability KPP and its KSAs.• Recognize the use of enabling technologies in meeting availability KPP/KSA

requirements.

LOG 103 TLO/ELO - 3


Lesson 4: The impact of legislation and DoD policy on RAM.

TLO: Recognize the impact of legislation and DoD policy on RAM. ELOs: • Identify the impacts of defense policy on RAM, per the GAO report.• Identify the impact of the DOT&E 2007 Report on RAM.• Identify the impact of the Defense Science Board Task Force on DOT&E on RAM.• Identify the impact of the Reliability Improvement Working Group (RIWG) on RAM.• Indicate the impact of the 2008 AT&L Memorandum on RAM.• Indicate the impact of DoDI 5000.02 on RAM.• Indicate the impact of the Weapons System Acquisition Reform Act on RAM.• Indicate the impact of the Weapon System Acquisition Reform Product Support

Assessment Report of November 2009 on RAM.• Recognize the changes to the Defense Acquisition Guidebook (DAG) as a result of

legislation and acquisition policy changes.• Recall how changes in the JCIDS process improved RAM requirements.• Identify how reliability growth programs have been implemented.• Recall how integrating Developmental and Operational Testing strengthen RAM.

LOG 103 TLO/ELO - 4


Lesson 5: RAM as a Key Element of Life Cycle Performance-Based Product Support TLO: Recognize how RAM is a key element of Life Cycle Performance-Based

Product Support. ELOs:• Identify the key elements of availability.• Identify the four key elements in the definition of reliability.• Indicate two key MTBxs that are logistics reliability parameters.• Identify the key elements of maintainability.• Recognize how RAM affects support costs.• Recognize how Availability KPP/KSA trade spaces are balanced.• Recall how RAM is a key driver in the development of a Performance-Based

Product Support Strategy.• Recall how RAM is a key driver in demand forecasting, spares planning,

provisioning, and supply support.• Recall how RAM is a key driver of Total Ownership Costs.• Recall how RAM is a key driver of Sustainment Maturity Levels.

LOG 103 TLO/ELO - 5


Lesson 6: Impacts of RAM on Warfighter Capability

TLO: Given a scenario, recognize how RAM impacts Warfighter Capability ELOs:• Identify User RAM requirements• Recall how the Joint Capabilities Integration and Development System (JCIDS)

Process works• List the measures of combat capability that are enhanced by RAM• Note changes

LOG 103 TLO/ELO - 6


Lesson 7: Operational and Contractual RAM Requirements

TLO: Describe how contractual requirements are developed from Operational Requirements for a new development systems and one using COTS/NDI items.

ELOs: • State the methods for converting operational RAM requirements into contractual

RAM requirements.• List the differences between field reliability data and contractual reliability data.• Distinguish between Mean Time Between Failure (MTBF) and Mean Time Between

Maintenance (MTBM).• Define Commercial and Nondevelopmental items.• List the methods for assessing the RAM of Commercial and Nondevelopmental

Items.• List the methods for ensuring the RAM of Commercial and Nondevelopmental

Items.

LOG 103 TLO/ELO - 7


Lesson 8: The Affordable Systems Operational Effectiveness (ASOE) Model

TLO: Explain how the Affordable Systems Operational Effectiveness (ASOE) Model is used to enhance system design for supportability.

ELOs:• Explain how the ASOE model is used • Identify the ASOE domains• Explain the Supportability Analysis process• Summarize how the ASOE outputs impact on performance, RAM, and sustainment

characteristics in the final system design

LOG 103 TLO/ELO - 8


Lesson 9: Providing Insight into Designing for RAM

TLO: Given a scenario, describe how the process inputs and expected outcomes of the System Engineering Process supports RAM requirements.

ELOs: • State Design Interface concepts• Identify the Supportability elements• State the Reliability Availability & Maintainability trade space considerations• State the analytic methodologies and tools used in the design process• Identify the design-supportability analyses processes• State the relationships between Mission reliability and logistics reliability• Identify the process for Reliability Centered Maintenance (RCM)• Identify the process for Condition Based Maintenance Plus (CBM+)• State how the Diagnostics, Prognostics and Health Management of the system are

related

LOG 103 TLO/ELO - 9


Lesson 9: Providing Insight into Designing for RAM

TLO: Given a scenario, describe how the process inputs and expected outcomes of the System Engineering Process supports RAM requirements.

ELOs: • Identify the reason that failure rates are easier to deal with than MTBFs• Identify the aim of FMECA• List three purposes for reliability predictions• Distinguish between maintenance and maintainability• List the types of diagnostic errors and their associated effects• Recognize the benefit of vertical testability• Distinguish among mean down time, mean active maintenance time, and mean

time to repair• Describe why the maintainability of a system depends on the reliability and

maintainability of its subsystems

LOG 103 TLO/ELO – 9 (Continued)


Lesson 10: Risk Reduction Through Test and Evaluation

TLO: Recognize how Test and Evaluation activities contribute to achievement of the RAM requirements.

ELOs:• State the benefits of utilizing Developmental and Operational Test and Evaluation

(D/OT&E).• Define the purpose of the Test & Evaluation Master Plan (TEMP)• List the requirements of the Reliability Management program• Name the requirements of the Reliability Growth Test program • Identify how the DT&E Test-Analyze-Fix process contribute to reliability growth• State the benefits of the Operational Test and Evaluation program in evaluating

military capability • Identify the risks in making early decisions• Identify industry and government best practices in the Test and Evaluation program• Recognize the importance of a contractual definition of failure • Restored per discussion re Lesson 7.

LOG 103 TLO/ELO - 10


Lesson 11: The Impact of Manufacturing Process Anomalies on RAM

TLO: Recognize the impact of manufacturing process anomalies on system RAM performance.

ELOs:• Recognize how stated RAM requirements drive the level of quality in the

manufacturing processes.[DAU1] • Identify the Impact of latent defects on performance and logistics• Identify how the process of the analysis of field data is used to in determine the

root causes of defects • State how latent defect issues are identified from field failure data• Identify the techniques used to eliminate latent manufacturing process defects

LOG 103 TLO/ELO - 11


Question/ Categories FY10 FY11*

Courseware n=499 n=721

Online Delivery

n=500 n=719

Learning Effectiveness

n=495 N=714

Job Impact n=499 n=722

5.98

6.07

5.89

5.74

0 5.24 5.25 5.59 5.6 7.0 Other0 5.24 5.25 5.99 6.0 7.0 Inst0 5.24 5.25 5.59 5.6 7.0 Other0 5.24 5.25 5.99 6.0 7.0 Inst

* Data (from Data Mart) as of 31 Dec 2010

5.86

5.67

5.80

5.96

LOG 103 Metrics That Matter (MTM)

24


LOG 103 Projected Throughput

LOG 103 FY 10* FY 11** FY 11***

Graduates 1,688 1,847 7,392

Army 512 821 3,284

Air Force 421 376 1,508

DoN 327 369 1,476

Industry 367 194 776

Other DoD 46 76 304

All Others 15 11 44

* Period of Mar 15 – Sep 30 2010 ** Period of Oct 1 – Dec 31 2010 *** FY 11 Projection

FY 09LOG 203

COMPARISION1,140

25


• Challenges students with minimal math and engineering skills.

• Expands students’ knowledge beyond the ‘traditional logistics’ perspective.

• Consistent statements “…glad I took this course.’“…never really understood what RAM was before.”“…it was difficult, but I really learned a lot.”“…really had to think about the answers.”“…I’m glad I passed.”

26

LOG 103 PLD Assessment


Directly addresses critical LCL RAM Competency and Curriculum needs• Weapons Systems Acquisition Reform Act (WSARA)• DoD 5000.02• OSD Memorandum /DOT&E Memorandum

Provides basic instruction in new area for students

• Availability KPP/KSAs

• RAM metrics / Sustainment governance

• Systems Engineering – Reliability Growth – T&E processes

• Sustainment governance/metrics

Cross-DAWIA Career Field training will promote communications between PM, SPRDE, T&E and LCL

27

LOG 103 Impact on Training


Questions & AnswersLOG 103 Curriculum Review

Thank You for the Opportunity to Serve the

Life Cycle Logistics (LCL) Functional Integrated Product Team (FIPT)

27


Back-up

29


LOG 103 Course Outline

Lesson 5: Impact of Legislation and DoD Policy on Reliability, Availability and Maintainability

Discuss USD(AT&L) RAM Policy Memorandum of July 08 and its impact on systems engineering, reliability/logistics and test & evaluation, with emphasis on reliability growth programs

Discuss impact of the Weapons System Acquisition Reform Act of 2009 and updates to DoDI 5000.02 on the Defense Acquisition Management System, systems engineering processes, sustainment and governance

Lesson 6/1: Impacts of RAM on Logistics– Recognize how RAM affects support costs– Recognize how RAM affects Total

Ownership Costs– List 4 key elements in the definition of

reliability– List 2 MTB_s that are logistics reliability

parameters– Discuss the definitions of availabilityLesson 7/2: Impacts of RAM on Missions– Distinguish between latent failures,

random failures and wear out– Identify 3 measures of combat capability

that are enhanced by RAM– Distinguish between reliability and

maintainability

Lesson 1: Introduction to LOG 203 Reliability, Availability and Maintainability (RAM)

Identify the role of LOG 103 within the LCL and other DAWIA Certification Paths

Identify the relationships between LOG 103 and other certification courses

Identify the role of Reliability, Availability and Maintainability(RAM)as a key part of the systems engineering process

Identify the role of Reliability, Availability and Maintainability(RAM) in minimizing the need for logistics

Lesson 2: Historical Roots of Reliability, Availability and Maintainability (RAM)

Recognize Early Commercial/DoD Reliability Analyses, Tools and Outcomes

Recognize development and use of DoD Reliability, Availability and Maintainability processes, specifications and documentation

Recognize the impact of RAM on DoD Systems performance, sustainment and costs

Lesson 3: The Impact of Acquisition Reform on Reliability, Availability and Maintainability

Discuss the scope and impact of the Perry Memorandum

Discuss the Loss of workforce and skilled RAM personnel

Discuss the Discontinuance of Military Standards and Specifications and its impact

Discuss the Impact of the use of Commercial-Off-The-Shelf on system reliability and performance

Discuss the decrease in effectiveness and suitability as determined by operational Test and Evaluation

Lesson 4: Mandatory Sustainment Materiel Availability Key Performance Parameter and Supporting Key System Attributes of Materiel Reliability and Ownership costs

Discuss the origins of the Material Availability KPP, the Material Reliability KSA and the Ownership Cost KSA

Identify the impact of the KPP/KSA on the requirements management process

Discuss the development of the KPP/KSAs within the JCIDS process

Discuss the enablers to materiel readiness that impact RAM, e.g., RCM, CBM, diagnostics/prognostics

30


LOG 103 Course Outline (Continued)

Lesson 8/3: Operational & Contractual RAM Requirements

– List 3 methods for converting operational RAM requirements into contractual RAM requirements

– List 3 approaches for assessing RAM of Commercial and Non-Developmental Items

Lesson 7: The Systems Design and Operational Effectiveness (SDOE) Model

– Discuss the SDOE model and domains– Discuss specific SDOE engineering

outputs and their impact on performance, RAM, and sustainment

Lesson 8/4: Providing Insight into Designing for RAM

– Discuss the concept of design interface– Discuss the elements of supportability– Discuss specific Reliability Availability &

Maintainability trade space considerations

– Discuss common methodologies and analytic tools

– Identify the specific analyses to be conducts, e.g., block diagram development, allocation and prediction, failure modes and effects analysis, maintenance task analysis

– Identify the reason that failure rates are easier to deal with than MTBFs

– Distinguish between mission reliability and logistics reliability

– Identify the aim of Reliability Centered Maintenance

– Identify the aim of Condition Based Maintenance

– Identify the aim of diagnostics and prognostics

Lesson 9/5: RAM Growth Programs and Risk Reduction

– Discuss requirements for reliability management programs

– Discuss requirements for reliability growth test programs

– Discuss best practices– Recognize the Test-Analyze-and Fix

process of achieving reliability growth– Recognize the concept of decision riskLesson 10/6: Impacts of RAM on

Manufacturing– Identify the effect that latent defects can

have on missions and logistics– How to recognize a manufacturing defect

from field data– 3 lines of defense to keep manufacturing

from producing latent defects

Lesson 6/3: Operational & Contractual RAM Requirements

– List 3 methods for converting operational RAM requirements into contractual RAM requirements

– List 3 approaches for assessing RAM of Commercial and Non-Developmental Items

Lesson 7/4: Providing Insight into Designing for Reliability

– Identify the reason that failure rates are easier to deal with than MTBFs

– Distinguish between mission reliability and logistics reliability

– Identify the aim of Reliability Centered Maintenance Analysis

– Identify the aim of Condition Based Maintenance

– Identify the aim of diagnostics and prognostics

in reliability qualification test (RQT)Lesson 9/6: Impacts of RAM on

Manufacturing– Identify the effect that latent defects can

have on missions and logistics– How to recognize a manufacturing defect

from field data– 3 lines of defense to keep manufacturing

from producing latent defects

31

Documents

LOG 103 Curriculum Review 07 Jan 2011 LOG 103 Reliability, Availability & Maintainability (RAM) Presented to the Life Cycle Logistics (LCL) Functional