August 2010 Version

Resources for Test and Evaluation and Systems Engineering Professionals

This collection of valuable acquisition resources was developed by the Defense Acquisition University as an aid to test and evaluation, systems engineering, and other acquisition professionals.

This document lists the following types of free or low cost, online or readily accessible resources: publications, websites, classes & training, software resources, M&S resources, T&E resources, and systems engineering resources. Each section title is highlighted. Contact Karen Stadler at karen.stadler@dau.mil to suggest additions or updates to this document.

Note: As a policy, the Defense Acquisition University (author of this list of resources) does NOT endorse any of the resources listed in this document.

Item / Name Description / Information Web-Link

PublicationsThe Acquisition Process Wall Chart

Life cycle management information on: phases, milestones, technical reviews; JCIDS process and documents; contracting, logistics, sustainment; Planning, Programming, Budgeting & Execution Process (PPBE); systems engineering and T&E processes and events.

https://acc.dau.mil/IFC/

National Defense Magazine (NDIA Journal)

Electronic version is free. www.nationaldefensemagazine.org

Defense Acquisition Review Journal

Used to be called Acquisition Review Quarterly

http://www.dau.mil/pubscats/Pages/ARJ.aspx

Defense AT&L Magazine

Used to be called Program Manager Magazine

http://www.dau.mil/pubscats/Pages/DefenseAtl.aspx

Government Executive

Magazine http://www.govexec.com/

Government Computer News

Magazine http://gcn.com/Home.aspx

CrossTalk The Journal of Defense Software Engineering

www.stsc.hill.af.milClick on the CrossTalk link to access the magazine.

Download the latest version of this document from the DAU Acquisition Community Connection:https://acc.dau.mil/CommunityBrowser.aspx?id=232974&lang=en-US

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkChips Magazine Sponsored by Navy Chief Information

Officer, and SPAWAR IT Umbrella Program Office

www.chips.navy.mil or chips@spawar.navy.mil

Defense News

Magazine is NOT free. Website has some free information

www.defensenews.com

Army AL&T Magazine http://asc.army.mil/altmag/

Aviation Week Magazine is NOT free. Website has some free information, articles, photos, links to other websites

www.aviationnow.com

The ITEA Journal of T&E

Magazine is NOT free (magazine comes with ITEA membership). Website has some free information, such as magazine articles & abstracts.

www.ITEA.org

Early Bird DoD related news articles http://ebird.osd.mil

DoD News Services

News releases, contract announcements, photos, news archives.

Links to Army, Navy, Air Force, Marine Corps, war on terrorism, and other federal government newsletters.

http://www.defense.gov/news/dodnews.aspx

U.S. Air Force AIM POINTS

e-Letter http://aimpoints.hq.af.mil/index.cfm

Handbooks, Guides, Publications

T&E Management GuideSystems Engineering FundamentalsGlossary Defense Acq. Acronyms/TermsIntro. to Defense Acq. ManagementProgram Managers Tool KitPerformance Based Logistics GuideScheduling Guide for PMsJoint Program Management HandbookCOTS & Commercial Item GuideCOSSI HandbookGuide to Incentive StrategiesGuide to Performance Based Services Acq

http://www.dau.mil/pubscats/Pages/Onlinepublications.aspx

Click on General Publications, Guidebooks, and/or DPAP Publications

Defense Acquisition Guidebook

Interactive on-line version of the Defense Acquisition Guidebook

https://dag.dau.mil/Pages/Default.aspx

2

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkHandbooks, Guidebooks

Acquisition Logistics GuideContracting for the Rest of UsDoD Guide for Achieving RM&ADoD Guide, Uniquely Identifying ItemsEVM Implementation GuideGuide for Mgmt. of Multinational Pgms.Risk Mgmt. Guide for DoD Acq.Mngr’s Guide to Tech. TransitionGAO Reports (Acquisition Related)DoD Acquisition Mgmt. MetricsDoD IPPD HandbookTechnology Readiness Assessment Guide

Numerous other handbooks and guides.

https://dap.dau.mil/aphome/das/Lists/Guidebooks%20and%20Handbooks/US%20Air%20Force.aspx?gtag=U.S.%20Air%20Force&ggroup=Guidebook%20Organization

Policy Documents and other Acquisition-related documents

First link is for acquisition-related laws, instructions, regulations, policy memos, reports, FAR and DFARS info., etc.Second link is for news and publications.

Both can be sorted by career field, organization, or topic.

https://dap.dau.mil/policy/Lists/Policy%20Documents/Policy.aspx?tag=Policy&group=none

https://dap.dau.mil/aphome/das/Lists/News%20and%20Publications/DoD.aspx?ptag=DoD&pgroup=Publication%20Organization

Operational Test Director’s Guide

COMOPTEVFOR publication www.cotf.navy.mil/otdguide.htm

e-Handbook of Statistical Methods

Handbook of Engineering Statistics http://www.itl.nist.gov/div898/handbook/

Guide to Specification Writing, for U.S. Government Engineers

NAVAIR publication http://nawctsd.navair.navy.mil/resources/library/acqguide/spec.htm

A Modular Open Systems Approach to Acquisition

Guidebook http://www.acq.osd.mil/se/pg/guidance.html#MOSA www.acq.osd.mil/osjtf/pmguide.html

Defense Procurement and Acquisition Policy

Contracting guidebooks, policy and information

www.acq.osd.mil/dpap/

3

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkDoD Corrosion Prevention and Control Planning Guidebook

Guidebook and other corrosion prevention information

http://www.corrdefense.org/default.aspx

DoD Guide to Integrated Product and Process Development

Guidebook http://sepo.spawar.navy.mil/DoD_Guide_To_IPPD.pdf

Top Eleven Ways to Manage Technical Risk (NAVSO P-3686)

Risk Guide. Also information on diminishing manufacturing sources and material shortages.

http://www.gidep.org/mod_perl/framepage.cgi?pg=/data/dmsms/library/dmslibrary.htm

Joint Testing Handbook

Handbook http://www.jte.osd.mil/ click on JT&E handbook (menu on left side)

Virtual Library - Pentagon

Virtual Library http://www.whs.mil/library/

Virtual Library - Naval Postgraduate School

Virtual Library“Ask a Librarian”

http://www.nps.edu/Library/index.html

Virtual Library - Library of Congress

Virtual Library http://catalog.loc.gov

Virtual Library - Air Force Institution of Technology

Virtual Library http://library.afit.edu/

Military Library Network

Search electronic catalogs of more than 30 military libraries. Also has defense related U.S. Policy statements on selected key topics.

http://merln.ndu.edu

Library locator Library locator. Also has access to 750,000 eBook titles

http://netlibrary.net

4

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkProject Gutenberg (30,000+ public domain books)

Public domain books http://www.gutenberg.org/

WebsitesDefense Acquisition Portal (DAP)

Policy documentsAcquisition workforce info.Education / professional development infoNews & publicationsIndustry support for acquisition – news & weblinksAsk-A-ProfessorAir Force Acquisition Policy Fact Pages

https://dap.dau.mil/Pages/Default.aspx

Acquisition Community Connection (ACC)

ACC – A website where the AT&L workforce meets to share knowledge.

Join ACC and access important acquisition resources, connect with professionals in your field, share information and knowledge (including posting documents to the ACC website)

ACC has Communities of Practice / Special Interest Areas for Systems Engineering, Test & Evaluation, and numerous others

https://acc.dau.mil/

Acquisition website links

Web-links http://www.library.dau.mil/websites_internet.html

Acquisition Central

Documents, instructions, website links https://www.acquisition.gov/

Acquipedia Online encyclopedia of common defense acquisition topics

https://acquipedia.dau.mil/default.aspx

DoDTechipedia website

Contains information on who is performing what work in DoD research and development.

https://www.dodtechipedia.mil/

5

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkNavy Research, Development & Acquisition Website

Website http://acquisition.navy.mil/

Army Acquisition Support Center

Website http://asc.army.mil

Defense Science Board (DSB)

Download or order DSB reports www.acq.osd.mil/dsb/

AcqWeb - USD(AT&L) Website

Documents, OSD information & website links, search engine

www.acq.osd.mil

Defense Acquisition Management Information Retrieval (DAMIR)

DAMIR identifies various data sources that the Acquisition community uses to manage Major Defense Acquisition Programs (MDAP) and Major Automated Information Systems (MAIS) programs, and enables the OSD, Military Services, Congress and other participating communities to access this information.

http://www.acq.osd.mil/damir/

FARSite Contracting docs, regs, forms, tools http://farsite.hill.af.mil

Army Knowledge Online, Defense Knowledge Online

Army-wide and DoD-wide information, Email, search engine, locator

https://www.us.army.mil

Navy Knowledge Online

Navy-wide information https://wwwa.nko.navy.mil

Air Force Portal Air Force-wide information www.my.af.mil

Marine Corps Home Page

Marine Corps-wide information www.marines.mil

Air Force Center of Excellence for Knowledge Mgmt.

Documents (search engine), samples & examples, POC’s, web links, tools, communities of practice (including T&E)

https://afkm.wpafb.af.mil

Air Force Documentation

Documents, publications http://www.e-publishing.af.mil/

6

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkArmy Documentation

Documents, publications www.apd.army.mil

Navy Documentation

Documents, publications http://doni.daps.dla.mil/default.aspx

Defense Technical Information Center

DoD documents, reports, publications (search, order docs)

www.dtic.milwww.dtic.mil/whs/directives

DoD Locator & Search Engine

Documents, websites, news releases http://www.defense.gov/

Government Information Search Engines

Search Engines, links to government information

http://www.usa.gov/ http://www.gpoaccess.gov/advancedsearch.html

Worldwide Military Installations Info.

Website http://apps.mhf.dod.mil/pls/psgprod/f?p=MI:ENTRY:457653404573013

DoD Military Installations

DoD installation and duty station information

www.militaryonesource.com

http://apps.mhf.dod.mil/pls/psgprod/f?p=MHF:RELO:42653992200467

Air War College DoD / military Lessons Learned http://www.au.af.mil/au/awc/awcgate/awc-lesn.htm

Air Force Knowledge Management

Best Practices / Lessons Learned https://afkm.wpafb.af.mil/community/views/home.aspx?Filter=OO

Center for Army Lessons Learned

Best Practices / Lessons Learned http://usacac.army.mil/cac2/call/index.asp

Acquisition Best Practices Clearinghouse

Best Practices (especially in areas of systems engineering and software acquisition.) Information on how to implement & implementation results.

https://bpch.dau.mil/pages/default.aspx

Naval Postgraduate School Library

Numerous Lessons Learned web-links http://www.nps.edu/library/research/subjectguides/index.html click on lessons learned (which is listed under military resources)

7

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkMarine Corps Lessons Learned

Best Practices / Lessons Learned https://www.mccll.usmc.mil/

National Defense Industrial Association (NDIA)

Documents, web-links, info on meetings & events, links to NDIA committees & local chapters.

Defense Acquisition University students may obtain free NDIA membership through the DAU website

www.ndia.org

Free NDIA membership for DAU students and faculty: http://www.ndia.org/MembershipAndChapters/Pages/DAU.aspx

North American Technology & Industrial Base Organization

Website www.dtic.mil/natibo

Office of Technology Transition

Website http://www.acq.osd.mil/ott/

Research & Engineering Portal

Information on federally funded R&D projects (budget, planning, project summaries, news highlights).

Search engine, links to other websites.

https://rdte.osd.mil

Independent Research & Development

Website www.dtic.mil/ird

Defense Advanced Research Projects Agency (DARPA)

Website www.darpa.mil

Human Systems Integration (HSI) and Advanced Distributed Learning

Websites, web-links www.manprint.army.mil http://www.dtic.mil/dticasd/org.html http://spider.adlnet.gov/

Reliability Analysis Center

Publications, tools, training http://www.theriac.org/

8

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkChemical, Biological, Radiological, & Nuclear Defense Information Analysis Center

Chemical, Biological, Radiological, & Nuclear Defense and Homeland Security Scientific and Technical Information

http://www.cbrniac.apgea.army.mil

Chemical Propulsion Information Analysis Center

U.S. national clearinghouse and resource center for chemical rocket propulsion technical information and research services.

http://cpiac.jhu.edu

Military Sensing Information Analysis Center

Purpose is to foster communications within the Military Sensing Technology community; create standards; and collect, analyze, synthesize, maintain, & distribute critical information within the field.

http://www.sensiac.gatech.edu

Weapons Systems Technology Information Analysis Center

Purpose is to provide information and engineering services related to conventional and directed energy weapons, their development, production, fielding, and maintenance.

http://wstiac.alionscience.com

Advanced Materials, Manufacturing, and Testing Information Analysis Center

The DoD Center of Excellence responsible for acquiring, archiving, analyzing, synthesizing, and disseminating scientific and technical information related to advanced materials, manufacturing, and testing.

http://ammtiac.alionscience.com

Open Systems Joint Task Force

Tools & guides, documents, lessons learned

www.acq.osd.mil/osjtf/

Best Manufacturing Practices

Industry / Government / Academia cooperative effort

www.bmpcoe.org/

Defense Environmental Network

Website https://www.denix.osd.mil

9

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkDoD Chief Information Officer Website

Home page has Section 508 information. Archives contains: Net-Centric docs & checklist, Global Information Grid guidance & docs, C3I documents.

http://cio-nii.defense.gov/

DIACAP Website DIACAP Knowledge Service Website https://diacap.iaportal.navy.mil/

DoD Architecture Framework (DODAF) version 2.0

Download DODAF docs (Volume I, Volume II, Volume III).

https://dars1.army.mil/IER/index.jsp https://www.us.army.mil/suite/page/454707

Joint Capability Technology Demonstrations

Website http://www.acq.osd.mil/jctd/

Comparative Testing Office

Administers the Defense Acquisition Challenge (DAC) Program, and Foreign Comparative Testing (FCT) Program

http://www.acq.osd.mil/cto/

Test Information Free testing information (particularly software testing) and articles from leading consultants

www.stickyminds.com

Survivability / Vulnerability Information Analysis Center

Website www.bahdayton.com/surviac/

Director, OT&E T&E website www.dote.osd.mil

Director, DT&E T&E website http://www.acq.osd.mil/dte/

Joint Interoperability Test Command (JITC)

T&E / interoperability website http://jitc.fhu.disa.mil

Test Resource management Center (TRMC)

T&E website http://www.acq.osd.mil/trmc/

10

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkRange Commanders’ Council

T&E website https://wsmrc2vger.wsmr.army.mil/rcc/selmid.htm

International T&E Association (ITEA)

T&E website http://www.itea.org/

Navy OT&E Force (OPTEVFOR)

T&E website www.cotf.navy.mil

Army T&E Command (ATEC)

T&E website www.atec.army.mil

Army T&E Office T&E website https://www.us.army.mil/suite/page/25 www.hqda.army.mil/teo

Marine Corps OT&E Activity (MCOTEA)

T&E website http://www.quantico.usmc.mil/activities/?section=MCOTEA

Air Force OT&E Center (AFOTEC)

T&E website www.afotec.af.mil

Joint Service T&E information

T&E website http://www.jte.osd.mil/

Hundreds of Statistics Website Links

Everything you ever wanted to know about statistics! (Also data analysis, evaluation, data collection & management, etc.)

http://www.math.yorku.ca/SCS/StatResource.html www.resources4evaluators.info/http://gsociology.icaap.org/methods http://onlinestatbook.com/

Statistics Websites (Statistics software & tools)

Free statistical software & tools, statistical software websites

http://gsociology.icaap.org/methods/soft.html http://gsociology.icaap.org/methods/statontheweb.html http://statpages.org/

Statistics Weblinks & Tools

Free statistical software & tools, statistical software websites

www.bettycjung.net Click on site index. Then scroll down to the statistics sections.

11

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkClasses & Training

Note: As a policy, the Defense Acquisition University (who developed this list of resources) does NOT endorse any non-government sources of education or training

Defense Acquisition University (DAU) Courses

Web based Classes: ACQ 101, PQM 101, SAM 101, SYS 101, SYS 202, TST 102, many others.

Resident Courses offered at numerous locations: TST 203, TST 303, SYS 203, SYS 302, many others.

http://www.dau.mil/ https://learn.dau.mil/

DAU Strategic Partnerships with Colleges and Universities

College credit for DAU classes

DAU credit for college classes

http://www.dau.mil/aboutDAU/Pages/partnerships.aspx

DAU Continuous Learning Modules

More than 200 continuous learning modules - Can browse or take for credit.

Modules include: - System Safety in Systems Engineering- Technical Reviews- Assessment of Tech. Readiness Levels- Designing for Supportability- Contracting for the Rest of Us- IPT Management and Leadership- Information Assurance- Introduction to Interoperability- Reducing Total Ownership Costs- Risk Management- M&S for T&E- DTEPI Intro. to Probability & Statistics- Testing in a Joint Environment- Environmental Issues in T&E- Telemetry- Time-Space-Position Information

http://icatalog.dau.mil/onlinecatalog/tabnavcl.aspx

DAU Catalog and iCatalog

- Course descriptions- Career Field Certification Requirements (Requirements for DAWIA Certification)- Course equivalencies- Continuing Education Units (CEUs)- American Council on Education (ACE) recommended credits

http://icatalog.dau.mil/ http://icatalog.dau.mil/onlinecatalog/Archived_Catalogs.asp

12

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkDAU Support Services

Research, analysis, consulting, problem solving, targeted training

http://www.dau.mil/images/Pages/mission_assistance.aspx

U.S. Navy Distance Learning

Distance Learning Courses & Degree Programs

https://www.navycollege.navy.mil/storefront.cfm

U.S. Government E-Learning Courses

Distance Learning Courses www.golearn.gov

International Engineering Consortium

Distance Learning Courses www.iec.org

International Council on Systems Engineering (INCOSE)

First web-link is for Distance Learning Courses

Second web-link is for Systems Engineering certification

www.incose.org/educationcareers/shortcourses.aspx

http://www.incose.org/educationcareers/certification/details.aspx?id=level

Federal Acquisition Institute

Distance Learning Courses http://www.fai.gov/

Systems Engineering (SE) On-Line Degrees

Note: Other colleges and universities (besides those listed) offer classes in systems engineering. The following universities offer on-line SE degrees or certificates.

See the next eleven rows (listings) in this table.

University of Southern California

On-line M.S. Systems Architecture & Engineering

http://www.usc.edu/dept/ise/

Oklahoma State University

On-line M.S. Control Systems Engineering

http://osu.okstate.edu/

University of Alabama in Huntsville (UAH)

Masters Certificate, Systems Engineering (Also certificates in T&E, M&S, Rocket Propulsion, and Reliability & Missile Systems).Classroom or distance learning.

Some DAU classes transfer towards UAH certificates.

http://www.pcs.uah.edu/jsp/home.jsp

1-800-448-4035

13

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkNational Technical University (now part of Walden University)

On-line M.S. degrees in Systems Engineering, and Software Engineering(312) 263-0456(866) 492-5336

http://www.waldenu.edu/c/Schools/Schools_1373.htm

Arizona State University

On-line Master of Engineering, in the following areas: Modeling and Simulation, Systems Engineering, Software Engineering, Quality and Reliability Engineering, Technical Engineering Management, Industrial Engineering, Electrical Engineering

On-line Graduate Certificate in Statistics

http://cpd.asu.edu/online/

Southern Methodist University

MS, Systems Engineering (distance learning or classroom setting).Certificate programs.

Some DAU course credits may transfer.DoD employees may receive reduced tuition.

http://engr.smu.edu/emis/sys/

Naval Postgraduate School

M.S. Systems Engineering www.nps.edu

Air Force Institute of Technology

M.S. and Masters Certificate in Systems and Engineering ManagementOn-line continuing education

www.afit.edu

On-Line Engineering Degrees

Search engine www.classesusa.com

Engineering degrees (some are on-line)

Search engine www.allengineeringschools.com

Systems Engineering Academic Programs

World-wide listing http://www.incose.org/educationcareers/academicprogramdirectory.aspx

14

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkT&E Certificates & Degrees

Note: Other colleges and universities (besides those listed) offer classes in T&E. The following universities offer T&E related degrees or certificates.

See the next seven rows (listings) in this table.

Air Force Institute of Technology

M.S. in Operations Research. Masters Certificate in Test and Evaluation.

www.afit.edu

University of Alabama in Huntsville

T&E CertificateSystems Engineering CertificateModeling & Simulation Certificate Classroom or distance learning

http://www.pcs.uah.edu/jsp/home.jsp

1-800-448-4035

University of Florida

Graduate-level T&E Certificate http://www.gerc.eng.ufl.edu/

Florida Institute of Technology

M.S., Operations Research www.fit.edu

Georgia Tech T&E Certificate www.terec.gatech.edu

National Test Pilot School

Masters programs, flight testing www.ntps.com

Naval Postgraduate School

Masters in Operations Analysis http://www.nps.edu/Academics/Schools/GSOIS/Departments/OR/index.html

U.S. Army Logistics Management College

Operations Research classes (also Army Acquisition, Environmental Science, and Logistics classes)

www.almc.army.mil

U.S. Air Force Test Pilot School

Short courses, and Test Pilot School Information

www.edwards.af.mil/ click on U.S. Air Force Test Pilot School Information

Electronic Warfare T&E University

Short Courses http://www.edwards.af.mil/library/factsheets/factsheet.asp?id=10860

Navy COMOPTEVFOR

Operational Test Director Course www.cotf.navy.mil

AFOTEC T&E University

Courses focus on OT&E training for AFOTEC personnel

Training@afotec.af.mil (505) 846-6074

15

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkArmy T&E Basic Course (TEBC)

Course focuses on T&E training for Army personnel

www.atec.army.mil/TEBC/tebc.htm

Air Force Design of Experiments & Statistics Classes

Air Armament Academy offers a variety of Design of Experiments & Statistics classes (many classes offered at Eglin Air Force Base).Once you access the website, click on College of Test and Evaluation.

https://afkm.wpafb.af.mil/community/views/home.aspx?Filter=OO-ED-AA-A2%20 Register with the Air Force Knowledge Now system to access this web-page.

Software Programming and Web-Development

More than 450 on-line classes www.thedacs.com/training/element_k.php

Software ResourcesDoD Software Data & Analysis Center

Software engineering data & information (numerous software related areas), Software Tech newsletter & E-newsletter, “Golden Practices” including those for software testing

http://www.thedacs.com/

Software Security Assurance

First web-link: Download the July 31, 2007 State-of-the-Art Report (SOAR).

Second web-link: Information Assurance Technology Analysis Center

http://iac.dtic.mil/iatac/download/security.pdf

http://iac.dtic.mil/iatac

Systems and Software Consortium, Inc. (formerly Software Productivity Consortium, SPC)

Processes, methods, tools, support services.

Some assets only available to consortium members.

http://www.software.org/

Software Program Managers Network (SPMN)

Lessons learned, best practices, guides to testing, configuration management.Originally sponsored by DoD, but now a commercial entity.

http://www.spmn.com

16

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkPractical Software & Systems Measurement

Information based on best measurement practices (DoD, government, industry) and ISO Measurement Standard.

Provides a basis for enterprise level management. Provides some free guidelines and handbooks.

www.psmsc.com

Software Engineering Measurement and Analysis

The Software Engineering Institute (SEI) provides guidance and expertise in the field of software measurement and analysis.

http://www.sei.cmu.edu/measurement/index.cfm

Software Engineering Institute (SEI)

SEI is a DoD federally funded R&D center, sponsored by the OSD AT&L.

Core purpose is to help others make measured improvements in their software engineering capabilities.

Web-links are the SEI home page, and Software Engineering Repository of technical information.

http://www.sei.cmu.edu/

https://seir.sei.cmu.edu/seir/

SEI Capability Maturity Model

SEI was the original developer of the Software Capability Maturity Model (SW-CMM), which has been supplanted by an integrated model called the CMMI.

Web-links give CMMI and legacy CMM information.

http://www.sei.cmu.edu/cmmi/

http://www.sei.cmu.edu/cmmi/start/faq/related-faq.cfm

Software Security Build Security in (BSI) website contains and has links to best practices, tools, guidelines, rules, principles, & other resources for software developers, architects, & security practitioners.

https://buildsecurityin.us-cert.gov/daisy/bsi/home.html

17

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkAir Force Software Technology Support Center (STSC)

Publishes CrossTalk, monthly magazine of software management issues and current practice, including testing.

Web-links are the STSC home page, and “Guidelines for Successful Acquisition and Management of Software Intensive Systems” publications.

http://www.stsc.hill.af.mil/ http://www.stsc.hill.af.mil/resources/tech_docs/

Army CECOM Software Engineering Center

Web-links are the home page, and a useful legacy checklist, Domain 6 which covers T&E.

http://www.sed.monmouth.army.mil/sit/index.htm http://www.sed.monmouth.army.mil/sit/sitstart.htm

Marine Corps Tactical Systems Support Activity

Software support center http://www.mctssa.USMC.mil

SPAWAR – Software Engineering & Process Office

Process asset library covering all parts of the software development process.Software Management for Executives Guidebook.

http://sepo.spawar.navy.mil

Acquisition Community Connection (ACC)

The ACC Systems Engineering and IT Communities-of-Practice, and the Software Acquisition Management Special Interest Area, contain many Software Related Resources

https://acc.dau.mil/

Continuous Learning Center (CLC) short courses

Distance learning short courses available for Information Assurance, Enterprise Integration, Interoperability, Naval Open Architecture, and the Net-Ready KPP

http://clc.dau.mil/

Federal Chief Information Officers Council

Website has best practices, guidebooks & other documents

http://www.cio.gov

For Enterprise Resource Planning (ERP) projects:

DoD Enterprise Integration Toolkit https://acc.dau.mil/CommunityBrowser.aspx?id=153015&lang=en-US

18

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkNational Vulnerability Database

A comprehensive cyber security vulnerability database that contains and has links to numerous resources and information sources.

http://www.us-cert.gov/nvd.html

M&S ResourcesModeling & Simulation Coordination Office(formerly Defense Modeling & Simulation Office)

M&S references and resources, standards, and education

Links to service (& NATO) M&S activities

http://www.msco.mil/

M&S Resource Repositories

Links to numerous M&S resources and repositories

http://nmso.navy.mil/tab.cfm?tab=106

Air Force Agency for Modeling & Simulation

Documents, links, lessons learned www.afams.af.mil

U.S. Army Program Executive Office for Simulation, Training and Instrumentation

M&S Support Center www.peostri.army.mil

Threat Systems Office

Automated Joint threat Systems Handbook (available on the SIPRNET) – lists threat simulators, facilities, targets, M&S, ranges, and foreign assets

For additional information, contact the DOT&E Threat Systems Office: www.dote.osd.mil/

Joint Accreditation Support Activity

VV&A resources, training, archives http://www.navair.navy.mil/nawcwd/jasa/

Navy M&S Office Articles, information, help desk https://nmso.navy.mil/

Air Force M&S Resource Repository

M&S Resources https://afmsrr.afams.af.mil/

19

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkArmy M&S Resource Repository

M&S Resources https://www.msrr.army.mil/

Navy M&S Resource Repository

M&S Resources http://nmso.navy.mil/

Verification, Validation, & Accreditation (VV&A) Recommended Practices Guide

VV&A information, templates, reference documents, diagrams.

Discussion of VV&A activities (legacy, new, or federation M&S) from perspective of the User, Developer, M&S Program Manager, V&V Agent, and Accreditation Agent.

http://vva.msco.mil/ http://dvdt.nmso.navy.mil/Help/MS_Interview.aspx

Annual DoD M&S Awards

Outstanding Achievement in development or application of M&S within DoD.

DoD awards are sponsored by the M&S Coordination Office (formerly DMSO)

Industry & Academia awards sponsored by National Training Systems Association

http://www.msco.mil/awardsprogram.html

www.trainingsystems.org/nomform.cfm

T&E ResourcesCentral Test and Evaluation Investment Program (CTEIP)

CTEIP objectives include: - Fund & help solve shortfalls in T&E infrastructure- Achieve consistency, commonality & interoperability- Develop & exploit M&S to support T&E- Develop mobile instrumentation- Expand / maintain T&E technology base

http://www.acq.osd.mil/trmc/jipp/cteip/functions.htm

Acquisition Community Connection (ACC)

These ACC Special Interest Areas contain many T&E related resources: - Test & Evaluation- TRMC - T&E Science & Technology- Operations Research/Systems Analysis

https://acc.dau.mil/

20

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkDOT&E Publications

Various T&E related reports, articles and/or presentations are available at the DOT&E website.

https://extranet.dote.osd.mil Common Access Card (CAC) is required for access

Range Commanders Council

Organization of DoD test, training and operational range commanders that:- Fosters cooperation & standardization- Seeks solutions to common needs- Establishes technical standards- Facilitates technical & equipment exchanges- Forms technical working groups for various functions

https://wsmrc2vger.wsmr.army.mil/rcc/selmid.htm

Test & Evaluation / Science & Technology Program (TEST)

Program Goals: To fund / exploit new technologies, and expedite their transition from the laboratory to the T&E community.

Top website is for the Acquisition Community Connection TEST Program special interest area.

Bottom website is for the DoD Test Resource Management Center (TRMC). The TEST Program is the responsibility of the TRMC, which reports to USD (AT&L).

https://acc.dau.mil

http://www.acq.osd.mil/trmc/jipp/te-st/

Test Resource Management Center Annual Report

Information on the CTEIP Program, T&E Science & Technology Program, Test ranges & resources, and other TRMC programs and initiatives.

www.acq.osd.mil/trmc/publications.htm

Army OT Entrance Criteria Templates

Appendix X of DA Pam 73-1 contains a set of 33 detailed templates, covering all aspects of T&E (Test Planning & Documentation, System Design & Performance, Test Assets & Support)

https://www.us.army.mil/suite/page/25

Must first access Army Knowledge Online (AKO), then type in the weblink.

21

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkArmy T&E Publications

Army TEMP approval status report “TEMP Preparation 101”T&E Refresher CourseT&E WIPT “Smart Book”Army T&E Strategic PlanArmy Guidelines: Use of M&S to support T&EMany other T&E reference documents

https://www.us.army.mil/suite/page/25

Must first access Army Knowledge Online (AKO), then type in the weblink.

Army Software Testing Standards

DA PAM 73-1 “T&E in Support of Systems Acquisition”, Appendices Q & T

https://www.us.army.mil/suite/page/25Must first access Army Knowledge Online (AKO), then type in the weblink.

NAVAIR T&E Training and Guides

This NAVAIR website has:- T&E training on the role of T&E, and the T&E process- T&E definitions- T&E Guide for Project Engineers- TEMP guidance, format, and training

http://nawctsd.navair.navy.mil/resources/library/acqguide/testing.htm

Guidelines for Conducting OT&E of Software-Intensive System Increments

Guidance for OT&E of software intensive systems

http://sepo.nosc.mil/Guidelines_for_Conducting_OT&E.doc

Defense Acquisition Guidebook Chapter 9 has T&E Resources & Information

Section 9.3 lists DT&E guidelinesSection 9.4 lists OT&E guidelinesSection 9.5 lists LFT&E guidelinesSection 9.6 discusses T&E planning documentation (TES and TEMP)Section 9.8 lists T&E best practicesSection 9.10 presents the TEMP recommended format

https://dag.dau.mil/Pages/Default.aspx

22

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkJoint T&E Methodology-and- Joint Mission Environment Test Capability (JMETC)

First web-link: Capability Test Methodology Handbooks for Testing in a Joint (distributed) Environment. Also briefings & tutorials.

Second web-link: JMETC information. JMETC provides a joint distributed test infrastructure (live, virtual, and constructive test resources that are configured to support the users' needs).

https://www.jte.osd.mil/jtemctm/handbooks/index.html

https://www.tena-sda.org/display/JMETCpub/Home

Systems Engineering ResourcesDoD Systems Engineering Policy and Guidance

- Systems Engineering Plan (SEP) Preparation Guide, and other related documents - Policy for Systems Engineering in DoD- Contracting for Systems Engineering- Designing & Assessing Supportability in DoD Weapon Systems- Technical review checklists- System of Systems Engineering Guides- Systems Engineering guides from various organizations- Engineering for System Assurance- DAPS Methodology (applies to ACAT I programs approaching DAB review)

http://www.acq.osd.mil/se/

Click on policy and guidance. Then click on policy, for systems engineering policy memos and instructions – or click on guidance & tools, for other systems engineering documents

Click on acquisition program resources for best practices & frequently asked questions

Air Force Center for Systems Engineering

Air Force Systems Engineering Info., SE guidance and resource docs, SE web-links

http://www.afit.edu/cse/

Air Force Deskbook – Engineering

Detailed engineering documents, for use by acquisition professionals

https://afkm.wpafb.af.mil/ASPs/deskbook/index2.asp?Filter=OO-EN&Cat=EN&Type=WA

SPAWAR Systems Engineering Process Office

Navy systems engineering information:Links & library for systems engineering, software engineering, process improvement, project management

Links to INCOSE Systems Engineering Handbook, Industry SE standards, NASA guidebooks and standards

http://sepo.spawar.navy.mil/

http://sepo.spawar.navy.mil/Systems_Engineering.html

23

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkNAVAIR Acquisition Guide

Acquisition Roadmap has a graphical flowchart, with detailed descriptions & guidance.Policies, documents, links, search engine.

Detailed information on contracts, configuration mgmt., funding, logistics, and numerous other topics.

http://nawctsd.navair.navy.mil/resources/library/acqguide/acqguide.htm

http://nawctsd.navair.navy.mil/resources/library/acqguide/contents.htm

Navy Technical Reviews Info. & Guides

Technical review checklists, entry & exit criteria, other information on technical reviews.

http://nawctsd.navair.navy.mil/resources/library/acqguide/reviews.htm

Navy Technical Reviews Handbooks & Checklists

Detailed handbooks & checklists for each technical review

http://www.navair.navy.mil/kms/41g/ Roll your mouse/curser over each review to access handbooks & checklists

Defense Acquisition Guidebook Chapter 4 - Systems Engineering (SE) Resources & Info.

- Section 4.2 discusses the eight technical processes & eight technical mgmt. processes- Section 4.3 discusses SE activities in the System Life Cycle- Section 4.4 discusses various SE design considerations- Section 4.5 discusses key SE tools & techniques- Section 4.6 discusses best practices, case studies, and lessons learned- Section 4.7 discusses SE resources

https://acc.dau.mil/CommunityBrowser.aspx?id=332951

https://dag.dau.mil/Pages/Default.aspx

International Council On Systems Engineering (INCOSE)

Non-profit membership organization.Website has: - News & events- Publications & book reviews- Systems Engineering Primer- Technical resources & tools- Technical Measurement Guide- Systems Engineering job bank- Professional certification program- INSIGHT newsletter- Listing of SE short courses- Directory of SE Academic Programs- Ethics for Engineering Professionals

www.incose.org

24

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkSystems Engineering Tools

This weblink has tools of interest to Systems Engineers (requirements management, systems architecture, measurement, and other tools).

http://www.incose.org/ProductsPubs/products/toolsdatabase.aspx

DoD Architecture Framework (DoDAF)

Website links to DODAF documents (Volumes I, II, and III), tutorials, and other DoDAF information.

https://dars1.army.mil/IER2/

https://www.us.army.mil/suite/page/454707 Must first access Army Knowledge Online (AKO), then type in the weblink.

Communities of Practice & Special Interest Areas, which are available on the Acquisition Community Connection (ACC)

Systems EngineeringRisk ManagementData ManagementProgram ManagementEarned Value ManagementLife Cycle LogisticsScience & Technology ManagementSpectrum & E3 ComplianceEnvironment, Safety & Occupational HealthReliability, Availability, & MaintainabilityTest and EvaluationItem Unique IdentificationProduction Quality & ManufacturingInformation TechnologyJoint Rapid Acquisition

https://acc.dau.mil

Risk Management Information & Tools

The Acquisition Community Connection has a wealth of risk management information & tools, including: risk management systems, databases, analysis tools, templates.

https://acc.dau.mil/rm

The Reliability Toolkit

Publications, documents, tools http://quanterion.com/

Program Manager’s e-Tool Kit

Has information on acquisition management, leadership and managerial skills, and problem solving skills

https://pmtoolkit.dau.mil/

25

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkThe ASSIST Database

Download DoD Standards & Specifications, HAZMAT information, Data Item Descriptions (DIDs), adopted Non-Governmental Standards, links to industry & international specs & standards, DoD POCs

For example, can download:MIL-STD-810G, DoD Test Method Standard (environmental testing)

MIL-STD-882D, System SafetyMIL-STD-963B, Data Item DescriptionsMIL-HDBK-245D, Statement of Work (SOW) Preparation

MIL-HDBK-881A, Work Breakdown Structure

MIL-HDBK-502, Acquisition LogisticsMIL-HDBK-61A, Configuration Management

MIL-STD-961E, Defense & Program Unique Specifications

MIL-STD-1521B (canceled), Technical Reviews

http://assist.daps.dla.mil/ Requires password

https://assist.daps.dla.mil/quicksearch/ No password required

DoD Specifications & Standards Repository

Specifications & standards http://dodssp.daps.dla.mil

American National Standards Institute

Specifications & standards www.ansi.org

Institute for Electrical and Electronic Engineers

Specifications & standards www.ieee.org

National Standards Systems Network

Specifications & standards – search engine

http://www.nssn.org/

26

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkInternational Organization for Standardization (ISO)

Specifications & standards http://www.iso.org/iso/home.htm

Specifications & Standards Tools

Turbo SpecRite (a tool to assist in developing performance specs), and other specifications & standards tools

http://www.seaport.navy.mil/Learn/Training.aspx

The Joint Spectrum Center (JSC)

The JSC website has: An electromagnetic spectrum chart, contact information, links to numerous other websites (DoD, Services, U.S. Government, International)

http://www.disa.mil/jsc/index.html

NAVSO P-6071, Best Practices – How to Avoid Surprises During the Transition from Development to Production

Identifies potential bad consequences, and specific (proven) best practices to avoid or alleviate these consequences

http://www.dau.mil/educdept/mm_dept_resources/guidance/6071.pdf

DoD 4245.7-M, Transition from Development to Production

Provides assistance in: structuring technically sound programs, assessing program risks, identifying areas needing corrective action.

Note: DoD 4245.7 was expanded into 4 books (available from the Defense Acquisition University library):- Design to Reduce Technical Risk- Design’s Impact on Logistics- Moving a Design into Production- Testing to Verify Design and Manufacturing Readiness

www.dtic.mil/whs/directives/corres/pub1.html

http://www.dau.mil/library/

27

Resources for Test and Evaluation and Systems Engineering Professionals (August 2010 Version)

Item / Name Description / Information Web-LinkDoD IT Standards Registry (DISR)

DISR contains lists of standards, which are applicable to all DoD systems that produce, use, or exchange information. (Links to the standards organizations are provided.)

DISR was formerly called Joint Technical Architecture (JTA).

DISRonline website replaces (includes) the former JTA website. DISRonline is the electronic version of DISR / JTA.

DISRonline contains tools, questionnaires, user guides to create IT profiles

https://disronline.disa.mil/

DoD Manufacturing Technology Program – Guides and Publications

DoD Technology Readiness Assessment Deskbook

Manager’s Guide to Technology Transition in an Evolutionary Acquisition Environment

Technology Transition for Affordability: A Guide for S&T Program ManagersAdopting Commercial Practices in DoD

Defense Science & Technology Planning Documents. QDR & Transformation Planning Guidance.

https://www.dodmantech.com

TurboTPMM Technology Program Management Model

TurboTPMM is an application that can be used to manage technology development in any domain and assist in transitioning technologies to Acquisition customers.

www.TPMM.info

28