15
2007 Fall Simulation Interoperability Workshop GM VV DG meeting, Sept. 18th 2007 GM-V&V Reference Manual Overview René Jacquart GM-V&V DGE

Ref Man For Vva Fall 07 D Gmeeting

Embed Size (px)

Citation preview

Page 1: Ref Man For Vva Fall 07 D Gmeeting

2007 Fall Simulation Interoperability WorkshopGM VV DG meeting, Sept. 18th 2007

GM-V&V Reference Manual Overview

René JacquartGM-V&V DGE

Page 2: Ref Man For Vva Fall 07 D Gmeeting

2007 Fall Simulation Interoperability WorkshopGM VV DG meeting, Sept. 18th 2007

GM-V&V Documentation Structure

RefMan

Why? What? For whom?

RationaleDefinitionsConceptsComponents

How? When? Who?

RolesResponsibilitiesProcessActivities

Method Basics& Architecture

Method Utilisation & Deployment

Specific Task oriented

Specific Product oriented

Method Implementation& Execution

Detailed DescriptionParticular ActivitiesParts of ProcessSpecific Roles

Product SpecificationTechniques Tools

UserMan

RPG

TN

Page 3: Ref Man For Vva Fall 07 D Gmeeting

2007 Fall Simulation Interoperability WorkshopGM VV DG meeting, Sept. 18th 2007

Part 1: Concepts

Page 4: Ref Man For Vva Fall 07 D Gmeeting

2007 Fall Simulation Interoperability WorkshopGM VV DG meeting, Sept. 18th 2007

GM-VV Methodology Rationale

• VV&A Vision• Assessment of Confidence in the Use of M&S Products and Results

• Address and Support for VV&A Issues

• M&S Problem Owner

• M&S Sponsor

• VV&A Project Manager

• V&V Executioners

Page 5: Ref Man For Vva Fall 07 D Gmeeting

2007 Fall Simulation Interoperability WorkshopGM VV DG meeting, Sept. 18th 2007

GM-V&V Methodology ContextScope and Position within the “Four World" View

Real World

ObjectivesNeeds

DecisionsActions

Problem Statement

Problem Solution

M&S Questions

M&S Answers

SystemRequirements

M&S Enabling Products

Problem World M&S World Product World

GM-V&V Addresses

Page 6: Ref Man For Vva Fall 07 D Gmeeting

2007 Fall Simulation Interoperability WorkshopGM VV DG meeting, Sept. 18th 2007

• M&S supplier skills and reputation

• Audit trail of experiments and uses

• Formal analysis of products, processes And organisation

VV&AInformal

Formal

GM-V&V Methodology ContextVV&A Focuses on Justification of Trust

Trust

Page 7: Ref Man For Vva Fall 07 D Gmeeting

2007 Fall Simulation Interoperability WorkshopGM VV DG meeting, Sept. 18th 2007

Goals

Products Organisation

Process

• Basic Project Management Concept

• Used for Methodology Design:

• Identifies the Components & Relations

• Organization of VV&A Project

• Guidance for Assessment of M&S

GM-V&V Methodology Context Builds upon the “Three Pillars" Concept

Page 8: Ref Man For Vva Fall 07 D Gmeeting

2007 Fall Simulation Interoperability WorkshopGM VV DG meeting, Sept. 18th 2007

FormalFormalAnalysisAnalysis

Acceptance

Utility?

Validity?

Correctness?

VV&A « observables »

Goals

GM-V&V Methodology Context Trust Justification Concept

(M&S)

Organisation

(M&S)

Products

(M&S)

Process

Page 9: Ref Man For Vva Fall 07 D Gmeeting

2007 Fall Simulation Interoperability WorkshopGM VV DG meeting, Sept. 18th 2007

• Utility

•MoE-MoP, MAUT,…

• Validity and Correctness

• Problem Frames (M. Jackson, Pamela Zave,…)

• Systems Theory (Arbib, Klir, Zeigler,..)

• Meta-properties:

• Relevance, completeness, reliability, independance,…

GM-V&V Methodology Context Trust Justification Theories

Page 10: Ref Man For Vva Fall 07 D Gmeeting

2007 Fall Simulation Interoperability WorkshopGM VV DG meeting, Sept. 18th 2007

Validity Correctness

UtilityReferent Simulation Execution Model

Simulation Model

Cost /Benefit

s

M&SIntended purpose

Risks

GM-V&V Methodology ComponentsElementary Building Blocks

Acceptance(Decision)

Evidence-Based Argumentation

Supported by

Evidence:

Completeness

Relevance

Independence

Reliability

Well-Balanced

Etc….

VV&A Project

Needs &

Constraints

Page 11: Ref Man For Vva Fall 07 D Gmeeting

2007 Fall Simulation Interoperability WorkshopGM VV DG meeting, Sept. 18th 2007

GM-V&V Methodology ComponentsVV&A Project Organization

GM-V&V

Products

Role Party

GM-V&V Process Activities

Performed by

Actor

Member ofPlays

Responsible for

Customer

Supplier

3rd Party

Problem Owner

Acceptance Leader

V&V Leader

V&V Executioner

VV&A Project Manager

Page 12: Ref Man For Vva Fall 07 D Gmeeting

2007 Fall Simulation Interoperability WorkshopGM VV DG meeting, Sept. 18th 2007

GM-V&V Methodology ComponentsVV&A Products & Activities

M&S Purpose

Impact & Cost

Decision Utility & Risks

M&S Corporate Memory

VV&AProject Memory

Develop V&V criteria and

plan V&V

Gather and assessVV&A information

Assess thevalidity and correctness

Assess the VV&A needs achievement

DevelopAcceptance

Criteria

V&V Report

Acceptance Report

Acceptance Plan

V&V Plan Items of

Evidence

VV&A Needs

Page 13: Ref Man For Vva Fall 07 D Gmeeting

2007 Fall Simulation Interoperability WorkshopGM VV DG meeting, Sept. 18th 2007

GM-V&V Methodology CompliancyRequirements

• Adopting the Core Concepts of Acceptance (N,U,V,C & ME) and Evidence-Based Argumentation

• Realisation of VV&A Project Organisation based on GM-V&V Organisation Components

• Implementation & Execution of the Actual VV&A Process based on GM-V&V Activity Model

• Production of the Core GM-V&V Products• Acceptance Plan & Report• V&V Plan & Report• Items of Evidence

• Documentation and Exchange of all VV&A Process Information according the GM-V&V Project Memory Concept and Templates

Page 14: Ref Man For Vva Fall 07 D Gmeeting

2007 Fall Simulation Interoperability WorkshopGM VV DG meeting, Sept. 18th 2007

Part 2 : Text

Page 15: Ref Man For Vva Fall 07 D Gmeeting

2007 Fall Simulation Interoperability WorkshopGM VV DG meeting, Sept. 18th 2007

• 1INTRODUCTION

• 2 REFERENCES

• 3 DEFINITIONS

• 4 ACRONYMS AND ABBREVIATIONS

• 5 THE METHODOLOGY RATIONALE

• 6 METHODOLOGY CONCEPTUAL TOOLS

• 7 METHODOLOGY COMPONENTS

• 8 REQUIREMENTS FOR COMPLIANCE

• Appendix 1: Conceptual Model of Entities and Relations underlying the GM V&V methodology

GM-V&V Reference Manual

Table of Contents