Upload
guest789cee
View
347
Download
2
Embed Size (px)
Citation preview
2007 Fall Simulation Interoperability Workshop
The GM V&VUser’s Manual
Constantinos Giannoulis
2007 Fall Simulation Interoperability Workshop
Presentation Overview
• Introduction
• A top level view of the GM V&V methodology.
• Designing a VV&A Organization.
• The GM V&V Activity Model.
• Tailoring the GM V&V.
• Return of experiment.
2007 Fall Simulation Interoperability Workshop
The GM V&V User’s Manual
• Offers prescriptive guidance to the individual responsible for the VV&A effort.
• Describes the concepts and procedures to be followed.
• Focuses on assisting the individuals responsible for planning and managing of the VV&A effort.
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
The GM V&V Activity Model
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
• The three pillars.
• Issues to be addressed.
• The three layers.
• The conceptual model.
Top level view of the GM V&V methodology
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
The GM V&V Activity Model
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
• Organization.
• Processes.
• Products.
Process
OrganisationGoals
Objectives
Goals
Objectives
Goals
ObjectivesProducts
Top level view of the GM V&V methodology
Introduction
Top level view of the GM V&V methodology
•The three pillars•Issues to be addressed•The three layers•The conceptual model
Designing a VV&A Organization
The GM V&V Activity Model
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
• Problem formulation.
• Feasibility of VV&A project.
• The ”non-refutation principle”.
• Tailoring.
• Communication of the outcomes.
• Consolidation of project knowledge (return of experiment).
• VV&A of M&S uses vs. VV&A during M&S development.
Top level view of the GM V&V methodology
Introduction
Top level view of the GM V&V methodology
•The three pillars•Issues to be addressed•The three layers•The conceptual model
Designing a VV&A Organization
The GM V&V Activity Model
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
• Acceptance layer.
• V&V layer.
• Evidence layer.
Top level view of the GM V&V methodology
Introduction
Top level view of the GM V&V methodology
•The three pillars•Issues to be addressed•The three layers•The conceptual model
Designing a VV&A Organization
The GM V&V Activity Model
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
Top level view of the GM V&V methodology
Introduction
Top level view of the GM V&V methodology
•The three pillars•Issues to be addressed•The three layers•The conceptual model
Designing a VV&A Organization
The GM V&V Activity Model
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
Designing a VV&A organization
• Parties & roles.
• Levels of Organization.
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
The GM V&V Activity Model
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
Designing a VV&A organization
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
•Parties & roles•Levels of organization
The GM V&V Activity Model
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
Designing a VV&A organization
Acceptance Leader V&V LeaderV&V Information
Providers and Executioners
SV&V Not explicitly assigned Supplier Supplier
IA Customer or 3rd Party Supplier Supplier
IV&V Customer or 3rd Party 3rd Party 3rd Party
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
•Parties & roles•Levels of organization
The GM V&V Activity Model
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
Designing a VV&A organization
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
•Parties & roles•Levels of organization
The GM V&V Activity Model
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
Purpose-Impact
Problem world
M&S baseReferent knowledge
Corporate Memory
VV&A knowledge base
Project Memory
VV&A Needs
Develop V&V criteria
Plan V&V
V&VPlan
Gather and assess
VV&A information
Items ofEvidence
VV&A world
UtilityRisks
Assess the VV&A needs achievement
Assess theValidity and Correctness
V&V Report
DevelopAcceptance
Criteria
AcceptancePlan
Decision
Acceptance Report
The GM V&V Activity Model
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
The GM V&V Activity Model
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
The GM V&V Activity Model
• High level guidance.
• Activities & Products.
• The pragmatics.
• The project memory.
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
The GM V&V Activity Model
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
The GM V&V Activity Model
• M&S products considered
• M&S products’ views
• Properties required & assessed
• Flow of activities
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
The GM V&V Activity Model
•High level guidance•Activities & products•The pragmatics•The project memory
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
The GM V&V Activity Model
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
The GM V&V Activity Model
•High level guidance•Activities & products•The pragmatics•The project memory
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
The GM V&V Activity Model
• Develop Acceptance Criteria → Acceptance Plan
• Develop V&V Criteria & Plan V&V → V&V Plan
• Gather & Assess VV&A Information → Items of Evidence
• Assess Validity & Correctness → V&V Report
• Assess the VV&A needs’ achievement → Acceptance Report
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
The GM V&V Activity Model
•High level guidance•Activities & products•The pragmatics•The project memory
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
The GM V&V Activity Model
• Feasibility analysis
• Handling modifications
• Communicating the results
• Evaluating the consequences
• Gathering raw data
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
The GM V&V Activity Model
•High level guidance•Activities & products•The pragmatics•The project memory
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
The GM V&V Activity Model
• Purpose
• Usage
• Communication
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
The GM V&V Activity Model
•High level guidance•Activities & products•The pragmatics•The project memory
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
Tailoring the GM V&V Model
• VV&A project constraints.
• Tailoring guidance.
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
The GM V&V Activity Model
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
Tailoring the GM V&V Model
• Intended purpose
• Budget
• Time
• Risks
• Skills
• Tools
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
The GM V&V Activity Model
Tailoring the GM V&V•VV&A project constraints•Tailoring guidance
Return of experiment
2007 Fall Simulation Interoperability Workshop
Tailoring the GM V&V Model
• The process
• The organization
• Selecting suitable techniques
• Experimental frame
• Application domain
• Model abstraction
• Outcomes
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
The GM V&V Activity Model
Tailoring the GM V&V•VV&A project constraints•Tailoring guidance
Return of experiment
2007 Fall Simulation Interoperability Workshop
Return of Experiment
• Qualitative assessment.
• Quantitative assessment.
Introduction
Top level view of the GM V&V methodology
Designing a VV&A Organization
The GM V&V Activity Model
Tailoring the GM V&V
Return of experiment
2007 Fall Simulation Interoperability Workshop
The GM V&VUser’s Manual