Military Police Host Nation Policing Simulation: A Case Study into Designing Experiential Games to...

Amy MorrisonDirector, Software DevelopmentJoy PachuckiInstructional DesignerRon PunakoSoftware Engineer June 16, 2011

Military Police Host Nation Policing Simulation: A Case Study into Designing Experiential Games to Meet

Instructional Objectives

CTC Overview

• 501(c)(3) nonprofit established in 1987• Staff of 1,400+ professionals• More than 50 locations• 900,000 sq. ft., including labs & demonstration space• Top 100 Government Contractor • Quality/EH&S Management System comprised of industry-

best models: ISO 9001 (Quality) and 14001 (Environmental), AS9100 (Aerospace), and CMMI-SE/SW (Systems/Software Engineering)

• Nationally recognized security capabilities with 300,000+ sq. ft. of Top Secret/Sensitive Compartmented Information Facility Space, JWICS, SIPRNet, and NIPRNet access

• Award-winning education and training solutions team

• Human Capital Strategic Planning

• Curriculum and Content Development and Distribution

• Learning, Education and Training Assessment and Evaluation

• Learning Technologies

• Modeling, Gaming and Simulation

• Knowledge Engineering

• Collaborative Environments

• Exercise Support

Learning and Human Performance Solutions

BackgroundProgram goals

Counter Insurgency (COIN) & Stabilization, Security, Transition, and Reconstruction Operations (SSTRO)

Overall goal: Develop a training exercise that enables learners to evaluate the security posture of a host-nation police station and build rapport with the host-nation police force.

BackgroundStakeholders

• Army Research Laboratory (ARL)

• Leonard Wood Institute (LWI)

• US Army Military Police School (USAMPS)

BackgroundAudience profile

BackgroundDevelopment challenges

• Easily operable / no training time

• Train students who have finished Police Transition Team and Police Mentorship Team Training

• Continue with Virtools or move to Unity?

• Small time frame and budget

BackgroundKey development facts

• 2009-2010 prototype

• Development time 6 months

• Rebuilt Virtools REAL engine and SAT in Unity– Unity received Certificate of Networthiness from Army &

Air Force in May

• Designed and implemented scenario

• Small team

BackgroundWhat kind of team?

• Artists

• Modelers/Animators

• Information Architects

• Instructional Designers

• Integrators

• Program/Project Manager

• Software Engineers

• Sound Engineer

• Subject Matter Experts

• Video Engineer

• Voice Actors

• Writers

BackgroundSolution system

Learners experience realistic environments, characters and cultural contexts

Learners explore a virtual host nation police station

A supporting cast of characters influence the learner

Learners investigate and make decisions regarding station security while building rapport

Learners make challenging decisions

Learners progress through a scenario event sequence

Feedback and after action reviews enable reflection on performance

Learners receive just-in-time performance feedback

Learner performance is scored

Learner makes a choice Score is averaged by objective and recoded

Final score is averaged across objective scores

 Objective 1: 50%Objective 2: 100%…

 Final: 75%1. Choice A

2. Choice B3. Choice C

Learner makes a choice Feedback is recorded by objective.

Feedback is provided to learner

 Objective 1: Good Job! …

 Good Job! You chose choice A. Choice A was best because…

1. Choice A2. Choice B3. Choice C

Quantitative

Qualitative +

Systems Development Life Cycle

22

Systems Development Life CycleAnalysis

• Project Planning– Initial Client Meetings

• Instructional Intent– Assess Training Needs– Determine Training

Solution

• Client Requirements

• Technical Specifications Identified and Analyzed

EngineeringRequirements development and management

Use Case

Client Requirement Derived

Requirement

Test Case

TRACEABILITY & PROCESS VISIBILITY

“The player makes decisions through dialogue with Non-Player Characters (NPC).”

“The simulation shall enable the learner to progress through making decisions.” “The simulation shall provide the capability

to respond to character dialogue.”

“PASS: The simulation enables the learner to progress through making decisions.”

24

Systems Development Life CycleDesign

• Concept Paper Development

• Simulation Course Outline

• Screenplay Development

• Initial Product Asset Development

• Technical System Design

Systems Development Life CycleDesign Continued

EngineeringDesign

Technical SolutionArt PlanInformation Architecture

27

Systems Development Life CycleDevelopment

• Text Simulation Development

• Asset Development

• Product Development

EngineeringDevelopment

Game EngineScenario

Authoring Tool

Sound Subsystem

Animation Subsystem

Event Sequencing Subsystem

Notification Subsystem

Lipsync Subsystem

UI/Menu Subsystem

ScoringSubsystem

Character AI Subsystem

REAL

EngineeringDevelopment

Scenario Integration

with Authoring Tool

Asset Development

SoundVideo

Models & Animation

Event Sequence

Scoring

SoundVideo

Models & Animation

Event Sequence

Scoring

Scenario

30

Systems Development Life CycleImplementation

• Verification for adherence to instructional specifications

• Final product installation

• Validation testing and discrepancies resolved

• Product training conducted

• Final review and acceptance

EngineeringVerification testing

ID: TST1 Prerequisites: 1. The system must be started 2. The simulation subsystem must be

started

Actions: 1. NPC engages the learner’s character

in dialogue 2. Learner attempts to select a dialogue

response

Outcome: 1. Pass: The learner is able to select a

response to character dialogue 2. Fail: The learner is not able to select a

response to character dialogue

Trace toDerived

Requirement

“The simulation shall provide the capability to respond to character dialogue.”

32

Systems Development Life CycleEvaluation

• Evaluation tasks directly planned in support of individual efforts, if applicable, would apply to each part of the process

33

Direct outcomes from challenges

• Rebuilt REAL system and developed exercise in 6 months

• REAL enabled rapid development of the MPHNP exercise

• Employed information architecture for easily operable training

• Employed sound development processes

34

Other results

• Visual representation of structured training for rapid development

• Teams build small simulations in a few weeks

• Savings vs. traditional development

Questions and Comments

Contact Information

Amy Morrison(814) 269-2879morrisoa@ctc.com

Joy Pachucki(814) 269-2833pachuckj@ctc.com

Ron Punako(814) 269-6538punakor@ctc.com

Conclusion and Hands-on Demo

REAL Video

(http://www.youtube.com/user/ConcurrentTechCorp#p/u/0/27QMKTeWk8c)

Putting ideas into action.SM

1-800-CTC-4392www.ctc.com