16a Guard and Response Performance TestingLevel I 13 Performance Testing: Guard and RFs Mission Drills • Considered rehearsals for Limited Scope Performance Tests • Used to Maintain

The Twenty-Sixth International Training CoursePage 1

16 –Performance Testing – Guard/Response Forces

16 . Pe r fo rmance Tes t i ng : Gua rd and Response Fo r ces

October 24 – November 11, 2016Albuquerque, New Mexico, USA

Bud Siple

Performance Testing: Guard and RFs

Learn ing Object ives

After completing this module, you should be able to:• Recognize performance testing recommendations from

INFCIRC/225/Rev.5• Identify purpose and importance of guard/response

testing program• Provide an overview of what guard/response

performance testing program must accomplish• Recognize performance measures for guard/response

force• Recognize three levels and associated tests of guard/

response performance testing

2




Gu idance on Per formance Test ing ( INFCIRC/225/Rev.5)• Evaluations, including performance testing, of the

physical protection measures and of the PPS, including timely response of the guards and response forces, should be conducted regularly to determine their reliability and effectiveness

• Evaluations include exercises to test integrated system, including training and readiness of guards and response forces

• Operator should develop and implement means and procedures for evaluations, including performance testing and maintenance of the PPS

3


Performance Test ing Program

• Response performance testing is part of an overall performance testing program

• Must be developed to: Validate the performance of response protection elements Ensure that response protection elements are performing as

designed Test response elements whose failure would reduce protection to

unacceptable levels Conduct at a frequency to achieve high level of confidence in the

reliability of the element Establish a documented performance testing process

4




Purpose

• Performance testing is a means to realistically test the effectiveness of response force programs

• Tests performance of People (response force, guards, emergency services) Equipment (weapons, vehicles, body armor) Procedures (response, entry control, CAS)

• Performance testing considers the following areas: Planning (Chain of command; area knowledge) Tactics (Cover and concealment; weapons limitations) Training (Protected targets; adversary scenarios) Practice (Maintain skills; Contingency plans)

5


Performance Test ing Methodology

• A combination of performance testing is used to evaluate performance of guard/response force

• Grouped into two categories: Subsystem Performance Testing Whole System Performance Testing

6



Subsystem Performance Test ing

Subsystem performance testing narrowly focuses on the performance and effectiveness of either part of a whole system or an individual component of the guard/response force function

Used to determine whether: Guard and response procedures are effective Personnel understand and follow the procedures Personnel and equipment interact effectively

Tests individual components of the whole system


7


Leve ls of Performance Test ing

• Subsystem Performance Testing Level I

• Time Motion Studies • Limited Scope Performance Test

Level II• Mission Drills (To demonstrate sustainability)• Alarm Response Assessments Performance Test

Level III• Enhanced Limited Scope Performance Test

• Each level Becomes more complex to conduct Consists of specialized controller / evaluator training

8




Contro l ler / Evaluator Roles

Controllers: People responsible for enforcing rules of engagement, safety rules, and other control measuresEvaluators: People responsible for observing and documenting exercise activities and conditions• Controllers and evaluators should be specifically trained

for each type of test Ensure all safety and security requirements are met Maintain an environment free of hazards associated with each

test and method

9


T ime Mot ion Studies

• Considered foundation for the response element Tests ability of responders to arrive at a designated response

point by a required time Determines and validates required response times for arrival at

various response locations (as derived from a response plan)

• Large number of studies should be conducted for each tactical position to quantitatively justify the average response time per position

Level ILevel I

10




T ime Mot ion Study “How i t Works”

• Time begins at the responder’s origination point and is measured to the dedicated response point

• Included in the overall response time: Donning all required equipment and firearms Traveling or traversal time Entering through entry gates, doors, or other type of barriers

Total Response Time

Level ILevel I

11


L imited Scope Performance Tests

• Narrow focus on performance and effectiveness of a subset of response elements

• Used to Determine or verify that the tested response elements work

together Determine level of a security force’s skill or capability Validate possession of a requisite knowledge or skill to perform a

specific task Validate the individual human element in the PPS

• Continuous process to validate probabilities documented in the vulnerability analysis

Level ILevel I

12




L imited Scope Performance Test “Example”Handheld Metal Detector Start-Up No Yes

Did guard turn-on the detector and conduct operability test? Power up the detector away from the area where the inspection is to be performed,

with the detector end away from the body. Touch and hold the power pad. Release the power button after the monitor beeps.

Unauthorized Contraband Inspection using Handheld Metal Detector Did guard instruct person to stand with feet apart at shoulder width and arms extended out to each side?

Did guard scan person’s entire body with bottom of detector facing subject 5 to 10 cm (2 to 4 inches) from person?

Did guard first perform an inverted “U” type scan on the front side of person: Start at either of the person's feet Scan up same side of the body including arm and sides of neck to the top of the

head Search other side and scan the body in same manner scanning down other foot

Did guard instruct person to turn around and repeat the same inverted “U” type scanning the back surface of the individual?

Did the guard scan all hand-carried packages and containers? Finding Unauthorized ContrabandIf unauthorized contraband is found, did the guard detain the person and notify the Guard Supervisor?

Level ILevel I

13


M iss ion Dr i l l s

• Considered rehearsals for Limited Scope Performance Tests

• Used to Maintain sustainability Train for Limited Scope Performance Tests Train the Trainer (Supervisors) Determine the level of a security force’s skill or capability Reinforce the level of a security force’s skill or capability

• Practice before you Play!

Level IILevel II

14




M iss ion Dr i l l “Example”

Handheld Metal Detector Start-Up No Yes

Instruct guard how to turn-on the detector and conduct operability test Power up the detector away from the area where the inspection is to be performed,

with the detector end away from the body. Touch and hold the power pad. Release the power button after the monitor beeps.

Unauthorized Contraband Inspection using Handheld Metal Detector Instruct guard how to instruct person to stand with feet apart at shoulder width and arms extended out to each side

Instruct guard how to scan person’s entire body with bottom of detector facing subject 5 to 10 cm (2 to 4 inches) from person

Instruct guard how to first perform an inverted “U” type scan on the front side of person: Start at either of the person's feet Scan up same side of the body including arm and sides of neck to the top of the head Search other side and scan the body in same manner scanning down other foot

Instruct guard how to instruct person to turn around and repeat the same inverted “U” type scanning the back surface of the individual

Instruct guard how to scan all hand-carried packages and containers Finding Unauthorized ContrabandInstruct guard how to detain a person and notify the Guard Supervisor when unauthorized contraband is found

Level IILevel II

15


A la rm Response and Assessment Per formance Tests• Tests response force readiness and response to an alarm at a

specific location• Measures specific performance actions:

Communications Personnel protective measures Equipment availability and serviceability Coordination activities Tactical movement

• Tests are “no notice” performance tests • Must be coordinated with facility representatives so that

Safety requirements are met Security is not compromised Disruption to operations is limited

Level IILevel II

16




A la rm Response and Assessment Per formance Tests “How I t Works”Picture In Time: A representation of response force patrol locations at a specific time.

Create a Picture In Time Position controllers with selected security force according to the Picture In Time A controller will intentionally simulate a breach at a designated alarm point to

stimulate the security force response Each controller evaluates the response and documents results

Level IILevel II

17


Enhanced L imited Scope Performance Test

• Modified Force-on-Force exercise minimizing resources Multiple Integrated Laser Engagement System or inert weapon

systems is required Ensures security personnel know how to respond according to

their contingency plans Parts of detection, delay, and response functions are tested

against fictitious yet credible adversary attack Ensures personnel are trained in command and control;

communications; tactics; equipment; and weapons Uses adversary scenarios from DBT with reduced adversaries

Level IIILevel III

18




Enhanced L imi ted Scope Per formance Test“How I t Works”• Create a Picture in Time• Position controllers with selected guard, response force, and adversary role

player(s)• Minimum of one adversary will intentionally trip a sensor to simulate a

breach at a designated alarm point to initiate the security force response• Each controller evaluates the response and documents results

Adversary Time Line

Level IIILevel III

19


Whole System Performance Test ing

• Testing sections of the whole system Ensure individual components work together Evaluate the overall performance of the PPS

• Two performance measure criteria are evaluated: Interruption – The successful arrival of the response force at an

appropriate location to stop the adversary Neutralization – When the response force kills, captures, or causes

the adversary to flee before the adversary can complete the task

• Types of simulation methods to evaluate overall PPS performance Tabletops Computer Simulations Force-on-Force

20




Tabletop Exerc ise

• Method of simulating an adversary attack on a site’s existing or proposed PPS

• Analyzes PPS Functions (Detection, Delay, Response)• Provides insight into a PPS that can stand alone or be

used in other analysis tools Evaluation Team

Protective

Force

Adversary Team

ExerciseModerator

SiteMap

21


Computer S imulat ions

• Computer simulation of small force engagement• Used to

Determine effectiveness for tactical movement, weapon and explosive calculations, etc.

Provide real-time results of engagements between the response force and an adversary

Determine probabilistic PH/PK calculations

22




Force-on-Force Exerc ise

Force-on-Force Exercise: A performance test of the physical protection system that uses designated personnel in the role of an adversary force to simulate an attack consistent with the threat or the design basis (IAEA INFCIRC/225/Rev.5)• A full-scale field simulation of an attack on a site

involving all onsite guards and response forces

23

Whole System Data Points• Methods concurrently determine two types of data PE for a PPS Guard and response force subsystem performance testing

data

Tabletops Force on Force ComputerSimulations

PE

Subsystem Data•Rules of engagement•Poor tactics•Poor communication

Subsystem Data•Chain of command•Equipment failure•Lack of knowledge of contingency plan

Subsystem Data•Training issues•Poor tactics•Poor communication


24




Summary

• Performance Testing is a means to realistically test the effectiveness of guard/response force programs

• Ensures that guard/response protection elements are performing as designed and provide the required protection level

• Subsystem and whole system performances tests are used to evaluate the performance of the guard and response force functions

• Three levels of response performance testing Level I: Time Motion Studies and Limited Scope Performance Tests Level II: Mission Drills and Alarm Response and Assessment

Performance Tests Level III: Enhanced Limited Scope Performance Tests

25

Documents

16a Guard and Response Performance TestingLevel I 13 Performance Testing: Guard and RFs Mission Drills • Considered rehearsals for Limited Scope Performance Tests • Used to Maintain