TECH 50800 Project JagWaRz Administrator Console Measure Phase
October 29, 2014 Vicky L. Smith
Slide 3
Brief Review of Project Charter Business Case: Connie Justice,
the project Champion, is course coordinator for most the networking
and information security courses in CIT. She wants to get this tool
implemented within the curriculum by the Fall semester 2015.
Problem: During the testing of JagWaRz, administrators reported
dissatisfaction with the usability of the administrator console.
They felt it took too much time and effort to set up or modify a
game. Goal: Improve the administrator console by 4-01-15 to the
point where 75% of instructors agree to implement the tool in the
classroom. Process Boundaries: The process starts when an
administrator creates a new game construct. The process includes
creating a game, adding challenges to a game, editing challenges,
and re-ordering challenges. The process stops when game and
challenge creation or modification is complete.
Slide 4
SIPOC
Slide 5
CTQ Tree(s) CustomerCTQKPOVKPIV Database Structure Add
ChallengesCode Functionality User Interface Living Lab Staff
Database Structure Ease of UseEdit ChallengesCode Functionality
User Interface CIT Instructors Database Structure Reorder
ChallengesCode Functionality User Interface
Slide 6
Process Map
Slide 7
Process Observation Worksheet TIME OBSERVATIONS Date:
Process:Create and Modify JagWaRz Game Observer:
StepDescription12345678910 1Create Game 2Add Access Control
Challenge 1 3Add Attack Exploitation Challenge 2 4Add Wireshark
Challenge 3 5Add Maltego Challenge 2 6Add Nmap Challenge 1 7Add
Access Control Challenge 3 8Edit Attack Exploitation Challenge 2
9Edit Maltego Challenge 2 10 Insert Attack Exploitation Challenge 3
in 3rd Slot & reorder challenges below 11 Insert Attack
Exploitation Challenge 2 in 5th Slot & reorder challenges below
Total Time for 1 Cycle (Minutes)
Slide 8
Data Collection Plan
Slide 9
Measurements Time to create a game Time to add a challenge Time
to edit a challenge Time to insert a challenge and reorder
remaining challenges Sampling 11 Step protocol developed to test
those items being measured Observer: Vicky Smith Measurements
measured in minutes and seconds Sampling frequency irrelevant One
measurement will be collected from each participant
Slide 10
Data Collection TIME OBSERVATIONS Date:10/28/2014Process:Create
and Modify JagWaRz Game Observer:Vicky Smith
StepDescription12345678910 1Create Game3:003:12 2Add Access Control
Challenge 12:453:18 3Add Attack Exploitation Challenge 22:152:54
4Add Wireshark Challenge 32:452:23 5Add Maltego Challenge 22:201:35
6Add Nmap Challenge 12:152:35 7Add Access Control Challenge
33:002:57 8Edit Attack Exploitation Challenge 22:322:47 9Edit
Maltego Challenge 22:221:18 10 Insert Attack Exploitation Challenge
3 in 3rd Slot & reorder challenges below17:2916:29 11 Insert
Attack Exploitation Challenge 2 in 5th Slot & reorder
challenges below9:578:25 Total Time for 1 Cycle
(Minutes)50:4047:53