Providing Context for Reuse

Providing Context for Reuse

Ian Douglas, Ph.D.Ian Douglas, Ph.D.

Knowledge Communities Research GroupKnowledge Communities Research Group

Learning Systems InstituteLearning Systems Institute

Florida State UniversityFlorida State University

Background

• This presentation will focus on a research project conducted by the Knowledge Communities Research Group (KCRG) part of the Learning Systems Institute at Florida State University

• Project funded initially to look at analysis support technology

• Extended to look at models for future technology to support a whole system approach – Net-centric Performance Improvement (NET-PI)

• Army sponsor - Army Training Information Systems Directorate, Director Mr. Frank Polster

• Has involved collaboration with the Coast Guard and Navy performance analysis teams, and ADL Job Performance Technology Center

The problem

• How can you best use technology to increase the efficiency and effectiveness of the whole performance improvement process?

SCOs

Reuse (objects) in Current Thinking

Analysis

Construction

Deployment

Evaluation

Analysis Document

Design Document

Evaluation Document

Design

S1000D

The Technology silo problem

LMS

LMS LMS

Digital Storage

Proprietary Data Formats

ProprietaryData Formats

ProprietaryData Formats

Solution Providers

The Solution Provider (horizontal) Silo

Tech Documents

Training Human Factors

Digital Storage

Tools/methodsInfo Formats



Solution Providers

There are lots of solutions toperformance problems

– Navy Human Performance Center analysts have “seen that 83% of performance improvement issues cannot be solved with training and require other solutions.” Capt Matt Peters, reported in Performance Express newsletter

Solutions directed to the environment Solutions directed to the person

• Clear standards• Performance expectations• Timely feedback• Accurate job descriptions• Knowledge management system• Software tools• Hardware• Materials• Safe work environment• Mobile computing• Checklists• Flowcharts• Procedural manuals• Decision aids• Work samples• Process reengineering• Cultural change • Financial incentives• Non-financial incentives• Recognition programs• Benefits• Development/advancement opportunities• Documentation• Help system• Orientation• Benchmarking

• Coaching• Mentoring• Monitoring• Simulations• Training

o Instructor led instructiono Computer-based trainingo Web-based trainingo On-the-job training

• Physical capacity• Mental capacity• Emotional capacity• Selection criteria• Psychometric testing• Competencies• Leadership development• Self-motivation

Performance Approach requires a consideration of all potential interventions

The Vertical Silo

Solution Developers

Analysts Evaluators

Digital Storage




Solution Providers

Solving the Stovepipe Problem

• Technology• Culture Change• Shared databases (single point of

reference)• Standards for digital storage and access

SCORM, SD1000, CORDRA

Focus on Front-end performance analysis

Net-PI: Solving the Problem

• Focus on the required results and consider the full range of solutions

• Implement a model for a single software system for performance analysis from which all solution development must derive

• Extend this model into a complete web-based system for performance improvement

Performance approach founded on sound up-front analysis

Important Issues:

Good measures for performance are importantGap and cause analysis should not be conducted with a specific intervention in mindA full range of potential interventions should be considered

A simplified view of the front-end performance analysis process

Desired on-the-jobPerformance

Performance Gap

Actual on-the-jobPerformance

CauseAnalysis

GAP ANALYSIS

SolutionSelection

What do the best performers achieve?

What do typical performers achieve?

AOOPA: Single web-based collaborative system for front-end performance analysis

If it makes sense to have standards for digital solutions it also makes sense to have a standard for the capturing

knowledge about the performance problems the solutions are intended to address

Analysis Knowledge Repository

Equipment Procurement

Training courses

Processengineering

Tech Documents

Interface design

Web Sites

Job Aids Software Tools

Solution Repositories

Front-end Analysis

Analysis Objects: proposed core unit of shared performance analysis knowledge

Conformant with existing standardsMeta-Data

Means of accessing the digital solutions objects related to the recommended intervention

Unique IDs of solutions

Statement of a proposed intervention that is directly related to the root cause at hand.

Recommended Intervention

Statement of proposed root cause that is affecting optimal performance. Cause

Quantifiable criteria or measure for acceptable performance.Indicator

Difference between current and optimal performance.Gap Statement

The desired achievement, behavior, or output that occurs.Performance Goal

The performer that is the focus of the performance analysis process. Primary Role

DEMO

Solution Objects

Objects throughout the Processes

Front-EndPerformanceAnalysis

Construction

Evaluation

Analysis Objects

Evaluation Objects

Knowledge of why the solution object was created, whatProblems it solved and

how effective it has proved, is important

contextual knowledge

InterService Silo problem

Coast Guard

Navy <add your unit>

Digital Storage




Configurability is a key feature

• Software systems should be configured to suit the way people work

• Modern software architectures allow this possibility (by separating the data, business rules, and presentation layers)

• Our research of this issue involved the creation and evaluation of three proof-of-concept prototypes: generic, Coast Guard, and Navy prototypes

• The prototypes demonstrate how to extend a core architecture to the specific way of working in different services

Proof-of-concept prototypes

Each prototype focuses on the basic performance analysis model (gap analysis, cause analysis, and intervention selection). The specifics: look and feel, steps in the process, add-on tools terminology are customized to different user groups

Visual models of performance role and goals are used as a structure for:• Brainstorming• Data collection• Navigation

One Performance Improvement System

The stovepipe problem

Solution Developers

Analysts Evaluators

Digital Storage




One Standards-BasedEnterprise IT Support System

CORDRA based repository

Net-Centric PI

Summary

• Presentation provided an overview of a research project on technology that supports knowledge reuse and sharing throughout the organizational performance improvement

• Analysis and Evaluation Data Provide important contextual knowledge for those who might reuse an existing solution.

• The Net-PI prototype provides a working model for enterprise-level software that supports the complete management of performance

• A vision of one system of compatible tools and standards to break down all the silos

Learn more at: www.lpg.fsu.edu/KCRG/