12
Simulators for Training: Assessment, Validation, and Acceptance Strategies The Human Patient Simulator™ Medicine Meets Virtual Reality January 25, 2003 Ron Carovano

Simulators for Training: Assessment, Validation, and Acceptance Strategies The Human Patient Simulator™ Medicine Meets Virtual Reality January 25, 2003

Embed Size (px)

Citation preview

Page 1: Simulators for Training: Assessment, Validation, and Acceptance Strategies The Human Patient Simulator™ Medicine Meets Virtual Reality January 25, 2003

Simulators for Training:

Assessment, Validation, and

Acceptance Strategies

The Human Patient Simulator™

Medicine Meets Virtual Reality

January 25, 2003

Ron Carovano

Page 2: Simulators for Training: Assessment, Validation, and Acceptance Strategies The Human Patient Simulator™ Medicine Meets Virtual Reality January 25, 2003

This document is proprietary and shall not be used or disclosed without the consent of METI 2

Overview

Needs

History

Pacing Technologies

User Experience

Assessment, Validation, and Acceptance

Emerging Concepts and Developments

Ongoing Challenges

Page 3: Simulators for Training: Assessment, Validation, and Acceptance Strategies The Human Patient Simulator™ Medicine Meets Virtual Reality January 25, 2003

This document is proprietary and shall not be used or disclosed without the consent of METI 3

Needs Challenges of the Apprenticeship Approach

Time is fixed, learning is variable

Limited access to patients in the clinical setting

Focus on patient care, rather than learning

Education and Training Initial

Refresher

Sustainment

Operational Levels Individual clinicians

Clinical teams

Healthcare system

Test and Evaluation Objective performance measurement

Operational test and assessment

Event rehearsal

Page 4: Simulators for Training: Assessment, Validation, and Acceptance Strategies The Human Patient Simulator™ Medicine Meets Virtual Reality January 25, 2003

This document is proprietary and shall not be used or disclosed without the consent of METI 4

Brief History

1969 Sim One Anesthesia Simulator, University of Southern California

1987 Anesthesia Simulators Reborn, University of Florida and Stanford University

1993 Simulation for Health Sciences Programs, State of Florida Department of Education

1994 Commercialization of Patient Simulation, Loral Corp. and CAE Link Corp.

1997 Combat Trauma Patient Simulation (CTPS) Program, US Army STRICOM

1999 PediaSim™ Pediatric Patient Simulator, METI

2001 CTPS Test and Evaluation, Fort Gordon, Georgia

2002 Emergency Care Simulator (ECS), METI

2003 Simulator-based Field Casualty Drills, Louisiana Office of Emergency Preparedness

Page 5: Simulators for Training: Assessment, Validation, and Acceptance Strategies The Human Patient Simulator™ Medicine Meets Virtual Reality January 25, 2003

This document is proprietary and shall not be used or disclosed without the consent of METI 5

Pacing Technologies Mannequin

Anatomy

Clinical signs

Monitored parameters

Haptics and End-effectors Technologies that bring the simulation to life

Palpable pulses, breathing, pupil dilation

Models Mathematical models of physiology and pharmacology

Physical models (e.g., pulmonary gas exchange)

Software Instructor operation

Scenario generation

After-action review

System Operational configuration

Computer hardware and operating systems

Communications, data acquisition and control

Page 6: Simulators for Training: Assessment, Validation, and Acceptance Strategies The Human Patient Simulator™ Medicine Meets Virtual Reality January 25, 2003

This document is proprietary and shall not be used or disclosed without the consent of METI 6

User Experience

World-Wide Simulator Installations

Over 300 HPS’s

Over 80 PediaSim’s

Over 50 ECS’s

User Site Distribution

72 Domestic Medical Schools

74 International Medical Schools

72 Nusing and Health Sciences Schools

71 Government and Military Sites

Hundreds of academic publications

Thousands of student learning experiences

Page 7: Simulators for Training: Assessment, Validation, and Acceptance Strategies The Human Patient Simulator™ Medicine Meets Virtual Reality January 25, 2003

This document is proprietary and shall not be used or disclosed without the consent of METI 7

Assessment, Validation, and Acceptance

User Acceptance Indicative of a High Level of Face Validity for Education and Training

Schwid, H.A. (2002, December) Evaluation of Anesthesia Residents Using Mannequin-

based Simulation. Anesthesiology. V 97. No 6. 1434-1444. Construct validity supported by improvement in performance from CB and CA-1 to CA-2 and CA-3 levels of

training

Criterion validity supported by correlation of simulator scores with faculty evaluations (P < 0.01, ABA written

in-training scores (P < 0.01), and departmental mock oral board scores (P < 0.01)

Reliability demonstrated by very good internal consistency ( == 0.71-0.76) and excellent inter-rater reliability

(P < 0.01)

Holcomb, J.B., Dumire, R.D. (2002) Evaluation of Trauma Team Performance Using an

Advanced Human Patient Simulation for Resuscitation Training. Journal of Trauma

Injury, Infection, and Critical Care. 52, 1078-1086.

Partners Healthcare, Boston, Massachusetts Anesthesiologists benefited from reduced cost in malpractice insurance upon completion of anesthesia crisis

resource management simulation program

Page 8: Simulators for Training: Assessment, Validation, and Acceptance Strategies The Human Patient Simulator™ Medicine Meets Virtual Reality January 25, 2003

This document is proprietary and shall not be used or disclosed without the consent of METI 8

Emerging Concepts and Developments

Operational Healthcare System Readiness

Disaster Response

Bioterrorism

Tactical Medicine

Mass Casualty Events

Test and Evaluation

Tool for design and test

Measures of performance and effectiveness

Objective, criterion-based assessment

Credentialing and Certification

Predictive Validity

Page 9: Simulators for Training: Assessment, Validation, and Acceptance Strategies The Human Patient Simulator™ Medicine Meets Virtual Reality January 25, 2003

This document is proprietary and shall not be used or disclosed without the consent of METI 9

Ongoing Challenges

Advance Simulation Beyond Training

Apply the Science of Simulation:

Verification, Validation, and Accreditation

Balance Needs, Technology, and Cost

QuickTime™ and aCinepak decompressor

are needed to see this picture.

Page 10: Simulators for Training: Assessment, Validation, and Acceptance Strategies The Human Patient Simulator™ Medicine Meets Virtual Reality January 25, 2003

This document is proprietary and shall not be used or disclosed without the consent of METI 10

Ron Carovano

Director of New Business Development

Medical Education Technologies, Inc.

6000 Fruitville Road

Sarasota, Florida 34232

U.S.A.

Phone: (941) 377-5562

Fax: (941) 379-1621

E-mail: [email protected]

http://www.meti.com

Contact Information

Page 11: Simulators for Training: Assessment, Validation, and Acceptance Strategies The Human Patient Simulator™ Medicine Meets Virtual Reality January 25, 2003

This document is proprietary and shall not be used or disclosed without the consent of METI 11

Virtual Hospital Chain of Patient Safety

OPERATIONALTEST & ASSESSMENT

MISSION REHEARSAL

Pre-HospitalGround

Ambulance

Hospital Ward

EmergencyDepartment

Air Ambulance

Operating Room

Critical Care

Page 12: Simulators for Training: Assessment, Validation, and Acceptance Strategies The Human Patient Simulator™ Medicine Meets Virtual Reality January 25, 2003

This document is proprietary and shall not be used or disclosed without the consent of METI 12

CTPS Chain of Survival

OPERATIONALTEST & ASSESSMENT

MISSION REHEARSAL

Point of InjuryCasualty

Collection Point

Combat SupportHospital

BattalionAid Station

GroundAmbulance

ForwardSurgical Team

Air Ambulance