Annual Product Evaluation · ASCP 2014 Lab Management University Skills Assessment Results. Contents • Study Design • Competencies Leadership Personnel Management Operations Financial

Annual Product Evaluation

Contents• LMU Research Questions• Study Design• Participants• Results• Takeaways

What does ASCP want to know about LMU users?• How are people actually using LMU?

• How is LMU enhancing the career of users?

• How present is LMU on the institutional level?

• Where does LMU go from here?

Study Design• 2014 Fiscal Year LMU users:

• 950 Surveyed• Institutional Purchaser• User• Residency Program Director• Laboratory Medical Director

• 178 Completed

LMU Product Evaluation Results

Who are ASCP LMU consumers?• 44% are supervisors

or managers; 31% are staff.

• 42% of respondents use LMU for self-improvement; 38% use LMU for career advancement.

3%

79%

9%2% 4% 3%

0%

20%

40%

60%

80%

100%

Number of years in practice…

11%

28%

13%9%

19%

6%13%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0-3 4-10 11-15 16-20 21-25 26-30 30+

LMU Respondents’ age varied widely…

0%

18%

26%29%

23%

4%

0%

5%

10%

15%

20%

25%

30%

35%

Less than22

23-32 33-42 43-52 53-62 63+

Respondents indicated their level of agreement with LMU on the following…Statement Percent (Sum of Agree & Strongly

Agree)Lacked commercial bias. 89%

Learning objectives were covered. 94%

Was well organized. 89%

Has educational value. 95%

Learning something new. 94%

Has practical applications. 93%

Will recommend to colleagues. 87%

Successful implementation in a resident program.

38%; 43% reported N/A

Participated in LMU Skills Assessment 59%; 25% reported N/A

Will Participate in online discussion groups for LMU.

43%

Respondents rate the quality of the LMU program on each of the following…Category Percentage (Sum of Good & Excellent)Overall Rating 89%

Instructions 89%

Content 90%

Response from product 75%

Cost (compared to other similar products) 71%

Ease of access to online content 75%

Live LMU approved sessions 57%; 32% reported N/A

Educational tools and resources 85%

Value of LMU Skills Assessment 66%; 24% reported N/A

New Candidate Monthly Orientations 46%; 37% reported N/A

Free Quarterly Hot Topic Webinars 47%; 38% reported N/A

Monthly Newsletters 50%; 29% reported N/A

Creating an interest in providing Inspiring Lab Management Stories or Quotes

55%; 21% reported N/A

LMU is raising users’ ability to perform…91%

70%

0%10%20%30%40%50%60%70%80%90%

100%

IncreaseAbility

Change inPractice

Change in Practice

Percent

Refresh/update current knowledge

83%

Improve practice procedures

58%

Utilize current technology

23%

Modify testingprotocols

12%

Apply differentmethods for diagnosis

12%

What are the barriers that prevent users from making changes?Barriers Percent

Administration/Management 30%

Time Constraints 24%

Availability of Resources 21%

Cost Implications 9%

Application to Community of Practice 7%

LMU has a great opportunity to engage institutions…

1%

21%

99%

79%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Group Discussions Teaching Tool

YesNo

LMU ImplementationPassive Usage

• “Purchased for all laboratory managers”

• “Purchased and we do it on an individual basis”

Active Usage

• “Required laboratory supervisors to either use LMU or another program to refresh their management skills”

• “Completion of the series is required for entry into our core lab management rotation…”

Takeaways from LMU• Users believe in the quality of LMU and its ability to better

their performance.• LMU is being utilized to inspire change of practice.• LMU has a great opportunity to penetrate the institutional

market and establish itself as the standard in laboratory management education.

ASCP 2014

Lab Management University Skills Assessment Results

Contents

• Study Design• Competencies▫ Leadership▫ Personnel Management▫ Operations▫ Financial▫ Informatics▫ Compliance

• Key Takeaways

Study Design

• 2014 LMU Users▫ Surveyed - 115▫ Statistics are based on the LMU Users

who completed the assessment in 2014.

AA2

Slide 18

AA2 Need Slide with assessment tool if simple, if not desccribe the tool. Asma Ali, 7/31/2014

Survey Example for Leadership Competency• Self-assessed proficiency on 5-point rating scale

Results by Laboratory Management Competencies

Competency Percent (Sum of Proficient & Very Proficient)

Applying emotional intelligence in the laboratory and healthcare environment

59%

Conducting effective team meetings 50%

Conducting a root cause analysis, identify solutions, prioritize, implement solution, and monitor for resolution

49%

Applying CLIA requirements in laboratory supervision and management

48%

Applying CAP and JCAHO Standards in laboratory supervision and management

48%

Leadership - Highest Scores

Competency Percent (Not at all Proficient)

Designing a laboratory outreach management plan including marketing, advertising and promotions

48%

Demonstrating leadership in developing government, institutional and industry laboratory grant applications

47%

Developing a laboratory business plan 42%

Analyzing public relations as it relates to the practice of pathology

37%

Leadership - Lowest Scores


Coaching employees for performance improvement.

54%

Appraising employee performance. 51%

Delegating for employee success and accountability.

50%

Conducting a new employee interview. 51%

Personnel Management - Highest Scores


Managing in compliance with labor laws, the America with Disabilities Act and EEO laws.

28%

Implementing employee retention strategies. 27%

Creating laboratory job descriptions. 23%

Discussing employee compensation and benefits. 23%

Personnel Management- Lowest Scores


Preparing laboratory standard operating procedures (SOPs)

62%

Understand common laboratory procedures associated with sensitivity and specificity of tests.

57%

Conducting External Proficiency Test Surveys and utilize results to improve laboratory processes.

57%

Analyzing and troubleshooting workflow. 50%

Operations - Highest Scores


Implementing supply chain management best practices.

36%

Defining standards for Provider performed tests. 34%

Designing and implement a staffing model. 32%

Analyzing and interpreting Westgard rules. 30%

Operations - Lowest Scores


Interpreting the elements of an income statement and balance sheet.

23%

Assigning correct CPT codes for common Pathology services and laboratory procedures.

23%

Preparing a unit and laboratory budget for pathology services and operations.

20%

Conducting a cost accounting for common laboratory procedures.

20%

Financial - Highest Scores


Preparing for a laboratory financial audit. 59%

Using test cost accounting principles. 57%

Identifying and analyzing forms for reimbursement of laboratory services (CMS, DRG Part A, DRG Part B, RBRVS).

57%

Conducting cash flow analysis. 56%

Financial - Lowest Scores


Using word processing software applications. 70%

Using presentation tools. 57%

Using scheduling applications. 45%

Using advance features of spreadsheets. 36%

Informatics - Highest Scores


Implementing a biorepository data bank 53%

Conducting an evaluation of laboratory transactional databases and data warehouses.

51%

Leading a laboratory EMR selection and implementation team for patient centered support.

43%

Informatics - Lowest Scores


Performing a CAP self-inspection. 50%

Effectively managing an incident. 39%

Designing, developing, and implementing a basic laboratory safety program including OHSA, MSDS, radiation safety, lab safety, bio hazards, universal precautions, and electrical safety.

37%

Implementing a patient safety program and protocol.

35%

Compliance - Highest Scores


Identifying how to obtain IRB approval for clinical research studies.

44%

Managing contracts with hospital, employees, managed care.

44%

Designing, developing, and implementing a risk management program.

40%

Designing a comprehensive compliance plan including CLIA certification, analytical complexity, CAP, COLA, and JCAHO accreditation.

31%

Compliance - Lowest Scores

Overall Competency Strength

37%44% 44%

18%

33% 32%

24%17%

22%

51%

31% 31%

0%10%20%30%40%50%60%70%80%90%

100%

Very Proficient/ProficientNot at all Proficient

Key Takeaways• Laboratory Professionals still have room to grow within

the six competencies.▫ ASCP can leverage this to provide more specialized

initiatives to address specific deficiencies. • Proficiency in the financial competency is lacking vastly

among respondents.▫ ASCP should consider additional financial literacy based

education offerings.• Data from the informatics competency can be used to

inform the upcoming Path Informatics program.

Documents

Annual Product Evaluation · ASCP 2014 Lab Management University Skills Assessment Results. Contents • Study Design • Competencies Leadership Personnel Management Operations Financial