Upload
others
View
5
Download
0
Embed Size (px)
Citation preview
COLLEGE OF MEDICINE
KPIs Guide
DEVELOPMENT & QUALITY UNIT
2
Table of Contents
Table of Contents 2
Speech of Dean of the college of medicine 3
Speech of Vice-Dean for Development and quality 4
College Vision, Mission and Goals 5
Introduction 6
Table -1 Benchmark types 8
Diagram – 1 MECHANISM OF Performance indicators measurement 9
Diagram – 2 Distribution of KPIs in relation to the relevant Strategic objectives 10
Table – 2 Links between the contents of the college mission, strategic objectives, and
key performance indicators 11
Diagram – 3 Distribution of the KPIs in relation to the contents of the program mission
13
Table - 3 Consistency of program key performance indicators and Najran university key
performance indicators 14
Table - 4 Consistency between program KPIs & vision 2030 15
Table – 5 Consistency of program KPIs with, NCAAA KPIs, and Afaaq KPIs 17
Table – 6 Program KPIs according to its type 19
Table – 7 KPIs description, Time of measurement and its responsible bodies 21
Important links 26
3
Speech of Dean of the college of medicine
The rapid evolving of the medical education institutions all around
the globe, resulting in shifting target of these institutions from the concept
of quantity to the concept of quality of their input in serving the local,
regional and international community; by providing competent doctors,
trustable distinguished scientific researches, and efficient community
services to support community health care and wellbeing.
In the college of medicine, We adopt quantitative and qualitative
measurable performance indicators in order to evaluate how far we achieve
our strategic objectives, in order to determine to which extent we fulfill our
mission, to Identify deficiencies, and to develop operational plans for
continuous improvement. Moreover, we choose benchmarks to compare our
performance with other national colleges, which help to assess the college
wellbeing and quality of the performance in relation to other national
colleges
Prof. DR. Mohamed Zayed Al Ayed
4
Speech of Vice-dean for Development and quality
The Vice deanship of the college of medicine for Development and
quality, through the unit of Development and quality, seeks to spread the
culture of development and quality to ensure that the standards of the
National Center for Academic Accreditation and Assessment (NCAAA) are
met; to ensure the quality of performance at the level of the medicine and
surgery program as an effort to contribute to achieving the vision, mission,
and strategic objectives of the college, and to achieve the leadership that the
college of medicine aspires to; in an integrated and reliable manner.
The Development and quality unit also focuses on the process of continuous
evaluation of all operations and activities within the college through which
it is possible to determine the level of its quality. This evaluation includes
all aspects of administrative, academic and research activities and other
activities that the college performs annually, enabling continuous
monitoring of the performance.
Evidence and information to support this evaluation are needed; among
these are performance indicators and the necessity for a benchmark
comparison with similar institutions and programs with good practices that
can be used, or information and measurements that can be compared with to
evaluate our performance.
In this booklet, the focus will be on explaining the types of performance
indicators and how to define and calculate them, as well as the types of
benchmark comparisons.
Dr.Abdullah Mufarreh Assiri
5
College Vision, Mission and Goals
College vision
Excellence in medical education and contribution to scientific research to promote health services and
participate in community service.
College Mission
Preparation of qualified medical personnel capable of providing distinguished medical services,
contributing to scientific research and establishing multiple partnerships to serve the community and
raise the level of health awareness.
College Goals
❖ Continuous Development of curricula and the means of medical education.
❖ Preparation of morally and professionally medical cadres, well qualified, and capable of
continuous self-learning.
❖ Development of the scientific research and cooperation with local, regional, and global
institutions in medical research environment.
❖ Development of the university hospital to provide excellent health services to the community
❖ Establishing an academic environment attract talented faculty members.
❖ To obtain accreditation from National Commission for Academic Accreditation & Assessment.
6
Introduction
Introduction
Definitions
Key Performance Indicators -KPIs:
It is the performance indicator that identifies evaluative criteria for scientific
assessment of an educational objective or student learning outcome
performance. A KPI must be measurable or written in a way that is designed
for assessment. When benchmarking and analysis are used with it, together,
they provide evidence for assessment to guide decision-making and
judgments.
Benchmark:
It is the performance level of achievement for a given KPI or performance
indicator. There are many kinds of benchmarks that align with KPIs;
therefore, it is necessary to qualify benchmarks in order to understand their
relationship to a given KPI. Benchmarks may be internal or external.
Target Benchmark:
It is the anticipated performance level or desired outcome (goal or aim) for a
KPI.
Finding Benchmark:
7
Also known as the actual benchmark; It is the actual outcome determined when the
KPI is measured or calculated. It represents the actual reality of the present
situation.
Internal Benchmarks:
They are benchmarks based on information from inside the program or institution.
Internal benchmarks include target or finding benchmark data results from
previous years.
External Benchmarks
They are benchmarks from similar programs or institutions that are outside the
program or institution. For example, external benchmarks for "student to teacher
ration" could be Six students to 1 teacher from a different program within the
institution or another program outside the institution, or for institutions, it refers to
other institutions (national or international).
KPI Analysis:
It is a process in which a comparison and contrast of the benchmarks to determine
strengths and recommendations for improvement. This is sometimes called
"benchmarking." For example, KPI analysis could compare and contrast "student
to teacher ratio" target and actual benchmarks from both internal and external
data banks to determine strengths and recommendations for improvement.
New Target Benchmark:
It is the establishment of a new or desired target.
8
The program of medicine and surgery utilizes quantitative or qualitative
measurable performance indicators in order to evaluate the extent to which
strategic objectives have been achieved, and that indicates how far the program
achieved its mission, to Identify deficiencies, and to develop operational plans for
continuous improvement.
The program measures the key performance indicators with benchmarking
depending on appropriate tools, such as (Surveys, Statistical data, etc.) according to
the nature and objective of each indicator, as well as determining the following
levels for each indicator:
• Actual performance
• Targeted performance level
• Internal reference (Internal benchmark)
• External reference (External benchmark)
• New target performance level
The college selects internal and external benchmarking, to assess the program
wellbeing and performance in relation to
Table -1 Benchmark types
Internal
benchmark
External benchmark
KPI of the same program for
the previous year
KPIs of the Program of
medicine, Qassim
University
KPIs of the Program of
medicine at King Khalid
University.
9
Diagram – 1 MECHANISM OF Performance indicators
measurement
Planning and follow-up
The responsible
committee of the index
OPERATION
Committee & Index
Performance
Measurement
INPUT
Committee & Index
Performance
Measurement
Committee
Formation a committee
to study the results of
the measurement to
identify strengths and
weaknesses.
1. Receive responses from
target groups.
2. Perform the necessary
statistical analyses
using the Statistical
Software Package
(SPSS).).
3. Discuss results, make
comparisons and
report.
Annual reports
for monitoring
approved
performance
indicators.
1. Follow-up on
the implementation
of improvement
plans.
OUTPUT
Committee & Index
Performance
Measurement
1. Paper & Electronic forms
2. The approved timeline
for submitting forms
electronically.
3. Links to the surveys on
the college's website.
4. Advertising procedures
and communication with
target groups to access
links
Planning and follow-up
College Agency for
Development and Quality
10
Diagram – 2 Distribution of KPIs in relation to the relevant
Strategic objectives
11
Table – 2 Links between the contents of the college mission,
strategic objectives, and key performance indicators
College Mission
Statement
Content of the
Mission
Consistent
Strategic
Objectives
Relevant Key Performance Indicators
Preparation of qualified
medical personnel
capable of providing
distinguished medical
services, contributing to
scientific research and
establishing multiple
partnerships to serve the
community and raise the
level of health awareness.
Teaching and
learning
1st Continuous
Development of
curricula and the
means of medical
education.
KPI-MED.2.Percentage of courses
students evaluated during the year
KPI-P.3.Students' Evaluation of the
quality of the courses
KPI-P.17. The satisfaction of
beneficiaries with the learning resource
KPI-MED.7. The satisfaction of
beneficiaries with facilities and
equipment.
2nd Preparation of
morally and
professionally
medical cadres,
well qualified and
capable of
continuous self-
learning.
KPI-P.2.Students' Evaluation of quality of
learning experience in the program
KPI-P.4.Completion rate
KPI-P.5.First-year students retention rate
KPI-P.6. Students' performance in the
professional and/or national examinations
KPI-P.7. Graduates' employability and
enrolment in postgraduate programs
within
KPI-P.8.The average number of students
in the class
KPI-P.9.Employers' Evaluation of the
program graduates' proficiency
KPI-P.10. Students' satisfaction with the
offered services
KPI-MED.3.Evaluation of students for
academic and professional guidance
KPI-P.11.The ratio of students to teaching
staff
5th Establishing an
academic
KPI-P.12.Percentage of teaching staff
distribution
KPI-P.13.The proportion of teaching staff
12
environment attract
talented faculty
members.
leaving the program
KPI-MED.6. Proportion (percentage) of
faculty members engaged in professional
development activities
6th To obtain
accreditation from
National
Commission for
Academic
Accreditation &
Assessment.
KPI-P.1. Percentage of achieved
indicators of the program operational
plan objectives.
KPI-MED.2. The degree of awareness of
the beneficiaries with the mission and
objectives (average range of knowledge
of faculty members and undergraduate
and graduate students in the thesis using a
five-year questionnaire)
Scientific
researches
3rd Development of
scientific research
and cooperation
with local, regional,
and global
institutions in the
medical research
environment.
KPI-P.14.Percentage of publications of
faculty members
KPI-P.15.Rate of published research per
faculty member
KPI-P.16.Citations rate in refereed
journals per faculty member
KPI-MED.4.The number of papers
(researches) or reports presented at
academic conferences for all faculty
members
Community
services
4th Development of
the university
hospital to provide
excellent health
services to the
community.
KPI-MED.5.Proportion (percentage) of
faculty members participating in
community service activities
KPI-MED.8.Satisfaction of beneficiaries
with the health services provided by the
university hospital
13
Diagram – 3 Distribution of the KPIs in relation to the contents
of the program mission
14
Table - 3 Consistency of program key performance indicators
and Najran university key performance indicators
No KPI code KPI program of medicine and
surgery
KPI
code
KPI of Najran university
1 KPI-MED.1 The degree of awareness of the beneficiaries
with the mission and objectives (average
range of knowledge of faculty members and
undergraduate and graduate students in the
thesis using a five-year questionnaire)
NU1.4 Satisfaction of the beneficiaries of
the university's mission and
objectives
2 KPI-P-02 Students' Evaluation of quality of learning
experience in the program
NU1.8 Final year student satisfaction rate
for academic program (calendar)
3 KPI-P-06 Students' performance in the professional
and/or national examinations
NU8.2 Ranking of graduates in
measurement tests at the level of
the Kingdom (health colleges -
teachers ..
4 KPI-P-09 Employers' Evaluation of the program
graduates' proficiency
NU8.1 Community and labour market
satisfaction ratio for graduate
performance skills
5 KPI-P-10 Students' satisfaction with the offered services NU6.6
Student satisfaction rate for
services and facilities provided by
the Deanship of Admissions and
Registration
6 KPI-MED.3 Evaluation of students for academic and
professional guidance
NU6.1
Student satisfaction rate for
counseling, social and
psychological services
7 KPI-P-12 Percentage of teaching staff distribution NU3.4 Percentage of Professor,
Associate Professor, Associate
Professor on both women's and
men's
8 KPI-MED.7 the satisfaction of beneficiaries with facilities
and equipment
NU4.1 Faculty satisfaction ratio for
facilities and equipment
9 KPI-MED.8 the satisfaction of beneficiaries with the health
services provided by the university hospital
NU6.4 Students’satisfaction rate for
health services
15
Table - 4 Consistency between program KPIs & vision 2030
KPI Code KPIs Vision 2030 objectives
KPI-P.02 Students' Evaluation of quality of learning experience in the program
Strategic objective
(1&4&5)
KPI-P.04 Completion rate
KPI-P.05 First-year students retention rate
KPI-P.08 The average number of students in the class
KPI-P.10 Students' satisfaction with the offered services
KPI-MED.03 Evaluation of students for academic and professional guidance
KPI-P.11 The ratio of students to teaching staff
KPI-P.01 Percentage of achieved indicators of the program operational plan objectives.
KPI-MED.01 The degree of awareness of the beneficiaries with the mission and objectives
KPI-MED.02 Percentage of courses students evaluated during the year Strategic objective (2) KPI-P.03 Students' Evaluation of the quality of the courses
KPI-P.17 The satisfaction of beneficiaries with the learning resource
KPI-MED.07 The satisfaction of beneficiaries with facilities and equipment.
KPI-P.14 Percentage of publications of faculty members Strategic objective
(2&3) KPI-P.15 Rate of published research per faculty member
KPI-P.16 Citations rate in refereed journals per faculty member
KPI-MED.04 The number of papers (researches) or reports presented at academic conferences
for all faculty members
16
KPI-P.06 Students' performance in the professional and/or national examinations Strategic objective
(4&5) KPI-P.07 Graduates' employability and enrolment in postgraduate programs within
KPI-P.9 Employers' Evaluation of the program graduate's proficiency
KPI-P.12 Percentage of teaching staff distribution Strategic objective (4) KPI-P.13 The proportion of teaching staff leaving the program
KPI-MED.06 Proportion (percentage) of faculty members engaged in professional
development activities
KPI-MED.05 Proportion (percentage) of faculty members participating in community service
activities Strategic objective
(1&5) KPI-MED.08 the satisfaction of beneficiaries with the health services provided by the
university hospital
17
Table – 5 Consistency of program KPIs with, NCAAA KPIs, and Afaaq KPIs
No KPI code KPI program of medicine and surgery NCAAA
KPIs
Afaaq
KPIs
1 KPI-P-01 Percentage of achieved indicators of the program operational
plan objectives.
KPI-P-01
2 KPI-P-02 Students' Evaluation of quality of learning experience in the
program
KPI-P-02 A8.2
3 KPI-P-03 Students' Evaluation of the quality of the courses KPI-P-03 A8.2
4 KPI-P-04 Completion rate KPI-P-04 A3.1
5 KPI-P-05 First-year students retention rate KPI-P-05
6 KPI-P-06 Students' performance in the professional and/or national
examinations
KPI-P-06
7 KPI-P-07 Graduates' employability and enrolment in postgraduate
programs within
KPI-P-07 A2.3
8 KPI-P-08 The average number of students in the class KPI-P-08
9 KPI-P-09 Employers' Evaluation of the program graduate's proficiency KPI-P-09 A7.1
10 KPI-P-10 Students' satisfaction with the offered services KPI-P-10 A7.2
11 KPI-P-11 The ratio of students to teaching staff KPI-P-11 A4.2
12 KPI-P-12 Percentage of teaching staff distribution KPI-P-12 A5.1
13 KPI-P-13 The proportion of teaching staff leaving the program KPI-P-13 A5.3
14 KPI-P-14 Percentage of publications of faculty members KPI-P-14 A10.1
18
15 KPI-P-15 Rate of published research per faculty member KPI-P-15 A12.2
16 KPI-P-16 Citations rate in refereed journals per faculty member KPI-P-16 A12.4
17 KPI-MED.6 Proportion (percentage) of faculty members engaged in
professional development activities
A8.1
18 KPI-P-17 The satisfaction of beneficiaries with the learning resource KPI-P-17
19
Table – 6 Program KPIs according to its type
NO KPI code KPI program of medicine and surgery Type
1 KPI-P-01 Percentage of achieved indicators of the program operational plan objectives. Productivity
2 KPI-MED.01 The degree of awareness of the beneficiaries with the mission and objectives Quality
3 KPI-P-02 Students' Evaluation of quality of learning experience in the program Quality
4 KPI-MED.02 Percentage of courses evaluated by the students during the year Quality
5 KPI-P-03 Students' Evaluation of the quality of the courses Quality
6 KPI-P-04 Completion rate Productivity
7 KPI-P-05 First-year students retention rate Efficiency
8 KPI-P-06 Students or graduates who were successful in the professional and / or national
examinations
Efficiency
9 KPI-P-07 Graduates' employability and enrolment in postgraduate programs Productivity
10 KPI-P-08 The average number of students in the class Efficiency
11 KPI-P-09 Employers' Evaluation of the program graduate's proficiency Efficiency
12 KPI-P-10 Students' satisfaction with the offered services Quality
13 KPI-MED.03 Evaluation of students for academic and professional guidance Quality
14 KPI-P-11 The ratio of students to teaching staff Efficiency
15 KPI-P-12 Percentage of teaching staff distribution Efficiency
16 KPI-P-13 The proportion of teaching staff leaving the program Efficiency
17 KPI-P-14 Percentage of publications of faculty members Productivity
20
18 KPI-P-15 Rate of published research per faculty member Productivity
19 KPI-P-16 Citations rate in refereed journals per faculty member Effectiveness
20 KPI-MED.04 The number of papers (researches) or reports presented at academic conferences for all
faculty members
Productivity
21 KPI-MED.05 Proportion (percentage) of faculty members participating in community service
activities
Effectiveness
22 KPI-MED.06 Proportion (percentage) of faculty members engaged in professional development
activities
Effectiveness
23 KPI-P-17 The satisfaction of beneficiaries with the learning resource Efficiency
24 KPI-MED.07 The satisfaction of beneficiaries with facilities and equipment Safety
25 KPI-MED.08 The satisfaction of beneficiaries with the health services provided by the university
hospital
Efficiency
21
Table – 7 KPIs description, Time of measurement and its responsible bodies
KPI code KPI operative KPI description Time of
measurement
Responsibility
KPI-P.01 Percentage of achieved
indicators of the
program operational plan
objectives.
Percentage of performance
indicators of the operational
plan objectives of the program
that achieved the targeted
annual level to the total number
of indicators targeted for these
objectives in the same year
Last four
weeks of the
academic
years
Mission and
Goals
Committee
KPI-
MED.01
The degree of awareness
of the beneficiaries with
the mission and
objectives
The mean of knowledge of
faculty members and
undergraduate and graduate
students with the program
mission and objectives. Using a
five-point scale in an annual
survey
Last four
weeks of the
academic
years
Mission and
Goals
Committee
22
KPI-P.02 Students' Evaluation of
quality of learning
experience in the
program
The mean of the rating of final year
students for the quality of learning
experience in the program on a
five-point scale in an annual survey
Last four
weeks of the
academic
years
Teaching and
Learning
Committee.
KPI-MED.02 Percentage of courses
evaluated by the
students during the
year
Percentage of courses taught and
then evaluated by the students in
the concerned year to the total
number of delivered courses in the
same year.
In the last
week of the
academic
year
Teaching and
Learning
Committee.
KPI-P.03 Students' Evaluation of
the quality of the
courses
The mean of students' rating for the
quality of courses on a five-point
scale in an annual survey
In the last
week of the
academic
year
Teaching and
Learning
Committee.
KPI-P.04 Completion rate The proportion of undergraduate
students who completed the
program in minimum Time in each
cohort
Beginning of
the second
semester of
the academic
year
Teaching and
Learning
Committee.
KPI-P.05 First-year students'
retention rate
Percentage of first-year
undergraduate students who
continue at the program the next
year to the total number of first-
year students in the same year
In the 1st four
weeks of the
next
academic
year-
Teaching and
Learning
Committee.
KPI-P.06 Students' performance
in the professional
and/or national
examinations
Percentage of students or graduates
who were successful in the
professional and / or national
examinations, or their score
average and median (if any)
According to
the result
disclosed by
SMLE
Teaching and
Learning
Committee.
KPI-P.07 Graduates'
employability and
enrolment in
Percentage of graduates from the
program who within a year of
graduation were:
Beginning of
the second
semester of
Teaching and
Learning
Committee.
23
postgraduate programs
a. employed
b. enrolled in postgraduate
programs
during the first year of their
graduation to the total number of
graduates in the same year
the academic
year
KPI-P.08 The average number of
students in the class
The average number of students per
class (in each teaching
session/activity: lecture, small
group, tutorial, laboratory, or
clinical session)
First 4 weeks
of the
academic
year
Teaching and
Learning
Committee.
KPI-P.09 Employers' Evaluation
of the program
graduate's proficiency
The mean of the rating of
employers for the proficiency of the
program graduates on a five-point
scale in an annual survey
One year
after their
graduate
Teaching and
Learning
Committee.
KPI-P.10 Students' satisfaction
with the offered
services
The mean of students' satisfaction
with the various services offered by
the program (restaurants, sports
transportation, facilities, academic
advising, ...) on a five-point scale in
an annual survey
Last four
weeks of the
academic
year
Students'
Committee.
KPI-MED.03 Evaluation of students
for academic and
professional guidance
The mean of students' satisfaction
with the appropriate academic and
vocational guidance for the all
teaching period on a five-point
scale in an annual survey for final
year students
Last four
weeks of the
academic
year
Students'
Committee.
KPI-P.11 The ratio of students to
teaching staff
The ratio of the total number of
students to the total number of full-
time and full-time equivalent
teaching staff in the program
First four
weeks of the
academic
year
Teaching
Staff
Committee
KPI-P.12 Percentage of teaching Percentage of teaching staff First four Teaching
24
staff distribution distribution based on:
a. Gender
b. Branches
c. Academic Ranking
weeks of the
academic
year
Staff
Committee
KPI-P.13 The proportion of
teaching staff leaving
the program
The proportion of teaching staff
leaving the program annually for
reasons other than age retirement to
the total number of teaching staff.
In the 1st
four weeks of
the next
academic
year
Teaching
Staff
Committee
KPI-P.14 Percentage of
publications of faculty
members
Percentage of full-time faculty
members who published at least
one research during the year to total
faculty members in the program
Last four
weeks of the
academic
year
Teaching
Staff
Committee
KPI-P.15 Rate of published
research per faculty
member
The average number of refereed
and/or published research per each
faculty member during the year
(total number of refereed and/or
published research to the total
number of full-time or equivalent
faculty members during the year)
Last four
weeks of the
academic
year
Teaching
Staff
Committee
KPI-P.16
Citations rate in
refereed journals per
faculty member
The average number of citations in
refereed journals from published
research per faculty member in the
program (total number of citations
in refereed journals from published
research for full-time or equivalent
faculty members to
the total research published)
Last four
weeks of the
academic
year
Teaching
Staff
Committee
KPI-MED.04 Number of researches
or reports submitted in
academic conferences
during the previous
The average number of researches
or reports submitted in academic
conferences during the previous
year per faculty member in the
Last four
weeks of the
academic
year
Teaching
Staff
Committee
25
year for all full-time
faculty members
program
KPI-MED.05 Percentage of staff
members and full-time
co-workers involved in
community service
activities
Percentage of staff members and
full-time co-workers involved in
community service activities to
total faculty members in the
program
Last four
weeks of the
academic
year
Teaching
Staff
Committee
KPI-MED.06 Percentage of faculty
members involved in
professional
development activities
during the previous
year
Percentage of staff members
involved in professional
development activities during the
previous year to total faculty
members in the program
Last four
weeks of the
academic
year
Teaching
Staff
Committee
KPI-P-17 The satisfaction of
beneficiaries with the
learning resource
(Students, staff
members)
The mean of beneficiaries'
(students') satisfaction with the
adequacy and diversity of learning
resources (references, journals,
databasesetc.) on a five-point scale
in an annual survey.
Last four
weeks of the
academic
year
Learning
Resources,
Facilities, and
Equipment
Committee
KPI-MED.07 The satisfaction of
beneficiaries with the
facilities and
equipment. (Students,
Staff member)
The mean of beneficiaries' (Staff
members') satisfaction with the
adequacy and diversity of learning
resources. (references, journals,
databases… etc.) on a five-point
scale in an annual survey.
Last four
weeks of the
academic
year
Learning
Resources,
Facilities, and
Equipment
Committee
KPI-MED.08 The satisfaction of the
beneficiaries with the
services provided in
the university hospital.
The mean of beneficiaries'
satisfaction with the services
provided in the university hospital.
(OPD, Lab, Pharmacy…etc.) on a
five-point scale in an annual
survey.
Last four
weeks of the
academic
year
Learning
Resources,
Facilities, and
Equipment
Committee
26
Important links
1. NCAAA KPIs for program accreditation:
https://etec.gov.sa/en/productsandservices/NCAAA/AccreditationProgrammatic/Pages/Forms.aspx
2. Afaaq higher education strategy:
https://sp.psau.edu.sa/sites/default/files/forms/field/file/st6.pdf
3. SAUDI ARABIA Vision 2030:
https://vision2030.gov.sa/en
27
Prepared by:
DR. OSMAN TAJELSIR DR. SOHEIR SOLIMAN DR. ABD ELRAHEEM ALMHBOUB
Supervisor of Supervisor of Chairman of
Development and quality unit Development and quality unit The Performance Measurement
Boys' section Girls' section Committee