Programme Exit Survey (PES) DIS 2013 Session (DTP) V1

Programme Exit Survey (PES)

Report

Diploma in Mechanical Engineering

(Manufacturing) - DTP

December 2013 Session

Politeknik Kota Kinabalu (PKK)

Sabah

RESEARCH COMMITTEE

Member of Advisory Committee

NO NAME POSITION1 Wan Mohamad Nasir bin Wan Abdul Rahman Director2 Zaidi Bin Zakaria Deputy Director (Academic)3 Sylvester Gindan Head of Department (JKM)

Research Fellow (Polytechnic)

NO NAME1 Dr Hasnim bin Harun (Chief, Bureau of Research and Innovation)2 Azman B Talib3 Farah AsyikinAbd Rahman4 Shalizan B. Kadir5 MohdMayuzieYusof6 Fadlilhisham B Ahmad

Research Fellow in Diploma in Mechanical Engineering (Manufacturing)

NO NAME1 Johnny Yakin Sinit (Head of Program)2 Limi Chong3 Nur Raihana binti Sukri

2PKK Program Exit Survey Report December 2013 Session (DTP)

ABSTRACT

The purpose of this Programme Exit Survey (PES) was to providedata to gauge perceptions

of various aspects of programmes and services offered and to identify areas where

improvements may be needed in the Department of Mechanical Engineering (JKM),

Politeknik Kota Kinabalu (PKK).This PES was conducted on 20final semester

students,graduating from Diploma in Mechanical Engineering (Manufacturing) (DTP). They

werethe thirdCohort whose intake was inJune 2011. The survey questionnaire hadfive main

sections: respondents’ profile; assessment of overall quality; assessment of skills and

knowledge; assessment of Lecturers and Academic Advisor; and assessment of academic

resources and facilities. All the data were analysed using the Statistical Product and Service

Solutions (SPSS) software version IBM SPSS Statistics 19.0. For the assessment of the

overall quality, attribute for teaching and learning experience was rated 100% with

“excellent”, “very good” and “good”. Skills and knowledge section was evaluated by

relating the statements with nine items as stated in the Programme Learning Outcomes

(PLO). All the PLOs’ were marked at least “good” by 99.8% of the students. Assessment on

lecturers and academic advisor were rated 41.2% as “excellent” and 51.7% as “very good”. In

terms of academic resources and facilities, the quality of laboratories/ workshops/ kitchens

had the highest unsatisfactory concerned from the respondent whereby 5.3% rated the item as

“weak” and 15.8% as “average”.

Keywords: overall quality, skills and knowledge, lecturer and academic advisor, academic

resources and facilities


1. INTRODUCTION

1.1 Programme Exit Survey (PES)

PES is a method of collecting information on the quality of diploma education from the

perspective of graduating students upon the completion of their diploma programme. This

report refers to an indirect measurement method by way of self-evaluation based on

individual perception for the assessment of PLO. PLOs are the specific statements of

graduates’ knowledge, skills and attitudes acquired at the end of the programme as

evidencefor the programme objectives achievements. This PES was conducted to assess the

graduate students’ satisfaction and perceptions about various aspects of their academic

experiences. 100% of the final semester students from the DTP programme had participated

in the survey.

The main objectives of this PES are to:

1) Determine the students perception in their attainment on the overall quality of

learning and teaching in PKK;

2) Determine the students self-assessment of knowledge, skills and soft skills

achievement after going through the PLOs of the programme;

3) Evaluate the students’ opinion towards contributions of Lecturer and Academic

Advisor system implemented based on Outcome Based Education (OBE) approach;

4) Evaluate the students’ opinion towards academic resources and facilities provided in

PKK.

1.2 Programme Learning Outcomes (PLO)

OBE is an educational philosophy that believedthat educational assessment should recognise

and reflect progress made by individual students. PLOsare statements that describe what

graduates are expected to know or be able to do on graduation. In the curriculumfor DTP

programme it has been specifiedthat there are nine (9) PLOs’to be acquired by the graduates

upon graduation.The nine PLOsare as follows:

i. Apply knowledge of mathematics, science and engineering fundamentals to well

defined mechanical and manufacturing engineering procedures and practices.


ii. Demonstrate practical skills which includes the ability to troubleshoot, repair and do

maintenance work for mechanical equipment

iii. Communicate effectively with the engineering community and the society at large.

iv. Apply creative and critical thinking in solving problem related to assigned tasks;

v. Demonstrate awareness and consideration for societal, health, safety, legal and

cultural issues and the consequent responsibilities, taking into account the need for

sustainable development;

vi. Recognise the need for professional development and engage in independent

acquisition of new knowledge and skill.

vii. Recognize the need for entrepreneurship

viii. Demonstrate an understanding of professional ethics, responsibilities and norms of

mechanical and manufacturing engineering practices.

ix. Function individually or in teams, effectively, with a capability to be a leader;


2. METHODOLOGY

This survey involved 20 DTP students from December 2013 semester.Students wereasked to

fill up the PES questionnaires which were postedonline and 100% of them responded. The

respondents were required to evaluate and rate themselves based on 5-Likert Scale

indicatedbelow:

1 = Weak

2 = Average

3 = Good

4 = Very Good

5 = Excellent

Student’s satisfaction and acceptance level was determined from the scale. Excellent, Very

Good and Good indication rate shows the students are satisfied with the item. While

Averageand Weakindication rate shows the item need some improvements and correction for

the program.

This online surveywas conducted betweenMarchs until May 2014. The survey

questionnaireswere divided into five sections as follows:

i. Section A: General Information

ii. Section B: Overall Quality of Teaching and Learning

iii. Section C: Skills and Knowledge

iv. Section D: Contributions of Lecturers and Academic Advisors

v. Section E: Academic Resources and Facilities

The data collected in this survey was processed through Statistical Product and Service

Solutions (SPSS) software version IBM SPSS Statistics 19.0.

The questionnaireswerebased on students’perception on teaching and learning in

PKK, students’ response on skills and knowledge related to PLO’s, students attainmenton the

soft skills, students’ rating for lecturers and academic advisors contribution, student’s opinion

towards academic resources, overall services and facilities in PKK. This assessment strategy

was aligned with the Curriculum Development Cycle -“develop-implement-review” as

required by the MQA in order to improve the quality of programme.


3. RESULTS

The response from the students wereanalysed based on the following four criteria:

i. Students’ responsetowards the Overall Quality

ii. Students’ response on Skills and Knowledge

iii. Students’ ratings for Lecturer and Academic Advisor contributions

iv. Students’ opinion towards Academic Resources and Facilities

In Section C: (Skills and Knowledge)thestatements have been classified under a particular

PLO so that the data analysis can be done appropriately for accreditation purposes. The

resultscan be used an indicator to show how well the students have acquired their skills and

knowledge as required in the PLOs of the programme.

3.1 SECTION A: PROFILE

Table 1: Student’s Gender

GENDER

Male Female

Qty 15 4(%) 78.9 21.1

Table 2: Student’s Race

RACE

Melayu Cina India Bumiputera Sabah

Bumiputera Sarawak

Others

Qty 0 0 0 16 0 3(%) 0.0 0.0 0.0 84.2 0.0 15.8


3.2 SECTION B: OVERALL QUALITY

Overall Quality was evaluated by relating the students experience with the teaching and

learning environment in PKK. Two survey statements were given and the results were as

follows:

Table 3: Overall Quality rating

OVERALL QUALITY Weak Average Good Very Good Excellent

What is your impression on the overall quality of curriculum; and teaching and learning at PKK?

0 0 7 8 4

(%) 0.0 0.0 36.8 42.1 21.1

To what extent has the quality of teaching and learning in PKK improved since you were here?

0 0 3 12 4

(%) 0.0 0.0 15.8 63.2 21.1

3.2.1 PLO1 (Knowledge)

ForPLO 1 (Knowledge), fourstatements were given and the results were as follows:

Table 4: PLO 1 Knowledge rating

SKILLS AND KNOWLEDGEPLO 1 (Knowledge)

Weak Average Good Very Good Excellent

I am able to apply knowledge of core discipline courses in my programme

0 0 3 11 5

(%) 0.0 0.0 15.8 57.9 26.3I am able to apply knowledge of specialized courses in my programme

0 0 6 10 3

(%) 0.0 0.0 31.6 52.6 15.8I am able to apply knowledge of elective courses in my programme

0 0 4 10 5


(%) 0.0 0.0 21.1 52.6 26.3

I am able to understand the technological applications relevant to my programme of study

0 0 5 10 4

(%) 0.0 0.0 26.3 52.6 21.1

3.2.2 PLO2 (Technical &Practical Skills)

For PLO 2 (Technical & Practical Skills), threestatements were given and the resultswere as

follows:

Table 5: PLO 2 Technical & Practical Skills rating

SKILLS AND KNOWLEDGEPLO 2 (Technical & Practical Skills)

Weak Average Good Very Good ExcellentI am able to apply information technology in my programme

0 0 5 10 4

(%) 0.0 0.0 26.3 52.6 21.1

I am able to demonstrate my practical skills effectively

0 0 5 7 7

(%) 0.0 0.0 26.3 36.8 36.8

I am able to use computing technology for applications in my programme

0 1 4 8 6

(%) 0.0 5.3 21.1 42.1 31.6

3.2.3 PLO3 (Communication Skills)

For PLO 3 (Communication Skills), three statements were provided and the resultswere as

follows:

Table 6: PLO 3 Communication Skills rating

SKILLS AND KNOWLEDGEPLO 3 (Communication Skills)



I am able to communicate effectively orally/visually (informal / formal / conversational / presentation)

0 0 3 9 7

(%) 0.0 0.0 15.8 47.4 36.8

I am able to communicate effectively in writing (writing reports and expressing ideas and opinions clearly and concisely)

0 0 1 12 6

(%) 0.0 0.0 5.3 63.2 31.6

I am able to use computing technology in communications

0 0 6 7 6

(%) 0.0 0.0 31.6 36.8 31.6

3.2.4 PLO4 (Critical Thinking & Problem Solving Skills)

For PLO 4 (Critical Thinking & Problem Solving Skills), three statements were given and the

results were as follows:

Table 7: PLO 4 Critical Thinking & Problem Solving Skills rating

SKILLS AND KNOWLEDGEPLO 4 (Critical Thinking & Problem Solving Skills)


I am able to solve problems using methods, tools and skills related to my programme

0 0 5 7 7

(%) 0.0 0.0 26.3 36.8 36.8I am able to think critically and logically

0 0 3 8 8

(%) 0.0 0.0 15.8 42.1 42.1I am able to plan, organize and complete a task

0 0 2 10 7

(%) 0.0 0.0 10.5 52.6 36.8

3.2.5 PLO5 (Social Skills and Responsibilities)


For PLO 5 (Social Skills and Responsibilities), three statements were given and the results

were as follows:

Table 8: PLO 5 Social Skills and Responsibilities rating

SKILLS AND KNOWLEDGEPLO 5 (Social Skills and Responsibilities)


I am able to understand the role of my work in relation to social or cultural issues

0 0 1 13 5

(%) 0.0 0.0 5.3 68.4 26.3

I am aware of the value of considering diversity and differences in cultures in my work

0 0 3 11 5

(%) 0.0 0.0 15.8 57.9 26.3

I am aware of the impact of my work in a social context

0 0 5 9 5

(%) 0.0 0.0 26.3 47.4 26.3

3.2.6 PLO6 (Continuous Learning & Information Management Skills)

For PLO 6 (Continuous Learning & Information Management Skills), fourstatements were

provided and the results were as follows:

Table 9: PLO 6 Continuous Learning & Information Management Skills rating

SKILLS AND KNOWLEDGEPLO 6 (Continuous Learning & Information Management Skills) Weak Average Good Very Good Excellent

I am able to continuously learn new skills and knowledge

0 0 1 7 11

(%) 0.0 0.0 5.3 36.8 57.9I am able to engage in continuous learning beyond the classroom

0 0 2 8 9

(%) 0.0 0.0 10.5 42.1 47.4I am able to learn and apply new concepts

0 0 3 10 6

(%) 0.0 0.0 15.8 52.6 31.6


I am able to use information resources (databases, libraries, internet etc)

0 0 4 6 9

(%) 0.0 0.0 21.1 31.6 47.4

3.2.7 PLO7 (Management & Entrepreneurial Skills)

For PLO 7 (Management & Entrepreneurial Skills), twostatements were provided and the

results were as follows:

Table 10: PLO 7 Management & Entrepreneurial Skills rating

SKILLS AND KNOWLEDGEPLO 7 (Management & Entrepreneurial Skills)

Weak Average Good Very Good ExcellentI am able to build/develop my career upon completion of my studies

0 0 2 8 9

(%) 0.0 0.0 10.5 42.1 47.4I am able to develop time management skills

0 0 1 11 7

(%) 0.0 0.0 5.3 57.9 36.8

3.2.8 PLO8 (Professionalism, Ethics & Moral)

For PLO 8 (Professionalism, Ethics & Moral), twostatements were provided and the results

were as follows:

Table 11: PLO 8 Professionalism, Ethics & Moral rating

SKILLS AND KNOWLEDGEPLO 8 (Professionalism, Ethics & Moral)


I am able to understand the professional and ethical responsibilities related to my work

0 0 1 10 8

(%) 0.0 0.0 5.3 52.6 42.1I am aware of the importance of safety issues related to my work

0 0 0 8 11

(%) 0.0 0.0 0.0 42.1 57.9

3.2.9 PLO9 (Leadership & Teamwork Skills)


For assessment of the PLO 9 (Leadership & Teamwork Skills), four statements were

provided and the results were as follows:

Table 12: PLO 9 Leadership & Teamwork Skills rating

SKILLS AND KNOWLEDGEPLO 9 (Leadership & Teamwork Skills)

Weak Average Good Very Good ExcellentI am able to work with individuals from different backgrounds

0 0 1 5 13

(%) 0.0 0.0 5.3 26.3 68.4

I am able to work successfully as a member of a team

0 0 2 7 10

(%) 0.0 0.0 10.5 36.8 52.6

I am able to work successfully as a leader of a team

0 0 1 11 7

(%) 0.0 0.0 5.3 57.9 36.8I am able to function in multidisciplinary teams

0 0 1 7 11

(%) 0.0 0.0 5.3 36.8 57.9

3.3 SECTION D: CONTRIBUTIONS OF LECTURERS AND ACADEMIC

ADVISORS

Responses from students towards the lecturers and academic advisors’ contributions are

summarized below. Graduates were asked to offer insights of encouragement given into the

programme delivery process. Six attributes of encouragementwere offered and the results

were as follows:

Table 13: Contributions of Lecturers and Academic Advisors rating


To what extent did your lecturer/academic advisor encourage you to:


Set high expectations for learning?

0 1 24 24 11

(%) 0.0 1.7 40.0 40.0 18.3Be an actively involved learner?

0 0 23 23 14

(%) 0.0 0.0 38.3 38.3 23.3Show concern for student learning?

0 1 22 24 13

(%) 0.0 1.7 36.7 40.0 21.7Provide feedback frequently and promptly?

0 0 23 21 16

(%) 0.0 0.0 38.3 35.0 26.7Show concern for student learning?

0 1 24 21 14

(%) 0.0 1.7 40.0 35.0 23.3Provide feedback frequently and promptly?

0 1 21 24 14

(%) 0.0 1.7 35.0 40.0 23.3

CONTRIBUTIONSContributions of Lecturers and Academic Advisors

3.4 SECTION E: ACADEMIC RESOURCES/FACILITIES

In the education eco-system, academic resources/facilities were important in terms of

educational hardware. The teaching and learningprocess would be greatly enhanced provided

that there were sufficient resources/facilities for students to thrive academically. Table

4shows the percentage of respondents’ ratings towards the sufficiency of resources/facilities

at the PKK. Eleven statements of resources/facilities were given and the results were as

follows:

Table 14: Academic Resources/Facilities rating


To what extent did Politeknik Kota Kinabalu provide you with the following resources/facilities?


Operation hours of the library

0 2 27 21 10

(%) 0.0 3.3 45.0 35.0 16.7Access to databases and collections both physically and online in the library

2 1 32 20 5

(%) 3.3 1.7 53.3 33.3 8.3Easy and responsive services of the HEP staff

2 2 28 19 9

(%) 3.3 3.3 46.7 31.7 15.0Easy and responsive services of the counselling staff

0 1 34 19 6

(%) 0.0 1.7 56.7 31.7 10.0Easy and responsive services of the library staff

0 2 31 19 8

(%) 0.0 3.3 51.7 31.7 13.3Easy and responsive services of the administration staff

0 4 29 21 6

(%) 0.0 6.7 48.3 35.0 10.0Access to Wi-Fi internet 10 13 20 12 5

(%) 16.7 21.7 33.3 20.0 8.3Quality of computer labs 2 2 29 17 10

(%) 3.3 3.3 48.3 28.3 16.7Quality of laboratories / workshops / kitchens

2 5 31 13 9

(%) 3.3 8.3 51.7 21.7 15.0Quality of classrooms 2 7 34 11 6

(%) 3.3 11.7 56.7 18.3 10.0Quality of sports and recreational facilities

1 4 35 13 7

(%) 1.7 6.7 58.3 21.7 11.7

ACADEMIC RESOURCES/FACILITIES

4. SUGGESTED IMPROVEMENTS FROM STUDENTS15

PKK Program Exit Survey Report December 2013 Session (DTP)

Internet service (Wi-Fi) for every department must be upgraded to ensure students can

easily access the information through internet.

Scheduled maintenance must be carried out for all equipments and machines to lower

the probability of the machine breakdown. Breakdown will affects the PnP process.

Ensure all facilities such as lavatories and classrooms are functioning, safe and sound.


Documents

Programme Exit Survey (PES) DIS 2013 Session (DTP) V1