Accreditation WorkshopAccreditation Workshop

Mechanical Engineering Preparation forMechanical Engineering Preparation forThe Accreditation ProcessThe Accreditation Process

Dr. Taj MohieldinDr. Taj MohieldinVisiting Professor of Thermal SciencesVisiting Professor of Thermal Sciences

College of Engineering College of Engineering University of BahrainUniversity of Bahrain

Fulbright ScholarFulbright ScholarOld Dominion UniversityOld Dominion University

Norfolk, VA, USANorfolk, VA, USA

Developing Assessment Plans that WorkDeveloping Assessment Plans that Work

o Quality Assessment ProgramQuality Assessment Programo Program Assessment and Evaluation MatrixProgram Assessment and Evaluation Matrixo What we need to Accomplish?What we need to Accomplish?o ABET, What we have do First?ABET, What we have do First?o What is Urgent Now?What is Urgent Now?o Whose responsibility? Whose responsibility? o Program Workshops to help your faculty use Program Workshops to help your faculty use

assessment to improve teaching and learning assessment to improve teaching and learning September 2005September 2005

o WEB PAGEWEB PAGEo Self-study reportSelf-study report

ABET: Quality Assessment ProgramABET: Quality Assessment Program

• What are we trying to do?What are we trying to do?o Review/DevelopReview/Developo Assess/EvaluateAssess/Evaluateo Document/use resultsDocument/use resultso ImproveImproveo Satisfy customers Satisfy customers o Satisfy ABETSatisfy ABETo Continue/StopContinue/Stop

• How well can we do it? o Good Assessment PlanGood Assessment Plano Faculty ownership and Faculty ownership and

responsibilityresponsibilityo institution-wide supportinstitution-wide support

• How can we improve what we are doing?

o BelieveBelieve in ito Do yours Do yours o Cooperate Cooperate o Help otherHelp other

Successful assessmentSuccessful assessment Flows from the institution's Flows from the institution's

mission and educational mission and educational purposes. purposes.

Emerges from a conceptual Emerges from a conceptual framework. framework.

Is marked by faculty ownership Is marked by faculty ownership and responsibility. and responsibility.

Has institution-wide support.Has institution-wide support. Relies on multiple measures. Relies on multiple measures. Provides feedback to students Provides feedback to students

and the institution. and the institution. Is cost-effective. Is cost-effective. Does not restrict or inhibit Does not restrict or inhibit

goals of access, equity, and goals of access, equity, and diversity established by the diversity established by the institution. institution.

Leads to improvement.Leads to improvement. Includes a process for Includes a process for

evaluating the assessment evaluating the assessment program.program.

UOB Mission & Goals

College of Engineering College of Engineering Mission & GoalsMission & Goals

Database

Assessment PlanAssessment Plan

Curricular IssuesCurricular Issues

ImplementationImplementation

22

33

Interpretation of Effectiveness &Interpretation of Effectiveness &ImprovementsImprovements

44

ConstituencyConstituencyFeedbackFeedback

ConstituencyConstituencyFeedbackFeedback

Electronic Assessment Electronic Assessment DatabaseDatabaseConceptConcept

Program’s Program’s MissionMission

PEO’s & PO’sPEO’s & PO’s

11

Program Assessment and Evaluation MatrixProgram Assessment and Evaluation Matrix

Goals:Goals: • What are the overall goals of the What are the overall goals of the

program? program? • How do they complement institutional How do they complement institutional

and accreditation expectations?and accreditation expectations?

Program Objectives:Program Objectives:• What are the program objectives? What are the program objectives? • What should your students know and What should your students know and

be able to do?be able to do?

Performance Criteria:Performance Criteria:• How will you know the objectives have How will you know the objectives have

been met?been met?• What level of performance meets each What level of performance meets each

objective?objective?

Implementation Strategy:Implementation Strategy:• How will the objectives be met? How will the objectives be met? • What program activities (curricular What program activities (curricular

and co-curricular) help you meet each and co-curricular) help you meet each objective?objective?

Evaluation Methods:Evaluation Methods:• What assessment methods will What assessment methods will

you use to collect data?you use to collect data?• How will you interpret and How will you interpret and

evaluate the data?evaluate the data?

Logistics:Logistics:• When will you measure?When will you measure?• How often? Who will collect How often? Who will collect

and interpret the data and and interpret the data and report the results?report the results?

Feedback:Feedback:• Who needs to know the Who needs to know the

results?results?• How can you convince them How can you convince them

the objectives were met?the objectives were met?• How can you improve your How can you improve your

program and your assessment program and your assessment process?process?

Mechanical Engineering ABET CriteriaMechanical Engineering ABET Criteria

1.1. Students Students AdmitAdmitAdviseAdviseEvaluateEvaluateMonitorMonitor

2. 2. Program Educational Program Educational Objective Objective

Published and Consistent Published and Consistent with Mission and These with Mission and These CriteriaCriteriaProcess in Place to Process in Place to Determine and Determine and Periodically EvaluatePeriodically EvaluateBased on of Based on of ConstituenciesConstituenciesCurriculum and Curriculum and processes to ensure processes to ensure achievement achievement Evaluation to Determine Evaluation to Determine AchievementAchievementResults Used to Improve Results Used to Improve Effectiveness of the Effectiveness of the ProgramProgram

3. Program Outcomes and 3. Program Outcomes and AssessmentAssessment

• Assessment Process with Documented Assessment Process with Documented Results to Measure Outcomes Results to Measure Outcomes

• Results Applied to Improvement of the Results Applied to Improvement of the Program Program

• Demonstration (incl. Process & Demonstration (incl. Process & Measurements) that Graduates have:Measurements) that Graduates have:

a)a) ability to apply knowledge of math, ability to apply knowledge of math, engineering, and scienceengineering, and science

b)b) ability to design and conduct ability to design and conduct experiments as well as to analyze and experiments as well as to analyze and interpret datainterpret data

c)c) ability to design system, component or ability to design system, component or process to meet needsprocess to meet needs

d)d) ability to function on multi-disciplinary ability to function on multi-disciplinary teamsteams

e)e) ability to identify, formulate, and solve ability to identify, formulate, and solve engineering problemengineering problem

f)f) understanding of professional and understanding of professional and ethical responsibilityethical responsibility

g)g) ability to communicate effectivelyability to communicate effectivelyh)h) Broad education Broad education i)i) recognition of need and ability to recognition of need and ability to

engage in life-long learningengage in life-long learningj)j) knowledge of contemporary issuesknowledge of contemporary issuesk)k) ability to use techniques, skills, and ability to use techniques, skills, and

tools in engineering practicetools in engineering practice

Mechanical Engineering ABET Criteria Mechanical Engineering ABET Criteria

4. Professional Component Major Design ExperienceOne year of Mathematics and Basic Science One and one-half Years on Engineering Topics General Education Component, Consistent with Program Objectives

5. Faculty Sufficient Number and Competencies to Cover All Curricular Areas (FTE)

Levels of Student- Faculty Interaction

Advise and Counsel students

Actively involve in service (College & University)

Interact with Practitioners and Employers

Professional development

Monitor and evaluate effectively

6. Facilities

Classrooms Laboratories Equipment and Tools Computing and Information InfrastructureCertified Technicians and qualified operators

7. Institutional Support & Financial Resources

Sufficient to Assure Quality and Continuity of the Program Sufficient to Attract and Retain a Well-Qualified Faculty Sufficient to Acquire, Maintain, and Operate Facilities and Equipment

8. Program Criteria Curricular Topics Faculty Qualifications Other

What We Have To Do First?What We Have To Do First?• Departmental Accreditation Committee (DACDAC)• Program’s Mission• Program Constituencies• Program Educational Objectives (PEO’sPEO’s)• Program Outcomes (PO’sPO’s)• Program Industrial Advisory Committee (PIACPIAC).• Program ABET Web Page.• Electronic Assessment Database. Electronic Assessment Database. • Plan of Improvement & Assessment (PIAPIA)• Develop performance criteria for each Develop performance criteria for each

objective/outcome. objective/outcome. • Conduct Assessments and Write Up ResultsConduct Assessments and Write Up Results • Document Use of Results for Program ImprovementDocument Use of Results for Program Improvement

Program’s MissionProgram’s MissionExample MissionExample Mission

Mechanical EngineeringMechanical Engineering

The The mission of the Department of Mechanical Engineering is to:mission of the Department of Mechanical Engineering is to:

Provide high quality education in mechanical engineering Provide high quality education in mechanical engineering for undergraduate studentsfor undergraduate students

Provide support for faculty to conduct high quality research Provide support for faculty to conduct high quality research and ensure high quality educationand ensure high quality education

Increase the program’s national and international Increase the program’s national and international reputationreputation

Enhance the community through civic responsibility and the Enhance the community through civic responsibility and the promotion of economic developmentpromotion of economic development

Provide technical expertise and training to industry on Provide technical expertise and training to industry on advanced technologiesadvanced technologies

Program’s MissionProgram’s MissionExample missionExample mission

Mechanical EngineeringMechanical EngineeringThe undergraduate program in Mechanical Engineering hasthe following educational objectives: To graduate students who

Can effectively useCan effectively use science, mathematics, and engineering concepts necessary for successful mechanical engineering careers.Can communicate effectivelyCan communicate effectively, work in teams, and provide leadership.Can adaptCan adapt to and influence the future technological environment in response to industrial and global changes.Are awareAre aware of the ethical, social, and environmental impact of their professional actions.Can succeedCan succeed in advanced study including graduate school, self-study, and industrial short courses.

Program’s MissionProgram’s Mission

Program ConstituenciesProgram Constituencies

Constituencies Means of I nteraction and Feedback

Current Students Course outcome surveys Student satisfaction survey Senior students exit survey

Faculty

Feedback on course outcomes surveys Department Accreditation committee Department meetings

Potential employers of program graduates

Employers survey

Former graduates and Alumni Alumni survey Industrial advisory committee Committee meetings Student Advisory committee

Committee meetings

Program Educational Objectives (PEO’s)Program Educational Objectives (PEO’s)

• PEO’s are consistent with the mission• Ensure that PEO’s are well-stated and

measurable.• PEO’s can be linked with the curriculum for

the Program• Involve constituencies

Program Educational Objectives (PEO’s)Program Educational Objectives (PEO’s)

Example PEO’sExample PEO’s Create well-rounded engineers who possess theoretical and Create well-rounded engineers who possess theoretical and

practical skills, and understand the significance of humanities practical skills, and understand the significance of humanities and social sciences. and social sciences.

Produce graduates who have the necessary teamwork and Produce graduates who have the necessary teamwork and leadership skills to excel in multidisciplinary team leadership skills to excel in multidisciplinary team environments. environments.

Develop innovative and creative thinking with an understanding Develop innovative and creative thinking with an understanding of entrepreneurship. of entrepreneurship.

Develop science, mathematics, analytical, computational, and Develop science, mathematics, analytical, computational, and experimental, skills, and apply them to formulate and solve experimental, skills, and apply them to formulate and solve engineering problems. engineering problems.

Instill in students an appreciation of the impact of engineering Instill in students an appreciation of the impact of engineering solutions in a global and societal context, including the broad solutions in a global and societal context, including the broad implications of professional ethics. implications of professional ethics.

Instill in students the flexibility to adapt to changing technology Instill in students the flexibility to adapt to changing technology and an understanding of the need for continuous improvement and an understanding of the need for continuous improvement and lifelong learning. and lifelong learning.

Program Educational Objectives (PEO’s)Program Educational Objectives (PEO’s)

The Department Mechanical Engineering1. To provide the skills and instill the values necessary for success in

the engineering profession and/or graduate-level study through rigorous instruction in fundamentals and engineering practice.

2. To acquire the technological skills to practice modern mechanicalengineering in today's global marketplace, and to provide theopportunity to develop specialized interests through electives, involvement in research projects, and industrial internships.

3. To provide comprehensive training in design and laboratory practice.

4. To encourage the development of communication and leadership skills increasing awareness of environmental and ethical responsibilities as a professional engineer.

Program Educational Objectives (PEO’s)Program Educational Objectives (PEO’s)

Example PEO’sExample PEO’s1.1. To provide our students with a strong technical To provide our students with a strong technical

education that will enable them to have successful education that will enable them to have successful careers as professional mechanical engineers, as careers as professional mechanical engineers, as educators in academia, and as members of other educators in academia, and as members of other professions; professions;

2.2. To prepare our students for rapid technological To prepare our students for rapid technological change with the core knowledge central to assuring change with the core knowledge central to assuring that they are able to improve their skills continuously that they are able to improve their skills continuously across a range of disciplines throughout their across a range of disciplines throughout their professional careers; professional careers;

3.3. To prepare our students to communicate effectively To prepare our students to communicate effectively and to deal knowledgeably and ethically with the and to deal knowledgeably and ethically with the impact of technology in our society and on global impact of technology in our society and on global issues.issues.

Program Outcomes (PO’s)Program Outcomes (PO’s)

• PO’s satisfy the 11 ABET criteriaPO’s satisfy the 11 ABET criteria• PO’s must be measurable and specify an appropriate PO’s must be measurable and specify an appropriate

method for measurementsmethod for measurements• Outcomes must specify a criterion for judging findings.Outcomes must specify a criterion for judging findings.• satisfies professional component satisfies professional component • For academic programs, include both of the following:For academic programs, include both of the following:

a. a. Curricular outcomesCurricular outcomesb. b. Learning outcomes at the course levelLearning outcomes at the course level

• Direct as well as indirect methods of measurement are to Direct as well as indirect methods of measurement are to be used.be used.

• Map PO’s into PEO’sMap PO’s into PEO’s• Map PO’s into ABET “a – k” criteriaMap PO’s into ABET “a – k” criteria• Curriculum achieves PO’sCurriculum achieves PO’s• Curriculum satisfies professional componentCurriculum satisfies professional component

• Curriculum meets program specific criteriaCurriculum meets program specific criteria

Program Outcomes (PO’s)Program Outcomes (PO’s)

ABET 11 OutcomesABET 11 Outcomes ability to apply knowledge of math, engineering, and ability to apply knowledge of math, engineering, and

sciencescience ability to design and conduct experiments as well as to ability to design and conduct experiments as well as to

analyze and interpret dataanalyze and interpret data ability to design system, component or process to meet ability to design system, component or process to meet

needsneeds ability to function on multi-disciplinary teamsability to function on multi-disciplinary teams ability to identify, formulate, and solve engineering problemability to identify, formulate, and solve engineering problem understanding of professional and ethical responsibilityunderstanding of professional and ethical responsibility ability to communicate effectivelyability to communicate effectively Broad education Broad education recognition of need and ability to engage in life-long recognition of need and ability to engage in life-long

learninglearning knowledge of contemporary issuesknowledge of contemporary issues ability to use techniques, skills, and tools in engineering ability to use techniques, skills, and tools in engineering

practicepractice

Relationship of PEO’s to EC2000 CriteriaRelationship of PEO’s to EC2000 Criteria How these PEO’s Relate to Other EC 2000 Criteria

Relationship of Objectives to EC2000 Criteria

EC 2000 Criterion

3 2 CE PEO a b c d e f g h i j k

4 5 6 7 8

1 2

3 4

5

6

7

8

PO’s PEO ’s

a. Ability to apply knowledge of mathematics, science, and engineering

b. Ability to design and conduct experiments as well as analyze and interpret data

c. Ability to design a system to meet desired needs

d. Ability to function on multidisciplinary teams

e. Ability to identify, formulate, and solve engineering problems

f. Understanding of professional and ethical responsibilityUnderstanding of professional and ethical responsibility

g.g. Ability to communicate effectively Ability to communicate effectively

h.h. Broad education necessary to understand impact of engineering Broad education necessary to understand impact of engineering solutions in a global/societal contextsolutions in a global/societal context

i.i. Recognition of the need for and ability to engage in lifelong learning Recognition of the need for and ability to engage in lifelong learning

j.j. Knowledge of contemporary issues Knowledge of contemporary issues

k.k. Ability to use the techniques, skills, and modern engineering tools Ability to use the techniques, skills, and modern engineering tools necessary for engineering practicenecessary for engineering practice

Table 3. Example of Mapping Program Outcomes to ABET Outcomes

PO’s ABET a-k a b c d e f g h i j K

1. 2. 3. 4. 5. 6. 7.

What is Urgent Now?What is Urgent Now?

(DAC) Submit(DAC) Submit

Program’s Mission Program’s Constituencies Program’s Educational Objectives (PEO’sPEO’s) Program’s Outcomes (PO’sPO’s) Tabulated Current Curriculum Program Industrial Advisory Committee (PIACPIAC).

Faculty Submit:Faculty Submit: ABET Course Syllabus ABET Resume Passport Photo (for Web Page) Collect sample of students work this semester Record of tests grades this semester

Test # Grade DistributionTest # Grade Distribution

student Question 1 Question 2 Question 3 Question 4 Question 5

1 18 10 20 15 10

2 18 15 00 18 20

3 16 12 12 10 05

4 15 20 20 15 14

5 14 05 14 17 11

6 14 12 14 20 19

7 14 17 20 04 14

8 12 03 12 15 20

9 12 00 15 06 14

10 11 20 08 11 05

11 10 15 18 09 07

12 10 14 10 07 13

13 05 17 13 20 02

UOB MissionUOB MissionCOE MissionCOE MissionCOIT MissionCOIT Mission

Programs MissionsPrograms Missions

ProgramsProgramsSelf-study ReportsSelf-study Reports

ABET DocumentationsABET DocumentationsCE, CHE, ET, MECE, CHE, ET, ME

CS, CEIT, MISCS, CEIT, MIS

Programs CurriculumPrograms CurriculumProgram Faculty Program Faculty

Students InformationStudents Information

On-lineOn-lineEmployer SurveyEmployer SurveyAlumni Survey Alumni Survey

Senior Exit SurveySenior Exit SurveyFaculty SurveyFaculty Survey

Industrial Advisory CommitteeIndustrial Advisory Committee

Grades are global evaluations thatrepresent the overall proficiency ofstudents. They don’t tell you aboutstudent performance on individuallearning goals…

First, answer these questions1. What do you really want students to know and learn?2. What are your students actually learning?3. What can you do to help students learn what you believe they need to know?

Then, follow these steps1. Identify and articulate what students should learn in your class2. Develop tools to measure student learning3. Establish systems to compile and analyze the data you collect with these tools4. Use the information gathered to improve/adapt curricula, pedagogy, and goals

CEE 100 Statics CEE 230 Civil Engineering Materials CEE 240 Geographic Information Systems in Engineering CEE 304 Introduction to Fundamentals of CEE Infrastructure Systems CEE 305 Civil & Environmental Engineering Computations CEE 310 Structures I CEE 323 Soil Mechanics CEE 330 Hydromechanics CEE 335 CE Soils and Hydraulics Laboratory CEE 340 Hydraulics and Water Resources CEE 350 Environmental Pollution and Control CEE 365 Transportation Engineering CEE 403W Civil Engineering Design Project CEE 410 Concrete Design I

Elective Courses for a BSCE Degree •CEE 411 Concrete Design II •CEE 412 Structures II •CEE 415 Steel Structures Design •CEE 416 Wood Structures Design •CEE 420 Foundation Engineering •CEE 421 Earth Structures Design with Geosynthetics •CEE 430 Introduction to Earthquake Engineering •CEE 440 Hydraulic Engineering •CEE 446 Urban Stormwater Hydrology •CEE 447 Groundwater Hydraulics •CEE 450 Water Distribution and Waste Water Collection System Design •CEE 451 Water and Waste Water Treatment •CEE 452 Air Quality •CEE 454 Hazardous Waste •CEE 458 Sustainable Development •CEE 482 Introduction to Coastal Engineering •CEE 495 Topics: Public Health Engineering