29
Prof. Oleg V. Boev Tomsk Polytechnic University Engineering Curricula Design: Methodology and Evaluation Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Prof. Oleg V. Boev

Tomsk Polytechnic University

Engineering Curricula Design: Methodology and

Evaluation

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Page 2: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

ABET Program Improvement

Loops

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Determine How LOs will be achieved

Input from Constituencies

Evaluate / Assess

Determine LOs required to achieve

POs

Determine How LOs will be assessed

Establish Indicators that POs are being

achieved

Determine POs

Page 3: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Definitions

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Constituencies (Stakeholders) are broad statements that describe what graduates are expected to attain within a few years of graduation.

Program educational objectives are based on the

needs of the program's constituencies.

Page 4: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Definitions

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Program Objectives are broad statements that describe what graduates are expected to attain within a few years of graduation.

Program educational objectives are based on the needs of the program's constituencies.

Page 5: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Definitions

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Learning Outcomes are statements

that describe what students are expected to know and be able to do by the time of graduation. These relate to skills, knowledge, and behaviors that students acquire as they progress through the program.

Page 6: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Definitions

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Performance Indicators are specific, measurable statements identifying the performance(s) required to meet the outcome; confirmable through evidence.

Page 7: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Definitions

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Credit is an award made to a learner in

recognition of the verified achievement of

designated learning outcomes at a specified

level

Level is an indicator of the relative demand,

complexity and depth of learning and of learner

autonomy

Page 8: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Definitions

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Notional Learning Time (Workload) is a number

of hours which it is expected a learner will

spend, on average, in order to accomplish the

specified learning outcomes at a particular

level.

Page 9: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Curriculum Design

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Stakeholders Stakeholders

Concept of

Programme

Programme Objectives

Page 10: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Module / Discipline

Programme

Programme Objectives

PLO-1

MLO-1 MLO-2

PLO-2

MLO-3

Curriculum Design

Page 11: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Curriculum Design

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Knowledge and Understanding

PLO1-1

PLO1-2

PLO1-3

Engineering Analysis

PLO2-1

PLO2-2

PLO2-3

PLO2-4

Engineering Design

PLO3-1

PLO3-2

PLO3-3

Investigations

PLO4-1

PLO4-1

PLO4-1

PLO4-4

Engineering Practice

PLO5-1

PLO5-2

PLO5-3

Transferable Skills

PLO6-1

PLO6-2

PLO6-3

PLO6-4

PLO6-5

Page 12: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Curriculum Design

• an in-depth knowledge and understanding of the principles of their branch of engineering;

• a critical awareness of the forefront of their branch.

Knowledge and

Understanding

Page 13: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Curriculum Design

• the ability to solve problems that are unfamiliar, incompletely defined, and have competing specifications;

• the ability to formulate and solve problems in new and emerging areas of their specialisation;

• the ability to use their knowledge and understanding to conceptualise engineering models, systems and processes;

• the ability to apply innovative methods in problem solving.

Engineering Analysis

Page 14: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Curriculum Design

• an ability to use their knowledge and understanding to design solutions to unfamiliar problems, possibly involving other disciplines;

• an ability to use creativity to develop new and original ideas and methods;

• an ability to use their engineering judgment to work with complexity, technical uncertainty and incomplete information.

Engineering Design

Page 15: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Curriculum Design

• the ability to identify, locate and obtain required data;

• the ability to design and conduct analytic, modeling and experimental investigations;

• the ability to critically evaluate data and draw conclusions;

• the ability to investigate the application of new and emerging technologies in their branch of engineering.

Investigations

Page 16: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Curriculum Design

• the ability to integrate knowledge from different branches, and handle complexity;

• a comprehensive understanding of applicable techniques and methods, and of their limitations;

• a knowledge of the non-technical implications of engineering practice.

• a knowledge of the non-technical implications of engineering practice.

Engineering Practice

Page 17: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Curriculum Design

• function effectively as leader of a team that may be composed of different disciplines and levels;

• work and communicate effectively in national and international contexts.

• demonstrate awareness of the health, safety and legal issues and responsibilities of engineering practice, the impact of engineering solutions in a societal and environmental context, and commit to professional ethics, responsibilities and norms of engineering practice;

• demonstrate an awareness of project management and business practices, such as risk and change management, and understand their limitations;

• recognise the need for, and have the ability to engage in independent, life-long learning.

Transferable Skills

Page 18: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Knowledge and Understanding

Engineering Analysis

Engineering Design

Investigations

Engineering Practice

Transferable Skills

70 ECTS

8 ECTS

8 ECTS

8 ECTS

6 ECTS

20 ECTS

Curriculum Design

Page 19: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Curriculum Design

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Engineering Analysis

the ability to solve problems that are unfamiliar,

incompletely defined, and have competing specifications;

the ability to formulate and solve problems in new and

emerging areas of their specialisation;

the ability to use their knowledge and

understanding to conceptualise engineering

models, systems and processes;

the ability to apply innovative methods in problem solving.

8 ECTS

2 ECTS 2 ECTS 2 ECTS 2 ECTS

Page 20: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Curriculum Design

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Transferable Skills

function effectively as leader of a team

that may be composed of

different disciplines and levels;

work and communicate effectively in national and international

contexts.

demonstrate awareness of the health, safety and legal issues

and responsibilities of engineering practice, the impact

of engineering solutions in a societal and environmental

context, and commit to professional ethics,

responsibilities and norms of engineering practice;

demonstrate an awareness of project

management and business practices,

such as risk and change management, and understand their

limitations;

recognise the need for, and have the

ability to engage in independent, life-long

learning.

20 ECTS

4 ECTS 4 ECTS 4 ECTS 6 ECTS 2 ECTS

Page 21: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Curriculum Design

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Knowledge and Understanding

PLO1-1

PLO1-2

PLO1-3

Engineering Analysis

PLO2-1

PLO2-2

PLO2-3

PLO2-4

Engineering Design

PLO3-1

PLO3-2

PLO3-3

Investigations

PLO4-1

PLO4-1

PLO4-1

PLO4-4

Engineering Practice

PLO5-1

PLO5-2

PLO5-3

Transferable Skills

PLO6-1

PLO6-2

PLO6-3

PLO6-4

PLO6-5

Page 22: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Credit Allocation

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Module /

Discipline

Knowledge

and

Understanding

Engineering

Analysis

Engineering

Design

Investigations Engineering

Practice

Transferable

Skills

………..

Artificial

Intelligence

5

-

1

-

-

-

………..

Research

Project 2 2 2 2 3 3

Master’s

Thesis 10 2 2 4 2 4

Page 23: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

6 ECTS

1 ECTS

Artificial Intelligence

Knoledge and Understanding

Methodology of Artificial Intelligence

Methods of Data Processing

Deductive and Inductive Methods of Decision Making

Programming Languages LISP, PROLOG

Expert Systems

Engineering Design

Design and Application of Artificial Intelligence

Systems

1 ECTS

1 ECTS

1 ECTS

1 ECTS

1 ECTS

5 ECTS

1 ECTS

Page 24: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Assessment is one or more processes that identify, collect, and prepare data to evaluate the attainment of student outcomes and program educational objectives.

Effective assessment uses relevant direct, indirect, quantitative and qualitative measures as appropriate to the objective or outcome being measured. Appropriate sampling methods may be used as part of an assessment process.

Evaluation is one or more processes for interpreting the data and evidence accumulated through assessment processes.

Evaluation determines the extent to which student outcomes and program educational objectives are being attained. Evaluation results in decisions and actions regarding program improvement.

Evaluation and Assessment

Page 25: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Inputs: - student background;

- faculty background;

- educational resources.

Processes: - programs & services offered;

- populations served;

- faculty teaching loads/class size;

- policies, procedures, governance.

Assessment of inputs and processes only establishes the capability or capacity of a program

Evaluation and Assessment

Page 26: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Outputs: - student grades/graduation rates;

- employment statistics;

- publication numbers;

- faculty development activities;

- credit hrs delivered;

- statistics on resource availability;

- participation rates;

Assessment of outputs serve as indirect measures

or proxies for effectiveness—they provide general

indicators of achievement.

Evaluation and Assessment

Page 27: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Outcomes: - what have students learned;

- what skills have they gained;

- attitudes developed;

- faculty publication citations data;

- faculty development;

- student learning and growth.

Assessment of outcomes provides for direct measures of the effectiveness of what has been done with that capability/ capacity related to individual learning and growth

Evaluation and Assessment

Page 28: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Evaluation and Assessment

Internal QA

POs

Program LOs

Module LOs

Accreditation

Public Opinion Stakeholders

Profession

Faculty

Page 29: Engineering Curricula Design: Methodology and Evaluationecdeast.tpu.ru/files/presentation/sibiu/Boev_Sibiu.pdf · 2011-10-20 · Definitions Workshop on Curricula Design, 10-11.10.2011,

Workshop on Curricula Design, 10-11.10.2011, Sibiu, Romania

Thank you for your attention.