Www.up.pt :: E-Assessment of Learning Outcomes in Engineering Education Rita Falcao Universidade do...

www.up.pt :: www.fe.up.pt

E-Assessment of Learning Outcomes in

Engineering Education Rita Falcao

Universidade do Porto :: FEUP

Portugal

WEEF2012 :: Buenos Aires, Argentina

www.up.pt :: www.fe.up.pt

Field of study

Learning Outcomes

E-Learning

Assessment

www.up.pt :: www.fe.up.pt

Initial problem

To what extent e-assessment methods

may be used to measure the

achievement of Learning Outcomes in

engineering education?

www.up.pt :: www.fe.up.pt

Research questions I

• RQ1) Which type of Learning

Outcomes in the field of Engineering

are relevant and should be

considered?

• RQ2) Which are the e-assessment

methods that should be considered?

www.up.pt :: www.fe.up.pt

Learning Outcomes

Learning outcomes are statements

of what a learner is expected to

know, understand and/or be able

to demonstrate after completion

of learning. (AHELO)

www.up.pt :: www.fe.up.pt

Learning Outcomes in EE

Selection and description of LOs in

Engineering Education

• ABET

• EUR-ACE

• CDIO

• EQF

www.up.pt :: www.fe.up.pt

(e) Assessment

Assessment: Any procedure used to

estimate student learning for whatever

purpose. (Brown et al)

e-Assessment is the use of ICT and the

Internet in particular for the assessment

of learning, including design, delivery

and/or recording of responses. (JISC)

www.up.pt :: www.fe.up.pt

(e) Assessment methods

• Multiple choice questions

• Short Answer Questions

• Problems

• Essays

• Practical work

• Reflexive practice

www.up.pt :: www.fe.up.pt

Research questions II

• RQ3) What type of intended Learning

Outcomes can be measured by e-

assessment methods?

• RQ4) Is it possible to propose specific

e-assessment strategies for each

type of LO in EE?

www.up.pt :: www.fe.up.pt

The ALIGNMENT question

Statement of intende

d LO

Teaching and

Learning

Activities

Learning

Outcomes

Assessment tasks

www.up.pt :: www.fe.up.pt

Revised Bloom’s Taxonomy

• Analyzing and describing the LOs of the qualification frameworks

• Analyzing and describing LOs from case-studies

• Analyzing and describing assessment methods

• Aligning assessment and LOs

www.up.pt :: www.fe.up.pt

The ALOA conceptual model

www.up.pt :: www.fe.up.pt

Alignment

Many LosOne

Assessment

Many LosMany

Assessment

One LOOne

Assessment

One LOMany

Assessment

www.up.pt :: www.fe.up.pt

Application of the model

Scenarios

Verification of internal alignment

Proposal of internal alignment

Vertical alignment

Horizontal alignment

Criteria

Match

Emphasis

Coverage

Precision

www.up.pt :: www.fe.up.pt

Application to EUR-ACE

www.up.pt :: www.fe.up.pt

Example of case-study

www.up.pt :: www.fe.up.pt

Thank you!

Rita Falcao de Berredo

ritafalcaoberredo@gmail.com