Assessment 2.0 – assessment in an interactive, participatory and distributed environment

120/04/23

Geoffrey Crisp

ALTC National Teaching FellowDirector, Centre for Learning and Professional Development

University of Adelaide

Assessment 2.0 – assessment in an interactive,

participatory and distributed environment

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

220/04/23 2

Examples and presentations available at

http://www.transformingassessment.com

Shamim JoarderMathew Hillier

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

320/04/23 3

Outline of presentation

introduction to learning and assessment traditional e-assessments examples of interactive e-assessments assessment in virtual environments assessment tasks for the future

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

4

Typical learning and assessment today?

20/04/23 4

http://www.flickr.com/photos/cristic/359572656/ http://www.pharmtox.utoronto.ca/Assets/Photos/pcl473+classroom+editted.JPG

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

New learning environments for students and teachers

20/04/23 5

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

6

Authentic learning and assessment – inverted curriculum approach

20/04/23 6

http://www.nasaimages.org/luna/servlet/detail/nasaNAS~9~9~58363~162207:

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

720/04/23 7

Do you want the red pill or the blue pill?

http://www.urvoting.com

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

820/04/23 8

Assessment tasks should be worth doing

if students can answer questions by copying from the web, you are asking the wrong questions

if students can answer questions by using Google, you are asking the wrong questions

if students can answer questions by guessing, you are asking the wrong questions

Why am I doing this course?

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

Different assessment types

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

1020/04/23 10

Outline of presentation

introduction to learning and assessment traditional e-assessments examples of interactive e-assessments assessment in virtual environments assessment tasks for the future

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

1120/04/23 11

Question types - LMS

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

Bobby Elliot and assessment 1.5 to 2.0

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

Assessment 1.0 v Assessment 2.0

Given Done alone Descriptive Text Closed book Done in class Teacher assessed

Negotiated Done collaboratively Researched/Deep Text/audio/video Open web Done anywhere Self- and peer-assessed

Assessment 1.0 Assessment 2.0

http://www.scribd.com/doc/461041/Assessment-20

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

1420/04/23 14

Outline of presentation

introduction to learning and assessment traditional e-assessments examples of interactive e-assessments assessment in virtual environments assessment tasks for the future

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

15

Interactive e-assessment design

Separate the interactive tool/object/artefact from the question and the feedback

Interactive tool

Response

Question

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

Guessing answers

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

17

QuickTime VR

20/04/23

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

Interactive Java applets

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

1920/04/23 19

Interactivity - Chemistry Java applet

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

20/04/23 20

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

2120/04/23

Process of problem solving - IMMEX

http://www.immex.ucla.edu

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

2220/04/23

Process of problem solving - IMMEX

http://www.immex.ucla.edu

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

IMMEX output – capability maps

Kong, S.C., Ogata, H., Arnseth, H.C., Chan, C.K.K., Hirashima, T., Klett, F., Lee, J.H.M., Liu, C.C., Looi, C.K., Milrad, M., Mitrovic,A., Nakabayashi, K., Wong, S.L., Yang, S.J.H. (eds.) (2009). Proceedings of the 17th International Conference on Computers in Education

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

2420/04/23 24

Outline of presentation

introduction to learning and assessment traditional e-assessments examples of interactive e-assessments assessment in virtual environments assessment tasks for the future

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

25

Characteristics of Web 2.0

• user-generated content

• encouragement and facilitation of participation

• access and openness

• (almost) unlimited data sources

• power of the crowd

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

26

Self and Peer Assessment Tools

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

27

What Happens in a Role Play?

Adopt a roleIssues & problems

occur

Reflection &

Learning

Interaction & debate

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

28

Scenario-based learning

http://www.pblinteractive.org

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

2920/04/23 29

Second Life – Virtual worlds

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

Second Life exampleshttp://www.youtube.com/watch?v=Ncj7xokweOc

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

Second Life exampleshttp://www.youtube.com/watch?v=ZgkUtSSEpBc

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

Second Life examples

http://www.youtube.com/watch?v=eQruIhMVgYI

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

3320/04/23 33

Serious Games Institute

http://www.seriousgamesinstitute.co.uk/

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

3420/04/23 34

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

Simulations and games

20/04/23 35

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

3620/04/23 36

Augmented reality

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

3720/04/23 37

Outline of presentation

introduction to learning and assessment traditional e-assessments examples of interactive e-assessments assessment in virtual environments assessment tasks for the future

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

3820/04/23 38

Future assessments? Will we see universal development of immersive and

authentic learning and assessment environments?

Will assessments measure approaches to problem solving and student responses in terms of efficiency, ethical considerations and the involvement of others?

Will teachers be able to construct future assessments or will this be a specialty activity?

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

3920/04/23 39

The e-Assessment Handbook and HERDSA Guide

Assessment 2.0 – assessment in an interactive, participatory and distributed environment

References Nicol, D. J. 2009. Assessment for learner self-regulation:

enhancing achievement in the first year using learning technologies. Assessment & Evaluation in Higher Education, 34, no. 3: 335–352

Knight, P. 2007. Fostering and assessing ‘wicked’ competences. http://www.open.ac.uk/cetl-workspace/cetlcontent/documents/460d1d1481d0f.pdf

Joughin, G. 2009. Assessment, Learning and Judgement. In G. Joughin (Ed) Assessment, Learning and Judgement in Higher Education. Springer p215-221

Yorke, M. 2005. Increasing the chances of student success. In Improving student learning 12: Diversity and inclusivity, ed. C. Rust, 35–52. Oxford: Oxford Centre for Staff and Learning Development