Open Embedded Assessments

Preview:

Citation preview

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.

Opening Embedded Assessment

Brandon Muramatsu, mura@mit.edu

David Wiley, david.wiley@gmail.com

Justin Ball, justinball@gmail.com

Joel Duffin, joel.duffin@gmail.com

1Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

Cite as: Muramatsu, B., Wiley, D., Ball, J. and Duffin, J. (2014, April). Open Embedded Assessment.OER14: Building communities of open practice. Newcastle, UK.

openassessments.org

2Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.

Tweet Questions#oer14oea

openassessments.org

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.

Where in the World…

3

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.

Outline

Motivation and Background

Demo

Shared Open Assessment Banks

4

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.

Content and Assessment are Separate

5

OER Content

Videos,Lectures,

Textbooks,Webpages,

Assessments

Current State ofOER Assessments

PDF Files,Static,

Contained inSeparate Quiz & Test Systems

The Challenge

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.

The Potential?

Do for assessments and items, what’s been done for content (whole courses, lectures, videos)

Embed Anywhere

Share Don’t reinvent the wheel for every course

Evaluate, Record and Track Responses

Scale More use of items/assessments for validity

May lead to evidence of impact?

6

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.

Focus: Formative Assessment

Putting mechanisms for students to check their understanding / mastery of concepts directly in course materials

Primarily for formative (self-check, understanding) not summative (exams or formal assignments)

7

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.

What’s done today in OER with embedded formative assessment?

8

Saylor Foundation – saylor.org

9

www.saylor.org

Cre

dit:

Sa

ylo

r F

ou

nd

atio

n,

CC

BY

Saylor.org Precalculus II

Course Assessments

http://www.saylor.org/courses/ma003/?ismissing=0&resourcetype=4

10

Cre

dit:

Sa

ylo

r F

ou

nd

atio

n,

CC

BY

www.saylor.org

Saylor.org – “Assessment”

http://www.saylor.org/site/wp-content/uploads/2011/11/MA003-1.2.5-PART2.pdf

Cre

dit:

Wa

shin

gto

n S

BC

TC

, C

C B

Y

12MIT OpenCourseWare: Massachusetts Institute of Technology, http://ocw.mit.edu/courses/ocw-scholar/ (Accessed 7 Nov, 2013). License: Creative Commons BY-NC-SA

OCW Scholar – 8.03SC

13

Lewin, Walter, Wit Busza, George Stephans, and Martin Connors. 8.03SC Physics III: Vibrations and Waves, Fall 2012. (MIT OpenCourseWare: Massachusetts Institute of Technology), http://ocw.mit.edu/courses/physics/8-03sc-physics-iii-vibrations-and-waves-fall-2012 (Accessed 7 Nov, 2013). License: Creative Commons BY-NC-SA

OCW Scholar – BCS9.00SC

14Gabrieli, John. 9.00SC Introduction to Psychology, Fall 2011. (MIT OpenCourseWare: Massachusetts Institute of Technology), http://ocw.mit.edu/courses/brain-and-cognitive-sciences/9-00sc-introduction-to-psychology-fall-2011 (Accessed 7 Nov, 2013). License: Creative Commons BY-NC-SA

OCW Scholar – 8.01SC

15

Lewin, Walter, Peter Dourmashkin, Thomas Greytak, Craig Watkins, Andy Neely, Sahana Murthy, J. Litster, and Matthew Strafuss. 8.01SC Physics I: Classical Mechanics, Fall 2010. (MIT OpenCourseWare: Massachusetts Institute of Technology), http://ocw.mit.edu/courses/physics/8-01sc-physics-i-classical-mechanics-fall-2010 (Accessed 7 Nov, 2013). License: Creative Commons BY-NC-SA

16

Lewin, Walter, Peter Dourmashkin, Thomas Greytak, Craig Watkins, Andy Neely, Sahana Murthy, J. Litster, and Matthew Strafuss. 8.01SC Physics I: Classical Mechanics, Fall 2010. (MIT OpenCourseWare: Massachusetts Institute of Technology), http://ocw.mit.edu/courses/physics/8-01sc-physics-i-classical-mechanics-fall-2010 (Accessed 7 Nov, 2013). License: Creative Commons BY-NC-SA

17Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

6.002x

18Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

6.002x

19Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

Our Approachopenassessments.org

20Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.

OpenAssessments.org

Tweet Questions#oer14oea

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.

Open Assessments (Beta)

OpenAssessments.org

Embed an assessment in any web content QTI-player

Sends analytics

Focus on formative assessments

Start with limited question types multiple-choice/single answer

21

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.

Demo!(cross your fingers)

22

openassessments.org

23Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.

OpenAssessments.org

Tweet Questions#oer14oea

openassessments.org

24Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

OEA Stats

25Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.

Shared Open Assessment Banks

26

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.

Questions?

Tweet them using #oer14oea

27

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.

Opening Embedded Assessment

Brandon Muramatsu, mura@mit.edu

David Wiley, david.wiley@gmail.com

Justin Ball, justinball@gmail.com

Joel Duffin, joel.duffin@gmail.com

28Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

Cite as: Muramatsu, B., Wiley, D., Ball, J. and Duffin, J. (2014, April). Open Embedded Assessment.OER14: Building communities of open practice. Newcastle, UK.

Recommended