Transcript
Page 1: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

TO P

ROCTOR O

R NOT

TO

PROCTOR:

AN E

VALUATI

ON OF

EXAM

FORM

ATS F

OR THE

ONLINE

CLASS

ROOM

J E N N I F E R L E W I S

S L O A N 2 0 1 3N O V E M B E R 2 0 ,

2 0 1 3

Page 2: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

BACKGROUND:

PROCTORED?ONLINE?

Page 3: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

DEFINITIONS

Online

• Online in LMS• Timed• Password

Protected• Unsupervised

Proctored

• Online in LMS or Paper

• Timed• Supervised

Page 4: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

DATA COLLECTION

1 Proctored1 Online Exam• 88 Students• 5 Classes

2 Online Exams• 102 Students• 5 Classes

2 Proctored Exams• 90 Students• 5 Classes

Page 5: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

ORIGINAL DATA RESULTS:

Page 6: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

DATA EXPANSION

1 Proctored1 Online Exam• 88 Students• 5 Classes

2 Online Exams• 165 Students• 9 Classes

2 Proctored Exams• 90 Students• 5 Classes

Page 7: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

APPLES TO ORANGES: A PROBLEM EMERGES

Page 8: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

UPDATED RESULTS:

Page 9: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

EXAM NO-SHOWS

PROCTORED

ONLINE

6 % 10 %

Page 10: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

DATA TAKE THREE

1 Proctored1 Online Exam• 88 Students• 5 Classes

2 Online Exams• 165 Students• 9 Classes

2 Proctored Exams• 90 Students• 5 Classes

598 more students

Page 11: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

EXAM-TO-EXAM PERFORMANCE

Page 12: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

EXAM TYPE COMPARISON

Page 13: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

CONCLUSIONS

1. Student performance from exam to

exam is highly correlated.

2. More students miss/skip online

exams.

3. There is no major difference in

student performance based on exam

type.

Page 14: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

BEST TIPS:

1. Decide exam type before the course starts.

2. Advertise early and often.

Page 15: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

KEYS FOR SUCCESS: ONLINE EXAMS

1. Provide clear instructions.

2. Use large question banks.

3. Randomize exams for each student.

4. Acknowledge “open book” exam.

5. Set time limits and passwords.

6. Make exam available for longer period.

7. Plan for technical failure before the exam.

8. REMINDERS! REMINDERS! REMINDERS!

Video Instructions: http://youtu.be/C92WQcbi4bk Paper Instructions: http://slidesha.re/IggqiA

Page 16: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

KEYS FOR SUCCESS: PROCTORED EXAMS1. Adopt college-wide process, when

possible.2. Provide clear instructions.3. Request proctor/exam choice early.4. Contact proctors ASAP.5. Provide a range of exam dates/times.6. Plan for technical failure before the

exam.7. REMINDERS! REMINDERS! REMINDERS!

http://slidesha.re/Igi9EF

Page 17: To Proctor or Not to Proctor: An Evaluation of Exam Formats for the Online Classroom

FOR MORE INFORMATION:

Jennifer Lewis, [email protected]

Skype: jennifer.l.nielsen

Twitter: GeoJenLewis

Your Feedback is Appreciated: http://bit.ly/1e3Ja9G