TO P
ROCTOR O
R NOT
TO
PROCTOR:
AN E
VALUATI
ON OF
EXAM
FORM
ATS F
OR THE
ONLINE
CLASS
ROOM
J E N N I F E R L E W I S
S L O A N 2 0 1 3N O V E M B E R 2 0 ,
2 0 1 3
BACKGROUND:
PROCTORED?ONLINE?
DEFINITIONS
Online
• Online in LMS• Timed• Password
Protected• Unsupervised
Proctored
• Online in LMS or Paper
• Timed• Supervised
DATA COLLECTION
1 Proctored1 Online Exam• 88 Students• 5 Classes
2 Online Exams• 102 Students• 5 Classes
2 Proctored Exams• 90 Students• 5 Classes
ORIGINAL DATA RESULTS:
DATA EXPANSION
1 Proctored1 Online Exam• 88 Students• 5 Classes
2 Online Exams• 165 Students• 9 Classes
2 Proctored Exams• 90 Students• 5 Classes
APPLES TO ORANGES: A PROBLEM EMERGES
UPDATED RESULTS:
EXAM NO-SHOWS
PROCTORED
ONLINE
6 % 10 %
DATA TAKE THREE
1 Proctored1 Online Exam• 88 Students• 5 Classes
2 Online Exams• 165 Students• 9 Classes
2 Proctored Exams• 90 Students• 5 Classes
598 more students
EXAM-TO-EXAM PERFORMANCE
EXAM TYPE COMPARISON
CONCLUSIONS
1. Student performance from exam to
exam is highly correlated.
2. More students miss/skip online
exams.
3. There is no major difference in
student performance based on exam
type.
BEST TIPS:
1. Decide exam type before the course starts.
2. Advertise early and often.
✔
KEYS FOR SUCCESS: ONLINE EXAMS
1. Provide clear instructions.
2. Use large question banks.
3. Randomize exams for each student.
4. Acknowledge “open book” exam.
5. Set time limits and passwords.
6. Make exam available for longer period.
7. Plan for technical failure before the exam.
8. REMINDERS! REMINDERS! REMINDERS!
Video Instructions: http://youtu.be/C92WQcbi4bk Paper Instructions: http://slidesha.re/IggqiA
KEYS FOR SUCCESS: PROCTORED EXAMS1. Adopt college-wide process, when
possible.2. Provide clear instructions.3. Request proctor/exam choice early.4. Contact proctors ASAP.5. Provide a range of exam dates/times.6. Plan for technical failure before the
exam.7. REMINDERS! REMINDERS! REMINDERS!
http://slidesha.re/Igi9EF
FOR MORE INFORMATION:
Jennifer Lewis, [email protected]
Skype: jennifer.l.nielsen
Twitter: GeoJenLewis
Your Feedback is Appreciated: http://bit.ly/1e3Ja9G