Embed Size (px)
Citation preview
1ExamSoft Assessment Conference | #ASSESS2015
ExamSoft Assessment Conference
#ASSESS2015
2ExamSoft Assessment Conference | #ASSESS2015
Student Acceptance
Students have a strong preference for writing on exams
Students worry about technology failures
Students acclimate rapidly to CBT
Use improves acceptance
Ease of Use is key factor in determining intent to use
3ExamSoft Assessment Conference | #ASSESS2015
23% Opt out Hochlehnert et. al. 2011
Students have a strong preference for writing on exams
4ExamSoft Assessment Conference | #ASSESS2015
7% Opt out Hochlehnert et. al. 2011
Students worry about technology failures
5ExamSoft Assessment Conference | #ASSESS2015
Students acclimate rapidly to CBT
Sheader, 2006Increased preference with exposure
6ExamSoft Assessment Conference | #ASSESS2015
Use improves acceptance
Deutsch, 2012Students endorse use after a single exposure
7ExamSoft Assessment Conference | #ASSESS2015
Ease of Use is key factor in determining intent to use
Wijerathne, 201370% thought CBT was more efficient
Sheader, 200648% thought CBT was faster 37% thought there was no difference
8ExamSoft Assessment Conference | #ASSESS2015
Cognitive Load Theory
Working Memory - limited Long-Term Memory - unlimited
9ExamSoft Assessment Conference | #ASSESS2015
Types of Cognitive Load
IntrinsicGermaneExtraneous
10ExamSoft Assessment Conference | #ASSESS2015
George Washington University SMHS
11ExamSoft Assessment Conference | #ASSESS2015
Mock Quiz
Distributed at installation
Dual purpose:
Familiarize students with platform
Collect Evaluation data
Sent to 188; downloaded by 102; completed by
98
12ExamSoft Assessment Conference | #ASSESS2015
Pilot Quiz
10 Question Exam ReviewIn class
Familiar session format
Sent to 188; downloaded by 151; completed by
120
Post-Assessment EvaluationDistributed via Qualtrics on the same day
13ExamSoft Assessment Conference | #ASSESS2015
Pilot Quiz
Technology glitch
Writing on Exam
Crossing out Options
Acclimation
Preference
Exam Navigation
Software Installation
iPad-specific considerations
Eye Strain
Scrolling
Question/Direction-specific
Waiting to Start
0.00
%
5.00
%
10.0
0%
15.0
0%
20.0
0%
25.0
0%
30.0
0%
14ExamSoft Assessment Conference | #ASSESS2015
Pilot Quiz
15ExamSoft Assessment Conference | #ASSESS2015
Pilot Quiz
pre T1 T2 T3 T40
0.5
1
1.5
2
2.5
3
3.5
4
20172018
16ExamSoft Assessment Conference | #ASSESS2015
Pilot Quiz
T1 T2 T3 T41
1.5
2
2.5
3
3.5
4
Comfort
17ExamSoft Assessment Conference | #ASSESS2015
T1 T2 T3 T41
1.5
2
2.5
3
3.5
4
4.5
5Preference
18ExamSoft Assessment Conference | #ASSESS2015
Conclusions
It is possible to pre-emptively address some student concerns
Students remain sensitive to technology failures
Students perceive CBT as faster with use
Students acclimate rapidly to CBT
As students grow more comfortable, they prefer CBT
