View
215
Download
0
Category
Preview:
Citation preview
I D E A LI D E A LI D E A LI D E A L
International Database for Enhanced Assessments & LearningInternational Database for Enhanced Assessments & Learning
HK Ng, C. Hazlett, J Ware, S. Yip
I D E A L
Additionally, some basic medical science teachers have difficulty assessing their students’ reasoning abilities within a clinically relevant context
R-type selected response items (also referred to as Extended Matching Questions [EMQ]) are particularly suitable for measuring medical students’ scientific & clinical reasoning abilities
However, some teachers find that composing an R-type item is difficult and/or time-consuming
Background
I D E A L
The R-type item writing wizard is designed to assist basic & clinical science teachers composing well designed R-Type items more easily & quickly
Objective & Purpose
I D E A LI D E A LI D E A LI D E A L
International Database for Enhanced Assessments & LearningInternational Database for Enhanced Assessments & Learning
Using the Wizard
to
Create an R-type Item
I D E A L
Select or Compose an Appropriate Lead-In Question
Select or Compose an Appropriate Lead-In Question
I D E A L
Next, compose a relevant, appropriate
scientific or clinical scenario
Next, compose a relevant, appropriate
scientific or clinical scenario
Two yr-old boy is brought to clinic complaining of generalized rash & fever for 1 day. Rash initially appeared on face & trunk then spread to limbs. Intensity of rash in axilla & groin region has recently increased. Skin feels like sand-paper & there is also circumoral pallor. Throat is congested & examination is otherwise uneventful.
I D E A L
Vignette can be composed within the wizard or copied &
pasted from Word Pad or another source except MS Word
I D E A L
Specify the Option Which is the Correct AnswerSpecify the Option Which is the Correct Answer
I D E A L
Compose Relevant Feedback for StudentsCompose Relevant Feedback for Students
Feedback can be provided to the students after the assessment for formative purposes
I D E A LI D E A LI D E A LI D E A L
International Database for Enhanced Assessments & LearningInternational Database for Enhanced Assessments & Learning
If another clinical scenario is relevant
for the same option set, compose a 2nd
vignette
I D E A L
Example of a 2nd Scenario Applicable
for the Same Option Set
Example of a 2nd Scenario Applicable
for the Same Option Set
Six yr-old girl, who has had cold & fever for 3 days, is sent
home from school because she is feeling so poorly. Later in the
same day she develops a maculopapular rash on her face &
trunk. She does not want to get out of bed, preferring the
bedroom curtains to be closed. On examination, there is
grayish spot on the mucous membrane of her mouth.
I D E A L
Click button ‘Add Scenario’Click button ‘Add Scenario’
I D E A L
2nd Scenario is Added2nd Scenario is Added
Sequential position of this scenario is indicated
I D E A L
By default the feedback from the previous (first) scenario is included
By default the feedback from the previous (first) scenario is included
I D E A LI D E A LI D E A LI D E A L
International Database for Enhanced Assessments & LearningInternational Database for Enhanced Assessments & Learning
Several vignettes can be generated under the
same option set
I D E A L
Example of a 3rd ScenarioExample of a 3rd Scenario
One yr-old boy is admitted to the A&E department due to
high fever & generalized rash. His mother claims that the
boy was still playful a few hours ago & his condition has
deteriorated very quickly. On examination, the rash is
non-blanching , irregular in size, with a necrotic centre.
I D E A LI D E A LI D E A LI D E A L
International Database for Enhanced Assessments & LearningInternational Database for Enhanced Assessments & Learning
Transferring the R-Type Item(s)
to MS Word
I D E A L
If one has finished entering all scenarios for a particular set of options, but wishes to also generate other R-type items, click the button ‘Export and Continue’
If one has finished entering all scenarios for a particular set of options, but wishes to also generate other R-type items, click the button ‘Export and Continue’
Using this protocol, the exported item will be displayed in MS Word only after all the other R-type items have been created
I D E A L
When one has finished generating all R-type items click button “Export and Exit”
When one has finished generating all R-type items click button “Export and Exit”
Using this protocol, the wizard will close & a MS Word document will appear (see next slide)
Example of an R-type Item Displayed in MS Word Example of an R-type Item Displayed in MS Word
After item(s) is (are)
displayed in MS Word,
go to Word’s menu bar
- click View
- select Print Layout
I D E A L
If no appropriate option set is presently available in the Wizard, add a new option set for use now & for the future
how to achieve this is explained in the following slides
The Wizard can Increase in its Capability
I D E A L
Click the Tab ‘Input/Edit Option Set(s)’ Click the Tab ‘Input/Edit Option Set(s)’
I D E A L
Select an existing DisciplineSelect an existing TopicSelect an existing Theme
Select an existing DisciplineSelect an existing TopicSelect an existing Theme
I D E A L
Compose (or copy & paste) your new options one by one within ‘Add Option’ text box & click the
button ‘Add’
Compose (or copy & paste) your new options one by one within ‘Add Option’ text box & click the
button ‘Add’
The options will be added to above option set text box
I D E A L
An Example of a New Option Set for the Theme of ‘Chest Pain’
An Example of a New Option Set for the Theme of ‘Chest Pain’
Asthma
Costochondritis (Tietze Syndrome)
Conversion Disorder
Esophagitis
Foreign Body
Myocarditis
Muscle strain
Pericarditis
Pneumonia
Pneumothorax
Precordial Catch Syndrome
Supraventricular Tachycardia
I D E A L
Generating the New Option Set Generating the New Option Set
Click ‘Create New Option Set’ button & the new option set is added to the wizard & its total number of option sets is appropriately increased (e.g., 271)
I D E A LI D E A LI D E A LI D E A L
International Database for Enhanced Assessments & LearningInternational Database for Enhanced Assessments & Learning
Wizard also enables one to add additional sets
of
Disciplines / Topics / Themes
I D E A L
Type in a new discipline in relevant text box & click button ‘Add Discipline/Panel’
Type in a new discipline in relevant text box & click button ‘Add Discipline/Panel’
I D E A L
Similarly type in a new topic & theme in relevant text box
& click the button ‘Add Topic/Theme’
Similarly type in a new topic & theme in relevant text box
& click the button ‘Add Topic/Theme’
I D E A LI D E A LI D E A LI D E A L
International Database for Enhanced Assessments & LearningInternational Database for Enhanced Assessments & Learning
Saving the changes made to
Discipline / Topic / Theme
I D E A L
Click button ‘Save Changes Permanently’Click button ‘Save Changes Permanently’
I D E A LI D E A LI D E A LI D E A L
International Database for Enhanced Assessments & LearningInternational Database for Enhanced Assessments & Learning
R-type Intranet Wizard
I D E A L
The R-type Wizard Intranet Version has all the same features as the PC Version.
and in addition, items created with the Intranet Wizard can be saved to the IDEAL non-restricted item bank if this item bank is being kept on the same server as the wizard
I D E A L
To enter the item into the non-restricted IDEAL
bank, click button ‘Save Item and Continue Edit’
To enter the item into the non-restricted IDEAL
bank, click button ‘Save Item and Continue Edit’
Recommended