8
REVIEW ARTICLE Motivating student learning using a formative assessment journey Darrell J. R. Evans, 1 Paul Zeun 2 and Robert A Stanier 3 1 Office of the Pro Vice-Chancellor (Learning and Teaching), Monash University, Melbourne, Australia 2 Brighton and Sussex Medical School, Sussex University, Brighton, UK 3 Information Services, University of Brighton, Brighton, UK Abstract Providing formative assessment opportunities has been recognised as a significant benefit to student learning. The outcome of any formative assessment should be one that ultimately helps improve student learning through familiarising students with the levels of learning required, informing them about gaps in their learning and providing feedback to guide the direction of learning. This article provides an example of how formative assessments can be developed into a formative assessment journey where a number of different assessments can be offered to students during the course of a module of teaching, thus utilising a spaced- education approach. As well as incorporating the specific drivers of formative assessment, we demonstrate how approaches deemed to be stimulating, interactive and entertaining with the aim of maximising enthusiasm and engagement can be incorporated. We provide an example of a mixed approach to evaluating elements of the assessment journey that focuses student reaction, appraisal of qualitative and quantitative feedback from student questionnaires, focus group analysis and teacher observations. Whilst it is not possible to determine a quantifiable effect of the assessment journey on student learning, usage data and student feedback shows that formative assessment can achieve high engagement and positive response to different assessments. Those assessments incorporating an active learning element and a quiz-based approach appear to be particularly popular. A spaced-education format encourages a building block approach to learning that is continuous in nature rather than focussed on an intense period of study prior to summative examinations. Key words: anatomy; feedback; formative assessment; quiz; spaced education; student learning. Introduction Formative assessment is designed to aid learning by gener- ating feedback information that benefits students during the learning process and leads to enhanced learning out- comes. The provision of opportunities for formative assess- ment has been recognised as a significant benefit to student learning (Rolfe & McPherson, 1995; Black & Wiliam, 1998; Bierer et al. 2008; Carrillo-de-la-Pena et al. 2009). For- mative assessments are usually systematic in approach, and are designed to be available to students during a particular period of study to provide motivation for learning. Whilst it is generally agreed that the outcome of any formative assessment should be one that ultimately helps improve learning, it has been suggested that there should be focus on three specific drivers when designing any formative assessment: using a method to inform students of gaps in their learning; familiarising students with the expectations of summative assessments; and providing feedback that guides the direction of student learning (Rolfe & McPherson, 1995; Krasne et al. 2006). Ideally and unlike summative assessments, formative assessment should occur in a non- threatening environment, be offered at a time that is applicable to the students’ learning journey and be one where the student takes an active part in the process (Rolfe & McPherson, 1995; Harlen & James, 1997; Krasne et al. 2006). The progress of students will only be enhanced by formative assessment if they are able to use the opportunities effectively and recognise where they need to develop their learning or skills. The retention of knowledge after the learning period is essential so that the ‘graduate’ is able to use and rely on a full understanding of that knowledge for use in their chosen career (Sugand et al. 2010). This deeper learning is Correspondence Darrell J.R. Evans, Office of the Pro Vice-Chancellor, Monash Univer- sity, PO Box 197, Caulfield East, Melbourne, Vic 3150, Australia. T: #61 3 990 34489; E: [email protected] Accepted for publication 21 August 2013 © 2013 Anatomical Society J. Anat. (2013) doi: 10.1111/joa.12117 Journal of Anatomy

Motivating student learning using a formative assessment journey

Embed Size (px)

Citation preview

Page 1: Motivating student learning using a formative assessment journey

REVIEW ARTICLE

Motivating student learning using a formativeassessment journeyDarrell J. R. Evans,1 Paul Zeun2 and Robert A Stanier3

1Office of the Pro Vice-Chancellor (Learning and Teaching), Monash University, Melbourne, Australia2Brighton and Sussex Medical School, Sussex University, Brighton, UK3Information Services, University of Brighton, Brighton, UK

Abstract

Providing formative assessment opportunities has been recognised as a significant benefit to student learning.

The outcome of any formative assessment should be one that ultimately helps improve student learning

through familiarising students with the levels of learning required, informing them about gaps in their

learning and providing feedback to guide the direction of learning. This article provides an example of how

formative assessments can be developed into a formative assessment journey where a number of different

assessments can be offered to students during the course of a module of teaching, thus utilising a spaced-

education approach. As well as incorporating the specific drivers of formative assessment, we demonstrate how

approaches deemed to be stimulating, interactive and entertaining with the aim of maximising enthusiasm and

engagement can be incorporated. We provide an example of a mixed approach to evaluating elements of the

assessment journey that focuses student reaction, appraisal of qualitative and quantitative feedback from

student questionnaires, focus group analysis and teacher observations. Whilst it is not possible to determine a

quantifiable effect of the assessment journey on student learning, usage data and student feedback shows that

formative assessment can achieve high engagement and positive response to different assessments. Those

assessments incorporating an active learning element and a quiz-based approach appear to be particularly

popular. A spaced-education format encourages a building block approach to learning that is continuous in

nature rather than focussed on an intense period of study prior to summative examinations.

Key words: anatomy; feedback; formative assessment; quiz; spaced education; student learning.

Introduction

Formative assessment is designed to aid learning by gener-

ating feedback information that benefits students during

the learning process and leads to enhanced learning out-

comes. The provision of opportunities for formative assess-

ment has been recognised as a significant benefit to

student learning (Rolfe & McPherson, 1995; Black & Wiliam,

1998; Bierer et al. 2008; Carrillo-de-la-Pena et al. 2009). For-

mative assessments are usually systematic in approach, and

are designed to be available to students during a particular

period of study to provide motivation for learning. Whilst it

is generally agreed that the outcome of any formative

assessment should be one that ultimately helps improve

learning, it has been suggested that there should be focus

on three specific drivers when designing any formative

assessment: using a method to inform students of gaps in

their learning; familiarising students with the expectations

of summative assessments; and providing feedback that

guides the direction of student learning (Rolfe &McPherson,

1995; Krasne et al. 2006). Ideally and unlike summative

assessments, formative assessment should occur in a non-

threatening environment, be offered at a time that is

applicable to the students’ learning journey and be one

where the student takes an active part in the process

(Rolfe & McPherson, 1995; Harlen & James, 1997; Krasne

et al. 2006). The progress of students will only be

enhanced by formative assessment if they are able to use

the opportunities effectively and recognise where they

need to develop their learning or skills.

The retention of knowledge after the learning period is

essential so that the ‘graduate’ is able to use and rely on a

full understanding of that knowledge for use in their

chosen career (Sugand et al. 2010). This deeper learning is

Correspondence

Darrell J.R. Evans, Office of the Pro Vice-Chancellor, Monash Univer-

sity, PO Box 197, Caulfield East, Melbourne, Vic 3150, Australia.

T: #61 3 990 34489; E: [email protected]

Accepted for publication 21 August 2013

© 2013 Anatomical Society

J. Anat. (2013) doi: 10.1111/joa.12117

Journal of Anatomy

Page 2: Motivating student learning using a formative assessment journey

usually achieved when knowledge is not restricted to learn-

ing a collection of isolated facts, and is instead a result of

an active learning process being engaged and knowledge

being fully understood and retained in context by the

learner. Cognitive psychology research demonstrates that

understanding involves creating links, and this is accom-

plished through active participation of the learner and

being familiar with the material in question (Harlen &

James, 1997). It has been suggested that the incorporation

of formative assessment into the process will encourage

adoption of an active learning approach and therefore may

help achieve deeper learning (Rolfe & McPherson, 1995). In

addition, it has been recognised that retention of gained

knowledge is improved when educational encounters are

spaced and repeated over a defined period and students

are encouraged to apply ongoing learning and not a cram-

ming technique just before the final examinations (Krasne

et al. 2006; Kerfoot et al. 2007). Greater use of formative

assessment throughout the module or course therefore pro-

vides an ideal opportunity for encouraging a spaced

approach to learning.

Incorporating an active experience into the formative

assessment format used is important, and research suggests

that students prefer approaches that are stimulating, moti-

vating and entertaining because they encourage their

involvement (Harlen & James, 1997; Hudson & Bristow,

2006). The use of games can be used as an educational

intervention to achieve these goals, and such strategies

may help promote longer-term knowledge retention and

the learning of key cognitive skills (Akl et al. 2010). A wide

variety of games has been used as formative assessments

in subjects such as physiology, biochemistry and pharma-

cology, and approaches have included board games,

puzzles and activities based on television game shows

(Moy et al. 2000; Willmott, 2001; Howard et al. 2002;

Zakaryan et al. 2005; Hudson & Bristow, 2006; Shah et al.

2010). In each case students appear to have reacted

positively to each intervention, and results suggests that

the students’ learning process might be enhanced using

such approaches.

Formative assessment opportunities have been used in

many areas of medical training, and are seen by some as

an expected provision by medical schools to ensure stu-

dents are able to track progress and therefore reach speci-

fied competencies (Bierer et al. 2008). For the opportunity

of formative assessment to be maximized, it must there-

fore feature as a built-in component of a planned curricu-

lum (Rushton, 2005). In the anatomy arena formative

assessment has been used for many years, although has

increasingly become a defined and integrated part of the

approach used in gross anatomy, histology and embryol-

ogy (McBride & Prayson, 2008; Rizzolo et al. 2010; Evans,

2011). Here we present a formative assessment journey

where a number of different assessments can be offered

to students during the course of a module or unit of

teaching, thus utilising a spaced-education approach. In

this example from Brighton and Sussex Medical School

(BSMS), assessments included those of differing content,

format and release, and were made available to all stu-

dents taking the module. A specific focus was given to

activity and quiz-based approaches with the aim of maxi-

mising enthusiasm and engagement. We demonstrate how

a mixed approach to evaluation that focusses on aspects

including evaluation of the server logs from the Learning

Management System (LMS), appraisal of qualitative and

quantitative feedback from student questionnaires, focus

group analysis and teacher observations can be used to

examine the use of and student reaction to formative

assessment.

Creating an assessment journey

A collection of nine formative assessments in anatomy was

designed and introduced into each of the system-based

modules at BSMS. The system-based modules make up the

basis of the first 2 years of the medical programme, and are

designed to combine both scientific and clinical knowledge

and skills in an integrated manner. Anatomy features as an

interwoven element throughout each of the system-based

modules, and is delivered using a multi-faceted approach

that includes dissection (Evans & Watt, 2005; Evans & Cuffe,

2009). Individual elements of assessment were designed to

have a different focus both in terms of content and

approach using an interactive element where possible.

Whilst content was directed towards anatomical knowl-

edge, each assessment included functional and clinical rele-

vance and reference to other elements of the module to

enhance an integrated approach. In each case the assess-

ments were targeted at different stages during the running

of the modules to create a formative assessment journey,

whereby specific assessments were released at defined

times during the 10 weeks of each module. All students

were introduced to the concept of formative vs. summative

assessments in order to reduce any confusion (Anziani et al.

2008).

Table 1 provides a summary of the formative assessments

released in each module, and includes the time of release,

the mode of delivery, and details of when students receive

answers and feedback. Assessments were not all originally

produced at the same time, and it took a period of 3 years

to put the full assessment journey together. Analysis was

made, however, for students that had access to all assess-

ments.

• A ‘Who wants to be an Anatomist’ quiz approach was

used in each lecture in order to break up the session,

to take account of students’ total concentration and

to see how they were responding to the material

being presented. A question would appear at different

times during the presentation with four possible

answers to which a colour was assigned. Students were

© 2013 Anatomical Society

Formative assessment journey, D. J. R. Evans et al.2

Page 3: Motivating student learning using a formative assessment journey

each provided with a collection of cards of the same

four colours as an automated audience response sys-

tems (ARS) was not available, and when prompted

were asked to show the lecturer the colour of their

chosen answer. The lecturer was able to receive an

immediate response of student performance and pro-

vide feedback to students.

• A wordsearch puzzle was released on the LMS after

each lecture, and contained 10 words that the lecturer

felt were important to the lecture topic and with

which the students should become familiar and be

able to define.

• The dissection checklists appeared in the dissection

notes along with a number of clinical and observa-

tional questions. The checklists covered the main

learning outcomes of the session, and were used by

each table to check student knowledge in a group

environment and provide immediate feedback. Simple

PowerPoint quizzes containing a selection of different

question formats were released to students via the

LMS at the end of every 2-week teaching period. The

quiz included image annotation, multiple choice and

short-answer questions. Answers were time-released

for the following week.

• A self-assessment quiz was released in the second half

of each module, it was held in a presentation format

for all students in the lecture theatre. Students were

asked to write down their individual answers to a

range of questions. Following the quiz, students went

through their answers in a group tutorial environment

with demonstrators.

• Spotter tests using specimens, models and images were

incorporated into the dissection review sessions in the

anatomy laboratory. The definitive answers were

released 1 day after the session on the LMS.

• The ‘A Question of Anatomy’ revision/review quiz was

developed as a screencast and delivered online. The

quiz was loosely based on a UK television programme

called ‘A Question of Sport’ and used a number of dif-

ferent quiz rounds with varying formats. The screen-

cast lasted for approximately 15 min without breaks,

but could be paused at any point. The screencast

approach allowed students to have multiple attempts,

and for the lecturer to provide immediate feedback

and include supplementary questions.

• The anatomy viva was delivered as a group activity

where the students from each dissecting table were

asked a serious of oral questions using specimens and

models. Students were each asked individual questions

to test their knowledge and understanding. Unlike all

the other assessments, an element of a summative

approach was included in the vivas with students

required to reach a satisfactory standard before being

‘signed-off’ by the examiner.

• The final element of the assessment journey was the

online picture quiz, which students could access on an

individual basis at any time. On entering the quiz, stu-

dents were presented with a set of six randomly cho-

sen anatomical images from a large database of

multiple choice and true/false answer image-based

questions. Whilst students would get a single attempt

at each question, they could access a new set of six

randomly chosen questions as many times as they

wished. Ongoing total scores were made available to

the student and also presented as part of a league

table to all students.

Table 1 Details of each assessment type used in the formative assessment journey.

Assessment Release time (Module is 10 weeks) Mode/location of delivery Answers/feedback

‘Who Wants to be an

Anatomist?’

During each lecture (weeks 1–7) Interactive coloured card quiz,

lecture theatre

Immediate

Anatomical wordsearch At the end of each lecture (weeks 1–7) Puzzle, managed learning

environment

One week after

release

Dissection session

checklist

At the end of each dissection session (weeks

1–7)

Checklist and questions, anatomy

laboratory

Immediate

‘Anatomy Quiz of the

Week’

At the end of each 2-week period of

anatomy teaching (weeks 2, 4, 6, 8)

PowerPoint-based quiz, managed

learning environment

One week after

release

Anatomy self-

assessment quiz

Week 6 PowerPoint-based quiz, lecture

theatre and tutorial rooms

Immediate

Anatomy spotter test Week 7 Anatomical specimens/models,

anatomy laboratory

One day after

dissection session

‘A Question of

Anatomy’ Revision quiz

Week 8 Screencast quiz, managed learning

environment

Immediate

Anatomy viva Week 8/9 Oral assessment, anatomy

laboratory

Immediate and

result 1 day later

Online picture quiz Week 7–10 (new questions added each week) Interactive online quiz, managed

learning environment

Immediate (plus

league table)

© 2013 Anatomical Society

Formative assessment journey, D. J. R. Evans et al. 3

Page 4: Motivating student learning using a formative assessment journey

Student reaction to a formative assessmentjourney

A mixed analysis approach was adopted to assess student

usage and reaction to the implementation of the formative

assessment journey, and focussed on both qualitative and

quantitative data retrieval for one first-year and one sec-

ond-year module. Data were collected from the LMS server

logs, teacher observations, a focus group and feedback

questionnaires.

Student usage

Server log data from the LMS were retrieved for each of

those assessments that had an online element, for example

‘Anatomy Quiz of the Week’ or the downloading of results

of the spotter test. Data for each assessment were focussed

on the total number of downloads; the number of students

within a cohort downloading or attempting the assessment;

and the maximum number of downloads made by an indi-

vidual student. Four separate items of analysis were chosen,

with each focussing on different aspects of the student

usage (Table 2). The number of downloads for each ele-

ment differed substantially, with some assessments such as

the wordsearches receiving relatively few downloads (e.g.

23 for one wordsearch in the first-year module), whilst oth-

ers received a much higher level (e.g. 270 for the second-

year spotter test results). This was largely reflected in the

total number of students downloading each assessment,

which ranged from 13% to 77% of the total cohort.

Although the average number of repeated downloads per

participating student averaged only 1 in each case, some

students downloaded a particular assessment up to 11

times. For the online picture quiz, student usage data were

recorded based on numbers of questions answered in the

quiz collectively by the student cohort and by individual

students. The quizzes were released for 3 weeks prior to the

summative examination, and a total of 39 704 and 12 795

questions were answered by first- and second-year students,

respectively. First-year students recorded a total of 85%

correct answers in their quiz, and second-year students

recorded 74% correct answers. The maximum number of

questions attempted by an individual student in each quiz

was 2765 for the first-year module and 689 for the second-

year module, with an average of 272 and 127 attempts per

student in each respective year group. The proportion of

students attempting the quiz was 94% for first-year stu-

dents and 75% for second-year students.

Student reaction

First- and second-year student feedback was collected for

formative assessments via questions contained in the formal

end-of-module anonymous questionnaires. Any open com-

ments made about anatomy and the assessment in particu-

lar were noted and categorised into common themes. One-

hundred and forty-four first-year students (97% of student

cohort) and 127 second-year students (96% of student

cohort) responded to the questionnaire. All students were

given the opportunity to contribute to open-ended com-

ments under two categories: best aspect of the module;

and aspects requiring improvement. A total of 134 (first

year) and 102 (second year) separate comments attributed

to the anatomy component were made in the ‘best aspect’

section, and included remarks related to the overall teach-

ing quality, the subject area, lecture content and staff. Of

the anatomy comments, 37 (first year) and 17 (second year)

individual comments were made specifically about the for-

mative assessments offered and are categorised in Table 3.

There were no first-year comments about anatomy in the

Table 2 Student usage data retrieved from LMS server logs for online formative assessments. Figures in brackets represent the number of

students as a percentage of the year cohort.

Assessment

Average number of

downloads per type of

assessment

Average number of

students downloading

each assessment

Average number of

downloads per student

Maximum number of

downloads for one

student

1st year

module

2nd year

module

1st year

module

2nd year

module

1st year

module

2nd year

module

1st year

module

2nd year

module

Anatomical wordsearch 23 41 20 (13%) 33 (25%) 1 1 1 1

‘Anatomy Quiz of the

Week’

133 122 74 (50%) 69 (52%) 1 1 7 6

Anatomy spotter test 144 270 77 (52%) 97 (73%) 1 1 4 11

‘A Question of Anatomy’

Revision quiz

177 112 114 (77%) 68 (52%) 1 1 4 6

For the wordsearch and quiz of the week assessments, the results presented are a typical example of each of these types of assess-

ments as there were multiple wordsearches and quizzes of the week released during the module.

LMS, learning management system.

© 2013 Anatomical Society

Formative assessment journey, D. J. R. Evans et al.4

Page 5: Motivating student learning using a formative assessment journey

‘aspects requiring improvement’ section of the question-

naire, but nine separate comments were made about the

anatomy component from the second-year students, and of

these two were attributed to the formative assessments

(Table 3).

Quantitative evaluation using a five-point Likert scale was

also made of whether first-year students found the ‘Ques-

tion of Anatomy’ quiz of high quality and as a useful ele-

ment in their learning. A total of 140 students (94% of

student cohort) completed this section of the questionnaire,

and indicated that they rated the usefulness of the material

covered as an average of 4.4 and the difficulty and chal-

lenge of the material tested at 4.1. Students also gave a

high rating for the interest and enjoyment of the quiz with

an average score of 4.5.

Analysis of student reaction was also assessed using a

small focus group approach, to which four volunteer stu-

dents from year 1 were recruited in response to an open

e-mail invitation. The focus group methodology was

included as we wanted to explore the question of formative

assessment in relation to learning styles, the approach used

to teach anatomy and to capitalise on group interactions. A

student facilitator was used for the focus group to help

ensure no bias was given to the questions and discussion

topics raised and responses recorded. The format of the

focus group was semi-structured, with prompts ensuring

that student views were appropriately explored. This

approach was used to help keep the discussion reasonably

focussed, whilst allowing views to be freely expressed.

Notes (agreed by the student group) were taken by the

facilitator during the discussion and used for further analy-

sis. The focus group highlighted that formative assessment

opportunities helped ‘consolidate their knowledge’ by link-

ing particular concepts and information learned in a teach-

ing session. Students commented that they ‘like to know

what you need to know and to what level’, and formative

assessments helped them gauge this more clearly. When

asked, not all students in the group were aware that they

had been through a formative assessment journey, but

recognised the benefit of releasing assessments at different

times. They felt such an approach helped reinforce their

learning in a continuous way and not just during the revi-

sion/review period. Students felt it was important that for-

mative assessments were ‘not an absolute requirement’,

and that they could choose what to use and when. When

asked about individual resources, the students commented

that ‘different students find different formative assessments

more useful than others’. Students were aware that they

have different learning styles and used the example that

whilst for some a wordsearch puzzle might be effective, for

others it was less so as it was not particularly active in

approach. The ‘Who wants to be an Anatomist’ quiz was

highlighted as a way of maintaining interest and attention

during lectures. The group members felt it gave them ‘more

of an incentive to listen’, allowed them to follow the thread

of the lecture and was done in a non-threatening way so as

not to embarrass particular students who did not know the

answer to the question. The immediate feedback allowed

them to re-examine a concept they may have been strug-

gling to grasp or identify gaps in their knowledge. This was

also true of the dissection checklists that the students in the

group valued as these allowed them to test each other and

identify and correct areas they had not been clear on

before leaving the laboratory. The quizzes of the week,

whilst popular, were not always accessed by this group of

students as they felt they needed time to direct towards

other non-anatomical areas of learning in the module and

not spend all their time on one subject. Some commented

that they thought the quizzes could have covered other

material delivered in that week of learning and not just

anatomy and delivered as a ‘unified quiz’. The group all

used the revision/review quiz and online picture quiz as

they felt it was a good way to review material, with one

student commenting that it helped ‘check my progress and

highlight what I didn’t know’. Students thought it was a

fun and interactive approach and gave variation to their

learning. In each case students felt that whilst the feedback

given for each question was useful it could have been

expanded.

Teacher observation

For those assessments that were not delivered online and

where no LMS data could therefore be retrieved, such

as in the lecture ‘Who wants to be an Anatomist’ quiz

and the anatomy self-assessment quiz, qualitative teacher

observations on student engagement (including atten-

dance, discussion and interaction) were recorded through

informal interviews. In the case of the delivery of the ‘Who

wants to be an Anatomist’ quiz, the lead teacher reported

that all students appeared to participate by raising the

Table 3 Details of qualitative student comments attributed to the for-

mative assessments obtained from the end-of module questionnaire.

Categorization of student comments

Number of

comments

First

year

Second

year

Best aspects

Having formative assessment in anatomy 11 8

Aided in lecture interaction 10 -

Needed for other disciplines 9 6

Variety of assessment types 6 3

Viva 1 –

Aspects requiring improvement

Questions were not always representative

of summative assessments

– 1

Viva should be placed earlier in the cycle – 1

© 2013 Anatomical Society

Formative assessment journey, D. J. R. Evans et al. 5

Page 6: Motivating student learning using a formative assessment journey

coloured card enthusiastically suggesting positive engage-

ment. A total of two–four questions were delivered in the

space of a 50-min lecture. It was noted that a minority of

students were initially rather hesitant in providing answers

to the questions; however, this appeared to improve as

the module progressed and students became used to the

quiz approach. The dissection checklists were used by both

tutors and students to check knowledge and understand-

ing of the main learning outcomes at the end of each dis-

section session. These appeared to work well, with most

students reported to have responded and interacted well.

Tutors found that the checklists were particularly useful in

identifying those areas requiring clarification or more

cadaveric dissection. Many students also used the checklists

as an aide memoir during their dissection sessions to

ensure they were covering the objectives of the session.

This was even more notable in the review/revision sessions

held towards the end of the module where students

reviewed all the material covered in the sessions and had

access to the checklists. The self-assessment quiz was well

attended by the students in both the lecture element and

subsequent feedback tutorial (approximately 95%). Tutors

reported that the feedback sessions were interactive and

students appeared positively engaged, with most students

regularly proffering answers to questions. Informal feed-

back from the students suggested they approached the quiz

in one of two ways, with some students actively revising

their knowledge beforehand and other students testing

their current level of knowledge and determining how

much extra learning was necessary to achieve a suitable

standard. The viva was a compulsory element and delivered

as a group activity. Students demonstrated professional

behaviour during the assessment, and the assessors gauged

the level of performance as very high for most students.

A total of seven second-year students (5%) were judged not

to have achieved the standard of knowledge and under-

standing required, and they were given a subsequent addi-

tional opportunity at a later date, and all students were

able to be ‘signed’ off at this stage. All first-year students

were ‘signed’ off after their first viva attempt.

The effect of an assessment journey onstudent learning activity

A formative assessment journey was designed and intro-

duced in anatomy to examine the effect of a variety of dif-

ferent assessment modes released and available to students

at defined stages during the course of the module on stu-

dent learning activity. Overall the analysis of the data col-

lected demonstrated that formative assessments were well

used by students, although the reasons for utilising each

assessment and the numbers of students using each assess-

ment were different.

A spaced-education approach was used for introducing

each of the formative assessments, and each was released

at different stages during the module to allow a building

block approach to learning to be supported and meant

each assessment included only the material that had already

been covered or alluded to at that stage of the module,

thus not alienating students by testing on unseen material.

It has been argued that knowledge retention is improved

when educational encounters are spaced and repeated over

time (Krasne et al. 2006; Kerfoot et al. 2007). Interestingly

students in the focus group did not appear to recognise

that they had been through a formative assessment jour-

ney, although they thought such an approach was benefi-

cial and would help reinforce their learning in a continuous

way, which is in line with student feedback from other

studies (Bierer et al. 2008). To improve the perception of

the journey, all students are now given an overview of the

assessment journey at the start of the module and provided

with an illustrative map showing the types of assessment

and when they are available.

An active approach was built into the design of many of

the assessments to encourage participation and to enhance

the way students experiment with their learning. Data from

the LMS server logs show that some assessments were used

more than others, with those that required a more active

approach such as the ‘A Question of Anatomy’ revision quiz.

The results of the online picture quiz, which combined the

most active elements, demonstrate this trend further with

extremely high participation rates recorded especially by

first-year students. In contrast, the wordsearch puzzles were

used less widely, and this might be because this was a less

active assessment type or that this approach does not reflect

the types of questions used in the summative assessment

and therefore is perceived as less useful. Rolfe & McPherson

(1995) suggest that when an active learning approach is

used in assessment design, deeper learning is encouraged. It

is unclear whether the introduction of a formative assess-

ment journey using active formats has helped develop a

deeper approach to learning in our students, and this can

only be judged at a later date when students are required

to use the knowledge and understanding gained in subse-

quent modules and when on particular clinical rotations.

It has been reported that students use a range of differ-

ent resources in their learning and in preparation for their

examinations (Ozolins et al. 2008). The formative assess-

ment journey was designed to incorporate a variety of dif-

ferent assessment types so that students would not get

overly used to just one type of assessment, and so that all

students would hopefully be able to find an assessment

that they felt was useful in their learning. Usage data dem-

onstrated that a large percentage of students used many if

not all the assessments on offer, although they utilised

some assessment types more than others. Students in the

focus group commented that it was important that they

could choose what to use and when, and this suited the

various learning styles different students have. Some

students suggested that if similar assessments could be

© 2013 Anatomical Society

Formative assessment journey, D. J. R. Evans et al.6

Page 7: Motivating student learning using a formative assessment journey

made available in other module themes or combined into

the anatomy assessments this would provide a more

rounded progress report for them and could utilise their

time more effectively. Student feedback demonstrated that

the online revision quiz and picture quiz were the most

popular assessments, and this was attributed in part to the

fun nature of the quizzes. Other studies also suggest that

students prefer approaches that are stimulating, motivating

and entertaining because they encourage their involvement

(Harlen & James, 1997; Hudson & Bristow, 2006). In addi-

tion, incorporation of fun into the learning process can help

reduce the stress and anxiety some students have about

assessment and help them to deal with the overwhelming

feeling that there is too much to learn (Allery, 2004; Ballon

& Silver, 2004; Zhang et al. 2011). One reason might be that

activities such as quizzes and puzzles are often associated as

being a recreational activity (Shah et al. 2010).

Teacher observations demonstrated that the ‘Who wants

to be an Anatomist’ quiz approach worked well in the

lecture sessions with high levels of participation. Students

reported that this quiz approach maintained interest

and attention during the lectures. This lecture-based quiz

approach has been used widely for many years, with

Harden reporting the use of audience response cards in lec-

tures several decades ago, and showed that it helped main-

tain student interest and enabled a student to self-assess

their understanding (Harden, 1968). The use of coloured

card and similar approaches has been largely superseded by

the introduction of automated ARS, which have also been

shown to enhance attention and enthusiasm in learners

(Miller et al. 2003; Latessa & Mouw, 2005; Alexander et al.

2009). The current study demonstrates, however, that the

coloured card system is still an appropriate method to use

and one that is highly valued by students. Whilst it is recog-

nised that the coloured card approach is more limited than

using ARS clickers, it does provide an opportunity for spon-

taneous questions to be introduced if gaps in understand-

ing are identified during the session, and unlike ARS it is

not subject to technical difficulties, is fully transportable

and the cost is minimal.

Immediacy of feedback appears to be appreciated by the

students and noted as an attribute for some of the assess-

ments used in the formative assessment journey, such as the

self-assessment quiz, anatomy viva and for the dissection

checklists. Students noted the checklists as particularly valu-

able as they allowed them to identify and correct areas

immediately (through their own investigation or with help

from a demonstrator) and before leaving the anatomy

laboratory. Checklists have been shown to also increase

practical examination scores and dissection quality (Hofer

et al. 2011). It is also recognised that students benefit

from not always being provided with answers immediately,

and a number of assessments can be used that encour-

age students to find out answers for themselves after the

assessment.

Concluding remarks

The development of a formative assessment journey in

anatomy provides a programme of different assessments

that can help ensure students find a format to engage

with and to act as an effective learning support resource.

Assessments are designed to incorporate the drivers of

highlighting gaps in student learning, giving indication to

the level of knowledge required, and to provide useful

feedback (Rolfe & McPherson, 1995; Krasne et al. 2006).

Presenting formative assessment using a temporal journey

format encourages a continuous and staged approach to

learning rather than an intense period of study just prior

to summative assessments. Whilst it was not possible to

determine a quantifiable effect of the assessment journey

on student learning, the overall engagement with the ele-

ments of the assessment journey suggests that students

reacted positively to the inclusion of each resource. To

ensure that active participation continues in the future,

however, it will be important to enhance assessment jour-

neys by involving students with the development of the

resources.

Acknowledgements

The authors would like to thank Tim Vincent for helping

with the technical aspects of some of the online materials,

Tracy Cuffe for some of the quiz design, and Alison Bryson

for help with the text. The authors are also grateful to

the students who took part in the focus group and com-

pleted anonymous questionnaires. Ethical approval was not

required for this study, and the anonymity of the partici-

pants in data collection through informal questioning,

questionnaires and the focus group was guaranteed.

Author contributions

DJRE: concept and design of the formative assessments, the

construction of the assessment journey, literature search,

data collection and analysis, and manuscript preparation.

PZ: literature search, focus group facilitation and analysis,

manuscript preparation. RAS: technical construction of the

online picture quiz, data collection and analysis, and manu-

script preparation.

References

Akl EA, Pretorius RW, Sackett K, et al. (2010) The effects of edu-

cational games on medical students’ learning outcomes: a sys-

tematic review. Med Teach 32, 16–27.

Alexander CJ, Crescini WM, Juskewitch JE, et al. (2009) Assess-

ing the integration of audience response system technology

in teaching of anatomical sciences. Anat Sci Educ 2, 160–166.

Allery LA (2004) Educational games and structured experiences.

Med Teach 26, 504–505.

© 2013 Anatomical Society

Formative assessment journey, D. J. R. Evans et al. 7

Page 8: Motivating student learning using a formative assessment journey

Anziani H, Durham J, Moore U (2008) The relationship between

formative and summative assessment of undergraduates in

oral surgery. Eur J Dent Educ 12, 233–238.

Ballon B, Silver I (2004) Context is key: an interactive experien-

tial and content frame game. Med Teach 26, 525–528.

Bierer SB, Dannefer EF, Taylor C, et al. (2008) Methods to assess

students’ acquisition, application and integration of basic sci-

ence knowledge in an innovative competency-based curricu-

lum. Med Teach 30, e171–e177.

Black P, Wiliam D (1998) Assessment and classroom learning.

Assess Educ 5, 7–74.

Carrillo-de-la-PenaMT, Bailles E, Caseras X, et al. (2009) Formative

assessment and academic achievement in pre-graduate students

of health sciences.Adv Health Sci Educ Theory Pract 14, 61–67.

Evans DJ (2011) Using embryology screencasts: a useful addition

to the student learning experience? Anat Sci Educ 4, 57–63.

Evans DJ, Cuffe T (2009) Near-peer teaching in anatomy: an

approach for deeper learning. Anat Sci Educ 2, 227–233.

Evans DJ, Watt DJ (2005) Provision of anatomical teaching in a

new British medical school: getting the right mix. Anat Rec

284B, 22–27.

Harden RM (1968) An audience response card. Br J Med Educ 2,

220–222.

Harlen W, James M (1997) Assessment and learning: differences

and relationships between formative and summative assess-

ment. Assess Educ 4, 365–379.

Hofer RE, Nikolaus OB, Pawlina W (2011) Using checklists in a

gross anatomy laboratory improves learning outcomes and

dissection quality. Anat Sci Educ 4, 249–255.

Howard MG, Collins HL, DiCarlo SE (2002) “Survivor” torches

“Who wants to be a physician?” in the educational games rat-

ings war. Adv Physiol Educ 26, 30–36.

Hudson JN, Bristow DR (2006) Formative assessment can be fun

as well as educational. Adv Physiol Educ 30, 33–37.

Kerfoot BP, Baker HE, Koch MO, et al. (2007) Randomized, con-

trolled trial of spaced education to urology residents in the

United States and Canada. J Urol 177, 1481–1487.

Krasne S, Wimmers PF, Relan A, et al. (2006) Differential effects

of two types of formative assessment in predicting perfor-

mance of first-year medical students. Adv Health Sci Educ The-

ory Pract 11, 155–171.

Latessa R, Mouw D (2005) Use of an audience response system

to augment interactive learning. Fam Med 37, 12–14.

McBride JM, Prayson RA (2008) Development of synergis-

tic case-based microanatomy curriculum. Anat Sci Educ 1,

102–105.

Miller RG, Ashar BH, Getz KJ (2003) Evaluation of an audience

response system for the continuing education of health pro-

fessionals. J Contin Educ Health Prof 23, 109–115.

Moy JR, Rodenbaugh DW, Collins HL, et al. (2000) Who wants

to be a physician? An educational tool for reviewing pulmo-

nary physiology. Adv Physiol Educ 24, 30–37.

Ozolins I, Hall H, Peterson R (2008) The student voice: recognis-

ing the hidden and informal curriculum in medicine. Med

Teach 30, 606–611.

Rizzolo LJ, Rando WC, O’Brien MK, et al. (2010) Design, imple-

mentation and evaluation of an innovative anatomy course.

Anat Sci Educ 3, 109–120.

Rolfe I, McPherson J (1995) Formative assessment: how am I

doing? Lancet 345, 837–839.

Rushton A (2005) Formative assessment: a key to deep learning?

Med Teach 27, 509–513.

Shah S, Lynch LMJ, Macias-Moriarity LZ (2010) Crossword puz-

zles as a tool to enhance learning about anti-ulcer agents. Am

J Pharm Educ 74, 117.

Sugand K, Abrahams P, Khurana A (2010) The anatomy of anat-

omy: a review for it modernization. Anat Sci Educ 3, 83–93.

Willmott CJR (2001) Revision bingo. Biochem Mol Biol Educ 29,

193–195.

Zakaryan V, Bliss R, Sarvazyan N (2005) Non-trivial pursuit of

physiology. Adv Physiol Educ 29, 11–14.

Zhang J, Peterson RF, Ozolins LZ (2011) Student approaches for

learning in medicine: what does it tell us about the informal

curriculum? BMC Med Educ 11, 87.

© 2013 Anatomical Society

Formative assessment journey, D. J. R. Evans et al.8