21
Pat Cartney, Middlesex University, October 2010

RIDE 2010 presentation - Using peer assessment to close the feedback gap

Embed Size (px)

Citation preview

Pat Cartney, Middlesex University, October 2010

Purpose of today’s sessionTo explore a case study of peer assessment as one

part of formative assessment on UG Year 1 social work module

Aim is to highlight process used, the outcome and the student feedback on what worked well and what the issues were

To consider whether peer assessment can close the gap between feedback given and feedback used by students

Setting the contextAssessment for learning debate highlights key role

assessment plays in student learningIncreasing attention paid to value of feedback and

formative assessment (Orsmond et al ,2004)Recent literature calls for more advanced

understanding – need for active participation of students and student tutor dialogue (Rust, 2007)

Gap between feedback given and feedback used – feedback alone not enough (Crisp, 2007)

Case studyOur aim was to encourage a more active , open

dialogue between students and tutors about assessment.

To use peer assessment as key component of creating this dialogue between students and between students and tutors.

To use formative assessment and peer feedback to encourage students to use the feedback they are given to improve future work.

What we did...Part of summative assessment 2 -3,000 word essay45 students in total: split into Home Groups with 5

students in eachEach Home Group were asked to formatively assess

each other’s essay and to give written feedback on marking sheet

Tutors to give feedback on the group feedbackHeld workshop to outline feedback process

The big ideaThe aim here is that you give each other feedback to

enable you to submit an improved essay for your final work which will be marked.

Feedback from your peers can be one of the best feedback channels.

Reading other’s work can be helpful.Getting used to the marking criteria can help your

own focus.

How process was managed...Initial workshop outlining purpose and process in NovReturn session in January – asked students to submit

feedback electronically after session to Home Group and to discuss on line

Brief feedback in Home Groups on process Tutors were given hard copies of each essay to read for

seminar students plus hard copies of feedback sheets given by students to each other

Students asked to comment on how they used formative feedback in their summative assessment – two fails and both disregarded comments

Issues from Focus GroupLevel of anxiety about commenting on other students’

work – higher than others seeing their work

“..I thought ‘oh my God’ I really don’t want to do this”

“ I was very worried about what would happen if someone gave me an essay to read and it’s, in my opinion, clearly rubbish”

“You think all the worst things at the start...all the horrible things that could happen.”

Level of anxiety about other students seeing their work

“ I can just about take criticism from teachers ...but to get it from peers as well. It was almost like that will stay with you for the rest of the time that I am with them. How are they going to judge me?”

“ It was a terrifying experience for me to actually give my work for someone to look at – not just one person but four...”

Many groups were reluctant to feedback on line and gave a hardcopy to each other: on –line discussion didn’t happen then in several groups

Feedback was variable across students – ranging from detailed constructive feedback to very brief comment.

Some students felt let down by lack of feedback,“I know I gave a lot of feedback but I didn’t receive it”Others had a positive experience,“The feedback was incredible...then I could change and

make things better”

Whilst everyone saw the rationale for using the marking sheet several commented on the need to spend more time in advance ‘decoding’ the language

“It’s in tutor speak and not student speak”

“Simplify it to make it a bit more friendly for people”

Overall experience...Very positive experience reported overall

“It was probably – I hate to say this – but probably the most enjoyable and helpful thing this year.”

“I think it was one of the most fantastic things ever ..but my initial feeling was ‘no way’”

Learning pluses in a nutshellFeedback from others on own work

“ I received very specific feedback and it really helped me. Some people gave really constructive (comments) like ‘this is how your introduction should be.”

“When I write I get too close to my essays so I am not reading them anymore..I can’t see the mistakes – so someone else reading them for me is invaluable.”

Finding new ways of writing from seeing work of other students

“ You don’t take whole chunks. You take ideas, and the way that people have written them in a clearer format than yours and then you think yes, if I had done it likethat it would have been better and then you can change it, and it helps everyone.”

Giving insight into what the standard on the programme is

“ It showed you how high you need to go and how low you were”

“ I could see where I had come from and I could see where I want to go”

Giving students a clearer understanding of the marking criteria

“ Having to use it makes you think my God the tutors have to do all this, so you need to be able to make it easy. And the easier it is the more likely you are to have a higher mark. It is almost stepping out and having a little insight into a different world. A sneaky preview into how you are going to get better marks.”

Helping with future academic work in other modules – feedback to feed-forward

“I have already started doing it – using the feedback in my other essays and transferring it.”

“You can transfer your feedback to the next piece of work...It is like going up a ladder.”

Changes we madeMore openly acknowledged the potential initial

anxieties and stressed potential gainsDevoted more time to making the marking sheet

more intelligibleAcknowledged reluctance to e discussions and

allocated class time for written feedback to be presented and discussed

Stressed need for full involvement in process and links to professional practice and employment

Future plansHeld focus groups with Year 3 BAs to explore how

they experienced the links between peer assessment exercises throughout their programme.

Data needs further analysis but one key finding is that the students supplemented the formal peer assessment exercises with their own informal peer feedback groups throughout the programme. Used in practice too.

Suggests peer assessment promoted a learning community and a way of addressing the feedback gap.

ReferencesCartney, P. (2010) Exploring the use of peer

assessment as a vehicle for closing the gap between feedback given and feedback received, Assessment and Evaluation in Higher Education,35, (5), 551 -564

Crisp, B. R. (2007) Is it worth the effort? How feedback influences students’ submission of assessable work, Assessment and Evaluation in Higher Education, 32, (5), 571 - 581

Orsmond, P., Merry, S. & Callaghan, A.C. (2004) Implementation of a formative assessment model incorporating peer and self assessment, Innovations in Higher Education and Training International, 41 (3), 273 – 290

Rust, C. (2007) Towards a scholarship of assessment, Assessment and Evaluation in Higher Education, 30 (3), 231 - 240