The pros and cons of using audio feedback to support
student learning
Dr Darren Comber Centre for Learning & Teaching
Dr Lindsay McPherson School of Biological Sciences
Outcomes
What?Why?How?Does it work?
1. What?
• PG Certificate programme 2010• Staff as students• Small number (n=16)• Formative assessment (low risk)
1. What?
Formative assessment:
1. Improve student learning2. Opportunity for feedback3. Clarifies what good performance looks like4. Compare current progress with desired goals5. Motivational – positive
2. Why?
“…there is strong evidence that feedback messages are invariably complex and difficult to decipher, and that students require opportunities to construct actively an understanding of them…before they can be used to regulate performance.”
(Nicol & McFarlane-Dick, 2006: 201)
2. Why?
1. Speaking can be quicker than typing2. Miscommunication / alignment / nuance3. Making sound files is becoming quicker,
cheaper and easier
Why not?
Generation Y?
3. How?
1. Acquire digital dictaphone with onboard USB
2. Record feedback on the dictaphone (saved as .mp3)
3. Plug the dictaphone directly into the PC
4. Drag & drop .mp3 files to their own folder
5. Rename, check then attach to email
3. How?
Digital dictaphone
Your PC
3. How?
• Files automatically segmented• No software involved• No technical knowledge beyond attaching files
to emails• 3 mins feedback: 4mb• Sony ICD-UX70 digital dictaphone (cost c. £80)• 1Gb can record 290 hours
4. Does it work?
1. Recipients really liked it– Personal– Nuanced– Feedback is threaded (+ and a single -)
2. Easy and quick3. Data protection: same as written files4. Generated lots of interest already
Things I learned whilst trying this
• Muttering in the corner…• Divert the phone• Waving the dictaphone• Indicative notes can help• Easy to get carried away• Double-check e-mail recipient• No it doesn’t work if the recipient is deaf
Case Study -
Audio feedback for large classes
Case study – audio feedback for large classes
• Level 3 SBS skills course (~130 students)• Produce sections of report and receive
feedback (summative)• Produce final report (summative)
1. Hand in draft intro &
materials and methods
2. Peer review another
students’ intro & materials
and methods
3. Hand in draft results
and discussion
4. Peer review another
students’ results and discussion
5. Hand in final report
FEEDBACK
Research Questions
1. Is there a difference in marks for final report between students given audio or written feedback?
2. Is there a difference in the time it takes to produce the feedback?
3. What attitudes do the students have about the two feedback methods?
What did we do?
• Randomly split class in half using random number generator
• Told class we would be giving two feedback types and why but didn’t indicate which we thought was better
• Measured the amount of time it took to mark and give feedback for each piece of work
• After receiving all feedback students given a questionnaire about their attitudes
Preliminary Results - groups
• No difference in median CAS grades achieved in exercises between groups
Preliminary Results - time
time_peer_intro time_intro time_peer_res time_res0
2
4
6
8
10
12
14
audiowritten
Exercise
Tim
e ta
ken
to co
mpl
ete
feed
back
(min
s)
• Time taken to give feedback appears to be much less for audio feedback
• Difference in time depends on length of work
(up to 4 minutes difference per student = 8.5 hours!)
How was it for staff?
• It was less stressful– Able to remain fresh– Easier to prepare meaningful comments– Prevents monotonously writing the same things
over and over again (possibly leading to illegibility)• Able to give more information overall• Able to give lots of encouragement• Not able to change small-scale issues in text
(e.g. punctuation etc.)
How was it for students?
• Students currently filling out a questionnaire on how they found the different types of feedback
• Specifically asked about:– Usefulness of feedback
• Relevance• Clarity• Did they learn from it?
– Whether they thoughtthat feedback methodtype would affect marks
Final results will be in in a few weeks!