SFC ProjectSFC Project

Re-engineering assessmentsRe-engineering assessments

Weekly multi-choice testsWeekly multi-choice tests

Aims of the projectAims of the project

Improve the quality Improve the quality of student learningof student learning

Reduce the cost of Reduce the cost of instruction (Twigg instruction (Twigg 2003)2003)

Improve Improve progression rates progression rates at first diet at first diet

Consumer Buying Behaviour Consumer Buying Behaviour 2004 - 52004 - 5

300 x 2300 x 2ndnd year students in Semester B year students in Semester B Core for Marketing students, option for Core for Marketing students, option for

other degreesother degrees 2 x 1 hour lectures per week2 x 1 hour lectures per week 16 groups x 1 hour seminar per week16 groups x 1 hour seminar per week Blackboard support for handbooks, lecture Blackboard support for handbooks, lecture

and seminar material, and announcements and seminar material, and announcements onlyonly

Previous assessment programmePrevious assessment programme

40% individual diary and essay (2500 words)- 40% individual diary and essay (2500 words)- week 8 submissionweek 8 submission

40% 2 hour exam- week 13 -1540% 2 hour exam- week 13 -15 20% group paper presentation in seminar class 20% group paper presentation in seminar class

– week 6-12 seminars– week 6-12 seminars DisadvantagesDisadvantages: turn around time for 300 : turn around time for 300

essays within 3 weeks was challenging.essays within 3 weeks was challenging. Feedback was never put to useFeedback was never put to use Exam scripts were not picked up by studentsExam scripts were not picked up by students

Re-engineering assessmentRe-engineering assessment

Improve the quality of student learning Improve the quality of student learning and encourage active self-assessmentand encourage active self-assessment

To clarify for the student what good To clarify for the student what good assessment is by delivering high quality assessment is by delivering high quality feedbackfeedback

To encourage positive motivational beliefs To encourage positive motivational beliefs and self-esteemand self-esteem

(Nicol D & MacFarlane-Dick D., 2005)(Nicol D & MacFarlane-Dick D., 2005)

Re-engineering assessmentRe-engineering assessment To reduce the cost of module delivery within To reduce the cost of module delivery within

assessment tasksassessment tasks Previous cost = 1000 hours staff time for Previous cost = 1000 hours staff time for

markingmarking Recommended CBS 3 week turn around time Recommended CBS 3 week turn around time

met only by staff working over Easter holidays to met only by staff working over Easter holidays to mark diary/essaysmark diary/essays

Delivery to students in week 10 seminar class Delivery to students in week 10 seminar class was too late to improve student performancewas too late to improve student performance

High fail rate/non submission at exam 1High fail rate/non submission at exam 1stst diet diet (85%)(85%)

New assessment strategyNew assessment strategy2005/062005/06

Move individual essay/diary to group Move individual essay/diary to group assessment (4-6 students per group)assessment (4-6 students per group)

3 learning papers each group (25% per 3 learning papers each group (25% per paper) with deep learning in chosen areapaper) with deep learning in chosen area

Detailed feedback for each paper Detailed feedback for each paper informing next submissioninforming next submission

Using email attachment to mark on-line Using email attachment to mark on-line and deliver feedbackand deliver feedback

Formative and summativeFormative and summative

New assessment strategy 2005/06 New assessment strategy 2005/06 part 2part 2

Weekly MCQ test on previous week’s lecture Weekly MCQ test on previous week’s lecture materialmaterial

10 questions weekly10 questions weekly Randomised but not timed Randomised but not timed Only one attempt allowedOnly one attempt allowed Student must sit 10 out of 12 possible tests Student must sit 10 out of 12 possible tests Broad learning over moduleBroad learning over module Formative and summativeFormative and summative

Benefits of weekly testsBenefits of weekly tests

Student is more involved with core textStudent is more involved with core text Learning is repeated by student’s reading prior Learning is repeated by student’s reading prior

to, or during, testto, or during, test Student forced to complete test within 2 week Student forced to complete test within 2 week

timeframetimeframe Full immediate feedback of score, incorrect Full immediate feedback of score, incorrect

choice identified and correct answer givenchoice identified and correct answer given Student sees score increase week by weekStudent sees score increase week by week Competitive aspect between students, and with Competitive aspect between students, and with

student competing with selfstudent competing with self

Using publisher’s materialUsing publisher’s material

Advantages:Advantages: no cost to universityno cost to university quality is good/ no staff training requiredquality is good/ no staff training required highly related to core texthighly related to core text Disadvantages:Disadvantages: proposed initial cost to studentproposed initial cost to student Compatibility with GCU blackboardCompatibility with GCU blackboard focuses student on one textfocuses student on one text

Increased use of BlackboardIncreased use of Blackboard

Used for all areas as before – but alsoUsed for all areas as before – but also On-line tests availableOn-line tests available Grade book to monitor student Grade book to monitor student

performanceperformance On-line activities available (non assessed)On-line activities available (non assessed) Much higher level of contact with studentsMuch higher level of contact with students Impacted on student email contact which Impacted on student email contact which

also increasedalso increased

Encouraging self-esteem and Encouraging self-esteem and motivationmotivation

Weekly happy tipWeekly happy tip Sourced from refereed journals, written in Sourced from refereed journals, written in

every day Englishevery day English Cheered everyone upCheered everyone up Showed site was “live”Showed site was “live” Focused on positive actions students Focused on positive actions students

could takecould take

Diary example 7Diary example 7thth March 06 March 06

With tongue in cheek I offer you these With tongue in cheek I offer you these pieces of research:pieces of research:

"Busy is better than bored.""Busy is better than bored." "Find something to do, because the feeling "Find something to do, because the feeling

that we have too much to do is much more that we have too much to do is much more pleasing than the feeling that we have pleasing than the feeling that we have nothing to do. A philosopher once noted nothing to do. A philosopher once noted that people long for immortality but run out that people long for immortality but run out of things to do on a rainy afternoon.of things to do on a rainy afternoon.

In studies of students, those with more In studies of students, those with more demanding schedules were 15% more demanding schedules were 15% more satisfied with life. Despite the more satisfied with life. Despite the more demanding schedules, the individuals demanding schedules, the individuals studied did not experience any more studied did not experience any more stress than those with less to do." Bailey, stress than those with less to do." Bailey, R. and Miller, C. 1998 Life Satisfaction and R. and Miller, C. 1998 Life Satisfaction and Life Demands in College Students"Life Demands in College Students"  Social   Social Behaviour and PersonalityBehaviour and Personality 26:51 26:51

Next happy tipNext happy tip

““Keep reading"Keep reading" "Reading engages the mind. Reading materials, "Reading engages the mind. Reading materials,

by exercising our memory and imagination, can by exercising our memory and imagination, can contribute to happiness in ways similar to active contribute to happiness in ways similar to active positive thinking. Regular readers are about 8 % positive thinking. Regular readers are about 8 % more likely to express daily satisfaction." Scope, more likely to express daily satisfaction." Scope, E.1999. "A Meta-Analysis of Research on E.1999. "A Meta-Analysis of Research on Creativity" PhD diss., Fordham University, New Creativity" PhD diss., Fordham University, New York, NY York, NY

Because….Because….

Wed, Mar 08, 2006 -- Wed, Mar 08, 2006 -- Time ManagementTime Management Here is a gentle reminder that the 17th of Here is a gentle reminder that the 17th of March is the date for the first group March is the date for the first group coursework paper to be submitted. It is coursework paper to be submitted. It is also the date that tests 2 and 3 will be also the date that tests 2 and 3 will be closed off. So in order to avoid massive closed off. So in order to avoid massive panic try not to leave everything to the last panic try not to leave everything to the last minute. A xminute. A x

Student feedbackStudent feedback

““Online assessments Online assessments were very useful as it were very useful as it allowed the student to allowed the student to learn one topic at a learn one topic at a time, instead of time, instead of having to learn the having to learn the entire module before entire module before an exam” student 1an exam” student 1

““75% groupwork is 75% groupwork is extremely unfair” extremely unfair” student 2student 2

Review for 2006/07Review for 2006/071.Investigate peer 1.Investigate peer

evaluation of one paperevaluation of one paper

2. on-line testing trial 2. on-line testing trial week for students week for students during first weekduring first week

3. Checking technology 3. Checking technology with student account with student account prior to live showprior to live show

4, tighter deadlines4, tighter deadlines