Using online workshops to Using online workshops to enhance student content enhance student content evaluation skills for VLE evaluation skills for VLE learning communitieslearning communities

De Montfort University RITA project 2008 – 2009

Mike Leigh, Lucy Mathers & Kaye Towlson

Session coverageSession coverage

BackgroundMethodologyResultsConnectionsFuture Applications

BackgroundBackgroundCross faculty/department RITA bid Build on work of previous RITA

funded project by Mike Leigh and Lucy Mathers◦revealed a significant gap between

information evaluation skills acknowledged by students and those manifest in work.

Wanted to develop an evaluative framework and publish on VLE for use when posting selected subject materials.

Methodology: Strand 1Methodology: Strand 1Lectures and LabsLectures and LabsEmbedded in curriculum.

◦2 different modulesSimilar assessment task

◦group or individual wiki◦Post material, mainly from the

internet to aid understanding of a negotiated topic.

◦Evaluate material posted. Group or peer evaluation of

material◦article review

Methodology Strand 1Methodology Strand 1Lectures and LabsLectures and Labs

Session re: information evaluation◦“Skill for life”, real life examples,

5W’s, 4C’sLab sessions run to enable the

creation and development of wikisLab sessions run to enable peer

evaluation of articles followed by feedback

Development of ISEMDevelopment of ISEMAnecdotal feedback reveals

improvement in quality of materials posted

Used criteria specified in info evaluation sessions (5 W’s) to develop Information Source Evaluation Matrix (ISEM)

Needed to test ISEM

Methodology Strand 2: Methodology Strand 2: UG and PG WorkshopsUG and PG WorkshopsSelf-assessment of info evaluation

skills (Likert Scale) “before and after”

Presentation/ refresher of the “5 Ws”

Intro to the ISEMApplication of ISEM to subject

specific materialRevised self-assessmentComments on ISEM application

Workshop Results 1Workshop Results 1UG and PG ISEM FeedbackUG and PG ISEM Feedback

Use of the ISEM positively received by UGs and PGs

All engaged with the matrix, its purpose and application

Recognition of importance of relevance and reliability

Some criteria valued more than others

Workshop results 2Workshop results 2Suggestions for ISEM Suggestions for ISEM improvementimprovementAll suggestions were positiveSome suggested a variation in

points allocation to reflect importance of individual criteria

Use of colour codingInclusion of space for

annotations, especially useful for future comparison

Inclusion of space for citation

ConnectionsConnectionsWith existing work:

◦Learner developed wiki of sources for module

◦UCPD: Researching business information Working with different communities

◦Academics and students from Faculty of Technology

Doing library stuff but not as “The Library”…student engagement

Confirmations….smugness not allowed

Project Results… so farProject Results… so farProject aim: To develop an evaluative

framework, publish on VLE for use when posting selected subject materials.

ISEM is offered as the pilot frameworkSelf-assessment Likert Scale to be

adjusted in the light of workshopsClear potential for developing

information evaluation skills as matrix clearly raises awareness and forces application

Future ApplicationsFuture Applications

Develop online tools, make available via VLE◦Offer as a generic tool?

Scope for future research:◦Application and implication of ISEM

in different subject areas and at different levels

◦May identify key criteria for specific subject areas