**The Application of Web-based Peer Evaluation SystemYu-Hui TaoNational University of Kaohsiungytao@nuk.edu.twMarch 13, 2009(Your way)

**MotivationStarted teaching in 1997

Initial impression of Taiwanese students: low class participation despite what I have done

Started adding various activities in class design for increasing students responsibility through their performance evaluation

Often asked students to criticizing others work/statements/

In some courses, students were asked to write down their comments to the presenters for me to evaluate, and sometimes I cut and past these comments to the presenters

**OutlineConcept of Peer Evaluation System (PES)

Comparison with Online Learning System and Instant Response System

PES Use Case Diagram and Process Flow Screenshots

PES Examples

PES Experience Sharing

**PES Concept in Class Assignment

Teacher announces assignment

Classpresentation

Peer evaluation

Teacherevaluation

Finalscore

Revision?

Yes

No

Studentssubmitassignment

Selfevaluation

Forumdiscussion

**Peer Evaluation in Literature

3/172007

Peer evaluationHelp students autonomy & higher-order thinking skills (Heywood, 2000; Tsai, et al., 2001; Tsai, Lin and Yuan, 2002), Peer Instruction (Donaldson and Topping, 1996)Teacher managing the process instead of grading all students assignment (Race, 1998)Formative evaluation opinions, and summative evaluation grades/scores (Bostock, 2000)

Theories from (2005)Vygotsky - social constructivism Piaget - cognitive conflict theoryOther educational theories extended from peer-assisted learning

Many learning management systems (LMS) do not support formal evaluations (Wong and Ng, 2005, CELT, 2004)

**Peer Evaluation in Literature(cont.)

109 peer evaluation studies analyzed by Topping (1998)have certain reliability and validityempirically tested with learning effects and students satisfaction in higher education (Searby & Ewer, 1997; Stanier, 1997; Gatfield, 1999; Hafner & Hafner, 2003)

Bostock (2000) pointed outdifficulties - passing evaluation information between the students, and saving these information for future auditShortcomings - avoided through anonymity, multiple evaluators, and teacher adjustment

**Peer Evaluation in Literature(cont.)

(Topping, 1998; ; 2000)ParameterDifferences

Visual Interface Development for e-Learning Management System, 2006Moodle Teacher Mode

Visual Interface Development for e-Learning Management System, 2006Moodle Student ModePracticeStandard materialsGroup discussionAssignmentQuestionnaireTopical forumDialogueOpinion surveyTestOnline resourceChatBBSCourseVocabularyClass activitiesSystem Management

**Online Learning System Comparison

**Online Learning System Comparison

**Online Learning System Comparison

**IRS (Instant Response System)Sourcehttp://www.habook.com.tw/software/Detail_soft.asp?BookNo=ME010200&B_key=IRS&CatalogID=12Interactive white board (IWT)Teachers remoteStudents remoteIRS SystemLearning profile databaseReceiver

**IRS Strategies SourceHaBook onine DM2007/09/21 Preview & Q&A before classPreview but answer Qs at beginning of the classNo preview before class

SchoolHarvard UniversityTaipei Medical University Taipei Municipal University of EducationClassPhysics courseMedical courseInformation Science courseApplication Model

**Online Learning System vs. IRS vs. PESLevel of SynchronizationSync.Async.Online Learning SystemIRSPESLevel of Interaction(class activities)LowHigh

**PES How it works?English Manual: http://tao.nuk.edu.tw/matsuyama/PESHelpStudent.ppt

System Setup

Class Offering & Registration

Peer Evaluation

Download system

Setup teacher accounts

Create new classes

Setup class Parameters

Announceassignment

Present in class

Evaluation

Calculate score

Boarder line of automation

Register PES

Uploadassignment

Enroll courses

Approve enrolled students

**PES Home page (http://pes.nuk.edu.tw)Class announcements

**PES Teachers first pageCurrent page and path

**PES Create a new classCo-teacher setupClass status setupAdvanced features setupEvaluation assignment setup

**PES Advanced features setupMostly default

**PESEvaluation assignment setupFor individual assignmentFor group assignmentPlus self evaluationThree assigning rules:N students before youN students after youOdd for Even #s and vice versa

**PESStudent account registrationThe first thing students do

**PES Student enrolling classesEnroll a class

**PES Class list for enrollement

**PES Teachers first page

**PES Student list/managementCheck the approved students

**PES Teachers assignment screen

**PES Adding a new assignmentClick confirm will go to due date setup screen

**PES Due dates setupFor every version

**PESStudent assignment screen (before due date)This groups upload linkOther groups uploaded assignment

**PESStudent assignment uploadThis groups upload linkOther groups uploaded assignmentBrowse the ZIP file for upload

**PESHow to zip a file?This groups upload linkOther groups uploaded assignment

**PES PESStudent assignment screen (after due date)Past due and disabled

**PES Student assignment screenAssignment contentAssignment descriptionAssignment evaluationAssignment in a new large window

**PES Student evaluationOpinion & reply+/- scoreTeacher can evaluate this student to others evaluationsOnly shown in teachers screen

**PES Student evaluation can be revised before due date& timeEdit or delete a comment

**PES Teachers evaluation on each students evaluation of othersPerformance evaluation of this students peer evaluationStudents evaluation of assigned students assignments

**PESStatistics and Exporting Scores

**PES Parameters of assignment activitiesIndividual vs. groupIn-class vs. after-class (vs. combo)Formative vs. summativeCompetition vs. not-competition

**Formative assignment upload the revision based on peer feedbackVersion listingEditing this assignment

**Formative assignment creating one more versioncreate a new version here

**PESCompetition func. N/A but can be done with regular functions 3 competitors from version 1Screening 3 finalist from round 1

*PES can incorporate what class activitiesInd. Sync.Assign.Grp.Sync.Assign.Ind. Async.Assign.Grp. Async.Assign.Ind. Form.Assign.Grp. Form.Assign.Ind. Comp.Assign.Ind. Comp.Assign.Ind. Assigned discus.Grp. Assigned discus.Ind. Test UploadGrp. Class Disc. uploadInd. Class RollcallInd. Free Disc. N/A

**PES Assigned discussion with students replies

**PES - Online test with uploadExcel online test

**PES Class roll callStudent sideTeacher side

**PES - Exporting assignment with a HTML file linking students assignments

**PES Other possibilities?Online survey BlogWeb-based BBSIRS functionalities

**Online Survey

**PES What I have learnedTeacherFocusing on managing students assignment process instead of grading them all With PES skill, class activity design can be agile and flexible

StudentFocusing on training higher-order thinking and peer mutual learning/instructionsFocusing on learning process not the final scores

PESA special purposed system, not to replace online learning platformBut can gradually incorporate more IRS and online learning functions

**PESSuggestionYou can start anytime now by obtaining a teacher account from me

It is free but half finished, so use it at your own convenience (only incomplete Chinese user manual)

Each assignment can be exported to be used as a simple HTML page link---The End---