20
1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh College of Education Indiana State University Presented at RosEvaluation April 18, 2011

1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

Embed Size (px)

Citation preview

Page 1: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

1Feng-Qi Lai

Project Peer Evaluation: Assessment and Collaborative Learning

Feng-Qi Lai Department of Curriculum, Instruction, and Media TechnologyBayh College of EducationIndiana State University

Presented at RosEvaluationApril 18, 2011

Page 2: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

2Feng-Qi Lai

IntroductionTraditional design of project

evaluationOnline peer evaluation at one

levelOnline peer evaluation at two

levelsConclusion and discussion

Page 3: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

3Feng-Qi Lai

Traditional Design

Problems◦Individual projects: Little peer interaction

◦Group projects: free ridersSolution: Individual projects with group discussion

Page 4: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

4Feng-Qi Lai

Traditional Design: Individual Projects

Learning context analysisLearner analysisLearning task analysisLearning objectives and

assessmentsLearning strategies designInstructional material productionFormative evaluation

Page 5: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

5Feng-Qi Lai

Traditional Design: Individual Projects

Problem: lack of peer interaction

Page 6: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

6Feng-Qi Lai

Traditional Design: Group Projects

1. Look for team members to form a group of four

2. Discuss with potential group members to determine a topic

3. Work on every project as a team4. Submission of 1) group project and 2)

peer evaluation5. Grade is based on three parts: 1) quality

of the project, 2) teammates’ evaluation of each teammate’s work and 3) evaluation of teammates’ work.

Page 7: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

7Feng-Qi Lai

An Example of Assessment of Students’ Performance

Example: Project C Learning Task Analysis, total possible 30 points. The group has four members and the group project gets 28.

Team member A’s grade (when A’s evaluation to her teammates is fair and thorough; no points taken off):The points that A gets from her three team members’ evaluations are 25, 24, and 25.A’s grade will be 28 * [(25+24+25)/75]. That is 27.6 points.

Team member B’s grade (when B’s evaluation to his teammates is not quite fair; 10% was taken off):The points that B gets from the peer evaluation are 23, 23, and 24.B’s grade will be 28 * [(23+23+24)/75] – 10% * {28 * [(23+23+24)/75]}. That is 26.1-2.61 = 23.5 points.

Page 8: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

8Feng-Qi Lai

Assessment Forms

Peer evaluation templateInstructor’s evaluation form

The original forms from Dr. Tristan Johnson, Florida State University

Page 9: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

9Feng-Qi Lai

Traditional Design: Group Projects

Problem: Free riders and limited peer interaction

Page 10: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

10Feng-Qi Lai

Online Peer Evaluation at One Level

Individual project on the same given topicEach project has a different groupPost project on Blog for group discussion (critique

and debate)Revise the projectSubmission of 1) individual project and 2) peer

evaluation of group members’ workProject grade is based on the average of peer

evaluationLearning performance grade is based on 1)

project, 2) peer evaluation, and 3) online discussion (critique and debate)

Instructor adjusts grade if peer evaluation is not fair

Page 11: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

11Feng-Qi Lai

Project Guidelines and Grades

Project guidelines examplePeer evaluation exampleGrades for each project

Page 12: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

12Feng-Qi Lai

Online Peer Evaluation at Two Levels

Designs◦The same as online peer evaluation

at one level + peer evaluation from a higher level class

Performance evaluation◦Peer evaluation at the same level◦Peer evaluation from a higher level◦Instructor’s evaluation

Page 13: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

13Feng-Qi Lai

Student A’s Approach to Completing the Project

Carefully reviewing the assigned readings

Determining the best course of action for completing the project

Page 14: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

14Feng-Qi Lai

Student A’s Approach to Peer Evaluation

Aesthetic valueReadabilityGrammatical correctnessInclusion of vital elements (based on project guidelines provided)

Page 15: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

15Feng-Qi Lai

Student A’s Perspective

• I believe it was the intensity of the course requirements that created a sense of satisfaction in the intrinsic value of the effort.

• There is no better way to learn than to teach.

Page 16: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

16Feng-Qi Lai

Student B’s Approach to Online Discussion

Ensure understanding of the specific requirements of the assignment

Proceed to read fellow student’s posted work

Provide subsequent feedback

Page 17: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

17Feng-Qi Lai

Student B’s Approach to Peer Evaluation

Read peers’ projects, analyzing what is read.

Review including◦ syntax and structure◦overall ideas◦obvious and not-so-obvious

inconsistencies◦other issues in regards to the

methodologies used

Page 18: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

18Feng-Qi Lai

Student B’s Perspective

• The Impact of Peer Criticism• Communication between

Foreign and Native Students• The Blackboard EMS• Concern of Peer-Assigned

Grading

Page 19: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

19Feng-Qi Lai

Conclusion & Discussion• Students’ attitudes toward projects• Capability of understanding the

assignment and reading materials• Critical thinking skills• Sense of responsibility--------• Communication problem• Anxiety about the grade

Page 20: 1 Feng-Qi Lai Project Peer Evaluation: Assessment and Collaborative Learning Feng-Qi Lai Department of Curriculum, Instruction, and Media Technology Bayh

20Feng-Qi Lai

Questions & Answers

Thank You for Your Attention!!Feng-Qi Lai

(812) [email protected]