Using Game Mechanics & Social Networking

Preview:

DESCRIPTION

Property of Dr. Ed Gehringer (c) 2010 All rights reserved.

Citation preview

Your feedback welcome: http://tinyurl.com/expertiza

Using game mechanics and social Using game mechanics and social networking to motivate student networking to motivate student

contributions to a coursecontributions to a course

Edward F. GehringerDept. of Computer Science

North Carolina State University

Your feedback welcome …http://tinyurl.com/expertiza

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Outline The goal: Authentic assessment Virtual demo Social networking and game mechanics Reputation systems Summary

Your feedback welcome: http://tinyurl.com/expertiza

Authentic assessment What is it? Why is it hard? How can we facilitate it?

Student-generated content Peer review

04/11/23

Your feedback welcome: http://tinyurl.com/expertiza

Student-generated content gets students working together to

improve others’ learning experiences, helps them learn, by performing tasks

that are similar to real-world responsibilities,

gives them experience in writing their ideas up for an audience of their peers,

allows each cohort to “stand on the shoulders” of students in earlier classes.

04/11/23

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Outline The goal: Authentic assessment Virtual demo Social networking and game mechanics Reputation systems Summary

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

“Virtual” demo Creating an assignment Selecting a topic Reviewing Feedback from author to reviewer Teammate review

Your feedback welcome: http://tinyurl.com/expertiza04/11/2304/11/23

Setting up a wiki assignment

Your feedback welcome: http://tinyurl.com/expertiza04/11/2304/11/23

Let’s create some teams …

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Here’s how we import it

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Now there are five teams …

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

“Virtual” demo Setting up an assignment Selecting a topic Reviewing Feedback from author to reviewer Teammate review

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Selecting a Topic

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

“Virtual” demo Setting up an assignment Selecting a topic Reviewing Feedback from author to reviewer Teammate review

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Let’s review a wiki page

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Click on the assignment …

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

… then on “Others’ work”

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Choose a review

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Read the submitted wiki page

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Then fill out the review template

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Save and view the review

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

“Virtual” demo Setting up an assignment Selecting a topic Reviewing Feedback from author to reviewer Teammate review

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Now the reviewee logs in …

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

… and views the scores

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Click on “View” to expand review

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Notice the link down at the bottom

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Use it to give feedback to the reviewer

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Then the reviewer can view the feedback

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

“Virtual” demo Setting up an assignment Selecting a topic Reviewing Feedback from author to reviewer Teammate review

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Review of teammates

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Summary of feedback in Expertiza Reviews Feedback to author Teammate reviews Metareviews (x reviews y’s review of z)

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Instructor report

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Outline The goal: Authentic assessment Virtual demo Social networking and game mechanics Reputation systems Summary

Your feedback welcome: http://tinyurl.com/expertiza

How to motivate students? Runners in a race are motivated by

seeing other runners ahead of them. Players in online games are motivated to

catch the leaders. Can we do the same thing in our peer-

review system?

04/11/23

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Motivating Students: Achievement System Categories in we can track achievement

Quality of submitted work Quality of reviews Helpfulness to authors Contribution to team

These factors make up reputation.

Your feedback welcome: http://tinyurl.com/expertiza04/11/23 Your feedback welcome: http://tinyurl.com/expertiza

Recognizing Achievement: Leaderboards Students can list their achievements for

all to see.

Your feedback welcome: http://tinyurl.com/expertiza

Now a new review is entered …

04/11/23

Your feedback welcome: http://tinyurl.com/expertiza

… and the leaders change

04/11/23

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

A new metareview is entered …

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

… and a new leader is recognized

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

What we have here is …

a social network! Connections among many individuals. Information contributed from many

sources (albeit coerced!) Can be used to discover competencies of

individuals.

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Future work: Message boards for extra credit Student a posts a question Student b responds Student a rates student b’s response Others can rate response too.

TAs can also respond Prompt reviews/answers are

more helpful, so reward for these …

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

New Features Coming to Expertiza Levels

“Special power”―rearranging messages Microtasks/micropayments … incentivize useful work

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Outline The goal: Authentic assessment Virtual demo Student-generated content Social networking and game mechanics Reputation systems Summary

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Are the evaluations reliable? Author feedback Metareviewing helps. Algorithmic strategies

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Algorithmic approaches

Strategies use quality and leniency as metrics for assigning grades.

Quality is dependent on leniency, and vice versa.

Their approach yields a system of simultaneous equations, which can be solved to yield values for quality.

Other researchers have devised similar methodologies.

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Other reputation systems What we have seen are “reputation

systems” devoted to evaluating required work.

Other reputation system deal with voluntary work.

Our hope is to blend the two.

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Outline The goal: Authentic assessment Virtual demo Student-generated content Social networking and game mechanics Reputation systems Summary

Your feedback welcome: http://tinyurl.com/expertiza

Summary If students do “real” tasks, authentic

assessment is possible. Peer assessment provides a scalable

approach to authentic assessment. Incentives such as leaderboards and

micropayments can be used to encourage student contributions.

A reputation system is needed for quality control.

04/11/23