2007-08-20 11 GALLAUDET UNIVERSITY Academic Affairs Waypoint Demo E-Scoring for Rubrics Celebrating...

2007-08-20http://at.gallaudet.edu/events/2007/waypoint11

GALLAUDET UNIVERSITYAcademic Affairs

Waypoint Demo E-Scoring for Rubrics

Celebrating the New Academic Year

08-20-07 10:30am, 1 pm, 3 pmPresented by Academic Technology

2007-08-20http://at.gallaudet.edu/events/2007/waypoint22

Agenda – August 20, 2007

• Welcome!• Rubrics at Gallaudet University• Waypoint Outcomes

A Blackboard Building Block for Scoring Rubricshttp://www.gowaypoint.com

• Student Uses: Feedback, Peer Review• Instructor Uses: Scoring• Instructor-Administrator Uses:

Data Analysis

2007-08-20http://at.gallaudet.edu/events/2007/waypoint3

What is a Rubric?• A set of criteria for grading assignments

Wikipedia.com

• A guide used to score performance assessments in a reliable, fair, and valid mannerGoogle.com Definitions

• CLAST – developing University-wide and Dept-specific rubrics for student learning– Written English– ASL– Critical Thinking– Presentation– Participation

2007-08-20http://at.gallaudet.edu/events/2007/waypoint4

What is Waypoint?

• A web-based system for electronic scoring of rubrics, integrated with Blackboard

What is WP Outcomes?

• A PC-based software program for aggregating and analyzing rubric scores

2007-08-20http://at.gallaudet.edu/events/2007/waypoint5

Rubric ElementName: Ideas and Critical Thinking

4 Levels of Competence: Strong, Competent, Weak, No Evidence

2007-08-20http://at.gallaudet.edu/events/2007/waypoint6

Rubric Element Advice and Reference

Be careful to cite the sources you use to support your ideas.

Review chapter 7 in your textbook. Watch the Concepts video from http://presentations.gallaudet.edu

Advice: Be careful to cite the sources you use to support your ideas. Reference: Review chapter 7 in your textbook. Watch the Concepts video from http://presentations.gallaudet.edu

2007-08-20http://at.gallaudet.edu/events/2007/waypoint7

Waypoint “Assignment” - Rubric

• A group of rubric elements

• Gallaudet Rubrics – Standardized for All• Dept Rubics – Standardized for One Dept• Individual Rubrics – Created and Used for a

Specific Course Assignment• Rubistar Rubrics – 26,000+ ready-made

rubrics http://rubistar.4teachers.org

2007-08-20http://at.gallaudet.edu/events/2007/waypoint8

Why Use Waypoint?

• Provide students with clear evidence of how assignments will be scored BEFORE they start a assignment

• Save time grading assignments• Create exceptional feedback for students• Share rubrics with colleagues• Contribute to University-wide assessment of

student performance

2007-08-20http://at.gallaudet.edu/events/2007/waypoint9

Student Feedback

2007-08-20http://at.gallaudet.edu/events/2007/waypoint10

Blackboard Grade Book

Feedback Automatically Attached to Bb Gradebook

2007-08-20http://at.gallaudet.edu/events/2007/waypoint11

Student Peer Review

• Students can review each other’s work, using the same criteria

• Depts can use Peer Review to manage course evaluations and use the data analysis tools for quick results

2007-08-20http://at.gallaudet.edu/events/2007/waypoint12

Student Benefits

• I know the criteria before I start the assignment.

• I get detailed feedback via the Bb gradebook or email.

• I get advice and reference materials, if the instructor provides them.

2007-08-20http://at.gallaudet.edu/events/2007/waypoint13

Instructor Uses: Scoring

• Link Bb Assignments to Waypoint

• Open Waypoint (Click Bb Assignment Title)

• Evaluate Student Work using Waypoint

• Send Evaluations to Bb Gradebook

2007-08-20http://at.gallaudet.edu/events/2007/waypoint14

Instructor Uses: Link to Waypoint

1. Link Bb Assignments to WaypointCourse > Control Panel > Link/Unlink Waypoint

2007-08-20http://at.gallaudet.edu/events/2007/waypoint15

Instructor Uses: Go to Waypoint2. When Ready to Grade Assignments, Click the

Assignment Name, which will take you to the Waypoint web site

2007-08-20http://at.gallaudet.edu/events/2007/waypoint16

Instructor Uses: Evaluate Work

3. Choose Evaluate. 4. Synch Student Roster5. Select Assignments, Classes, Student6. Retrieve Student Work from CMS

2007-08-20http://at.gallaudet.edu/events/2007/waypoint17

Instructor Uses: Evaluate Work

7. Choose Score for Each Rubric Element8. Add Advice and Reference

2007-08-20http://at.gallaudet.edu/events/2007/waypoint18

Instructor Uses: Evaluate Work

9. Add Overall Comment and Grade10. Save Evaluation

2007-08-20http://at.gallaudet.edu/events/2007/waypoint19

Instructor Uses: Send Evals to Bb

11. Click Manage 12. Select Class13. Click All 14. Click “Send Results”

Send Results

2007-08-20http://at.gallaudet.edu/events/2007/waypoint20

Instructor Uses: Data Analysis• Click View Data.

2007-08-20http://at.gallaudet.edu/events/2007/waypoint21

Instructor: Bb Data Analysis• Course > Control Panel > Gradebook• Click Assignment Name > Item Detail

2007-08-20http://at.gallaudet.edu/events/2007/waypoint22

Administrator: Data Analysis

• Download data

• Aggregate data, using PC-based WP Outcomes software

• Analyze data

• Make data-based decisions

• Implement actions to enhance student performance

2007-08-20http://at.gallaudet.edu/events/2007/waypoint23

Administrator: Data Analysis

• Types of Data

– Scores on Specific Rubric: University-Wide

– Scores by Specific Depts or Courses

– Performance Changes Over Time

– Individual Student Performance Over Time

2007-08-20http://at.gallaudet.edu/events/2007/waypoint24

Strong Competence Competent Weak Competence No Evidence

Administrator: Data Analysis

2007-08-20http://at.gallaudet.edu/events/2007/waypoint25

Administrator: Course Eval Results

2007-08-20http://at.gallaudet.edu/events/2007/waypoint26

Administrator: Item Analysis

2007-08-20http://at.gallaudet.edu/events/2007/waypoint27

Administrator: Cumulative Graph

2007-08-20http://at.gallaudet.edu/events/2007/waypoint28

Administrator: Comparison Graph

2007-08-20http://at.gallaudet.edu/events/2007/waypoint29

Q & A

2007-08-20http://at.gallaudet.edu/events/2007/waypoint30

Next Steps

• Waypoint Installed on my.Gallaudet.edu

• Gallaudet Rubrics Created on Waypoint

• Hands-On Workshops: Bb and WaypointStarting Sept 2007

• Analysis of University-Wide ResultsStarting Dec 2007