Quality Matters

Quality MattersTM:

Introduction to QM and to the Rubric

The Quality Matters™ Rubric 2008 – 2010 Edition Updated July 08

About About Quality Matters Quality Matters

Quality MattersQuality does matter to …• students• faculty• administrators• institutions• consortia• accrediting agencies• legislators• tax-payers

How do we …• identify & recognize it?• motivate & instill it?• assess & measure it?• insure it?• assure it?

Peer Course Peer Course ReviewReview

FeedbackFeedback

CourseCourse

Course Meets Course Meets Quality ExpectationsQuality Expectations

Course Course RevisionRevision

Instructional Designers

InstitutionsFaculty Course Developers National Standards &

Research LiteratureRubric

Faculty ReviewersTraining

Quality Matters:Quality Matters: Peer Course Peer Course

Review ProcessReview Process

Factors Affecting Course Quality

• Course design QM REVIEWS THIS

• Course delivery (i.e. teaching, faculty performance)

• Course content• Course management system• Institutional infrastructure• Faculty training and readiness• Student engagement and readiness

For Our Purposes, Quality Is…

• More than average; more than “good enough”

• An attempt to capture what’s expected in an effective online course at about an 85% level

• Based on research and widely accepted standards

85 %

The Rubric The Rubric

The Rubric Eight General Standards:

1. Course Overview and Introduction2. Learning Objectives 3. Assessment and Measurement4. Resources and Materials5. Learner Interaction6. Course Technology7. Learner Support8. Accessibility

Key components must align.

Alignment: Critical course elements work together to ensure that students achieve the desired learning outcomes. (Stated Course Objectives – Activities – Assessments – are consistent with one another.)

Course Learning Objectives (2)

Resources, Materials (4) & Technology (6)

Assessment and Measurement (3)

Learner Interactions & Activities (5)

Key sections that must align…

Rubric Scoring

Standards Points Relative Value

17 3 Essential

11 2 Very Important

12 1 Important

TOTALS

40 85

Team of 3 reviewers initially score individually One score per standard based on team majority Pre-assigned point value Yes/No decision; All/None points Consensus is NOT required

To Meet Expectations…

A course must achieve:

• “Yes” on all 17 of the 3-point “essential” standards.

• A minimum of 72 out of 85 points

72/85 = 85%

Underlying Principles of QM…

1. Based in national standards of best practice, the research literature & instructional design principles

2. The course under review does not have to be “perfect” but better than just “good enough” (Standards met at about 85% level or better.)

3. Integral to a continuous quality improvement process

4. Valued as part of a faculty-driven, peer review process

5. Designed to promote student learning    

Underlying Principles of QM (cont)….

6. Designed to ensure all reviewed courses will eventually meet expectations

7. QM is a collegial review process, not an evaluation process

8. A review team must include an external peer reviewer

9. Set up so that the course faculty or instructor considered part of the review team