Designing Electronic Homework for Learning First, and Assesment

Second

Bill Vining SUNY College at Oneonta

Beatrice Botch UMass Amherst

Roberta Day UMass Amherst

Development of the OWLElectronic Homework System

Philosophy

Needs

How it all Works

Philosophy

Exams and Quizzes are for evaluation.

Homework is for learning.

Needs to Support Learning

• Graded Homework questions

• No “penalty” for trying

• Feedback on how to answer each question

• A way to ensure that sometime, eventually, they really get it right on their own

• Extra Support– Teaching materials aimed at concepts– Detailed, step-by-step help for the more troubled

among us

Needs to Support Teaching

• Comprehensive coverage

• Strong accuracy and pedagogical vetting

• Flexibility

• Ease of use:– Assigning work– Obtaining grades– Managing Students

• It needs to work

Needs to Support Learning

• Graded Homework questions

• No “penalty” for trying

• Feedback on how to answer each question

• A way to ensure that sometime, eventually, they really get it right on their own

• Extra Support– Teaching materials aimed at concepts– Detailed, step-by-step help for the more troubled

among us

Homework Question

Correct Answer and Feedback

Answer

Mastery Credit

correct

incorrect

The Necessity of Parameterization:

The No-Penalty Mastery Method

Three Dimensions of Parameterization Numbers Chemistry Questions

Support I: Question-Specific Feedback

Homework Question

Correct Answer and Feedback

Answer

Mastery Credit

correct

incorrect

Concept Simulations and Exercises

Newly generated question

Step-by-step tutorial

Support II: Additional Help forConcepts and Problem Solving

Tutorials: Numerical

Tutorials: Graphical

Concept Simulations

Multimedia Exercises

Homework Question

Correct Answer and Feedback

Answer

Mastery Credit

correct

incorrect

Concept Simulations and Exercises

Newly generated question

Step-by-step tutorial

Support III: Integration of Materials

Textbook and Learning Resources

Support III: Integration of Materials

Organization: Chapter Folders

Organization: Assignments

Organization: Units

Organization: Questions

Instructor Control

• Assignment Dates/ Retroactively Changeable

• Individual Extensions

• Scoring Cutoffs/Number of Tries

• Show Answers/Feedback

• Full Grade and Reporting Functions

• Full Question Editing and Authoring

OWL: The Current State

• Courses:– General Chemistry– Organic Chemistry– GOB– Introductory– Liberal Arts– Gen Chem and Organic “Prep”

• Users> 300 schools> 75,000 studentsOver 500,000 student users to date

OWL: The Current State

Content: General Chemistry

> 600 Assignments> 1200 Units~ 700 Tutors~ 100 Simulations~ 150 Multimedia Exercises

Including 20-40 Text End-of-Chapter-Specific Questions per Chapter.

OWL: The Current State

Evaluation Studies

Multiple Studies, None Perfect, General Conclusions:

Can raise grades by ~ letter gradeMost effective for C/D studentsQuestion Repeation/Feedback is essential

Electronic Homework Hints and Tips

Be a believer, even if you’re not

Assign early, assign often

Assign intro- how to assignments

Put some slack in the system

The Content/Software Team

Chemistry

Roberta DayBeatrice BotchBill ViningBarbara StewartPeter LillyaSteve HixsonSusan Young

Cowtown Productions

Eric MulvihillJesse CharetteBill Rohan

UMass CCBIT OWL Creators

Steve BattistiCindy SteinDave Hart

Thomson Learning

Lisa Lockwood, David Harris, Michelle Julet,

Gayle Huntress, Amee Mosely, Lisa Weber

Electronic Book