41
Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Embed Size (px)

Citation preview

Page 1: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Beyond Multiple Choice: Using Performance and Portfolio Assessments to

Evaluate Student Learning

Page 2: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Assessments can be classified as either selected-response or

constructed- response.

Page 3: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Selected-response types:

true/false, multiple choice, multiple answer, matching

Page 4: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Selected-response types are typically graded objectively and usually measure recall of facts and

information, lower levels of Bloom’s taxonomy.

Page 5: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Constructed-response types:

essays, performance tasks, portfolios, projects

Page 6: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Constructed-response types are typically graded subjectively and usually measure application of knowledge and skills, higher levels of Bloom’s

taxonomy.

Page 7: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Selected-response assessments are frequently criticized by education experts

because of what they don’t do

Page 8: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Selected-response assessments don’t replicate the kinds of complex tasks that students will face in the real world when they try to use their knowledge and skills to succeed, tasks that involve more cognitively demanding decisions than picking the right answer.

Page 9: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Also, selected-response assessments don’t give students the responsibility to develop and opportunities

to practice self-assessment and self-adjustment. Instead, they encourage passivity and a reliance on

luck or chance.

Page 10: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

However, selected-response assessments are the ideal choice when a teacher needs a simple, easy to grade method of assessing students’ knowledge of facts.

Page 11: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

They are less useful if a teacher needs to measure synthesis of knowledge or application of information. In those cases, constructed-response assessments are

more appropriate.

Page 12: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Today, performance assessment and portfolio assessment are considered the two types of

constructed-response assessments most likely to allow the teacher to make accurate decisions about the

students’ mastery of the learning outcomes.

Page 13: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Performance Assessment

Students are given a task to complete. For authentic assessment, the task should be a challenge that is likely to be encountered by a worker, citizen, or consumer in the real world.

Page 14: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Performance Assessment

Create a multimedia presentation that analyzes the strengths and weaknesses of a documentary on global warming.

Page 15: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Performance Assessment

Build a website for a small business in your community.

Write up a bid for a job to landscape the new Canyon Country campus.

Page 16: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Performance Assessment

Have students plan how to invest $40,000 in the stock market for their children’s college education. They have to select the stock, make a record of their value for 30 days, then write a report describing their success and indicating what changes they would make in their stock portfolio.

Page 17: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Two Kinds of Performance Tasks

Restricted performance: highly structured.

Example: construct a graph from a set of data.

Extended performance: comprehensive.

Example: prepare a presentation on endangered species.

Page 18: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Most performance tasks fall into one of these three categories:

1. Solving realistic problems.2. Oral or psychomotor skills without a product.3. Writing or psychomotor skills with a product.

Page 19: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

If you want to use performance assessment, what must you know?

Page 20: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

The evaluative criteria for judging the performance have to be clearly explained to the

student before he or she begins the task.

Page 21: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

The student is given feedback on the quality of the performance using the evaluative criteria and then uses the

feedback to improve in future performances of the task.

Page 22: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

One area of concern when using performance assessment:

Is the task actually a performance assessment or is it a learning activity?

Page 23: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

A learning activity may help engage the students and provide an opportunity for them to practice with the

material without being a good way for you to measure their learning.

Page 24: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Also, a learning activity may involve a kind of performance that is not the kind you want to measure in order to determine whether the student has met the

learning outcome.

Page 25: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

If we use a particular performance genre as a means to an assessment end, we may not think about how the performance genre itself is a variable in the task and

will affect the results.

Page 26: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Example: a mock trial of Socrates in ancient Greece.

A good way to assess this SLO: Judge the contributions of Socrates, Athens, Plato’s Apology to

the Western philosophic tradition?

Page 27: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Always ask yourself:

Could the student do well at the task for reasons that have little to do with the desired

understanding or skill being assessed?

Page 28: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

And, could the student do poorly at the task for reasons that have little to do with the desired

understanding or skill being assessed?

Page 29: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Another area of concern when using performance assessment:

Grading!

Page 30: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

You need to establish the evaluative criteria for the quality of the task.

These criteria should be based on the SLOs and objectives for the course.

Page 31: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Typically, the evaluative criteria are incorporated into a rubric that is used to

grade the performance assessment.

Page 32: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

By yourself or with a colleague from your discipline or a related discipline, design a performance assessment

task for an SLO you are used to teaching to, first answering the questions on the handout.

Page 33: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Portfolio Assessment

A collection of student work that is used for assessment purposes.

Page 34: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Its popularity comes from its ability to base assessment on diverse evidence (including different performance tasks) and to foster self-assessment in students in the

process.

Page 35: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

However, portfolio assessment has been sharply criticized on two counts:

Sometimes its purpose is unclear from the beginning.

Sometimes the way it is graded seems unreliable.

Page 36: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Three different kinds of purposes:

1. Document progress in student learning?

2. Showcase the student’s accomplishments?

3. Prove the student has met the learning outcomes?

Page 37: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Failure to define the purpose of the portfolio before

designing it will undermine its validity!

Page 38: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Grading Issues

Portfolio assessment requires specific evaluative criteria for grading to be valid.

Portfolios are best graded through the use of a rubric built on the evaluative criteria.

Page 39: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Creating Rubrics for both Performance and Portfolio Assessments

Page 40: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

Self-assess your level of experience with performance and portfolio assessment:

Novice, Apprentice, or Expert

Page 41: Beyond Multiple Choice: Using Performance and Portfolio Assessments to Evaluate Student Learning

If you are now a novice, do you have any desire to become an apprentice? How would you do that?

If you are now an apprentice, do you have any desire to become an expert? How would you do that?

If you are now an expert, how might you share your expertise with your colleagues so that they also can

reach experthood?