19
1 Assessments that IMPROVE LEARNING Thomas R. Guskey For help or additional information: Thomas R. Guskey College of Education University of Kentucky Lexington, KY 40506 tguskey.com [email protected] @tguskey 859-221-0077 Learning Targets 1. Recognize the need for classroom assessments to serve as learning tools rather than evaluation devices. 2. Understand the effective use of traditional and alternative assessments to measure different learning goals. 3. Develop guidelines for implementing high-quality classroom assessments.

Assessments that IMPROVE LEARNING - nesacenter.org · Learning Targets 1. ... Clarity Few errors of grammar ... [Levels of Quality for Student Self-Assessment] Criteria 4 3 2 1 1

Embed Size (px)

Citation preview

1

Assessments that

IMPROVE

LEARNING

Thomas R. Guskey

For help or additional information:

Thomas R. Guskey

College of Education

University of Kentucky

Lexington, KY 40506

tguskey.com

[email protected]

@tguskey

859-221-0077

Learning Targets

1. Recognize the need for classroom assessments

to serve as learning tools rather than evaluation devices.

2. Understand the effective use of traditional and alternative

assessments to measure different learning goals.

3. Develop guidelines for implementing high-quality classroom

assessments.

2

6 Crucial Steps

for Effective

Assessment

Practice

1. Begin with assessment

purpose and level.

Purposes and Levels of Assessments

Purpose Level

Classroom Benchmark Annual

Formative (Inform & Support)

Summative (Judge & Evaluate)

Why?

Who?

What?

Why?

Who?

What?

Why?

Who?

What?

Why?

Who?

What?

Why?

Who?

What?

Why?

Who?

What?

3

Essential Question:

Is your purpose as an educator

to select talent,

or to develop talent?

What level has the most direct and most

powerful influence on student learning?

Purpose Level

Classroom Benchmark Annual

Formative (Inform & Support)

Summative (Judge & Evaluate)

X

X

2. Small differences in

assessments

yield big differences in

what is measured!

4

A Complex Problem:

2 3 5 + = 3 4 7

Assessment Formats Traditional Assessments

True / False

Matching

Multiple-Choice

Completion

Essay / Short Answer

A Complex Problem:

Find x :

3 c

m

4 cm

5

Assessment Formats Traditional Assessments

True / False

Matching

Multiple-Choice

Completion

Essay / Short Answer

Assessment Formats

True / False Problem:

T Solution:

T F 1. One of the ...

Matching Problem: Format Solution:

xxxx xxxxxxxxxxxxxxxxx

xxxx xxxxxxxxxxxxxxxxx

xxxx xxxxxxxxxxxxxxxxx

xxxx xxxxxxxxxxxxxxxxx

xxxx xxxxxxxxxxxxxxxxx

xxxx xxxxxxxxxxxxx xxxx

xxxx xxxxxxxxxxxxxxxxx

xxxx xxxxxxxxxxxxxxxxx

xxxx xxxxxxxxxxxxxxxxx

__ __________

__ __________

__ __________

__ __________

__ __________

__ __________

__ __________

__ __________

xxxxxxxxxxxxxxxxx xxxx

xxxxxxxxxxxxxxxxx xxxx

xxxxxxxxxxxxxxxxx xxxx

xxxxxxxxxxxxxxxxx xxxx

xxxxxxxxxxxxxxxxx xxxx

xxxxxxxxxxxxxxxxx xxxx

xxxxxxxxxxxxxxxxx xxxx

xxxxxxxxxxxxxxxxx xxxx

xxxxxxxxxxxxxxxxx xxxx

Assessment Formats

Multiple-Choice Items: Include common errors to

diagnose learning problems

1. 1.2 + .23 = ____

a. 3.5

b. .35

c. 1.43

d. 14.3

6

Name ________________ Name ________________

Date ________________ Date ________________

1. A B C D E ______ 1. A B C D E ______

2. A B C D E ______ 2. A B C D E ______

3. A B C D E ______ 3. A B C D E ______

4. A B C D E ______ 4. A B C D E ______

5. A B C D E ______ 5. A B C D E ______

6. A B C D E ______ 6. A B C D E ______

7. A B C D E ______ 7. A B C D E ______

8. A B C D E ______ 8. A B C D E ______

9. A B C D E ______ 9. A B C D E ______

10. A B C D E ______ 10. A B C D E ______

11. A B C D E ______ 11. A B C D E ______

12. A B C D E ______ 12. A B C D E ______

13. A B C D E ______ 13. A B C D E ______

14. A B C D E ______ 14. A B C D E ______

15. A B C D E ______ 15. A B C D E ______

16. A B C D E ______ 16. A B C D E ______

17. A B C D E ______ 17. A B C D E ______

18. A B C D E ______ 18. A B C D E ______

19. A B C D E ______ 19. A B C D E ______

20. A B C D E ______ 20. A B C D E ______

Tallying Assessment Results

Assessment Analysis

(# of Errors / Item)

1. / 11. ///

2. /// 12. //// //// //// //

3. 13. //

4. // 14 ////

5. //// 15.

6. / 16. ///

7. //// //// /// 17. //// /

8. //// //// //// 18. //

9. /// 19. /

10. // 20. //

Common Formative Assessment Results

Formative Assessment 3

Item Jen Michael Chris

1 ||| |

2 || | ||

3 |||| |||| |||| | ||| ||

4

5 ||| | |||

6 | ||| |

7 || |||| |||| |||| |||| |||| |||| |

8

9 |||| |||| |||| | |||| |||| ||| |

10 ||| | |||

11 | || |

12 |||| |||| |||| |||| |||| |||| || |||| |||| |||

7

Assessment Formats Alternative Assessments

Skill Demonstrations

Oral Presentations

Task Performances

& Complex Problems

Compositions & Writing Samples

Laboratory Experiments

Projects & Reports

Group Tasks or Activities

Portfolios

The Key To Success with

Alternative Assessments:

Clearly specified

performance criteria

or scoring rubrics.

What is a Rubric?

“A coherent set of criteria for

students’ work that includes

descriptions of levels of

performance quality on the

criteria.” (Brookhart, 2013)

8

Essential Aspects of a Rubric

1. Set of criteria for a performance or piece of work:

-- What counts?

2. Descriptions of levels of quality for each criterion:

-- What is ‘Excellent’? What is ‘Poor’?

Purpose of a Rubric

“Rubrics don’t judge the performance;

they describe the performance.”

(Brookhart, 2013)

Types of Rubrics Types of Rubrics

Compliance rubrics Focus on required elements, checklists, or counts.

Learning rubrics Describe levels of quality in performance.

9

Example of a Compliance Rubric

Homework (Process Criterion) [Count / Frequency]

Criteria 4 3 2 1

Completion All assignments completed

and turned in on time.

1-2 assignments

missing or turned in late.

3-4 assignments

missing or turned in

late.

Multiple assignments

missing or turned in

late.

Example of a Compliance Rubric

Class Participation (Process Criterion) [Count / Frequency]

Criteria 4 3 2 1

Discussion Contributes daily to

class discussions.

Contributes regularly to

class discussions

Contributes

occasionally to class

discussions.

Contributes only rarely

to class discussions.

Activities Enthusiastically takes part

in all class activities.

Regularly takes part in

class activities.

Occasionally takes part

in class activities.

Rarely takes part in

class activities.

Example of a Compliance Rubric (Brookhart, 2013)

Poster Project (Product Criterion) [Number / Count]

Criteria 4 3 2 1

1. Facts

Poster includes at least 6

facts and is interesting to

read.

Poster includes 4-5 facts

and is interesting to read.

Poster includes at least

2-3 facts.

Several facts are

missing.

2. Graphics

All graphics are related to

the topic and make it easy

to understand.

One graphic is not

related to the topic.

Two graphics are not

related to the topic.

Graphics do not relate

to the topic

3. Grammar

There are no mistakes in

grammar, punctuation, or

spelling.

There are 1-2 mistakes in

grammar, punctuation, or

spelling.

There are 3-4 mistakes

in grammar,

punctuation, or spelling.

There are more than 4

mistakes in grammar,

punctuation, or spelling.

4. Neatness

Poster is exceptionally

attractive in terms of

design, layout, and

neatness.

Poster is attractive in

terms of design, layout,

and neatness.

Poster is acceptably

attractive, although

parts are messy.

The poster is messy or

very poorly designed.

10

Example of a Learning Rubric (Brookhart, 2013)

Writing Projects (Product Criterion)

[Levels of Quality]

Criteria 4 3 2 1

1. Content

Thesis is clear.

A large amount and

variety of evidence

supports the thesis.

All materials are

relevant

Information is

accurate.

Appropriate sources

were consulted.

Thesis is clear.

An adequate amount

and variety of evidence

supports the thesis.

Material includes

details. Information is

mostly accurate.

Appropriate sources

were consulted.

Thesis is somewhat

unclear.

Some evidence supports

the thesis.

Some material is relevant.

Details are lacking.

Information includes some

inaccuracies.

Some resources were

appropriate.

Thesis is not clear.

Much of the evidence

is irrelevant to the topic

or inaccurate.

Details are lacking.

Appropriate sources

were not consulted.

Writing Projects (Product Criterion) [Levels of Quality]

Criteria 4 3 2 1

2. Reasoning

and Evidence

Information is clearly

and explicitly related to

the points in the

material.

Information is organized

in a logical manner and

presented concisely.

Flow is good.

Information is clearly

related to the points in

the material, although

not all connections are

explained. Information

is organized in a logical

manner.

Flow is adequate.

Some information is

related to the points in

the material, but

connections are not

explained.

Information is not

entirely organized in a

logical manner.

Flow is choppy.

Information is not related

to the points in the

material.

Information is not

organized in a logical

manner.

Material does not flow.

3. Clarity

Few errors of grammar

and usage; any minor

errors do don’t interfere

with meaning.

Language style and

word choice are highly

effective and enhance

meaning.

Some errors of grammar

and usage; errors do not

interfere with meaning.

Language style and

word choice are

generally effective and

appropriate to the

project.

Major errors of grammar

and usage begin to

interfere with meaning.

Language style and

word choice are simple

bland, and not very

effective or appropriate.

Major errors of grammar

and usage make

meaning unclear.

Language style and

word choice are

ineffective and/or

inappropriate.

Example of a Learning Rubric (Brookhart, 2013)

Group Participation (Process Criterion) [Levels of Quality for Student Self-Assessment]

Criteria 4 3 2 1

1. Goal-setting

and focus

I helped set my group’s

goals and helped keep

the group focused.

I helped set my group’s

goals and stayed

focused on them.

I accepted the goals

that other group

members set.

I resisted the goals we

set and got the group

off-task.

2. Personal

contribution

I contributed something

very important to our

work.

I contributed something

important to our work.

I contributed something

to our work.

I didn’t contribute to our

work, or I did contribute

but the group made me

do it.

3. Attention

I listened to other group

members and

responded in a helpful

way.

I listened to other group

members.

I talked to much or

didn’t listen to other

group members.

I distracted the group

by what I said and did.

11

Simple Guideline for Developing

“Graduated Levels of Quality” 4 Yes

3 Yes, but ...

2 No, but ...

1 No

See: Arter, J., & McTighe, J. (2001). Scoring rubrics in the classroom.

Thousand Oaks, CA: Corwin Press.

Why Use Rubrics? 1. They are powerful tools for teaching and assessment.

2. They help students become more thoughtful judges of their own work.

3. They reduce the time teachers spend evaluating students’ work.

4. They allow teachers to accommodate individual differences in heterogeneous classes.

5. They are easy to use and explain.

6. They improve objectivity in scoring.

Tips for Designing Rubrics

1. Begin with “Models of Excellence”

2. Avoid unclear language (e.g., “A creative beginning”)

3. Avoid unnecessary negative language

4. Involve students in the process

See: Arter, J., & McTighe, J. (2001). Scoring rubrics in the classroom.

Thousand Oaks, CA: Corwin Press.

12

3. Simple questions can reveal

deep understanding!

Multiple-choice items can measure complex behaviors!

A boat with a rock in it is floating in a pool of water. A mark

is made to show the level of the water on the side of the pool.

The rock is thrown overboard and sinks. What happens to the

level of water on the side of the pool? Is it now?

a. Below the mark

b. Above the mark

c. Did not change

d. Not enough information to know

Sample Question:

Why is it warm in summer

and cold in winter?

13

Private Universe

https://www.learner.org/vod/vod_wind

ow.html?pid=9

4. Start with learning goals,

NOT assessment

format!

Essential Questions in

Planning Assessments

1. What do I want students to learn?

(Content / Knowledge)

2. What do I want students to be able to do?

(Processes / Behaviors)

3. What evidence best reflects that learning?

14

These ideas are

not new!

Basic Principles of Curriculum

and Instruction (1949)

Two Fundamental Decisions: A. What do I want students to learn?

B. What evidence would I accept to

verify their learning?

Ralph W. Tyler

5. Assessments must be an integral

part of the instructional process.

Assessments should be

learning tools,

Not evaluation devices

that mark the end

of learning.

Implication #1

Assessments must be

Sources of

Information for students and teachers.

15

Implication #2

Assessments must

be followed by

High Quality

Corrective

Instruction.

Different presentation Different

engagement

Correctives must include:

Different learning styles

Different learning modalities

Different types of intelligence

Not repetition of the initial

instruction!

Correctives include:

16

Implication #3

Students must be

given a

second chance to show improvement!

“Spectacular achievements

are always preceded by

unspectacular preparation.”

Roger Staubach

How do I use formative

assessments in my classes?

Questions / Concerns

Time vs. Coverage?

Motivation?

After the 2nd Assessment?

Grading?

17

6. Ensure early success!

1. Begin with assessment purpose and level.

2. Small differences in assessments yield big differences in what is measured.

3. Simple questions can reveal deep understanding.

4. Start with learning goals, not assessment format.

5. Assessment must be an integral part of instruction.

6. Ensure early success.

6 Crucial Steps for Effective

Assessment Practice

Guidelines for

Better Practice

18

1. Adapt assessments

to fit student learning goals.

What do we want students to

learn and be able to do?

What evidence best reflects that

learning?

2. Feedback first;

evaluation second!

Our primary goal is

student learning.

Better assessments =

better feedback!

3. Feedback must include guidance and direction on how to improve!

Different from initial instruction

Adapted to individual students’

learning needs

19

For help or additional information:

Thomas R. Guskey

College of Education

University of Kentucky

Lexington, KY 40506

tguskey.com

[email protected]

@tguskey

859-221-0077