33
Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Embed Size (px)

Citation preview

Page 1: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Skills - Knowledge - Dispositions

Assessment Management - Set UpJanuary 2014

Page 2: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

MEET Jack

Company ABCRULES

Page 3: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

MEET Jack

Company ABCRULES

Jack works at Company ABC.

Page 4: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

The 3 RulesCompany ABC

1. You must be really good at making widgets.

2. You must know how to use a GPS to find the company picnic.

3. You must wear the color green every day.

At Company ABC there are 3 Rules that all employees must follow.

Page 5: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

The 3 RulesCompany ABC

Company ABC wants to win the “Good Company” award…

1. You must be really good at making widgets.

2. You must know how to use a GPS to find the company picnic.

3. You must wear the color green every day.

Page 6: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

The 3 RulesCompany ABC

...so the company must prove that its employees are following the rules.

1. You must be really good at making widgets.

2. You must know how to use a GPS to find the company picnic.

3. You must wear the color green every day.

Page 7: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

3 Types of Rule Information

1. Some rules have information about Skills

2. Other rules have information about Knowledge

3. Still other rules have information about Dispositions

There are 3 different types of information in rules.

Page 8: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

3 Types of Rule Information

1. Some rules have information about Skills

2. Other rules have information about Knowledge

3. Still other rules have information about Dispositions

To make a judgment about each type of information…

(Does the person have this skill?

Does the person have this knowledge?

Does the person have this disposition?)

Page 9: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

3 Types of Rule Information

1. Some rules have information about Skills

2. Other rules have information about Knowledge

3. Still other rules have information about Dispositions

...the information must be documented.

This is getting tricky!

To make this kind of judgment

Page 10: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

3 Types of Rule Information

1. Some rules have information about Skills

2. Other rules have information about Knowledge

3. Still other rules have information about Dispositions

The tricky part is that each type of information is documented in a different way.

This is getting tricky!

Page 11: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Documenting Skills

1. Skills

Skills are easy to document because they are both observable and measurable.

Skills are documented by observation.

2. Knowledge

3. Dispositions

Page 12: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Documenting Knowledge

1. Skills Knowledge is not directly observable.

2. Knowledge

3. Dispositions

Page 13: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Documenting Knowledge

1. Skills

The way to find out what someone knows is to have them talk about it.

Knowledge is documented by reflection.

2. Knowledge

3. Dispositions

Page 14: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Documenting Disposition

1. Skills

To document dispositions, you need to show evidence of consistency in different contexts...

Dispositions are documented by reflection that shows consistency.

2. Knowledge

3. Dispositions

Page 15: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Rule 1. “You must be really good at making widgets.”

Is this statement describing a skill, knowledge or a disposition?

Page 16: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Data Collection for Rule 1

“You must be really good at making widgets.”

WIDGET Production Report

Name # of Widgets

Quality

Jack 235 High

Sam 40 Mediocre

Karen 55 High

Joe 300 Poor

Company ABC tracks the production of widgets and keeps a record of their quality.

Page 17: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Data Collection for Rule 1

“You must be really good at making widgets.”

WIDGET Production Report

Name # of Widgets

Quality

Jack 235 High

Sam 40 Mediocre

Karen 55 High

Joe 300 Poor

Is the ‘Widget Report’ an effective way to collect this information?

Page 18: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Data Collection for Rule 1

“You must be really good at making widgets.”

WIDGET Production Report

Name # of Widgets

Quality

Jack 235 High

Sam 40 Mediocre

Karen 55 High

Joe 300 Poor

Yes! Making widgets is a skill. It is both observable and measurable.

The report documents the widget-making skill.

Page 19: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Rule 2. “You must know how to use a GPS to find the company picnic.”

Is this statement describing a skill, knowledge or a disposition?

Page 20: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Data Collection for Rule 2

“You must know how to use a GPS to find the company picnic.”

Company Picnic Attendees

Name 2011 2012 2013

Jack Yes Yes Yes

Sam No No Yes

Karen No Yes Yes

Joe Yes Yes Yes

The company picnic is held each year at a different secret location.

The company keeps a record of who attends the picnic as a way of determining who knows how to use a GPS to get there.

Page 21: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Data Collection for Rule 2

“You must know how to use a GPS to find the company picnic.”

Company Picnic Attendees

Name 2011 2012 2013

Jack Yes Yes Yes

Sam No No Yes

Karen No Yes Yes

Joe Yes Yes Yes

Is the Attendee Report an effective way to gather this information?

Page 22: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Data Collection for Rule 2

“You must know how to use a GPS to find the company picnic.”

Company Picnic Attendees

Name 2011 2012 2013

Jack Yes Yes Yes

Sam No No Yes

Karen No Yes Yes

Joe Yes Yes Yes

No. This is knowledge and knowledge is not directly observable.

An effective way to gather information about knowledge is to get people to talk about their understanding.

So…

Page 23: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

As a more effective method of gathering data about Rule 2, Company ABC has decided to run a training session just before the picnic to teach the employees how to use a GPS.

As the final activity in the training session, each employee must write an explanation of how to use the GPS to get to the picnic.

The written reflection documents the knowledge.

Data Collection for Rule 2

“You must know how to use a GPS to find the company picnic.”

Now that’s data-driven improvement !

Page 24: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Rule 3. “You must wear green every day.”

Is this statement describing a skill, knowledge or a disposition?

Page 25: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Data Collection for Rule 3“You must wear green every day.”

Green Apparel Report

Name Observation 1 Oct

Observation 2 Feb

Observation 3 June

Jack green shirt green shirt green shirt

Sam no green no green green shoes

Karen green hair ribbon

green hair ribbon

green skirt

Joe no green green trousers green socks

The Company ABC supervisor observes each employee 3 times a year to determine if the employee is following the rule.

Page 26: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Data Collection for Rule 3“You must wear green every day.”

Green Apparel Report

Name Observation 1 Oct

Observation 2 Feb

Observation 3 June

Jack green shirt green shirt green shirt

Sam no green no green green shoes

Karen green hair ribbon

green hair ribbon

green skirt

Joe no green green trousers green socks

Is the ‘Apparel Report’ an effective way to collect this information?

Page 27: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Data Collection for Rule 3“You must wear green every day.”

No. This is a disposition. Jack may have worn his green shirt for the 3 observations, but that doesn’t prove that he wore the green shirt the other days.

The behavior may be observable, but that doesn’t necessarily mean it is consistent.

Page 28: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

To make a judgment about a disposition we must have documented evidence that the behavior is consistent.

As a more effective method of collecting information about dispositions...

Data Collection for Rule 3“You must wear green every day.”

Is there a rule about smiling?

Page 29: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

...Company ABC now has their employees document what they wear each day with date-stamped photos.

Data Collection for Rule 3“You must wear green every day.”

Is there a rule about smiling?

The group of date-stamped Photos documents the disposition.

Page 30: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Conclusion

Company ABC has been collecting data about skills, knowledge, and dispositions for several years.

When they applied for the “Good Company” award, they learned that the information they were collecting was not telling them what they needed to know about employees following Rule 2 and Rule 3.

1. You must be really good at making widgets.

2. You must know how to use a GPS to find the company picnic.

3. You must wear the color green every day.

Page 31: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Conclusion

In the end, Company ABC was able to improve data collection strategies to accurately document Knowledge and Dispositions, as well as Skills!

1. You must be really good at making widgets.

2. You must know how to use a GPS to find the company picnic.

3. You must wear the color green every day.

Page 32: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Conclusion

Company ABC received the “Good Company” award...

Page 33: Skills - Knowledge - Dispositions Assessment Management - Set Up January 2014

Conclusion

Jack got “Employee of the Year”

...because he is so good at making widgets

...he knows how to use a GPS to find the company picnic

...and he ALWAYS wears green.

JACK

EMPLOYEE OF THE YEAR

I’m glad I found my green shirt!