13
A MODEL FOR A MODEL FOR OUTCOMES ASSESSMENTS OUTCOMES ASSESSMENTS Danita McAnally Danita McAnally Dean of Assessment & Dean of Assessment & Development Development Kara Larkan-Skinner Kara Larkan-Skinner Director of Outcomes Director of Outcomes Assessments Assessments

A MODEL FOR OUTCOMES ASSESSMENTS Danita McAnally Dean of Assessment & Development Kara Larkan-Skinner Director of Outcomes Assessments

Embed Size (px)

Citation preview

Page 1: A MODEL FOR OUTCOMES ASSESSMENTS Danita McAnally Dean of Assessment & Development Kara Larkan-Skinner Director of Outcomes Assessments

A MODEL FOR A MODEL FOR OUTCOMES ASSESSMENTSOUTCOMES ASSESSMENTS

Danita McAnallyDanita McAnallyDean of Assessment & Dean of Assessment & DevelopmentDevelopment

Kara Larkan-SkinnerKara Larkan-SkinnerDirector of Outcomes Director of Outcomes AssessmentsAssessments

Page 2: A MODEL FOR OUTCOMES ASSESSMENTS Danita McAnally Dean of Assessment & Development Kara Larkan-Skinner Director of Outcomes Assessments

CULTURE OF CULTURE OF ASSESSMENTSASSESSMENTS

Shifting to a Shifting to a culture of evidence culture of evidence = similar to turning = similar to turning a shipa ship

Page 3: A MODEL FOR OUTCOMES ASSESSMENTS Danita McAnally Dean of Assessment & Development Kara Larkan-Skinner Director of Outcomes Assessments

CONCERNS:CONCERNS: Faculty and Staff Buy-inFaculty and Staff Buy-in

Make It Valuable to the Employees within Make It Valuable to the Employees within Each UnitEach Unit

Keep it SimpleKeep it Simple

Build on What the Employees Already KnowBuild on What the Employees Already Know

Ensure Data, Analysis, and Improvements Ensure Data, Analysis, and Improvements Meet Expectations of External EntitiesMeet Expectations of External Entities

Page 4: A MODEL FOR OUTCOMES ASSESSMENTS Danita McAnally Dean of Assessment & Development Kara Larkan-Skinner Director of Outcomes Assessments

CHARACTERISTICS OF SOLUTIONCHARACTERISTICS OF SOLUTION::

Principles of AssessmentPrinciples of Assessment

Customized Outcomes Designed by Each Unit Customized Outcomes Designed by Each Unit Based on their ConcernsBased on their Concerns

A-E MethodA-E Method

Integrated into Existing Unit Plan FormatIntegrated into Existing Unit Plan Format

Ongoing Training by PeersOngoing Training by Peers

Continuous Improvement Continuous Improvement

Page 5: A MODEL FOR OUTCOMES ASSESSMENTS Danita McAnally Dean of Assessment & Development Kara Larkan-Skinner Director of Outcomes Assessments

PRINCIPLES OF PRINCIPLES OF ASSESSMENTASSESSMENT

Developed to Developed to reassure employees reassure employees of assessment of assessment purposes and usespurposes and uses

See attachment for See attachment for the 8 principlesthe 8 principles

Page 6: A MODEL FOR OUTCOMES ASSESSMENTS Danita McAnally Dean of Assessment & Development Kara Larkan-Skinner Director of Outcomes Assessments

CUSTOMIZED OUTCOMES CUSTOMIZED OUTCOMES BY UNITBY UNIT

.

     

Training Sessions: Training Sessions:

Writing OutcomesWriting Outcomes

Non-Instructional Units – 2X2; large group; Non-Instructional Units – 2X2; large group; 1X1- 10/04-12/041X1- 10/04-12/04

Instructional Units – 21 training sessions Instructional Units – 21 training sessions 11/07-9/0811/07-9/08

http://http://www.actx.edu/iea/index.php?modulewww.actx.edu/iea/index.php?module==article&idarticle&id=20=20

Begin by Identifying Main Begin by Identifying Main Concerns or Issues Concerns or Issues

Page 7: A MODEL FOR OUTCOMES ASSESSMENTS Danita McAnally Dean of Assessment & Development Kara Larkan-Skinner Director of Outcomes Assessments

A-E METHODA-E METHOD

Based on A-D method Based on A-D method developed bydeveloped by

Non-Instructional Non-Instructional Assessement Sub-comm. - Assessement Sub-comm. - added E and the recipes/ added E and the recipes/ formulasformulas

Page 8: A MODEL FOR OUTCOMES ASSESSMENTS Danita McAnally Dean of Assessment & Development Kara Larkan-Skinner Director of Outcomes Assessments

INTEGRATED IN UNIT PLAN INTEGRATED IN UNIT PLAN FORMATFORMAT

Planning & Planning & Evaluation Tracking Evaluation Tracking (PET) forms(PET) forms

Based on the Nichols Based on the Nichols 5-column model5-column model

Used for about two Used for about two decades at ACdecades at AC

Page 9: A MODEL FOR OUTCOMES ASSESSMENTS Danita McAnally Dean of Assessment & Development Kara Larkan-Skinner Director of Outcomes Assessments

ONGOING TRAINING BY ONGOING TRAINING BY PEERSPEERS Non-Instructional Sub-Non-Instructional Sub-

committee – 1X1 long-term committee – 1X1 long-term trainingtraining

Instructional Sub-committee Instructional Sub-committee – 1X1 training for Reporting – 1X1 training for Reporting Results IIResults II

Page 10: A MODEL FOR OUTCOMES ASSESSMENTS Danita McAnally Dean of Assessment & Development Kara Larkan-Skinner Director of Outcomes Assessments

CONTINUOUS CONTINUOUS IMPROVEMENTIMPROVEMENT

Sub -committees Sub -committees Review Internal Audit of Review Internal Audit of PET FormsPET Forms

Tk20 – Computer Tk20 – Computer Database Generates Database Generates Audits for ReportsAudits for Reports

Page 11: A MODEL FOR OUTCOMES ASSESSMENTS Danita McAnally Dean of Assessment & Development Kara Larkan-Skinner Director of Outcomes Assessments

CONTINUOUS CONTINUOUS IMPROVEMENTIMPROVEMENT

Assessment Committee - Assessment Committee - Ensures Units Make Ensures Units Make Improvements Based on Improvements Based on OutcomesOutcomes

Assessment Committee – Assessment Committee – Revises Approaches for Revises Approaches for Ensuring Shift to a Culture Ensuring Shift to a Culture of Evidenceof Evidence

PET w/1 Direct Outcome

70%

75%

80%

85%

90%

95%

100%

2005-06 2006-07 2007-08

Total Inst Non-Inst

PET # of RESULTS

50%

55%

60%

65%

2006-07 2007-08

Total Instructional Non- Instructional

Page 12: A MODEL FOR OUTCOMES ASSESSMENTS Danita McAnally Dean of Assessment & Development Kara Larkan-Skinner Director of Outcomes Assessments

KEEP THE FAITHKEEP THE FAITH Shifting to a culture of outcomes assessments is an evolution

Be prepared to repeat the same information often

Expect peaks and valleys in employee buy-in

Bring a team with you – allow your representatives on committees to manage the shift to outcomes

Coach frequently and laugh often

Page 13: A MODEL FOR OUTCOMES ASSESSMENTS Danita McAnally Dean of Assessment & Development Kara Larkan-Skinner Director of Outcomes Assessments

QUESTIONS & CONTACTSQUESTIONS & CONTACTS

Danita McAnallyDanita McAnally Dean of Assessment & Dean of Assessment &

DevelopmentDevelopment

[email protected]

Kara Larkan-SkinnerKara Larkan-Skinner Director of Outcomes Assessments Director of Outcomes Assessments

[email protected]

Copyright 2009