13
2012 West Texas Assessment Conference CREATING A CULTURE OF ASSESSMENT IN NON-INSTRUCTIONAL AREAS KARA LARKAN-SKINNER, DIRECTOR OF IR AND IE & KRISTIN MCDONALD-WILLEY, ASSESSMENTS COORDINATOR

2012 West Texas Assessment Conference CREATING A CULTURE OF ASSESSMENT IN NON-INSTRUCTIONAL AREAS KARA LARKAN-SKINNER, DIRECTOR OF IR AND IE & KRISTIN

Embed Size (px)

Citation preview

Page 1: 2012 West Texas Assessment Conference CREATING A CULTURE OF ASSESSMENT IN NON-INSTRUCTIONAL AREAS KARA LARKAN-SKINNER, DIRECTOR OF IR AND IE & KRISTIN

2012 West Texas

Assessment Conference

CREATING A CULTURE OF ASSESSMENT

IN NON-INSTRUCTIONAL AREAS

KARA LARKAN-SKINNER, DIRECTOR OF IR AND IE&

KRISTIN MCDONALD-WILLEY, ASSESSMENTS COORDINATOR

Page 2: 2012 West Texas Assessment Conference CREATING A CULTURE OF ASSESSMENT IN NON-INSTRUCTIONAL AREAS KARA LARKAN-SKINNER, DIRECTOR OF IR AND IE & KRISTIN

Speaking Request:Discuss how Amarillo College (AC) addresses the following SACSCOC requirements: 3.3.1.2 Administrative Support Services 3.3.1.3 Academic and Student Support Services 3.3.1.5 Community/Public Service Within Mission Note: 3.3.1.4 Research is not applicable within our mission

Focus Areas: Discuss AC’s process for evaluating 3.3.1.2 - 3.3.1.5 Discuss AC’s accountability practices Discuss how AC guides the institution toward improvement Discuss how AC tackled the recent SACSCOC compliance

demands in the 2012 reaffi rmation reports and documentation

SESSION OUTLINE

Page 3: 2012 West Texas Assessment Conference CREATING A CULTURE OF ASSESSMENT IN NON-INSTRUCTIONAL AREAS KARA LARKAN-SKINNER, DIRECTOR OF IR AND IE & KRISTIN

Give you a few ideas/tools to aid you in your assessment practices.

Key Points:One size does not fi t allChange is not instantConsiderations

Type of institution Size of institution Number of

administrators/staff

SESSION GOAL

Page 4: 2012 West Texas Assessment Conference CREATING A CULTURE OF ASSESSMENT IN NON-INSTRUCTIONAL AREAS KARA LARKAN-SKINNER, DIRECTOR OF IR AND IE & KRISTIN

AC’S PROCESS FOR EVALUATING 3.3.1.2 - 3.3.1.5

PLANNING EVALUATION AND TRACKING (PET) PROCESS

Based on organizat ional chart , not i fy “people responsible”

Invite Non- Instruct ional (NI) area representatives to a training Discuss Measurable Goals Discuss Writing Good Outcomes and Direct Outcomes Walk through PET Form Template

NI areas given a template cal led a PET form Requirements:

Purpose Statement 1 Goal/Outcome from Strategic Plan 1 Goal/Outcome from Achieving the Dream (AtD) which is also called No Excuses 1 Direct Outcome 1 Set of Results and Analysis 1 Past Improvement and 1 Future Action Plan

PET form reminders/materia ls sent up unti l the due date

IE staff or NI committee off er assistance when needed

PET Form Submitted(See Sample PET Form Content: Next Sl ide)

Page 5: 2012 West Texas Assessment Conference CREATING A CULTURE OF ASSESSMENT IN NON-INSTRUCTIONAL AREAS KARA LARKAN-SKINNER, DIRECTOR OF IR AND IE & KRISTIN

Goal Statement #1:

Outcome/Objective Statement #1A(Be sure to include audience, behavior, condit ions, degree/benchmark, and evaluation method):

Resul ts ( I f Appl icable, Provide Numbers and Percentages for Quant i tat ive Data) 2010-2011 Data: Numbers = ___ out of ____ and Percentage =s ____% 2011-2012 Data: Numbers = ____ out of ____ and Percentage =s ____%

Analys is Provide Previous Data/Result Analysis

(Include if benchmark was met and how results relate to outcome statement):

Improvements List any Improvements Made in the 2011-2012 (Last Academic) Year: Evaluate Why Improvements Were Successful/Were Not Successful: What Budget Implications Were Involved with this Improvement? (Please Provide Cost

Estimate/Details):

Recommendat ions/Act ions for 2012-2013 Person Responsible (Who will complete the action?): Action Plan: Expected Time Frame Needed to Implement Action Plan (Please provide specifi c deadline

date): What Budget Implications Are Involved with this Action? (Please Provide Cost

Estimate/Details):

AC’S PROCESS FOR EVALUATING 3.3.1.2 - 3.3.1.5

SAMPLE PORTION OF PET TEMPLATE

Page 6: 2012 West Texas Assessment Conference CREATING A CULTURE OF ASSESSMENT IN NON-INSTRUCTIONAL AREAS KARA LARKAN-SKINNER, DIRECTOR OF IR AND IE & KRISTIN

AC’S PROCESS FOR EVALUATING 3.3.1.2 - 3.3.1.5

PLANNING AND EVALUATION TRACKING (PET) PROCESS

PET Form Reviewed by NI Assessment CommitteeResponse Form Returned to Person ResponsibleNeeded Edits Made to PET Form by Person

ResponsibleExtent of Outcome Achievement Documented Final PET Form Information Passed On For

Improvements: NI Assessment Committee President’s Cabinet Anyone Who Needs Access to Specialized Information

Page 7: 2012 West Texas Assessment Conference CREATING A CULTURE OF ASSESSMENT IN NON-INSTRUCTIONAL AREAS KARA LARKAN-SKINNER, DIRECTOR OF IR AND IE & KRISTIN

Use Your Verbal Judo Skills!

To Get Compliance Encourage wide representation, but have 1 primary person responsible Copy supervisors on al l PET-related communications Clearly defi ne in advance how the PET form wil l be used and who wil l see it Small trainings with “l ike” groups help peer pressure into compliance

To Get Cooperation (A.K.A. “Buy In”) Simplify as Much as Possible Make Process Fair

Clearly defined guidelines Clearly defined evaluation process

Prove that the Process is Meaningful Tie it to other institutional initiatives Answer the “why” and the “so what?” questions

To Get Collaboration (Ultimate Goal) Involve NI people in Forming and Evolving Your Process

NI Assessment Committee (at AC, minimum 10 members) Invite all NI staff /administration to “Chats and Stats” discussions

ACCOUNTABILITY PRACTICES-HOW DO YOU GET PARTICIPATION?-

Page 8: 2012 West Texas Assessment Conference CREATING A CULTURE OF ASSESSMENT IN NON-INSTRUCTIONAL AREAS KARA LARKAN-SKINNER, DIRECTOR OF IR AND IE & KRISTIN

Improvement for NI Areas in Creating Outcomes/Objectives Multiple Training Opportunities (Outside of “Assigned” Time) Ability to Work with IE employees or NI Committee Members Feedback Off ered via NI Assessment Committee Response Forms Opportunity to Edit and Improve Form Based on Feedback Opportunity to Improve from NI Assessment Committee

Recommendations Improved Results (See Handout)

Improvement for Institution as a Whole Based on PET Form Information Budget – President’s Cabinet reviews to assess institutional needs. Strategic Plan – President’s Cabinet can see where we are at on

institutional priorities and avoid duplication of eff ort. No Excuses – Identify how each area can help guide students toward

success either directly or indirectly.

GUIDE INSTITUTION TOWARD IMPROVEMENT

-HOW DO YOU USE THE INFORMATION?-

Page 9: 2012 West Texas Assessment Conference CREATING A CULTURE OF ASSESSMENT IN NON-INSTRUCTIONAL AREAS KARA LARKAN-SKINNER, DIRECTOR OF IR AND IE & KRISTIN

Improvement for Those Who Oversee the Assessment Process Use NI Assessment Committee Comments to Improve

Use SACSCOC Comments to Improve For example, choose terminology you use in your responses very carefully

Use Collaboration with All Possible Stakeholders to Improve For example, we now collaborate with Academic Affairs because they do

oversee some of the student and academic support areas and thus have an invested interest in the process

GUIDE INSTITUTION TOWARD IMPROVEMENT

Page 10: 2012 West Texas Assessment Conference CREATING A CULTURE OF ASSESSMENT IN NON-INSTRUCTIONAL AREAS KARA LARKAN-SKINNER, DIRECTOR OF IR AND IE & KRISTIN

AC Identifi es Expected Outcomes Writing Outcomes: Audience, Behavior, Condition, Degree, Evaluation (A-E)

Model PET Process Training and Training Support Information

AC Identifi es the Extent to Which it Achieves These Outcomes Brief overview on where and how the achievement of outcomes is identified Information on methodology that outlines how outcomes will be assessed

AC Provides Evidence of Improvement Based on Result Analysis Examples provided for key words identified in SACSCOC handbook Information on reports that document improvements made by NI areas Response Form Information Information on Review Process After PET Submission

SUMMARY: -HOW DID WE USE OUR PROCESS TO MEET SACSCOC

GUIDELINESS?-

Page 11: 2012 West Texas Assessment Conference CREATING A CULTURE OF ASSESSMENT IN NON-INSTRUCTIONAL AREAS KARA LARKAN-SKINNER, DIRECTOR OF IR AND IE & KRISTIN

QUESTIONS

Assessments CoordinatorAmarillo College

Kristin [email protected]

Director of Institutional Research and Institutional EffectivenessAmarillo College

Kara [email protected]