Reinventing Program and Reinventing Program and Services Review at Chaffey Services Review at Chaffey

CollegeCollege

Marie BoydMarie Boyd

Giovanni Sosa Giovanni Sosa

Tom VitzelioTom Vitzelio

Presentation OverviewPresentation Overview

SETTING THE STAGESETTING THE STAGETHE PROCESSTHE PROCESSPROBLEMSPROBLEMSTHE RESULTSTHE RESULTSREWARDSREWARDSFUTURE GOALSFUTURE GOALS

SETTING THE STAGESETTING THE STAGEChaffey completed a Chaffey completed a

program review (“PSR”) every year.program review (“PSR”) every year. The Problems:The Problems:

Labor intensive process Labor intensive process Undefined process = No real substantive Undefined process = No real substantive

comments comments Evolved into a budgeting focused process Evolved into a budgeting focused process Discontent with the decision making processDiscontent with the decision making process Slow SLO process Slow SLO process Confusion regarding the definition of a “ Confusion regarding the definition of a “

program”program”

SETTING THE STAGESETTING THE STAGE Dr. Sherrie Guerrero decided that a new Dr. Sherrie Guerrero decided that a new

PSR was to be launched.PSR was to be launched. Summer of 2008Summer of 2008: revising the PSR templates : revising the PSR templates

in Curricunet in Curricunet Fall 2008:Fall 2008: fine tuning new model and fine tuning new model and

dialoging with the PSR committee. dialoging with the PSR committee. Spring 2009:Spring 2009: reading and critiquing the SLO reading and critiquing the SLO

portion of PSR was now established under the portion of PSR was now established under the SLO CommitteeSLO Committee

February to March 2009February to March 2009: development of : development of resources and training for both the PSR writer resources and training for both the PSR writer and the SLO Committee Readersand the SLO Committee Readers

THE PROCESSTHE PROCESS

The SLO Committee was divided into reading The SLO Committee was divided into reading teamsteams

AUOs (administrative unit outcomes)AUOs (administrative unit outcomes)Administrators and non-instructional staff membersAdministrators and non-instructional staff members

SLOs SLOs Faculty and staff from instructional programsFaculty and staff from instructional programs

Hybrid programs Hybrid programs either an AUO team or SLO team.either an AUO team or SLO team.

The SLO Committee:The SLO Committee: Decide the desired progress of the program Decide the desired progress of the program

SLOs/AUOsSLOs/AUOs

THE PROCESSTHE PROCESS

A consistent set of comments A consistent set of comments 5 phases of the assessment cycle5 phases of the assessment cycle Goal: consistency among teams of readersGoal: consistency among teams of readers

Institutional Research online evaluation formInstitutional Research online evaluation form Electronically submitted to IR Electronically submitted to IR Copy for programs being evaluatedCopy for programs being evaluated

Chaffey PSR Screen Shots:Chaffey PSR Screen Shots:Program Mission and OverviewProgram Mission and Overview

Chaffey PSR Screen Shots:Chaffey PSR Screen Shots:Program Goals and Outcomes AssessmentProgram Goals and Outcomes Assessment

Chaffey PSR Screen Shots: Chaffey PSR Screen Shots: ProgramProgram Curriculum Mapping MatrixCurriculum Mapping Matrix

Chaffey PSR Screen Shots:Chaffey PSR Screen Shots:SLO Committee CommentsSLO Committee Comments

Chaffey PSR Screen Shots:Chaffey PSR Screen Shots:Institutional Research Summary E-Institutional Research Summary E-

FormForm

PROBLEMSPROBLEMS New Curricunet design did not norm to the 5 New Curricunet design did not norm to the 5

phase of the assessment cycle exactlyphase of the assessment cycle exactly Catching up after the SLO process had gone Catching up after the SLO process had gone

“cold”“cold” 5 phases of the SLO process, and a common language5 phases of the SLO process, and a common language

Tight time frame for the SLO readers Tight time frame for the SLO readers training on the new tools, training on the new tools, establishing a common understanding of the task, and establishing a common understanding of the task, and

the evaluationthe evaluation The SLO Committee readers had two weeks to read 127 The SLO Committee readers had two weeks to read 127

program reviews (Over 600 AUOs and SLOs) and provide program reviews (Over 600 AUOs and SLOs) and provide feedback to the PSR Committeefeedback to the PSR Committee

Alignment with IR online evaluation form and Alignment with IR online evaluation form and Curricunet SLO/AUO section of PSRCurricunet SLO/AUO section of PSR

Technical glitches with the online evaluation formTechnical glitches with the online evaluation form

THE RESULTSTHE RESULTS

Different “GOALS” Different “GOALS” Evaluation of “student-centered”Evaluation of “student-centered”Differences in writing outcome Differences in writing outcome

statements and benchmarks. statements and benchmarks. Consistent comments = all program Consistent comments = all program

SLO/AUOs were “graded” with the SLO/AUOs were “graded” with the same rubric.same rubric.

THE RESULTSTHE RESULTS

Programs with difficult selected forms of Programs with difficult selected forms of assessments.assessments.

Many did not know about the unique and exciting Many did not know about the unique and exciting possibilities of assessment formatpossibilities of assessment format

Heavy reliance on “pre/post” test.Heavy reliance on “pre/post” test.

Widespread confusion regarding “reflective Widespread confusion regarding “reflective dialogue”dialogue”

REWARDSREWARDS

Program goals are student-centeredProgram goals are student-centered

Chaffey has an actual count – a complete Chaffey has an actual count – a complete picture – of the status of program AUOs picture – of the status of program AUOs and SLOs for the first time ever.and SLOs for the first time ever.

All programs have a consistent set of All programs have a consistent set of recommendations to follow to jump start recommendations to follow to jump start the SLO process which had gone coldthe SLO process which had gone cold

REWARDSREWARDS

The SLO Co-coordinators know exactly the The SLO Co-coordinators know exactly the sorts of interventions and advice to offer sorts of interventions and advice to offer to specific program SLOsto specific program SLOs

Suggestions for more interesting, Suggestions for more interesting, engaging, and AUTHENTIC forms of engaging, and AUTHENTIC forms of assessmentassessment

Noticeably more involvement and positive Noticeably more involvement and positive dialogue regarding the outcomes dialogue regarding the outcomes assessment process at Chaffey among assessment process at Chaffey among faculty, staff and administratorsfaculty, staff and administrators

NEW FOCUS: NEW FOCUS: FUTURE GOALSFUTURE GOALS

Modify the Curricunet SLO screensModify the Curricunet SLO screens Streamline the IR electronic survey Streamline the IR electronic survey Improve the ability to search the databaseImprove the ability to search the database Reword comments/recommendations for Reword comments/recommendations for

clarificationclarification Continue to create an authentic link between Continue to create an authentic link between

SLO PSR process and the planning/budgeting SLO PSR process and the planning/budgeting processprocess

Include students in the overall SLO process Include students in the overall SLO process Improve the communication and dialogue Improve the communication and dialogue

between the SLO Committee and the PSR between the SLO Committee and the PSR CommitteeCommittee