AY 2010 CTE Instructional Program Review Data Delivery Plan Data Description Process – Timeline Rev. 10-18-10

AY 2010 CTE Instructional AY 2010 CTE Instructional Program Review Data Delivery Program Review Data Delivery

PlanPlan

Data DescriptionData DescriptionProcess – TimelineProcess – Timeline

Rev. 10-18-10Rev. 10-18-10

PurposePurposeThe primary purpose of this presentation is to provide clarity to all instructional programs on how the The primary purpose of this presentation is to provide clarity to all instructional programs on how the data is calculated for both our local Comprehensive and the system required Annual Program data is calculated for both our local Comprehensive and the system required Annual Program Reviews.Reviews.

We have been asked to produce an annual program review for each and every one of our We have been asked to produce an annual program review for each and every one of our instructional programs and units. They are required of each system CC and will be taken to the U of instructional programs and units. They are required of each system CC and will be taken to the U of H Board of Regents for their review.H Board of Regents for their review.

So who has to do a program review this year? If you are normally scheduled to do a comprehensive So who has to do a program review this year? If you are normally scheduled to do a comprehensive or are “Jumping” you will do a comprehensive review this year. Additionally, every instructional and or are “Jumping” you will do a comprehensive review this year. Additionally, every instructional and non-instructional program will do an Annual Program Review this year.non-instructional program will do an Annual Program Review this year.

Not sure if you’re scheduled for a comprehensive review or not? Not sure if you’re scheduled for a comprehensive review or not?

Click here for the Click here for the Program-Unit Review ScheduleProgram-Unit Review Schedule

22

What are we doing to improve our program review process?What are we doing to improve our program review process?

Based on the feedback we received from you last year from our program review process Based on the feedback we received from you last year from our program review process improvement focus groups, the following changes have been made:improvement focus groups, the following changes have been made:

In the interest of continuous process improvement your suggestions for improving this process In the interest of continuous process improvement your suggestions for improving this process are posted on the Assessment Website and linked here for your convenienceare posted on the Assessment Website and linked here for your convenience

Program/Unit Process Improvement SummaryProgram/Unit Process Improvement Summary

Over the course of the summer the new program review website was developed and most of the Over the course of the summer the new program review website was developed and most of the documentation was updated to reduce the amount of time it takes to get you the data you need documentation was updated to reduce the amount of time it takes to get you the data you need for your review.for your review.

Joni and Guy worked with programs to reevaluate SOC codes for programs.Joni and Guy worked with programs to reevaluate SOC codes for programs.

Your overall program budget this year will include the actual cost for salaries, the actual b-budget Your overall program budget this year will include the actual cost for salaries, the actual b-budget expenditures, and the cost to run your program taking grant dollars into consideration.expenditures, and the cost to run your program taking grant dollars into consideration.

Annual Instructional Program Review data, glossaries, and health call rubrics will be delivered Annual Instructional Program Review data, glossaries, and health call rubrics will be delivered entirely on-line, through an in-house developed program designed for UHCC’s.entirely on-line, through an in-house developed program designed for UHCC’s.

Programs completing comprehensive reviews this year will continue to receive their Programs completing comprehensive reviews this year will continue to receive their comprehensive review template with the imbedded and formatted data table.comprehensive review template with the imbedded and formatted data table.

33

What is different this year?What is different this year?

Five separate training sessions will be given this year in order to focus on specific groups. They Five separate training sessions will be given this year in order to focus on specific groups. They are:are:

– 1.1. ATE Division ProgramsATE Division Programs– 2.2. Hospitality, Business Ed, and Nursing Division ProgramsHospitality, Business Ed, and Nursing Division Programs– 3.3. Liberal Arts Division ProgramsLiberal Arts Division Programs– 4.4. Public Services Public Services – 5. Units5. Units

This year the Liberal Arts program has it’s own program review and health call scoring rubric.This year the Liberal Arts program has it’s own program review and health call scoring rubric.

There will be 3 distinct training presentations to accommodate the new Liberal Arts review.There will be 3 distinct training presentations to accommodate the new Liberal Arts review.

2 full years of data provided to programs—next year we will have 3.2 full years of data provided to programs—next year we will have 3.

No coversheetsNo coversheets

No upload capabilities with web submission tool. Your analysis should be on the data provided.No upload capabilities with web submission tool. Your analysis should be on the data provided.

The new “due to VCAA” date this year is November 15The new “due to VCAA” date this year is November 15 thth..

Your budget numbers will be made available to you this year on the Assessment website atYour budget numbers will be made available to you this year on the Assessment website at

AY 2010 Instructional Program Review Budget TableAY 2010 Instructional Program Review Budget Table

Annual reviews are completely on-line this year with the web submission tool.Annual reviews are completely on-line this year with the web submission tool.44

What’s a Jumper?What’s a Jumper?

A Jumper is a locally defined term that is used to describe an instructional A Jumper is a locally defined term that is used to describe an instructional program or non-instructional program (unit) that has decided to jump out of program or non-instructional program (unit) that has decided to jump out of their normally scheduled slot for their comprehensive program reviews and their normally scheduled slot for their comprehensive program reviews and into this years cycle.into this years cycle.

Why would anyone want to do that? Jumping into this years comprehensive Why would anyone want to do that? Jumping into this years comprehensive cycle means that you will have an opportunity to be considered for any cycle means that you will have an opportunity to be considered for any budgetary decisions that will be made in this years budget process.budgetary decisions that will be made in this years budget process.

Jumpers will still have to do their comprehensive review on their next Jumpers will still have to do their comprehensive review on their next scheduled review. Jumping does not affect the existing schedule—you are scheduled review. Jumping does not affect the existing schedule—you are voluntarily doing an extra review to be considered in this budget cycle.voluntarily doing an extra review to be considered in this budget cycle.

55

I belong to an Instructional Program… which form do I use?I belong to an Instructional Program… which form do I use?

COMPREHENSIVE REVIEWSCOMPREHENSIVE REVIEWS Your programs data table has been backfilled with Fall 2007 data, embedded and formatted into Your programs data table has been backfilled with Fall 2007 data, embedded and formatted into

your the comprehensive program review template. You should have everything you need to your the comprehensive program review template. You should have everything you need to begin writing your review. The comprehensive template has been emailed to you.begin writing your review. The comprehensive template has been emailed to you.

(Use this template ONLY if you are scheduled for a comprehensive program review this year or are (Use this template ONLY if you are scheduled for a comprehensive program review this year or are jumping)jumping)

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

ANNUAL REVIEWSANNUAL REVIEWS Your programs data table is available on-line using the link below. You should have everything Your programs data table is available on-line using the link below. You should have everything

you need to begin writing your review within the web submission tool. Plan to save your work you need to begin writing your review within the web submission tool. Plan to save your work often—especially when switching between screens, and plan to do most of your formatting often—especially when switching between screens, and plan to do most of your formatting within the tool if you are copying and pasting in from Word.within the tool if you are copying and pasting in from Word.

UHCC Annual Report of Program Data Web Submission ToolUHCC Annual Report of Program Data Web Submission Tool

((ALLALL Instructional programs will need to complete this—even if you’re completing a comprehensive Instructional programs will need to complete this—even if you’re completing a comprehensive review)review)

66

Terminology / TimingTerminology / Timing

For AY 2009 the data is pulled as of Summer 08, Fall 08, and Spring 09 terms.For AY 2009 the data is pulled as of Summer 08, Fall 08, and Spring 09 terms.

For AY 2010 the data is pulled as of Summer 09, Fall 09, and Spring 10 terms.For AY 2010 the data is pulled as of Summer 09, Fall 09, and Spring 10 terms.

The Census freeze event is the fifth Friday after the first day of instruction.The Census freeze event is the fifth Friday after the first day of instruction.

The End of semester freeze event is 10 weeks after the last day of instruction.The End of semester freeze event is 10 weeks after the last day of instruction.

FY stands for Fiscal Year. The UH Fiscal year runs from July 1FY stands for Fiscal Year. The UH Fiscal year runs from July 1stst to June 30 to June 30thth. So, for . So, for example, if you are looking at the number of degrees in your program for the period FY example, if you are looking at the number of degrees in your program for the period FY 2010, that would include all degrees conferred between July 12010, that would include all degrees conferred between July 1stst 2009 to June 30 2009 to June 30thth 2010. 2010.

77

Instructional Program Review Data ElementsInstructional Program Review Data Elements

For those programs doing a comprehensive review or jumping this year, Fall 07 data was For those programs doing a comprehensive review or jumping this year, Fall 07 data was copied directly in from last years program review. This should be the last year we see any copied directly in from last years program review. This should be the last year we see any fall data, as next year we will have 3 full academic years of data available.fall data, as next year we will have 3 full academic years of data available.

The system office reported your AY 2009 data using today’s routines, which may vary from The system office reported your AY 2009 data using today’s routines, which may vary from what was reported to you last year. This is due to the system office using improved what was reported to you last year. This is due to the system office using improved routines over the ones used last year.routines over the ones used last year.

Student information data this year comes exclusively from the Operational Data Store Student information data this year comes exclusively from the Operational Data Store (ODS). Organizationally this means that all community colleges are getting the data from (ODS). Organizationally this means that all community colleges are getting the data from the same place and at the same snapshot in time (this is a good thing).the same place and at the same snapshot in time (this is a good thing).

The following slides will explain in detail what data has been provided to you for your The following slides will explain in detail what data has been provided to you for your comprehensive-annual instructional program review write ups and how it has been comprehensive-annual instructional program review write ups and how it has been calculated.calculated.

88

#1#1 New and Replacement Positions (State)New and Replacement Positions (State)

Economic Modeling Specialists Inc. (EMSI) annual new and replacement Economic Modeling Specialists Inc. (EMSI) annual new and replacement jobs at state level. Compiles data based on Standard Occupational jobs at state level. Compiles data based on Standard Occupational Classification (SOC) codes that the college has linked to the instructional Classification (SOC) codes that the college has linked to the instructional program.program.

Data based on annual new/replacement positions projections as of Spring Data based on annual new/replacement positions projections as of Spring 20102010

State position numbers are not pro‐rated. State position numbers are not pro‐rated.

From their website, “…EMSI specializes in reports that analyze and quantify From their website, “…EMSI specializes in reports that analyze and quantify the total economic benefits of community and technical colleges in their the total economic benefits of community and technical colleges in their region, and also creates data-driven strategic planning tools that help region, and also creates data-driven strategic planning tools that help colleges maximize their impact through labor market responsiveness…” colleges maximize their impact through labor market responsiveness…”

99

#2#2 New and Replacement Positions (County prorated) New and Replacement Positions (County prorated)

Economic Modeling Specialists Inc. (EMSI) annual new and replacement Economic Modeling Specialists Inc. (EMSI) annual new and replacement jobs at county level. Compiles data based on Standard Occupational jobs at county level. Compiles data based on Standard Occupational Classification (SOC) codes that the college has linked to the instructional Classification (SOC) codes that the college has linked to the instructional program.program.

Note: It is possible for the number of new and replacement positions in the Note: It is possible for the number of new and replacement positions in the county to be higher than the state if the projection in other counties is for a county to be higher than the state if the projection in other counties is for a loss of new and replacement positions.loss of new and replacement positions.

County data pro‐rated to reflect number of programs aligned to the SOC County data pro‐rated to reflect number of programs aligned to the SOC code and weighted by number of majors in each program/institution.code and weighted by number of majors in each program/institution.

Data based on annual new/replacement positions projections as of Spring Data based on annual new/replacement positions projections as of Spring 2010.2010.

1010

#3#3 Number of MajorsNumber of Majors

Count of program majors who are home‐institution at your college. Count of program majors who are home‐institution at your college. Count excludes students that have completely withdrawn from the Count excludes students that have completely withdrawn from the semester at CENSUS.semester at CENSUS.

This is an annual number. Programs receive a count of .5 for each This is an annual number. Programs receive a count of .5 for each term within the academic year that the student is a major. A term within the academic year that the student is a major. A maximum count of 1.0 (one) for each student.maximum count of 1.0 (one) for each student.

1111

#4#4 SSH Program majors in Program ClassesSSH Program majors in Program ClassesThe sum of Fall and Spring SSH taken by program majors in The sum of Fall and Spring SSH taken by program majors in courses linked to the program. Captured at Census and excludes courses linked to the program. Captured at Census and excludes students who have already withdrawn (W) at this point.students who have already withdrawn (W) at this point.

Note: for programs where year‐round attendance is mandatory, Note: for programs where year‐round attendance is mandatory, Summer SSH are included.Summer SSH are included.

Excludes Directed Studies (99 series). Excludes Directed Studies (99 series).

Differs from MAPS as UHCC data includes Cooperative Education Differs from MAPS as UHCC data includes Cooperative Education (93 series) as there is a resource cost to the program.(93 series) as there is a resource cost to the program.

Not sure what your program classes are? Click here to find out:Not sure what your program classes are? Click here to find out:

Program Course ListingProgram Course Listing1212

#5#5 SSH Non-Majors in Program ClassesSSH Non-Majors in Program Classes

The sum of Fall and Spring SSH taken by non‐program majors (not The sum of Fall and Spring SSH taken by non‐program majors (not counted in #4) in courses linked to the program. Captured at counted in #4) in courses linked to the program. Captured at Census and excludes students who have already withdrawn (W) at Census and excludes students who have already withdrawn (W) at this point.this point.

Note: for programs where year‐round attendance is mandatory, Note: for programs where year‐round attendance is mandatory, Summer SSH are includedSummer SSH are included


Differs from MAPS as UHCC data Includes Cooperative Education Differs from MAPS as UHCC data Includes Cooperative Education (93 series) as there is a resource cost to the program.(93 series) as there is a resource cost to the program.

1313

#6#6 SSH in All Program ClassesSSH in All Program Classes

The sum of Fall and Spring SSH taken by all students in classes The sum of Fall and Spring SSH taken by all students in classes linked to the program. Captured at Census and excludes students linked to the program. Captured at Census and excludes students who have already withdrawn (W) at this point.who have already withdrawn (W) at this point.

Note: for programs where year‐round attendance is mandatory, Note: for programs where year‐round attendance is mandatory, Summer SSH are included.Summer SSH are included.



1414

#7#7 FTE Enrollment in Program ClassesFTE Enrollment in Program Classes

Sum of Student Semester Hours (SSH) taken by all students in Sum of Student Semester Hours (SSH) taken by all students in classes linked to the program (#6) divided by 30. Undergraduate, classes linked to the program (#6) divided by 30. Undergraduate, lower division Full Time Equivalent (FTE) is calculated as 15 credits lower division Full Time Equivalent (FTE) is calculated as 15 credits per term. per term.

Captured at Census and excludes students who have already Captured at Census and excludes students who have already withdrawn (W) at this point.withdrawn (W) at this point.

Note: for programs where year‐round attendance is mandatory, Note: for programs where year‐round attendance is mandatory, summer SSH are included.summer SSH are included.

1515

#8#8 Total Number of Classes TaughtTotal Number of Classes Taught

Total number of classes taught in Fall and Spring that are linked to Total number of classes taught in Fall and Spring that are linked to the program. Includes Summer classes if year‐round attendance is the program. Includes Summer classes if year‐round attendance is mandatory.mandatory.

Concurrent and Cross listed classes are only counted once for the Concurrent and Cross listed classes are only counted once for the primary class. primary class.



1616

Determination of program’s health based on Determination of program’s health based on demanddemand

This year the system office will calculate and report health calls for all This year the system office will calculate and report health calls for all instructional programs using academic year 2010 data. The following instructional programs using academic year 2010 data. The following instructions illustrate how those calls are made.instructions illustrate how those calls are made.

Program Demand is determined by taking the number of majors (#3) and Program Demand is determined by taking the number of majors (#3) and dividing them by the number of New and Replacement Positions by County dividing them by the number of New and Replacement Positions by County (#2).(#2).

The following benchmarks are used to determine demand health:The following benchmarks are used to determine demand health:

Healthy:Healthy: 1.5 - 4.01.5 - 4.0Cautionary:Cautionary: .5 – 1.49; 4.1 – 5.0.5 – 1.49; 4.1 – 5.0Unhealthy:Unhealthy: <.5; >5.0<.5; >5.0

Finally, an Overall Category Health Score is assigned where:Finally, an Overall Category Health Score is assigned where:

2 = Healthy2 = Healthy1= Cautionary1= Cautionary0= Unhealthy0= Unhealthy

1717

#9#9 Average Class SizeAverage Class Size

Total number of students actively registered in Fall and Spring Total number of students actively registered in Fall and Spring program classes divided by classes taught (#8). Does not include program classes divided by classes taught (#8). Does not include students who have already withdrawn from the class by Census.students who have already withdrawn from the class by Census.

Excludes Directed Studies (99 series).Excludes Directed Studies (99 series).


1818

#10#10 Fill RateFill Rate

Total active student registrations in program classes Total active student registrations in program classes (number of seats filled) at Fall and Spring census divided (number of seats filled) at Fall and Spring census divided by the maximum enrollment (number of seats offered).by the maximum enrollment (number of seats offered).

Captured at Census and excludes students who have Captured at Census and excludes students who have already withdrawn (W) at this point.already withdrawn (W) at this point.

1919

#11#11 FTE BOR Appointed FacultyFTE BOR Appointed Faculty

Sum appointments (1.0, 0.5, etc.) of all BOR appointed program faculty Sum appointments (1.0, 0.5, etc.) of all BOR appointed program faculty (excludes lecturers and other non BOR appointees).(excludes lecturers and other non BOR appointees).

Uses the “hiring status” of the faculty member – not the teaching/work load.Uses the “hiring status” of the faculty member – not the teaching/work load.

Uses the Employing Agency Code (EAC) recorded in the Human Resources Uses the Employing Agency Code (EAC) recorded in the Human Resources (HR) database to determine faculty’s program home.(HR) database to determine faculty’s program home.

Data as of March 2010.Data as of March 2010.

Data provided by UH Human Resources Office.Data provided by UH Human Resources Office.

Click here to find out who the BOR Appointed Program Faculty are for your Click here to find out who the BOR Appointed Program Faculty are for your program:program:

Instruction Program BOR AppointmentsInstruction Program BOR Appointments

2020

#12 #12 Majors to FTE BOR Appointed Faculty Majors to FTE BOR Appointed Faculty

Number of majors (#3) divided by sum appointments (#11) (1.0, 0.5, Number of majors (#3) divided by sum appointments (#11) (1.0, 0.5, etc.) of all BOR appointed program faculty. etc.) of all BOR appointed program faculty.

Data show the number of student majors in the program for each Data show the number of student majors in the program for each faculty member (25 majors to 1 faculty shown as “25”)faculty member (25 majors to 1 faculty shown as “25”)

2121

#13#13 Majors to Analytic FTE FacultyMajors to Analytic FTE Faculty

Number of majors (#3) divided by number of Analytic Number of majors (#3) divided by number of Analytic FTE faculty (13a).FTE faculty (13a).

2222

#13a#13a Analytical FTE Faculty (Workload)Analytical FTE Faculty (Workload)

Calculated by sum of Semester Hours (not Student Semester Calculated by sum of Semester Hours (not Student Semester Hours) taught in program classes divided by 27.Hours) taught in program classes divided by 27.

Analytic FTE is useful as a comparison to FTE of BOR appointed Analytic FTE is useful as a comparison to FTE of BOR appointed faculty (#11). Used for analysis of program offerings covered by faculty (#11). Used for analysis of program offerings covered by lecturers.lecturers.

2323

Where are my budget numbers?Where are my budget numbers?

This year, a decision was made to use the actual expenditures of This year, a decision was made to use the actual expenditures of both B-Budgets and salaries, as part of your overall budget.both B-Budgets and salaries, as part of your overall budget.

The budget numbers you need for your program review are now The budget numbers you need for your program review are now available on the Assessment website at available on the Assessment website at

AY 2010 Instructional Program Review Budget TableAY 2010 Instructional Program Review Budget Table

Programs doing comprehensive reviews will need to first enter the Programs doing comprehensive reviews will need to first enter the budget information into the annual web submission tool, then plug budget information into the annual web submission tool, then plug those numbers into your data sheets, which have been embedded those numbers into your data sheets, which have been embedded and formatted into your newly approved template.and formatted into your newly approved template.

2424

How do I get the budget numbers into the How do I get the budget numbers into the web submission tool?web submission tool?

Log in, using your UH username and password.Log in, using your UH username and password. Click on the “Enter web submission” button.Click on the “Enter web submission” button. Select the “Cost per SSH” tab.Select the “Cost per SSH” tab. Click the “Edit” button for your program.Click the “Edit” button for your program. Go to the link on the assessment website for your budget and…Go to the link on the assessment website for your budget and… Enter the value of general funds. (this is b-budget plus salary)Enter the value of general funds. (this is b-budget plus salary) Enter the value of federal funds.Enter the value of federal funds. Enter any other funds that you wish to add.Enter any other funds that you wish to add. Click the “Save Cost per SSH Data” button at bottom of page.Click the “Save Cost per SSH Data” button at bottom of page. Your overall budget allocation (sum of everything you entered) and the Your overall budget allocation (sum of everything you entered) and the

cost per SSH will automatically populate the data table in your review.cost per SSH will automatically populate the data table in your review. For those programs doing a comprehensive review, this is where you will For those programs doing a comprehensive review, this is where you will

get your budget numbers.get your budget numbers. Note: There is no way to update your budget for AY 2009 this year.Note: There is no way to update your budget for AY 2009 this year.

2525

#14#14 OverallOverall Program Budget AllocationProgram Budget Allocation

The overall program budget allocation = General Funded Budget The overall program budget allocation = General Funded Budget Allocations (14a) + Special/Federal Budget Allocations (14b)Allocations (14a) + Special/Federal Budget Allocations (14b)

2626

#14a#14a General Funded Budget AllocationGeneral Funded Budget Allocation

The general funded budget allocation = actual personnel costs + b The general funded budget allocation = actual personnel costs + b budget expendituresbudget expenditures

Personnel costs this year include the salaries for : faculty, lecturers, Personnel costs this year include the salaries for : faculty, lecturers, overload, APT, student help, and clerical.overload, APT, student help, and clerical.

2727

#14b#14b Special/Federal Budget AllocationSpecial/Federal Budget Allocation

The expenditure of dollars from Federal grantsThe expenditure of dollars from Federal grants

2828

#15#15 Cost per SSHCost per SSH

Program Budget Allocation (#14) divided by SSH in program Program Budget Allocation (#14) divided by SSH in program classes (#6)classes (#6)

2929

#16#16 Number of Low Enrolled (<10) ClassesNumber of Low Enrolled (<10) Classes

Classes taught (#8) with 9 or fewer active students at Classes taught (#8) with 9 or fewer active students at Census. Census.

Excludes students who have already withdrawn (W) at Excludes students who have already withdrawn (W) at this point.this point.

Excludes Directed Studies (99 series).Excludes Directed Studies (99 series).

Includes Cooperative Education (93 series) as there is a Includes Cooperative Education (93 series) as there is a resource cost to the program.resource cost to the program.

3030

Determination of program’s health based on Determination of program’s health based on efficiencyefficiency

This year the system office will calculate and report health calls for all This year the system office will calculate and report health calls for all instructional programs using AY 2010 data. The following instructions instructional programs using AY 2010 data. The following instructions illustrate how those calls are made.illustrate how those calls are made.

Program Efficiency is calculated using 2 separate measures…Fill rate Program Efficiency is calculated using 2 separate measures…Fill rate (#10), and Majors to FTE BOR Appointed Faculty (#12). (#10), and Majors to FTE BOR Appointed Faculty (#12).

The following benchmarks are used to determine health for Fill Rate:The following benchmarks are used to determine health for Fill Rate:

Healthy:Healthy: 75 – 100%75 – 100%Cautionary:Cautionary: 60 – 74%60 – 74%Unhealthy:Unhealthy: < 60%< 60%

An Overall Category Health Score is assigned where:An Overall Category Health Score is assigned where:

2 = Healthy2 = Healthy1 = Cautionary1 = Cautionary0 = Unhealthy0 = Unhealthy

3131

Determination of program’s health based on Determination of program’s health based on efficiencyefficiency cont… cont…

The following benchmarks are used to determine health for Majors/FTE BOR Appointed The following benchmarks are used to determine health for Majors/FTE BOR Appointed Faculty :Faculty :

Healthy:Healthy: 15 - 3515 - 35Cautionary:Cautionary: 30 – 60; 7 - 1430 – 60; 7 - 14Unhealthy:Unhealthy: 61 +; 6 or fewer61 +; 6 or fewer



Finally, average the 2 overall health scores for Class fill rate and Majors/FTE BOR Finally, average the 2 overall health scores for Class fill rate and Majors/FTE BOR Appointed Faculty then use the following rubric:Appointed Faculty then use the following rubric:

1.5 - 2 1.5 - 2 = Healthy= Healthy.5 - 1.5 - 1 = Cautionary= Cautionary00 = Unhealthy= Unhealthy

3232

#17#17 Successful Completion Successful Completion (Equivalent C or higher) (Equivalent C or higher)

Percentage of students actively enrolled in program classes at Fall Percentage of students actively enrolled in program classes at Fall and Spring census who at end of semester have earned a grade and Spring census who at end of semester have earned a grade equivalent to C or higher.equivalent to C or higher.

3333

#18#18 Withdrawals (grade = W)Withdrawals (grade = W)

Number of students actively enrolled (at this point have not Number of students actively enrolled (at this point have not withdrawn) at Fall and Spring census who at end of semester have withdrawn) at Fall and Spring census who at end of semester have a grade of W.a grade of W.

3434

#19#19 Persistence Fall to SpringPersistence Fall to Spring

Count of students who are majors in program at fall Count of students who are majors in program at fall census (from Fall semester #3) and at subsequent census (from Fall semester #3) and at subsequent Spring semester census are enrolled and are still majors Spring semester census are enrolled and are still majors in the program. in the program.

Example: Example: 31 majors start in Fall31 majors start in Fall

21 majors of the original 31 persist into Spring21 majors of the original 31 persist into Spring21/31 = .6774 or 67.74%21/31 = .6774 or 67.74%

3535

#20#20 Unduplicated Degrees/Certificates AwardedUnduplicated Degrees/Certificates Awarded

Unduplicated headcount of students in the fiscal year reported to whom a program Unduplicated headcount of students in the fiscal year reported to whom a program degree or any certificate has been conferred. (Sum of 20a, 20b, 20c, and 20d). degree or any certificate has been conferred. (Sum of 20a, 20b, 20c, and 20d).

Uses most recent available freeze of fiscal year data.Uses most recent available freeze of fiscal year data.

For ARPD year 2009, the most recent fiscal data on August 15, 2009, was from FY For ARPD year 2009, the most recent fiscal data on August 15, 2009, was from FY 2008. 2008.

For ARPD year 2010, the most recent fiscal data on August 15, 2010, was from FY For ARPD year 2010, the most recent fiscal data on August 15, 2010, was from FY 2010.2010.

3636

#20a#20a Number of Degrees AwardedNumber of Degrees Awarded

Degrees conferred in the FISCAL_YEAR_IRO.Degrees conferred in the FISCAL_YEAR_IRO.

The count is of degrees and may shows duplicate degrees received in the The count is of degrees and may shows duplicate degrees received in the program by the same student if the program offers more than one degree.program by the same student if the program offers more than one degree.

Uses most recent available freeze of fiscal year data. Note: for ARPD year Uses most recent available freeze of fiscal year data. Note: for ARPD year 2009, the most recent fiscal data on August 15, 2009, was from FY 2008.2009, the most recent fiscal data on August 15, 2009, was from FY 2008.

For ARPD year 2010, the most recent fiscal data on August15, 2010, was For ARPD year 2010, the most recent fiscal data on August15, 2010, was from FY 2010.from FY 2010.

FISCAL_YEAR_IRO:FISCAL_YEAR_IRO:

“ “Fiscal year, where the value indicates the ending of the fiscal year. For Fiscal year, where the value indicates the ending of the fiscal year. For example, a FISCAL_YR_IRO value of 2005 indicates the fiscal year 2004‐example, a FISCAL_YR_IRO value of 2005 indicates the fiscal year 2004‐2005 (July 1, 2004 to June 30, 2005) which includes Summer 2004, Fall 2005 (July 1, 2004 to June 30, 2005) which includes Summer 2004, Fall 2004, and Spring 2005 semesters…”2004, and Spring 2005 semesters…”

3737

#20b#20b Certificates of Achievement AwardedCertificates of Achievement Awarded

Certificates of achievement conferred in the FISCAL_YEAR_IRO.Certificates of achievement conferred in the FISCAL_YEAR_IRO.

The count is of program certificates of achievement and may show multiple The count is of program certificates of achievement and may show multiple certificates of achievement in the same program received by the same certificates of achievement in the same program received by the same student.student.

Uses most recent available freeze of fiscal year data.Uses most recent available freeze of fiscal year data.

FISCAL_YEAR_IRO:FISCAL_YEAR_IRO:

“ “Fiscal year, where the value indicates the ending of the fiscal year. For Fiscal year, where the value indicates the ending of the fiscal year. For example, a FISCAL_YR_IRO value of 2005 indicates the fiscal year 2004‐example, a FISCAL_YR_IRO value of 2005 indicates the fiscal year 2004‐2005 (July 1, 2004 to June 30, 2005) which includes Summer 2004, Fall 2005 (July 1, 2004 to June 30, 2005) which includes Summer 2004, Fall 2004, and Spring 2005 semesters…”2004, and Spring 2005 semesters…”

3838

#20c#20c Academic Subject Certificates AwardedAcademic Subject Certificates Awarded

The count is of program Academic Subject Certificates and may show The count is of program Academic Subject Certificates and may show multiple Academic Subject Certificates in the same program received by the multiple Academic Subject Certificates in the same program received by the student.student.

Uses most recent available freeze of fiscal year data. Uses most recent available freeze of fiscal year data.

3939

#20d#20d OtherOther Certificates AwardedCertificates Awarded

The count is of other program certificates (such as APC) and will show The count is of other program certificates (such as APC) and will show multiples received by the same student.multiples received by the same student.

Uses most recent available freeze of fiscal year data. Uses most recent available freeze of fiscal year data.

4040

#21#21 Transfers to UH 4-yr programsTransfers to UH 4-yr programs

Students with home campus UH Manoa, UH Hilo, or UH West Oahu Students with home campus UH Manoa, UH Hilo, or UH West Oahu for the first time Fall 2009 who prior to Fall 2009 had UH community for the first time Fall 2009 who prior to Fall 2009 had UH community college as home campus. college as home campus.

Also includes students who for the first time in Fall 2009 show Maui Also includes students who for the first time in Fall 2009 show Maui CC, Applied Business Information Technology as home campus and CC, Applied Business Information Technology as home campus and major.major.

This is a program measure. A student is included in the count of This is a program measure. A student is included in the count of program transfers in as many programs in which they have been a program transfers in as many programs in which they have been a major at the college.major at the college.

4141

#21a#21a Transfers with credential from programTransfers with credential from program

Students included in #21 who have received a degree from the Students included in #21 who have received a degree from the community college program prior to transfer. Does not include any community college program prior to transfer. Does not include any certificates. certificates.

4242

#21b#21b Transfers without credential from programTransfers without credential from program

Students included in #21 who did not receive a degree from the Students included in #21 who did not receive a degree from the community college program prior to transfer.community college program prior to transfer.

4343

Determination of program’s health based on Determination of program’s health based on effectivenesseffectiveness

This year the system office will calculate and report health calls for all instructional This year the system office will calculate and report health calls for all instructional programs using academic year 2010 data. The following instructions illustrate how programs using academic year 2010 data. The following instructions illustrate how those calls are made.those calls are made.

Program Effectiveness is calculated using 3 separate measures: Unduplicated Program Effectiveness is calculated using 3 separate measures: Unduplicated Degrees/Certificates Awarded (#20) / Majors (#3), Unduplicated Degrees/Certificates Degrees/Certificates Awarded (#20) / Majors (#3), Unduplicated Degrees/Certificates Awarded (#20) / Annual new and replacement positions (County prorated) (#2), and Awarded (#20) / Annual new and replacement positions (County prorated) (#2), and Persistence Fall to Spring (#19).Persistence Fall to Spring (#19).The following benchmarks are used to determine health for Unduplicated The following benchmarks are used to determine health for Unduplicated Degrees/Certificates Awarded per major:Degrees/Certificates Awarded per major:

Healthy:Healthy: > 20%> 20%Cautionary:Cautionary: 15 - 20%15 - 20%Unhealthy:Unhealthy: < 15%< 15%


2 = Healthy2 = Healthy1= Cautionary1= Cautionary0= Unhealthy0= Unhealthy

4444

Determination of program’s health based on Determination of program’s health based on effectivenesseffectiveness cont… cont…

The second measure used to determine health is Unduplicated Degrees/Certificates The second measure used to determine health is Unduplicated Degrees/Certificates Awarded (#20) / Annual new and replacement positions (County prorated) (#2).Awarded (#20) / Annual new and replacement positions (County prorated) (#2).

The following benchmarks are used to for this measure:The following benchmarks are used to for this measure:

Healthy:Healthy: .75 – 1.5.75 – 1.5Cautionary:Cautionary: .25 - .75 and 1.5 – 3.0.25 - .75 and 1.5 – 3.0Unhealthy:Unhealthy: < .25 and >3.0< .25 and >3.0



4545


The third measure used to determine health is Persistence (Fall to Spring) (#19).The third measure used to determine health is Persistence (Fall to Spring) (#19).

The following benchmarks are used for this measure:The following benchmarks are used for this measure:

Healthy:Healthy: 75 - 100%75 - 100%Cautionary:Cautionary: 60 - 74%60 - 74%Unhealthy:Unhealthy: < 60%< 60%



4646


You should now have a value of zero, one, or two for each of the 3 effectiveness You should now have a value of zero, one, or two for each of the 3 effectiveness measures. The process of determining the Effectiveness health call score contains the measures. The process of determining the Effectiveness health call score contains the following 3 steps:following 3 steps:

Step #1: Add up all 3 Overall Category Health scores for the effectiveness measures. Step #1: Add up all 3 Overall Category Health scores for the effectiveness measures. (the zero’s, one’s and two's you assigned earlier)(the zero’s, one’s and two's you assigned earlier)

Step #2: Determine the effectiveness category health call range where:Step #2: Determine the effectiveness category health call range where:

5 - 6 5 - 6 = Healthy= Healthy2 - 4 2 - 4 = Cautionary= Cautionary0 - 1 0 - 1 = Unhealthy= Unhealthy

Step #3: Now use the scoring rubric below to determine the effectiveness health call Step #3: Now use the scoring rubric below to determine the effectiveness health call score: (for example: you had a healthy 5 in the previous step you would assign it a score: (for example: you had a healthy 5 in the previous step you would assign it a healthy 2 here)healthy 2 here)

2 2 = Healthy= Healthy1 1 = Cautionary= Cautionary0 0 = Unhealthy= Unhealthy

4747

Determination of program’s Determination of program’s overalloverall health health

You should now have a value of zero, one, or two for each of the 3 program health You should now have a value of zero, one, or two for each of the 3 program health calls; Demand, Efficiency, and Effectiveness. Simply add those 3 values together calls; Demand, Efficiency, and Effectiveness. Simply add those 3 values together and use the Scoring Range Rubric below to determine the overall health of your and use the Scoring Range Rubric below to determine the overall health of your program.program.

5 - 6 5 - 6 = Healthy= Healthy2 - 4 2 - 4 = Cautionary= Cautionary0 - 1 0 - 1 = Unhealthy= Unhealthy

4848

#22#22 Number of Distance Education Classes TaughtNumber of Distance Education Classes Taught

Measures the number of classes taught with the mode of delivery as Measures the number of classes taught with the mode of delivery as “Distance Completely Online.”“Distance Completely Online.”

In setting up the class, the college indicates the method of In setting up the class, the college indicates the method of instruction used by the instructor in conducting the class. instruction used by the instructor in conducting the class.

If the method is Distance Education, and the college indicates the If the method is Distance Education, and the college indicates the “mode” of distance delivery as “Distance Completely Online” the “mode” of distance delivery as “Distance Completely Online” the class will be included in this count.class will be included in this count.

4949

#23#23 Enrollment Distance Education ClassesEnrollment Distance Education Classes

At the Fall and Spring census, the number of students actively At the Fall and Spring census, the number of students actively enrolled in all classes owned by the program and identified as enrolled in all classes owned by the program and identified as Distance Completely On‐Line (#22).Distance Completely On‐Line (#22).

Does not include students who at Census have already withdrawn Does not include students who at Census have already withdrawn from the class.from the class.

5050

#24#24 Fill RateFill Rate

Total active student registrations in program distance education Total active student registrations in program distance education classes (#23) classes (number of seats filled) at Fall and Spring classes (#23) classes (number of seats filled) at Fall and Spring census divided by the maximum enrollment (number of seats census divided by the maximum enrollment (number of seats offered). offered).

Does not include students who at Census have already withdrawn Does not include students who at Census have already withdrawn from the class.from the class.

5151

#25#25 Successful Completion (Equivalent C or higher)Successful Completion (Equivalent C or higher)

Percentage of students enrolled in program Distance Education Percentage of students enrolled in program Distance Education classes (#23) at Fall and Spring census who at end of semester classes (#23) at Fall and Spring census who at end of semester have earned a grade equivalent to C or higher.have earned a grade equivalent to C or higher.

5252

#26#26 Withdrawals (Grade=W)Withdrawals (Grade=W)

Number of students actively enrolled in program Distance Education Number of students actively enrolled in program Distance Education classes (#23) at Fall and Spring census who at end of semester classes (#23) at Fall and Spring census who at end of semester have a grade of W.have a grade of W.

5353

#27#27 Persistence (Fall to Spring not limited to Distance Ed)Persistence (Fall to Spring not limited to Distance Ed)

Students enrolled in program distance education classes at Fall census who Students enrolled in program distance education classes at Fall census who at subsequent Spring semester census are enrolled in the college.at subsequent Spring semester census are enrolled in the college.

Not limited to students continuing to take program distance education Not limited to students continuing to take program distance education classes.classes.

Example: Example: 31 majors enrolled in DE classes in Fall31 majors enrolled in DE classes in Fall

21 majors of the original 31 majors persist into any Spring class21 majors of the original 31 majors persist into any Spring class21/31 = .6774 or 67.74%21/31 = .6774 or 67.74%

5454

#28#28 Perkins Core Indicator: Technical Skills Perkins Core Indicator: Technical Skills Attainment (1P1)Attainment (1P1)

Perkins Core Indicators are used in the development of the HawCC Program Health Indicator (PHI) reports Perkins Core Indicators are used in the development of the HawCC Program Health Indicator (PHI) reports completed annually for CTE programs. The data that you see in your program review is for the 2010 completed annually for CTE programs. The data that you see in your program review is for the 2010 academic year. academic year. All Perkins Core Indicator goals not met must be addressed in the narrative and action All Perkins Core Indicator goals not met must be addressed in the narrative and action plan in your review.plan in your review.

A concentrator is a student who has a major (taken from the major field in Banner) for a CTE program, and A concentrator is a student who has a major (taken from the major field in Banner) for a CTE program, and who has completed 12 or more credits by the end of the Perkins year.who has completed 12 or more credits by the end of the Perkins year.

Uses Perkins data from prior year Perkins Consolidated Annual Report (CAR). Data show State goal and Uses Perkins data from prior year Perkins Consolidated Annual Report (CAR). Data show State goal and College actual.College actual.

Technical Skills Attainment is calculated by:Technical Skills Attainment is calculated by:

Number of concentrators who have a cumulative GPA> or =Number of concentrators who have a cumulative GPA> or = 2.00 in Career and Technical Education courses and who have stopped program 2.00 in Career and Technical Education courses and who have stopped program participation in the year reported.participation in the year reported.

Number of concentrators who have stopped program participation in the year reported.Number of concentrators who have stopped program participation in the year reported.

5555

#29#29 Perkins Core Indicator: Completion (2P1)Perkins Core Indicator: Completion (2P1)

Perkins Core Indicators are used in the development of the HawCC Program Health Perkins Core Indicators are used in the development of the HawCC Program Health Indicator (PHI) reports completed annually for CTE programs. The data that you see Indicator (PHI) reports completed annually for CTE programs. The data that you see in your program review is for the 2010 academic year. in your program review is for the 2010 academic year. All Perkins Core Indicator All Perkins Core Indicator goals not met must be addressed in the narrative and action plan in your review.goals not met must be addressed in the narrative and action plan in your review.

A concentrator is a student who has a major (taken from the major field in Banner) for A concentrator is a student who has a major (taken from the major field in Banner) for a CTE program, and who has completed 12 or more credits by the end of the Perkins a CTE program, and who has completed 12 or more credits by the end of the Perkins year.year.

Uses Perkins data from prior year Perkins Consolidated Annual Report (CAR). Data Uses Perkins data from prior year Perkins Consolidated Annual Report (CAR). Data show State goal and College actual.show State goal and College actual.

Completion is calculated by:Completion is calculated by:

Number of concentrators who received a degree or certificate in a Career and Technical Education program and who Number of concentrators who received a degree or certificate in a Career and Technical Education program and who have stopped program participation in the year reported.have stopped program participation in the year reported.

Number of concentrators who have stopped program participation in the year reported.Number of concentrators who have stopped program participation in the year reported.

5656

#30#30 Perkins Core Indicator: Student Retention or Perkins Core Indicator: Student Retention or Transfer (3P1)Transfer (3P1)

Perkins Core Indicators are used in the development of the HawCC Program Health Indicator (PHI) Perkins Core Indicators are used in the development of the HawCC Program Health Indicator (PHI) reports completed annually for CTE programs. The data that you see in your program review is for the reports completed annually for CTE programs. The data that you see in your program review is for the 2010 academic year. 2010 academic year. All Perkins Core Indicator goals not met must be addressed in the narrative and All Perkins Core Indicator goals not met must be addressed in the narrative and action plan in your review.action plan in your review.

A concentrator is a student who has a major (taken from the major field in Banner) for a CTE program, A concentrator is a student who has a major (taken from the major field in Banner) for a CTE program, and who has completed 12 or more credits by the end of the Perkins year.and who has completed 12 or more credits by the end of the Perkins year.

Uses Perkins data from prior year Perkins Consolidated Annual Report (CAR). Data show State goal and Uses Perkins data from prior year Perkins Consolidated Annual Report (CAR). Data show State goal and College actual.College actual.

Student Retention or Transfer is calculated by:Student Retention or Transfer is calculated by:

Number of concentrators in the year reported who have not completed a program and who continue postsecondary enrollment or who have Number of concentrators in the year reported who have not completed a program and who continue postsecondary enrollment or who have transferred to a baccalaureate degree program.transferred to a baccalaureate degree program.

Number of concentrators in the year reported who have not completed a program.Number of concentrators in the year reported who have not completed a program.

5757

#31#31 Perkins Core Indicator: Student Placement Perkins Core Indicator: Student Placement (4P1)(4P1)

Perkins Core Indicators are used in the development of the HawCC Program Health Indicator Perkins Core Indicators are used in the development of the HawCC Program Health Indicator (PHI) reports completed annually for CTE programs. The data that you see in your program (PHI) reports completed annually for CTE programs. The data that you see in your program review is for the 2010 academic year. review is for the 2010 academic year. All Perkins Core Indicator goals not met must be All Perkins Core Indicator goals not met must be addressed in the narrative and action plan in your review.addressed in the narrative and action plan in your review.

A concentrator is a student who has a major (taken from the major field in Banner) for a CTE A concentrator is a student who has a major (taken from the major field in Banner) for a CTE program, and who has completed 12 or more credits by the end of the Perkins year.program, and who has completed 12 or more credits by the end of the Perkins year.

Uses Perkins data from prior year Perkins Consolidated Annual Report (CAR). Data show State Uses Perkins data from prior year Perkins Consolidated Annual Report (CAR). Data show State goal and College actual.goal and College actual.

Student Placement is calculated by:Student Placement is calculated by:

Number of concentrators in the year reported (previous Perkins year) who have stopped program participation and who are placed or Number of concentrators in the year reported (previous Perkins year) who have stopped program participation and who are placed or retained in employment, military service, or an apprenticeship program within retained in employment, military service, or an apprenticeship program within

unemployment insurance quarter following program completion.unemployment insurance quarter following program completion.

Number of concentrators in the year reported (previous Perkins year) who have stopped program participationNumber of concentrators in the year reported (previous Perkins year) who have stopped program participation

5858

#32#32 Perkins Core Indicator: Nontraditional Perkins Core Indicator: Nontraditional Participation (5P1)Participation (5P1)

Perkins Core Indicators are used in the development of the HawCC Program Health Indicator Perkins Core Indicators are used in the development of the HawCC Program Health Indicator (PHI) reports completed annually for CTE programs. The data that you see in your program (PHI) reports completed annually for CTE programs. The data that you see in your program review is for the 2010 academic year. review is for the 2010 academic year. All Perkins Core Indicator goals not met must be All Perkins Core Indicator goals not met must be addressed in the narrative and action plan in your review.addressed in the narrative and action plan in your review.

A concentrator is a student who has a major (taken from the major field in Banner) for a CTE A concentrator is a student who has a major (taken from the major field in Banner) for a CTE program, and who has completed 12 or more credits by the end of the Perkins year.program, and who has completed 12 or more credits by the end of the Perkins year.

Uses Perkins data from prior year Perkins Consolidated Annual Report (CAR). Data show Uses Perkins data from prior year Perkins Consolidated Annual Report (CAR). Data show State goal and College actual.State goal and College actual.

Nontraditional Participation is calculated by:Nontraditional Participation is calculated by:

Number of participants from underrepresented groups who participated in a program that leads to employment in nontraditional Number of participants from underrepresented groups who participated in a program that leads to employment in nontraditional fields during the reporting year.fields during the reporting year.

Number of participants who participated in a program that leads to employment in nontraditional fields during the reporting year.Number of participants who participated in a program that leads to employment in nontraditional fields during the reporting year.

5959

#33#33 Perkins Core Indicator: Non-Traditional Perkins Core Indicator: Non-Traditional Completion (5P2)Completion (5P2)

Perkins Core Indicators are used in the development of the HawCC Program Health Indicator (PHI) Perkins Core Indicators are used in the development of the HawCC Program Health Indicator (PHI) reports completed annually for CTE programs. The data that you see in your program review is for the reports completed annually for CTE programs. The data that you see in your program review is for the 2010 academic year. 2010 academic year. All Perkins Core Indicator goals not met must be addressed in the narrative and All Perkins Core Indicator goals not met must be addressed in the narrative and action plan in your review.action plan in your review.

A concentrator is a student who has a major (taken from the major field in Banner) for a CTE program, A concentrator is a student who has a major (taken from the major field in Banner) for a CTE program, and who has completed 12 or more credits by the end of the Perkins year.and who has completed 12 or more credits by the end of the Perkins year.

Uses Perkins data from prior year Perkins Consolidated Annual Report (CAR). Data show State goal Uses Perkins data from prior year Perkins Consolidated Annual Report (CAR). Data show State goal and College actual.and College actual.

Non-Traditional Completion is calculated by:Non-Traditional Completion is calculated by:

Number of concentrators from underrepresented gender groups who received a degree or certificate in a program that leads to Number of concentrators from underrepresented gender groups who received a degree or certificate in a program that leads to employment in nontraditional fields during the reporting year. employment in nontraditional fields during the reporting year.

Number of concentrators who received a degree or certificate in a program that leads to employment in nontraditional fields during the Number of concentrators who received a degree or certificate in a program that leads to employment in nontraditional fields during the reporting year. reporting year.

6060

Comprehensive & Annual Program Review TimelineComprehensive & Annual Program Review Timeline

Develop presentation and training materials (3 presentations and 5 training sessions)

Provide Annual Program Review Training to Campus

Package and Delivery of all Program & Unit Reviews to System Office

Post all Program & Unit Reviews to Assessment Website

Aug 26th

All program and unit reviews (Comprehensive and Annual) due to Interim VCAA by web/email by EOB Monday November 15th.

Work with Chancellor to determine best strategy for rolling out new on-line data submission tool.

Collect and deliver data to Student Support Services

Build out 2010 program review page on the assessment website

Plan this year’s program review based on suggested improvements from last year’s review

Create and post a Program-unit review process improvement summary document to capture year over year improvements to existing PR process

Determine what templates will be used and that they are linked to a common website (UHCC).

Review and edit all PR documentation and work with Trina and AC for approvals

Determine what changes to our local program-unit review processes need to be made and plan for same.

Develop and administer PR Process Improvement Survey

Work with AC and Interim VCAA to determine what needs to be taken back to UHCC IPRC

Receive 2 years data from system office, perform data validation, and begin building instructional comprehensive data tables

Aug 15th

Dec 15thThru Oct

Aug 28th

Jul - Sept

Jul 28th

Jan 5th

Dec 20th

Jan 25th

Jul - Aug Aug - Oct

Jul - Sept Nov 15Sept 23rd

Oct 23rd

6161

AY2010 Comprehensive & Annual Review ProcessAY2010 Comprehensive & Annual Review Process

Step 1Step 1 Write your instructional program review using Write your instructional program review using the appropriate template or web submission tool.the appropriate template or web submission tool.

Step 2Step 2 Send yourSend your documents documents (one Word document per review) (one Word document per review) to to Interim VCAA Joni Onishi by email no later than end of Interim VCAA Joni Onishi by email no later than end of business, Monday November 15th, 2010. business, Monday November 15th, 2010.

Step 3Step 3 Interim VCAA will ensure that all required documents Interim VCAA will ensure that all required documents have been received and that they are adequate.have been received and that they are adequate.

Step 4Step 4 Interim VCAA will forward all approved reviews to the Interim VCAA will forward all approved reviews to the Institutional Research Office for further processing.Institutional Research Office for further processing.

Step 5Step 5 The Annual reviews will be collected on-line by the System The Annual reviews will be collected on-line by the System Office for review by the UH Board of Regents. Comprehensive Office for review by the UH Board of Regents. Comprehensive reviews will be forwarded along as appropriate following CERC reviews will be forwarded along as appropriate following CERC guidelines.guidelines.

Step 6Step 6 All reviews will finally be converted to PDF and posted All reviews will finally be converted to PDF and posted to the Assessment Web Site.to the Assessment Web Site.

6262

Questions?Questions?The intention of this presentation was to provide a single source for all of the The intention of this presentation was to provide a single source for all of the documentation related to the Comprehensive & Annual Instructional CTE documentation related to the Comprehensive & Annual Instructional CTE Program Review process. I have linked all of the documents you should Program Review process. I have linked all of the documents you should need directly into this presentation.need directly into this presentation.

For additional information, the glossary and health call scoring rubric can be For additional information, the glossary and health call scoring rubric can be found at: found at:

UHCC Annual Report of Program Data Web Submission ToolUHCC Annual Report of Program Data Web Submission Tool

If you need more information on this process please feel free to contact me:If you need more information on this process please feel free to contact me:

Shawn FloodShawn Flood 974-7512974-7512

Mahalo!Mahalo!

6363

Documents

AY 2010 CTE Instructional Program Review Data Delivery Plan Data Description Process – Timeline Rev. 10-18-10