61
AY 2013 LBRT AY 2013 LBRT Instructional Program Instructional Program Review Process Review Process Data Description Data Description Process – Timeline Process – Timeline Rev. 10-18-13 Rev. 10-18-13

AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

Embed Size (px)

DESCRIPTION

Covered in today’s session… Quick review of Program and Unit Review website Navigating the Annual Reports from Program Data (ARPD) website Overview of our local program and unit review process on campus What are we doing to improve our process? What is different this year? Terminology used in the review Data definitions Timeline Assessment with James Kiley New Annual Review and Budget Process with Dean of CTE Joyce Hamasaki New CERC/Comprehensive Review Process with VCAA Joni Onishi 3

Citation preview

Page 1: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

AY 2013 LBRT Instructional AY 2013 LBRT Instructional Program Review ProcessProgram Review Process

Data DescriptionData DescriptionProcess – TimelineProcess – Timeline

Rev. 10-18-13Rev. 10-18-13

Page 2: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13
Page 3: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

Covered in today’s session…Covered in today’s session…

Quick review of Program and Unit Review websiteQuick review of Program and Unit Review website

Navigating the Annual Reports from Program Data (ARPD) websiteNavigating the Annual Reports from Program Data (ARPD) website

Overview of our local program and unit review process on campusOverview of our local program and unit review process on campus

What are we doing to improve our process?What are we doing to improve our process?

What is different this year?What is different this year?

Terminology used in the reviewTerminology used in the review

Data definitionsData definitions

TimelineTimeline

Assessment with James KileyAssessment with James Kiley

New Annual Review and Budget Process with Dean of CTE Joyce HamasakiNew Annual Review and Budget Process with Dean of CTE Joyce Hamasaki

New CERC/Comprehensive Review Process with VCAA Joni OnishiNew CERC/Comprehensive Review Process with VCAA Joni Onishi

33

Page 4: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

PurposePurpose

The purpose of this presentation is to describe the process we follow for our local Comprehensive The purpose of this presentation is to describe the process we follow for our local Comprehensive Program Reviews, the system required Annual Program Reviews, and to provide definitions of the Program Reviews, the system required Annual Program Reviews, and to provide definitions of the data used in the reviews.data used in the reviews.

We have been asked to produce an annual program review for each and every one of our We have been asked to produce an annual program review for each and every one of our instructional programs and non-instructional units. They are required of each community college instructional programs and non-instructional units. They are required of each community college in the system and will be taken to the U of H Board of Regents for their purview.in the system and will be taken to the U of H Board of Regents for their purview.

You will need to complete a comprehensive review this year this year if you are scheduled for You will need to complete a comprehensive review this year this year if you are scheduled for one. Every program and unit is required to complete a comprehensive review once within 5 years one. Every program and unit is required to complete a comprehensive review once within 5 years time. time.

Click on the link below to find out if you are scheduled for a comprehensive review this year. Click on the link below to find out if you are scheduled for a comprehensive review this year.

Comprehensive Program-Unit Review Cycle and ScheduleComprehensive Program-Unit Review Cycle and Schedule

44

Page 5: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

Reason for Program ReviewReason for Program Review

The review of a program should be an on-going, year-round, reflective process. The review of a program should be an on-going, year-round, reflective process. 

Program review processes assure educational quality and help programs to evaluate and improve their Program review processes assure educational quality and help programs to evaluate and improve their services.services.

Program review is an opportunity for self-study, self-renewal, and an opportunity to identify the need for Program review is an opportunity for self-study, self-renewal, and an opportunity to identify the need for improvement. improvement.

Your program review may be one of the few opportunities you have to showcase the accomplishments of Your program review may be one of the few opportunities you have to showcase the accomplishments of your program. Take this opportunity to shine.your program. Take this opportunity to shine.

A robust program review process is one mechanism available to the college to improve student success.A robust program review process is one mechanism available to the college to improve student success.

55

Page 6: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

What are we doing to improve our program review process?What are we doing to improve our program review process?

Upon conclusion of every program/unit review cycle, the IR Office takes extra care to ensure that we are improving our program/unit review process on campus. This is accomplished by sending out questionnaires specific to the groups, and then meeting with those groups across campus and collecting their feedback. The feedback is reviewed and an action plan is put into place, which is used in the planning phase for our next review cycle. Your suggestions, and the actions taken for improving this process, are then published to the Program Review website and have been linked here for your convenience.

2012 Program-Unit Process Improvement Summary2012 Program-Unit Process Improvement Summary

To drive accountability in the organization, the Vice Chancellor for Academic Affairs will ensure To drive accountability in the organization, the Vice Chancellor for Academic Affairs will ensure that all of the work we commit to as part of this process, is completed every year. Based on the that all of the work we commit to as part of this process, is completed every year. Based on the feedback we received from everyone last year from our program-unit review process improvement feedback we received from everyone last year from our program-unit review process improvement focus groups, the following changes have been made and have been incorporated into the focus groups, the following changes have been made and have been incorporated into the planning of this year’s review:planning of this year’s review:

66

Page 7: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

In order to assure the best possible communication and attendance for our annual training, the IR In order to assure the best possible communication and attendance for our annual training, the IR Office developed the Program-Unit Review Campus Communication Plan. We found out that Office developed the Program-Unit Review Campus Communication Plan. We found out that information about our program and unit review process on campus was not always getting to the information about our program and unit review process on campus was not always getting to the people that need it, availability of faculty, lecturers and staff were not taken into consideration when people that need it, availability of faculty, lecturers and staff were not taken into consideration when scheduling meetings/training, and using email alone was not sufficient to reach everyone on campus. scheduling meetings/training, and using email alone was not sufficient to reach everyone on campus.

The new communication plan includes: managing a scheduling request for meetings, using the The new communication plan includes: managing a scheduling request for meetings, using the campus-wide email distribution to include faculty, lecturers and staff, and a hardcopy reminder will be campus-wide email distribution to include faculty, lecturers and staff, and a hardcopy reminder will be printed off and placed in division/department mailboxes and posted in break areas. printed off and placed in division/department mailboxes and posted in break areas.

Additionally, the Vice Chancellor for Academic Affairs will work with the Admin Team and the DC’s to Additionally, the Vice Chancellor for Academic Affairs will work with the Admin Team and the DC’s to ensure that we are adequately communicating program and unit review activities across the campus. ensure that we are adequately communicating program and unit review activities across the campus.

77

What else are we doing to improve our program review process?What else are we doing to improve our program review process?

Page 8: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

What else are we doing to improve our program review process?What else are we doing to improve our program review process?

There were some issues that came up last year from folks that were unable to find their assessments, which they needed in There were some issues that came up last year from folks that were unable to find their assessments, which they needed in order to write their reviews. It turns out that the assessments had all been moved from the assessment website to the Intranet, order to write their reviews. It turns out that the assessments had all been moved from the assessment website to the Intranet, but instructions were never sent out to communicate the change. All assessments can now be found in the assessment folder but instructions were never sent out to communicate the change. All assessments can now be found in the assessment folder on the Intranet. Click here to log in and view your assessments: Intranet Assessmentson the Intranet. Click here to log in and view your assessments: Intranet Assessments

Your suggestions for improving our program review process at the system level were taken to the Instructional Program Review Your suggestions for improving our program review process at the system level were taken to the Instructional Program Review Committee (UHCC IPRC) by our UHCC IPRC Representatives on campus. Results of that meeting are published here: 2012 Committee (UHCC IPRC) by our UHCC IPRC Representatives on campus. Results of that meeting are published here: 2012 UHCC IPRC ResponsesUHCC IPRC Responses

A special “Mahalo” goes out to our local UHCC IPRC representatives for helping us improve this important process!A special “Mahalo” goes out to our local UHCC IPRC representatives for helping us improve this important process!

88

Page 9: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

What else are we doing to improve our program review process?What else are we doing to improve our program review process?

99

Page 10: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

What is different this year?What is different this year?

Remember: Joni will find someone to copy your template information into the online Remember: Joni will find someone to copy your template information into the online ARPD tool. Just fill out the template you are required to submit this year!ARPD tool. Just fill out the template you are required to submit this year!

The following data elements are all new this year:The following data elements are all new this year:

Number of majors Native HawaiianNumber of majors Native Hawaiian Fall Full-TimeFall Full-Time Fall Part-Time Fall Part-Time Fall Part-Time that are full-time in systemFall Part-Time that are full-time in system Spring Full-TimeSpring Full-Time Spring Part-Time Spring Part-Time Spring Part-Time that are full-time in systemSpring Part-Time that are full-time in system Persistence Fall to FallPersistence Fall to Fall

Performance FundingPerformance Funding

Number of Degrees and CertificatesNumber of Degrees and Certificates Number of Degrees and Certificates Native HawaiianNumber of Degrees and Certificates Native Hawaiian Number of Degrees and Certificates STEMNumber of Degrees and Certificates STEM Number of PELL RecipientsNumber of PELL Recipients Number of Transfers to UH 4-yrNumber of Transfers to UH 4-yr

1010

Page 11: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

Navigating the ARPD Web Submission ToolNavigating the ARPD Web Submission Tool

If you have attended the training session in-person today you can skip the next few If you have attended the training session in-person today you can skip the next few slides (go to slide page 20) that deal with Navigating the ARPD site. I’ve included the slides (go to slide page 20) that deal with Navigating the ARPD site. I’ve included the slides here for those that may not have been able to join us today.slides here for those that may not have been able to join us today.

The Annual Reports of Program Data Web Submission Tool (or ARPD for short), is a The Annual Reports of Program Data Web Submission Tool (or ARPD for short), is a repository for Annual program and unit reviews for: Instruction, the Academic Support repository for Annual program and unit reviews for: Instruction, the Academic Support Unit, and Student Support Services. Much of the data that you will need to complete Unit, and Student Support Services. Much of the data that you will need to complete your review has been provided by the Office of the Vice President for Community your review has been provided by the Office of the Vice President for Community Colleges. Colleges.

The ARPD is a home-grown tool, developed in-house, and was developed specifically The ARPD is a home-grown tool, developed in-house, and was developed specifically to meet the needs of the community college system. to meet the needs of the community college system.

1111

Page 12: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

Navigating the ARPD Web Submission Tool cont…Navigating the ARPD Web Submission Tool cont…

Your programs data table is available on-line within the tool by August 15Your programs data table is available on-line within the tool by August 15 thth every every year. You should have everything you need to begin writing your review within the year. You should have everything you need to begin writing your review within the web submission tool. web submission tool.

Plan to save your work often—especially when switching between screens, and plan Plan to save your work often—especially when switching between screens, and plan to do most of your formatting within the tool if you are copying and pasting in from to do most of your formatting within the tool if you are copying and pasting in from Word. Also plan to spell check and save your review in Word before starting. Word. Also plan to spell check and save your review in Word before starting.

One of the nicest features about the ARPD is that you can go back and look at One of the nicest features about the ARPD is that you can go back and look at reviews from previous years. You can also enhance your own review by leveraging reviews from previous years. You can also enhance your own review by leveraging off similar reviews at other institutions.off similar reviews at other institutions.

1212

Page 13: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

Navigating the ARPD Web Submission Tool continued…Navigating the ARPD Web Submission Tool continued…

UHCC Annual Report of Program Data Web Submission ToolUHCC Annual Report of Program Data Web Submission Tool

Begin by clicking on the link above. To enter information on your review, click on the button Begin by clicking on the link above. To enter information on your review, click on the button in the lower part of the screen called, “2013 Instructional Submission”. You will be asked to in the lower part of the screen called, “2013 Instructional Submission”. You will be asked to log in by typing in your UH username and password, in order to get to the web submission log in by typing in your UH username and password, in order to get to the web submission site. The default will take you to the site. The default will take you to the “Status” tab“Status” tab, where you will be able to view whoever , where you will be able to view whoever was the last user to modify the information in your review.was the last user to modify the information in your review.

Clicking on the Clicking on the “Users” tab “Users” tab will take you to a screen that shows all of the people that have will take you to a screen that shows all of the people that have permission to update your program. For each program there is a list of people with specific permission to update your program. For each program there is a list of people with specific roles: Program Coordinator, Div./Dept. Chair, and Dean. The VCAA determines who can roles: Program Coordinator, Div./Dept. Chair, and Dean. The VCAA determines who can update your program. If there is someone you’d like to add to the list, contact the VCAA with update your program. If there is someone you’d like to add to the list, contact the VCAA with your request.your request.

You can enter the information about your program in any order you wish, but moving from You can enter the information about your program in any order you wish, but moving from left to right across the tabs at the top of the screen follows the same logical path we used left to right across the tabs at the top of the screen follows the same logical path we used when we were filling out the templates in the past. Start by clicking on the when we were filling out the templates in the past. Start by clicking on the “Analysis” tab“Analysis” tab..

On the Analysis screen you can either go in and just preview what has already been On the Analysis screen you can either go in and just preview what has already been inputted by clicking on the “Preview” button, or you can go to the edit screen and begin inputted by clicking on the “Preview” button, or you can go to the edit screen and begin entering or updating information.entering or updating information.

1313

Page 14: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

Navigating the ARPD Web Submission Tool continued…Navigating the ARPD Web Submission Tool continued…

On the Analysis screen begin editing by going to the bottom of the page, under the data On the Analysis screen begin editing by going to the bottom of the page, under the data sheet. Click the edit button and scroll down. There are 3 sections for you to edit here: sheet. Click the edit button and scroll down. There are 3 sections for you to edit here: Analysis of your Program, Action Plan, and Resource Implications. Simply click on the Analysis of your Program, Action Plan, and Resource Implications. Simply click on the “Edit” link and you will be taken to a screen very similar to MS Word, where you can begin “Edit” link and you will be taken to a screen very similar to MS Word, where you can begin typing in your analysis. (Note the Save button in the left hand corner!)typing in your analysis. (Note the Save button in the left hand corner!)

In the Action Plan section you will need to include your action plans for any of your Perkins In the Action Plan section you will need to include your action plans for any of your Perkins Core Indicators, where the program did not meet the goal. Check your data sheet for this.Core Indicators, where the program did not meet the goal. Check your data sheet for this.

Also very important this year…Also very important this year…if you are requesting additional people, services, or if you are requesting additional people, services, or equipment for your program, you will need to make the justification in the “Resource equipment for your program, you will need to make the justification in the “Resource Implications” section. Asks for your program are no longer part of the comprehensive Implications” section. Asks for your program are no longer part of the comprehensive review as they have been in the past.review as they have been in the past.

Now click on the Now click on the “Description tab” “Description tab” and input the year and web address of your last and input the year and web address of your last comprehensive review. You should be able to copy and paste the link right off the comprehensive review. You should be able to copy and paste the link right off the program-unit review website for the year of your last review. Finish this tab off by typing in program-unit review website for the year of your last review. Finish this tab off by typing in a brief description of your program and mission.a brief description of your program and mission.

Now, click on the Now, click on the “P-SLOs tab” “P-SLOs tab” and go to the next slide…and go to the next slide…

1414

Page 15: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

What to enter on the “P-SLO” tab in ARPD Web Submission ToolWhat to enter on the “P-SLO” tab in ARPD Web Submission ToolIndicate which PLOs were assessed during the reporting year’s assessment(s).Indicate which PLOs were assessed during the reporting year’s assessment(s).

Evidence of Industry ValidationEvidence of Industry ValidationProvide documentation that the program has submitted evidence and achieved certification or accreditation from an organization granting Provide documentation that the program has submitted evidence and achieved certification or accreditation from an organization granting certification in an industry or profession.  If the program/degree/certificate does not have a certifying body, the recommendations for, certification in an industry or profession.  If the program/degree/certificate does not have a certifying body, the recommendations for, approval of, and/or participation in, assessment by the program’s advisory committee/board can be submitted.approval of, and/or participation in, assessment by the program’s advisory committee/board can be submitted.

  Expected Level of AchievementExpected Level of AchievementDescribe the different levels of achievement for each characteristic of the learning outcome(s) that were assessed.  What represented Describe the different levels of achievement for each characteristic of the learning outcome(s) that were assessed.  What represented “excellent,” “good,” “fair,” or “poor” performance using a defined rubric and what percentages were set as goals for student success (for “excellent,” “good,” “fair,” or “poor” performance using a defined rubric and what percentages were set as goals for student success (for example: “85% of students will achieve good or excellent in the assessed activity.”)example: “85% of students will achieve good or excellent in the assessed activity.”)

Courses AssessedCourses AssessedList the courses assessed during the reporting period.List the courses assessed during the reporting period.

  Assessment Strategy/InstrumentAssessment Strategy/InstrumentDescribe what, why, where, when, and from whom assessment artifacts were collected.Describe what, why, where, when, and from whom assessment artifacts were collected.

Results of Program AssessmentResults of Program AssessmentThe % of students who met the outcome(s) and at what level they met the outcome(s).The % of students who met the outcome(s) and at what level they met the outcome(s).

Other CommentsOther CommentsInclude any information that will clarify the assessment process report.Include any information that will clarify the assessment process report.

  Next StepsNext StepsDescribe what the program will do to improve the results.  "Next Steps" can include revision to syllabi, curriculum, teaching methods, Describe what the program will do to improve the results.  "Next Steps" can include revision to syllabi, curriculum, teaching methods, student support, and other options.student support, and other options.

1515

Page 16: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

What to enter on the “Cost Per SSH” tab in ARPD Web Submission ToolWhat to enter on the “Cost Per SSH” tab in ARPD Web Submission Tool

There are 4 different values that need to be added on the Cost Per SSH screen in There are 4 different values that need to be added on the Cost Per SSH screen in ARPD. Basically, all of the fund amounts that will be entered are used in the ARPD. Basically, all of the fund amounts that will be entered are used in the calculation for the cost per SSH for your program. The costs that need to be entered calculation for the cost per SSH for your program. The costs that need to be entered are:are:

General FundsGeneral Funds

Federal FundsFederal Funds

Other FundsOther Funds

Tuition and FeesTuition and Fees

The definitions for what comprises each of these funds, are laid out in detail in the The definitions for what comprises each of these funds, are laid out in detail in the data definitions section of this presentation, so will not be duplicated here.data definitions section of this presentation, so will not be duplicated here.

Joni will be uploading all of the budget information you need this year. Once the Joni will be uploading all of the budget information you need this year. Once the values are loaded and saved in the tool, the values for “Total Funds” and “Cost per values are loaded and saved in the tool, the values for “Total Funds” and “Cost per SSH” will auto-calculate into your datasheet.SSH” will auto-calculate into your datasheet.

1616

Page 17: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

What to enter on the “External” tab in ARPD Web Submission ToolWhat to enter on the “External” tab in ARPD Web Submission Tool

This slide only applies to the Nursing program. Included here for “additional info”This slide only applies to the Nursing program. Included here for “additional info”

The “External” screen is intended for programs that utilize external licensures. The “External” screen is intended for programs that utilize external licensures. Currently, the only program at HawCC with external licensures is the Nursing Currently, the only program at HawCC with external licensures is the Nursing program. program.

If you are not in the Nursing program you can skip this tab/screen altogether because If you are not in the Nursing program you can skip this tab/screen altogether because the first question is, “Does this program utilize external licensures?” The radio button the first question is, “Does this program utilize external licensures?” The radio button defaults to “No”. (mighty thoughtful programming, I’d say defaults to “No”. (mighty thoughtful programming, I’d say ))

If you If you areare in the Nursing program please click the “Yes” radio button to answer the in the Nursing program please click the “Yes” radio button to answer the question and then enter the Number sitting for exam, and the Number passed. Do question and then enter the Number sitting for exam, and the Number passed. Do this for each program where you utilize external licensures. The percent passed will this for each program where you utilize external licensures. The percent passed will auto-calculate into your datasheet when you click the “Save External Data” button.auto-calculate into your datasheet when you click the “Save External Data” button.

The Vice President of Community College’s office collects this data as part of our The Vice President of Community College’s office collects this data as part of our annual Graduate-Leaver reporting as well as the UH system, “Measuring our annual Graduate-Leaver reporting as well as the UH system, “Measuring our Progress” report.Progress” report.

1717

Page 18: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

What to enter on the “Capacity” tab in ARPD Web Submission ToolWhat to enter on the “Capacity” tab in ARPD Web Submission Tool

The “Capacity” screen is only intended for programs that have an externally The “Capacity” screen is only intended for programs that have an externally mandated capacity. Slide Included here for “additional info”mandated capacity. Slide Included here for “additional info”

The following criteria is used as an alternate measure for the Student/Faculty Ratio The following criteria is used as an alternate measure for the Student/Faculty Ratio measure within the Efficiency Health call:measure within the Efficiency Health call:

““If your program has an externally mandated (e.g. professional accreditation or If your program has an externally mandated (e.g. professional accreditation or licensing) capacity of less than 16 students per faculty, the program may be eligible licensing) capacity of less than 16 students per faculty, the program may be eligible for the alternative efficiency health call calculation.”for the alternative efficiency health call calculation.”

If your program fits the criteria listed above, AND your Efficiency Health call is other If your program fits the criteria listed above, AND your Efficiency Health call is other than Healthy, AND your efficiency health call can be improved by using the alternate than Healthy, AND your efficiency health call can be improved by using the alternate method…method…

Please contact:Please contact:

Cheryl Chappell-LongCheryl Chappell-LongDirector Academic Planning, Assessment, and Policy AnalysisDirector Academic Planning, Assessment, and Policy AnalysisPhone: 808-956-4561Phone: 808-956-4561Email: [email protected] Email: [email protected]

1818

Page 19: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

““Help” tab in ARPD Web Submission ToolHelp” tab in ARPD Web Submission Tool

The “Help” screen is a very useful resource for some of the documentation needed to The “Help” screen is a very useful resource for some of the documentation needed to support your program within the review process. It contains all of the glossaries and support your program within the review process. It contains all of the glossaries and health call scoring rubrics for each year we have used the online tool.health call scoring rubrics for each year we have used the online tool.

1919

Page 20: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

Process for Completing the Liberal Arts Program ReviewProcess for Completing the Liberal Arts Program Review

COMPREHENSIVE REVIEWSCOMPREHENSIVE REVIEWS

If you are on the schedule to complete a comprehensive review this year, follow this simple 2-step process:If you are on the schedule to complete a comprehensive review this year, follow this simple 2-step process:

Step 1:Step 1: Complete your review in the ARPD online submission tool.Complete your review in the ARPD online submission tool.Step 2: Step 2: Move to the Comprehensive Review Process for further instructions.Move to the Comprehensive Review Process for further instructions.

ANNUAL REVIEWSANNUAL REVIEWS

If you are on the If you are on the NOTNOT on the schedule to complete a comprehensive review this year, follow this simple 2-step on the schedule to complete a comprehensive review this year, follow this simple 2-step process:process:

Step 1:Step 1: Complete your review in the ARPD online submission tool.Complete your review in the ARPD online submission tool.Step 2: Step 2: Move to the Annual Review & Budget Process for further instructions.Move to the Annual Review & Budget Process for further instructions.

The comprehensive review process, and annual review and budget process, and their associated templates, The comprehensive review process, and annual review and budget process, and their associated templates, are brought to you this year by the VCAA and Interim Dean of CTE Programs. The template and instructions are brought to you this year by the VCAA and Interim Dean of CTE Programs. The template and instructions should be part of their presentation today.should be part of their presentation today.

2020

Page 21: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

Process OwnersProcess Owners

The graphic below depicts who is responsible for each part of the program review process—from The graphic below depicts who is responsible for each part of the program review process—from ARPD through CERC. For more information please use the contact list below.ARPD through CERC. For more information please use the contact list below.

Contact ListContact List

Assessment = James KileyAssessment = James Kiley 934-2649934-2649IR = Shawn FloodIR = Shawn Flood 934-2648934-2648Dean CTE = Joyce HamasakiDean CTE = Joyce Hamasaki 934-2522934-2522VCAA = Joni OnishiVCAA = Joni Onishi 934-2514934-2514

2121

ASSESSMENTIR Dean CTE

PublishReviews

VCAAARPD Web Submission

Annual Review & Budget Process/Template

Done!

ARPD Web Submission

Comprehensive Review Process/Template

CERC

Annual Review

Comprehensive Review

Page 22: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

Terminology / TimingTerminology / Timing

The Census freeze event is the fifth Friday after the first day of instruction.The Census freeze event is the fifth Friday after the first day of instruction.

The End of semester (EOS) freeze event is 10 weeks after the last day of instruction.The End of semester (EOS) freeze event is 10 weeks after the last day of instruction.

Degrees are conferred in the “Fiscal year”. The fiscal year value represents the ending of that fiscal year. For example, a FISCAL_YR_IRO value Degrees are conferred in the “Fiscal year”. The fiscal year value represents the ending of that fiscal year. For example, a FISCAL_YR_IRO value of 2013 indicates the fiscal year 2012-2013 (July 1, 2012 to June 30, 2013) which includes Summer 2012, Fall 2012, and Spring 2013 semesters. of 2013 indicates the fiscal year 2012-2013 (July 1, 2012 to June 30, 2013) which includes Summer 2012, Fall 2012, and Spring 2013 semesters.

““Home Institution” is the campus where the student was admitted.Home Institution” is the campus where the student was admitted.

““Program Year” listed on your data sheet for “12-13” represents your programs data in semesters: Summer 2012, Fall 2012, and Spring 2013.Program Year” listed on your data sheet for “12-13” represents your programs data in semesters: Summer 2012, Fall 2012, and Spring 2013.

Student information data this year comes exclusively from the Operational Data Store (ODS). Organizationally this means that all community Student information data this year comes exclusively from the Operational Data Store (ODS). Organizationally this means that all community colleges are getting the data from the same place and at the same snapshot in time (this is a good thing).colleges are getting the data from the same place and at the same snapshot in time (this is a good thing).

2222

Page 23: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#1#1 Number of MajorsNumber of Majors

Count of program majors who are home‐institution at your college. Count of program majors who are home‐institution at your college.

Count excludes students that have completely withdrawn from the semester at Count excludes students that have completely withdrawn from the semester at CENSUS.CENSUS.

This is an annual number. Programs receive a count of .5 for each term within the This is an annual number. Programs receive a count of .5 for each term within the academic year that the student is a major. A maximum count of 1.0 (one) for each academic year that the student is a major. A maximum count of 1.0 (one) for each student.student.

2323

#1a#1a Number of Majors Native HawaiianNumber of Majors Native Hawaiian

Count of program majors who are Native Hawaiian and home‐institution at your Count of program majors who are Native Hawaiian and home‐institution at your college. Count excludes students that have completely withdrawn from the semester college. Count excludes students that have completely withdrawn from the semester at CENSUS.at CENSUS.

This is an annual number. Programs receive a count of .5 for each term (fall and This is an annual number. Programs receive a count of .5 for each term (fall and spring) within the academic year that the Native Hawaiian student is a major. A spring) within the academic year that the Native Hawaiian student is a major. A maximum count of 1.0 (one) for each student.maximum count of 1.0 (one) for each student.

Page 24: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#1b#1b Fall Full-TimeFall Full-Time

Percentage of majors (#1) enrolled in 12 or more credits in the college in the reporting Percentage of majors (#1) enrolled in 12 or more credits in the college in the reporting Fall semester. Fall semester.

2424

#1c#1c Fall Part-TimeFall Part-Time

Percentage of majors (#1) enrolled in less than12 credits in the college in the Percentage of majors (#1) enrolled in less than12 credits in the college in the reporting Fall semester. reporting Fall semester.

#1d#1d Fall Part-Time who are Full-Time in SystemFall Part-Time who are Full-Time in System

Percentage of majors in #1c (enrolled in less than 12 credits in the reporting Fall Percentage of majors in #1c (enrolled in less than 12 credits in the reporting Fall semester in the institution) who are enrolled in credits in other UH institutions where semester in the institution) who are enrolled in credits in other UH institutions where their total number of credits enrolled in the UH System is equal to or greater than 12.their total number of credits enrolled in the UH System is equal to or greater than 12.

Page 25: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

2525

Percentage of majors enrolled in 12 or more credits in the reporting Spring semester Percentage of majors enrolled in 12 or more credits in the reporting Spring semester at the institution.at the institution.

#1e#1e Spring Full-TimeSpring Full-Time

#1f#1f Spring Part-TimeSpring Part-Time

Percentage of majors enrolled in less than 12 credits at the institution in the reporting Percentage of majors enrolled in less than 12 credits at the institution in the reporting Spring semester.Spring semester.

#1g#1g Spring Part-Time who are Full-Time in SystemSpring Part-Time who are Full-Time in System

Percentage of majors in #1f (enrolled in less than 12 credits in the reporting Spring Percentage of majors in #1f (enrolled in less than 12 credits in the reporting Spring semester in the institution) who are enrolled in credits in other UH institutions where semester in the institution) who are enrolled in credits in other UH institutions where their total number of credits enrolled in the UH System is equal to or greater than 12.their total number of credits enrolled in the UH System is equal to or greater than 12.

Page 26: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#2#2 Percent Change Majors from Prior Year Percent Change Majors from Prior Year

In alignment with UHCC Strategic Planning Goals, General and Pre‐Professional In alignment with UHCC Strategic Planning Goals, General and Pre‐Professional Education programs are expected to grow by 3% per year.Education programs are expected to grow by 3% per year.

Difference between the number of majors (#1) in the current year from the prior year, Difference between the number of majors (#1) in the current year from the prior year, divided by the number of majors in the prior year.divided by the number of majors in the prior year.

For example, last program year (1112) there were 1306 majors, this year (1213) there For example, last program year (1112) there were 1306 majors, this year (1213) there are 1390 majors in the program.are 1390 majors in the program.

This methodology works for HawCC in the current reporting year as This methodology works for HawCC in the current reporting year as ((1390-1306)/1306)*100 = about 6%((1390-1306)/1306)*100 = about 6%

2626

Page 27: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#3#3 SSH Program majors in Program ClassesSSH Program majors in Program Classes

The sum of Fall and Spring Student Semester Hours (SSH) taken by program majors The sum of Fall and Spring Student Semester Hours (SSH) taken by program majors in courses linked to the program. Captured at Census and excludes students who in courses linked to the program. Captured at Census and excludes students who have already withdrawn (W) at this point.have already withdrawn (W) at this point.

Excludes Directed Studies (99 series). Differs from MAPS as UHCC data includes Excludes Directed Studies (99 series). Differs from MAPS as UHCC data includes Cooperative Education (93 series) as there is a resource cost to the program.Cooperative Education (93 series) as there is a resource cost to the program.

Not sure what your program classes are? Click here to find out:Not sure what your program classes are? Click here to find out:

Courses Taught Aligned to Instructional ProgramsCourses Taught Aligned to Instructional Programs

2727

Page 28: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#4#4 SSH Non-Majors in Program ClassesSSH Non-Majors in Program Classes

The sum of Fall and Spring SSH taken by non‐program majors (not counted in #3) in The sum of Fall and Spring SSH taken by non‐program majors (not counted in #3) in courses linked to the program. Captured at Census and excludes students who have courses linked to the program. Captured at Census and excludes students who have already withdrawn (W) at this point.already withdrawn (W) at this point.

Excludes Directed Studies (99 series). Excludes Directed Studies (99 series).

Differs from MAPS as UHCC data includes Cooperative Education (93 series) as Differs from MAPS as UHCC data includes Cooperative Education (93 series) as there is a resource cost to the program.there is a resource cost to the program.

2828

Page 29: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#5#5 SSH in All Program ClassesSSH in All Program Classes

The sum of Fall and Spring SSH taken by all students in classes linked to the The sum of Fall and Spring SSH taken by all students in classes linked to the program. Captured at Census and excludes students who have already withdrawn program. Captured at Census and excludes students who have already withdrawn (W) at this point.(W) at this point.

Excludes Directed Studies (99 series). Excludes Directed Studies (99 series).

Differs from MAPS as UHCC data Includes Cooperative Education (93 series) as Differs from MAPS as UHCC data Includes Cooperative Education (93 series) as there is a resource cost to the program.there is a resource cost to the program.

2929

Page 30: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#6#6 FTE Enrollment in Program ClassesFTE Enrollment in Program Classes

Sum of Student Semester Hours (SSH) taken by all students in classes linked to the Sum of Student Semester Hours (SSH) taken by all students in classes linked to the program (#5) divided by 30. Undergraduate, lower division Full Time Equivalent (FTE) program (#5) divided by 30. Undergraduate, lower division Full Time Equivalent (FTE) is calculated as 15 credits per term. is calculated as 15 credits per term.

Captured at Census and excludes students who have already withdrawn (W) at this Captured at Census and excludes students who have already withdrawn (W) at this point.point.

3030

Page 31: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#7#7 Total Number of Classes TaughtTotal Number of Classes Taught

Total number of classes taught in Fall and Spring that are linked to the program. Total number of classes taught in Fall and Spring that are linked to the program.

Concurrent and Cross listed classes are only counted once for the primary class. Concurrent and Cross listed classes are only counted once for the primary class.

Excludes Directed Studies (99 series). Excludes Directed Studies (99 series).

Differs from MAPS as UHCC data Includes Cooperative Education (93 series) as Differs from MAPS as UHCC data Includes Cooperative Education (93 series) as there is a resource cost to the program.there is a resource cost to the program.

3131

Page 32: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

Liberal Arts Program Scoring Rubric DefinitionsLiberal Arts Program Scoring Rubric Definitions

Your program health is determined by 3 separate types of measures: Demand, Your program health is determined by 3 separate types of measures: Demand, Efficiency, and Effectiveness. This slide explains why these measures were chosen Efficiency, and Effectiveness. This slide explains why these measures were chosen to determine program health.to determine program health.

Demand: Demand: A seeking or state of being sought after.A seeking or state of being sought after. i.e. your programs ability to attract new students every year based on your offering.i.e. your programs ability to attract new students every year based on your offering.

Efficiency: Efficiency: Acting or producing effectively with a minimum of waste, expense, or Acting or producing effectively with a minimum of waste, expense, or unnecessary effort.unnecessary effort.i.e. your programs ability to use its resources in the best possible way.i.e. your programs ability to use its resources in the best possible way.

Effectiveness: Effectiveness: Stresses the actual production of, or the power to produce an affect.Stresses the actual production of, or the power to produce an affect.i.e. your programs ability to produce the desired result.i.e. your programs ability to produce the desired result.

3232

Page 33: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

Determination of Program’s HealthDetermination of Program’s Health

3333

Page 34: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#8#8 Average Class SizeAverage Class Size

Total number of students actively registered in Fall and Spring program classes Total number of students actively registered in Fall and Spring program classes divided by classes taught (#7). Does not include students who have already divided by classes taught (#7). Does not include students who have already withdrawn from the class by Census.withdrawn from the class by Census.

Excludes Directed Studies (99 series). Differs from MAPS as UHCC data. Includes Excludes Directed Studies (99 series). Differs from MAPS as UHCC data. Includes Cooperative Education (93 series) as there is a resource cost to the program.Cooperative Education (93 series) as there is a resource cost to the program.

3434

#9#9 Fill RateFill Rate

Total active student registrations in program classes (number of seats filled) at Fall Total active student registrations in program classes (number of seats filled) at Fall and Spring census divided by the maximum enrollment (number of seats offered).and Spring census divided by the maximum enrollment (number of seats offered).

Captured at Census and excludes students who have already withdrawn (W) at this Captured at Census and excludes students who have already withdrawn (W) at this point.point.

Page 35: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#10#10 FTE BOR Appointed FacultyFTE BOR Appointed Faculty

Sum appointments (1.0, 0.5, etc.) of all BOR appointed program faculty (excludes lecturers and other non Sum appointments (1.0, 0.5, etc.) of all BOR appointed program faculty (excludes lecturers and other non BOR appointees).BOR appointees).

Uses the “hiring status” of the faculty member – not the teaching/work load.Uses the “hiring status” of the faculty member – not the teaching/work load.

Uses the Employing Agency Code (EAC) recorded in the Human Resources (HR) database to determine Uses the Employing Agency Code (EAC) recorded in the Human Resources (HR) database to determine faculty’s program home.faculty’s program home.

Data provided by UH Human Resources Office as of 10/31/2012.Data provided by UH Human Resources Office as of 10/31/2012.

Faculty Teaching solely Remedial and/or Developmental Reading, Writing, or Mathematics are excluded Faculty Teaching solely Remedial and/or Developmental Reading, Writing, or Mathematics are excluded from the counts in Liberal Arts and included in the counts for the Remedial/and or Developmental from the counts in Liberal Arts and included in the counts for the Remedial/and or Developmental programs. Faculty with “split” assignments among Remedial/Developmental classes and Transfer level programs. Faculty with “split” assignments among Remedial/Developmental classes and Transfer level classes are reflected proportionally.classes are reflected proportionally.

If your FTE BOR faculty count is off for your program, contact the VCAA.If your FTE BOR faculty count is off for your program, contact the VCAA.

Click here for the count of BOR Appointed Program Faculty in your program:Click here for the count of BOR Appointed Program Faculty in your program:

2013 BOR Appointed Program Faculty2013 BOR Appointed Program Faculty

3535

Page 36: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#11 #11 Majors to FTE BOR Appointed Faculty Majors to FTE BOR Appointed Faculty

Number of majors (#1) divided by sum appointments (#10) (1.0, 0.5, etc.) of all BOR Number of majors (#1) divided by sum appointments (#10) (1.0, 0.5, etc.) of all BOR appointed program faculty. appointed program faculty.

Data shows the number of student majors in the program for each faculty member Data shows the number of student majors in the program for each faculty member (25 majors to 1 faculty shown as “25”)(25 majors to 1 faculty shown as “25”)

3636

Page 37: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#12#12 Majors to Analytic FTE FacultyMajors to Analytic FTE Faculty

Number of majors (#1) divided by number of Analytic FTE faculty (#12a).Number of majors (#1) divided by number of Analytic FTE faculty (#12a).

3737

#12a#12a Analytical FTE Faculty (Workload)Analytical FTE Faculty (Workload)

Calculated by sum of Semester Hours (not Student Semester Hours) taught in Calculated by sum of Semester Hours (not Student Semester Hours) taught in program classes divided by 27.program classes divided by 27.

Analytic FTE is useful as a comparison to FTE of BOR appointed faculty (#10). Used Analytic FTE is useful as a comparison to FTE of BOR appointed faculty (#10). Used for analysis of program offerings covered by lecturers.for analysis of program offerings covered by lecturers.

Page 38: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#13#13 OverallOverall Program Budget AllocationProgram Budget Allocation

The overall program budget allocation = General Funded Budget Allocations (13a) + The overall program budget allocation = General Funded Budget Allocations (13a) + Special/Federal Budget Allocations (13b) + Tuition and Fees (13c) + Other feesSpecial/Federal Budget Allocations (13b) + Tuition and Fees (13c) + Other fees

The overall program budget allocation The overall program budget allocation is automatically calculated when you enter is automatically calculated when you enter your general funded budget allocation, special/federal budget allocation, other funds, your general funded budget allocation, special/federal budget allocation, other funds, and/or tuition and fees, into the online tool tab called, “Cost per SSH.” and/or tuition and fees, into the online tool tab called, “Cost per SSH.” Again, Joni will Again, Joni will upload the data for you this year.upload the data for you this year.

The overall program budget allocation is to be determined by the College using these The overall program budget allocation is to be determined by the College using these guidelines from VCAA/DOI/ADOI and should include: Salaries (general funds, special guidelines from VCAA/DOI/ADOI and should include: Salaries (general funds, special funds, etc.), overload, lecturers, costs for all faculty and staff assigned to the funds, etc.), overload, lecturers, costs for all faculty and staff assigned to the program, supply and maintenance, amortized equipment, and tuition and fees.program, supply and maintenance, amortized equipment, and tuition and fees.

3838

Page 39: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#13a#13a General Funded Budget AllocationGeneral Funded Budget Allocation

The general funded budget allocation = actual personnel costs + b budget The general funded budget allocation = actual personnel costs + b budget expendituresexpenditures

3939

#13b#13b Special/Federal Budget AllocationSpecial/Federal Budget Allocation

The dollars from Federal grantsThe dollars from Federal grants

#13c#13c Tuition and FeesTuition and Fees

The amount collected for tuition and fees in the 2013 academic year.The amount collected for tuition and fees in the 2013 academic year.

Page 40: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#15#15 Number of Low Enrolled (<10) ClassesNumber of Low Enrolled (<10) Classes

Classes taught (#7) with 9 or fewer active students at Census. Classes taught (#7) with 9 or fewer active students at Census.

Excludes students who have already withdrawn (W) at this point.Excludes students who have already withdrawn (W) at this point.

Excludes Directed Studies (99 series).Excludes Directed Studies (99 series).

Includes Cooperative Education (93 series) as there is a resource cost to the Includes Cooperative Education (93 series) as there is a resource cost to the program.program.

4040

Overall Program Budget Allocation (#13) divided by SSH in all program classes (#5)Overall Program Budget Allocation (#13) divided by SSH in all program classes (#5)

#14#14 Cost per SSHCost per SSH

Page 41: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#16#16 Successful Completion (Equivalent C or higher)Successful Completion (Equivalent C or higher)

Percentage of students actively enrolled in program classes at Fall and Spring Percentage of students actively enrolled in program classes at Fall and Spring census who at end of semester (EOS) have earned a grade equivalent to C or higher.census who at end of semester (EOS) have earned a grade equivalent to C or higher.

4141

#17#17 Withdrawals (grade = W)Withdrawals (grade = W)

Number of students actively enrolled (at this point have not withdrawn) at Fall and Number of students actively enrolled (at this point have not withdrawn) at Fall and Spring census who at end of semester have a grade of W.Spring census who at end of semester have a grade of W.

Page 42: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#18#18 Persistence Fall to SpringPersistence Fall to Spring

Count of students who are majors in program at fall census and at subsequent Spring Count of students who are majors in program at fall census and at subsequent Spring semester census are enrolled and are still majors in the program. semester census are enrolled and are still majors in the program.

Removed from the count (both numerator and denominator) are program major Removed from the count (both numerator and denominator) are program major students to whom a program degree (or CA if highest credential awarded) has been students to whom a program degree (or CA if highest credential awarded) has been conferred in the reporting Fall semester.conferred in the reporting Fall semester.

Example: Example: 31 majors start in Fall31 majors start in Fall

21 majors of the original 31 persist into Spring21 majors of the original 31 persist into Spring21/31 = .6774 or 67.74%21/31 = .6774 or 67.74%

4242

Page 43: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#18a#18a Persistence Fall to FallPersistence Fall to Fall

Count of students who are majors in program at fall census and at subsequent Fall Count of students who are majors in program at fall census and at subsequent Fall semester census are enrolled and are still majors in the program. semester census are enrolled and are still majors in the program.

Removed from the count (both numerator and denominator) are program major Removed from the count (both numerator and denominator) are program major students to whom a program degree (or CA if highest credential awarded) has been students to whom a program degree (or CA if highest credential awarded) has been conferred in the first Fall, Spring or Summer reporting term.conferred in the first Fall, Spring or Summer reporting term.

Example: Example: 31 majors start in Fall31 majors start in Fall

11 majors of the original 31 persist into Fall of the next year11 majors of the original 31 persist into Fall of the next year11/31 = .3548 or 35.48%11/31 = .3548 or 35.48%

4343

Page 44: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#19#19 Unduplicated Degrees/Certificates AwardedUnduplicated Degrees/Certificates Awarded

Unduplicated headcount of students in the fiscal year reported to whom a program Unduplicated headcount of students in the fiscal year reported to whom a program degree or any certificate has been conferred. (Sum of 19a and 19b). degree or any certificate has been conferred. (Sum of 19a and 19b).

Uses most recent available freeze of fiscal year data.Uses most recent available freeze of fiscal year data.

4444

Page 45: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#19a#19a Associate Degrees AwardedAssociate Degrees Awarded

Degrees conferred in the FISCAL_YEAR_IRO.Degrees conferred in the FISCAL_YEAR_IRO.

The count is of degrees and may show duplicate degrees received in the program by The count is of degrees and may show duplicate degrees received in the program by the same student.the same student.

Uses most recent available freeze of fiscal year data. Uses most recent available freeze of fiscal year data.

FISCAL_YEAR_IRO:FISCAL_YEAR_IRO: “ “Fiscal year, where the value indicates the ending of the fiscal year. For example, a Fiscal year, where the value indicates the ending of the fiscal year. For example, a

FISCAL_YR_IRO value of 2005 indicates the fiscal year 2004‐2005 (July 1, 2004 to FISCAL_YR_IRO value of 2005 indicates the fiscal year 2004‐2005 (July 1, 2004 to June 30, 2005) which includes Summer 2004, Fall 2004, and Spring 2005 June 30, 2005) which includes Summer 2004, Fall 2004, and Spring 2005 semesters…”semesters…”

4545

Page 46: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#19b#19b Academic Subject Certificates AwardedAcademic Subject Certificates Awarded

The count is of program Academic Subject Certificates and may show multiple The count is of program Academic Subject Certificates and may show multiple Academic Subject Certificates in the same program received by the student.Academic Subject Certificates in the same program received by the student.

Uses most recent available freeze of fiscal year data. Uses most recent available freeze of fiscal year data.

4646

Page 47: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#19c#19c GoalGoal

The UH Community Colleges have established increasing the number of Associate The UH Community Colleges have established increasing the number of Associate Degrees awarded as a priority.Degrees awarded as a priority.

Beginning with the baseline of 2006 (see MAPS Degrees and Certificates Earned Beginning with the baseline of 2006 (see MAPS Degrees and Certificates Earned 2005‐2006) programs are expected to increase the number of Associate Degrees by 2005‐2006) programs are expected to increase the number of Associate Degrees by 3% compounded annually.3% compounded annually.

The number in 19c reflects the goal for the appropriate year.The number in 19c reflects the goal for the appropriate year.

Example: 127 degrees was the goal for the 1112 program year, 130 is the goal for the Example: 127 degrees was the goal for the 1112 program year, 130 is the goal for the 1213 program year (about a 3% increase).1213 program year (about a 3% increase).

4747

Page 48: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#19d#19d Difference Between Unduplicated Awarded and GoalDifference Between Unduplicated Awarded and Goal

The percent difference between the number of Associate degrees awarded (#19a) The percent difference between the number of Associate degrees awarded (#19a) and the goal (#19c).and the goal (#19c).

General Pre Professional Programs are expected to increase Associate Degrees General Pre Professional Programs are expected to increase Associate Degrees awarded by 3% compounded annually.awarded by 3% compounded annually.

Uses most recent available freeze of fiscal year data.Uses most recent available freeze of fiscal year data.

Example: The program’s goal for program year 1213 is 130 (19c). The actual number Example: The program’s goal for program year 1213 is 130 (19c). The actual number of Associate degrees awarded (19a) is 231.of Associate degrees awarded (19a) is 231.

((231-130)/130)*100 = about 78% difference between the number of unduplicated ((231-130)/130)*100 = about 78% difference between the number of unduplicated degrees awarded and the goal for associate degreesdegrees awarded and the goal for associate degrees

4848

Page 49: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#20#20 Transfers to UH 4-yrTransfers to UH 4-yr

The number of students who are home‐institution at a UH System 4‐yr institution for The number of students who are home‐institution at a UH System 4‐yr institution for the first time in Fall who were in the reporting program prior to that Fall.the first time in Fall who were in the reporting program prior to that Fall.

In the event that a student has more than one major at the college, each In the event that a student has more than one major at the college, each program/major receives the count.program/major receives the count.

An individual student may be counted in more than one program.An individual student may be counted in more than one program.

UH Maui College is included when students transfer from any UHCC program to a UH Maui College is included when students transfer from any UHCC program to a UH Maui College four year programs. Number based on Fall semester only.UH Maui College four year programs. Number based on Fall semester only.

4949

Page 50: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#20a#20a Transfers with degree from programTransfers with degree from program

Students included in #20 who have received a degree from the community college Students included in #20 who have received a degree from the community college program prior to transfer. program prior to transfer.

Does not include any certificates. Does not include any certificates.

Number based on Fall semester only.Number based on Fall semester only.

5050

#20b#20b Transfers without degree from programTransfers without degree from program

Students included in #20 who did not receive a degree from the community college Students included in #20 who did not receive a degree from the community college program prior to transfer.program prior to transfer.

Number based on Fall semester only.Number based on Fall semester only.

Page 51: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#20c#20c Increase by 3% Annual Transfers to UH 4-yr GoalIncrease by 3% Annual Transfers to UH 4-yr Goal

The UH Community Colleges have established increasing the number of The UH Community Colleges have established increasing the number of students who transfer to UH 4‐year institutions as a priority. students who transfer to UH 4‐year institutions as a priority.

Beginning with the baseline of 2006, General Pre Professional programs are Beginning with the baseline of 2006, General Pre Professional programs are expected to increase the number of students who transfer by 3% expected to increase the number of students who transfer by 3% compounded annually. compounded annually.

The number in 20c reflects the goal for the appropriate year.The number in 20c reflects the goal for the appropriate year.

Example: The annual transfer goal for program year 1112 was 62, the goal Example: The annual transfer goal for program year 1112 was 62, the goal for the 1213 program year is 64, about a 3% increase.for the 1213 program year is 64, about a 3% increase.

5151

Page 52: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#20d#20d Difference Between Transfers and GoalDifference Between Transfers and Goal

The percent difference between the number of Transfers to UH 4‐year institutions The percent difference between the number of Transfers to UH 4‐year institutions (20) and the goal (#20c).(20) and the goal (#20c).

General Pre Professional Programs are expected to increase transfers to UH 4‐year General Pre Professional Programs are expected to increase transfers to UH 4‐year institutions by 3% compounded annually.institutions by 3% compounded annually.

Example: The program’s goal is for program year 1213 was 64 (20c). The actual Example: The program’s goal is for program year 1213 was 64 (20c). The actual number of transfers (20) is 137.number of transfers (20) is 137.

((137-64)/64)*100 = about a 114% difference between the number of transfer ((137-64)/64)*100 = about a 114% difference between the number of transfer students and the goal.students and the goal.

5252

Page 53: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#21#21 Number of Distance Education Classes TaughtNumber of Distance Education Classes TaughtMeasures the number of classes taught with the mode of delivery as “Distance Measures the number of classes taught with the mode of delivery as “Distance Completely Online.”Completely Online.”

In setting up the class, the college indicates the method of instruction used by the In setting up the class, the college indicates the method of instruction used by the instructor in conducting the class. instructor in conducting the class.

If the method is Distance Education, and the college indicates the “mode” of distance If the method is Distance Education, and the college indicates the “mode” of distance delivery as “Distance Completely Online” the class will be included in this count.delivery as “Distance Completely Online” the class will be included in this count.

5353

#22#22 Enrollments Distance Education ClassesEnrollments Distance Education Classes

At the Fall and Spring census, the number of students actively enrolled in all classes At the Fall and Spring census, the number of students actively enrolled in all classes owned by the program and identified as Distance Completely On‐Line (#21).owned by the program and identified as Distance Completely On‐Line (#21).

Does not include students who at Census have already withdrawn from the class.Does not include students who at Census have already withdrawn from the class.

The number is an unduplicated count of registrations but is a duplicated count of The number is an unduplicated count of registrations but is a duplicated count of students. (e.g. If a student is enrolled in two DCO classes both are included in this students. (e.g. If a student is enrolled in two DCO classes both are included in this count.)count.)

Page 54: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#23#23 (DE) Fill Rate(DE) Fill Rate

Total active student registrations in program distance education classes (#22) Total active student registrations in program distance education classes (#22) (number of seats filled) at Fall and Spring census divided by the maximum enrollment (number of seats filled) at Fall and Spring census divided by the maximum enrollment (number of seats offered). (number of seats offered).

Excludes students who at Census have already withdrawn from the class.Excludes students who at Census have already withdrawn from the class.

5454

#24#24 (DE) Successful Completion (Equivalent C or higher)(DE) Successful Completion (Equivalent C or higher)

Percentage of students enrolled in program Distance Education classes (#22) at Fall Percentage of students enrolled in program Distance Education classes (#22) at Fall and Spring census who at end of semester have earned a grade equivalent to C or and Spring census who at end of semester have earned a grade equivalent to C or higher.higher.

#25#25 (DE) Withdrawals (Grade=W) (DE) Withdrawals (Grade=W)

Number of students actively enrolled in program Distance Education classes (#22) at Number of students actively enrolled in program Distance Education classes (#22) at Fall and Spring census who at end of semester have a grade of W.Fall and Spring census who at end of semester have a grade of W.

Page 55: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#26#26 (DE) Persistence (Fall to Spring not limited to Distance Ed) (DE) Persistence (Fall to Spring not limited to Distance Ed)

Students enrolled in program distance education classes at Fall census (#22) who at Students enrolled in program distance education classes at Fall census (#22) who at subsequent Spring semester census are enrolled in the college.subsequent Spring semester census are enrolled in the college.

Not limited to students continuing to take program distance education classes.Not limited to students continuing to take program distance education classes.

This measure provides college‐level data to inform the question, “do DE students This measure provides college‐level data to inform the question, “do DE students have lower persistence than students enrolled in non‐DE classes?”have lower persistence than students enrolled in non‐DE classes?”

Note: Distance education classes may not be offered in the Fall.Note: Distance education classes may not be offered in the Fall.

Example: Example: 31 students enrolled in DE classes in Fall31 students enrolled in DE classes in Fall

21 students of the original 31 students persist into any Spring class21 students of the original 31 students persist into any Spring class21/31 = .6774 or 67.74%21/31 = .6774 or 67.74%

5555

Page 56: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#27#27 Performance Funding: Number of DegreesPerformance Funding: Number of Degrees

Number of Degrees in the program conferred in the fiscal year.Number of Degrees in the program conferred in the fiscal year.

This is a count of credentials, not students.This is a count of credentials, not students.

Academic Subject Certificates are not counted by the UH system, so we do not count them for performance funding.Academic Subject Certificates are not counted by the UH system, so we do not count them for performance funding.

5656

#28#28 Performance Funding: Number of Degrees Native HawaiianPerformance Funding: Number of Degrees Native Hawaiian

Number of Degrees in the program conferred in the fiscal year to Native Hawaiians.Number of Degrees in the program conferred in the fiscal year to Native Hawaiians.

This is a count of credentials, not students.This is a count of credentials, not students.

Academic Subject Certificates are not counted by the UH system, so we do not count them for performance funding.

Page 57: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#29#29 Performance Funding: Number of Degrees and Certificates STEMPerformance Funding: Number of Degrees and Certificates STEM

If the CTE program is designated as a Science, Technology, Engineering, or Math If the CTE program is designated as a Science, Technology, Engineering, or Math (STEM) program, the number of degrees and certificates of achievement (or higher) (STEM) program, the number of degrees and certificates of achievement (or higher) in the program conferred in the fiscal year will be counted. in the program conferred in the fiscal year will be counted.

This is a count of credentials, not students.This is a count of credentials, not students.

If this is not a STEM program, the cell in the ARPD datasheet will display “Not If this is not a STEM program, the cell in the ARPD datasheet will display “Not STEM”.STEM”.

List of program majors identified to be STEM can be located at:List of program majors identified to be STEM can be located at:

STEM MajorsSTEM Majors

5757

Page 58: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

#31#31 Performance Funding: Number of Transfers to UH 4-yrPerformance Funding: Number of Transfers to UH 4-yr

The number of students who are home‐institution at a UH System 4‐yr institution for the The number of students who are home‐institution at a UH System 4‐yr institution for the first time in Fall whom were in the reporting program prior to that Fall.first time in Fall whom were in the reporting program prior to that Fall.

UH Maui College is included when students transfer from any UHCC program to a UH UH Maui College is included when students transfer from any UHCC program to a UH Maui College four year program. Maui College four year program.

Number based on Fall semester only.Number based on Fall semester only.

Note: At the college level, an individual student might be counted in more than one Note: At the college level, an individual student might be counted in more than one program in the event the student has had more than one major at the college. Each program in the event the student has had more than one major at the college. Each program/major receives the count. Therefore adding transfers program by program will program/major receives the count. Therefore adding transfers program by program will exceed the unduplicated college‐level transfer number reported in the Strategic Plan.exceed the unduplicated college‐level transfer number reported in the Strategic Plan.

5858

#30#30 Performance Funding: Number of PELL RecipientsPerformance Funding: Number of PELL Recipients

The number of majors who received a Pell Grant in the Academic Year beginning The number of majors who received a Pell Grant in the Academic Year beginning Fall.Fall.

Page 59: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

Comprehensive & Annual Program Review TimelineComprehensive & Annual Program Review Timeline

Develop training materials for Instructional Liberal Arts program/ Data Validation

Provide Program Review Training to Liberal Arts Instructional Programs

Publish all Comprehensive Program Reviews to Program-Unit Review WebsiteLiberal Arts

program review due to your DC and/or UHCC ARPD website by EOB Wednesday November 27th.

Follow up on last year’s list of suggested improvements for completion

Review instructional CTE glossary and health call scoring rubric and provide suggestions for improvements to system officePlan this year’s

program review based on suggested improvements from last year’s review

Evaluate ARPD online web submission site for functionality and report bugs to system office

Administer PR Process Improvement Sessions (Develop questionnaire, schedule sessions, collect feedback)

Work with Process Improvement Team to determine what feedback needs to be taken back to UHCC IPRC

Develop/update documentation for website needed for program review

Sept

OctAug-Sept Jan 27th

Dec 20th

Jan 25th

Sept

SeptAug Nov 27Sept-Oct

5959

Send Campus-wide update on program review process with link to data and due date

Sept

Summarize PR Process Improvement Feedback, communicate results to groups, publish to web.

Jan 5thNov 28

VCAA collects all annual Unit reviews and forwards on to IR to submit to system office as required.

Page 60: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

Questions?Questions?

The intention of this presentation was to provide a single source for all of the The intention of this presentation was to provide a single source for all of the documentation related to the Annual Reports for Program Data —specifically for the documentation related to the Annual Reports for Program Data —specifically for the Liberal Arts program. All of the documents you should need for your ARPD review Liberal Arts program. All of the documents you should need for your ARPD review have been linked directly into this presentation.have been linked directly into this presentation.

As always, your feedback regarding this process is essential in making improvements As always, your feedback regarding this process is essential in making improvements year over year. Please take a moment to provide feedback at the end of this process.year over year. Please take a moment to provide feedback at the end of this process.

Those wishing to print this presentation without color may set their printer settings to Those wishing to print this presentation without color may set their printer settings to print in “grayscale,” and set to print in portrait orientation, if desired.print in “grayscale,” and set to print in portrait orientation, if desired.

If you need more information on this process please feel free to contact me:If you need more information on this process please feel free to contact me:

HawCC Institutional Analyst HawCC Institutional Analyst Shawn FloodShawn Flood 934-2648934-2648

Mahalo!Mahalo!

6060

Page 61: AY 2013 LBRT Instructional Program Review Process Data Description Process – Timeline Rev. 10-18-13

Annual Report of Program DataAnnual Report of Program DataSLOs AssessmentSLOs Assessment

If you need assistance with the If you need assistance with the P-SLO TabP-SLO Tab information please contact: information please contact:

James KileyJames KileyInstitutional Assessment CoordinatorInstitutional Assessment Coordinator Email: [email protected]: [email protected]: 934-2649Phone: 934-2649

Mahalo!Mahalo!

6161