17Acad AP152 152 Computer Aided Design-Cert Cert
Priority for Substantial Modification
Average: 2.550 Range: 1.550
1. ALIGNMENT
Reviewer: 1 Score: 3 Weighted Score: 0.6
- the program claims to align with the Plans's Values but does not provide evidence or further
explanation
- does not explain how a reduction of their resources would weaken the University's ability to achieve
its mission
- doesn't fully explain how they are essential to UM
- the CAD program aligns with the UM2020 Plan by providing hands-on practical experience with
business and industry to prepare their students for a global society
- explains in great detail how their program prepares students for the cultural, social and workforce
needs of the 21st century
Strengths:
Weaknesses:
Reviewer: 2 Score: 2 Weighted Score: 0.4
Does not address how the program has addressed the UM2020 Strategic Plan. This report does not
explain how essential this program is to UM or how reduction of resources would weaken the
University’s ability to achieve its mission
Addresses how this program prepares students with skills needed for the workforce.Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.8
* Report does not adequately address the UM 2020 values of diversity and sustainability.
* Could have used more specific examples of how program addresses UM 2020 values of leadership
and engagement.
* Could have specifically addressed how CAD certificate program is essential to UM "to achieve its
mission."
* Report adequately addresses the UM 2020 values of leadership and engagement.
* CAD certificate program provides students with a set of highly desired skills.
Strengths:
Weaknesses:
2. Demand
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
2 2 0.4 3 0.45 3 0.6 3 0.6 4 0.4 1 0.15 2.6Reviewer:
1 3 0.6 2 0.3 1 0.2 2 0.4 1 0.1 1 0.15 1.75Reviewer:
3 4 0.8 4 0.6 1 0.2 4 0.8 3 0.3 4 0.6 3.3Reviewer:
Ranking Category:
Consider for Development and/or Modification: 1
Priority for Substantial Modification: 15
Priority for Devlopment and Growth: 0
Total Count: 16
Page 1 of 14511/13/2017
17Acad AP152 152 Computer Aided Design-Cert Cert
Priority for Substantial Modification
Reviewer: 1 Score: 2 Weighted Score: 0.3
- does not provide evidence for its existing collaborations or interdisciplinary activities
- does not show how STEM programs will be impacted by a reduction in size
- collaborates with other STEM programsStrengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.45
The quintile for non-majors is 2. Assessment does not explain how or what programs would be
impacted if it were reduced or curtailed.
-Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.6
* Report does not adequately address the questions for bullet 2 of this criteria (Impacts on other
programs if program was reduced).
Centralized data:
None provided
Bullet 1 (Existing collaborations or interdisciplinary activities):
* Students in electronics, arts and sciences, and industrial technology at MC also take CAD courses.
* Technical drafting course fulfills a general education requirement.
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 1 Weighted Score: 0.2
- responded N/A for all bullets, though they mention research by faculty members in Criteria 4
- responded with N/A for all bulletsStrengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.6
Trends on number of majors rank this program in the 2nd quintile. There is no statement of whether to
expect this program to grow or continue to shrink in number of students.
Number of majors place this program in the 4th quintile.
Number of certificates awarded and the 5 yr trend indicates that the number remains consistent with
no significant increase or decrease in numbers.
Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
No responses given for this criteria.
No centralized data
No responses
Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 2 Weighted Score: 0.4
- no evidence provided for student outcomes
- no evidence provided for faculty outcomes
- the program is preparing for the Accreditation Board for Engineering and Technology accreditation,
but does not say if it currently is
Strengths:
Weaknesses:
Page 2 of 14511/13/2017
17Acad AP152 152 Computer Aided Design-Cert Cert
Priority for Substantial Modification
Reviewer: 2 Score: 3 Weighted Score: 0.6
Central data is unable to provide information on the time it takes for a student to complete this “1 yr”
certificate and this is not addressed by the report writer.
Unclear how close the program is to meeting the ABET accreditation requirements.
Student outcomes are fair.
Report indicates ongoing professional development for faculty. No benchmarks noted. States that there
are collaborations with other programs but is not specific.
The program has been preparing for the ABET accreditation.
Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.8
* I’m not sure if this program is currently accredited.
* I would have liked to see a breakdown or specific numbers with respect to faculty research in this
program-- a more direct response to the question of the quality of faculty outcomes.
* I would have liked to see a breakdown or specific numbers on student outcome quality.
Centralized data:
None provided
Bullet 1 (Quality of student outcomes):
* Most graduates of this program go on to work in engineering fields and/or go on to bachelors or
masters programs in engineering.
Bullet 2 (Quality of faculty outcomes):
* Faculty participate in conferences, workshops, and certification programs
* One faculty member serves as an examination administrator for the Electronics Technician
Association International certificate test.
Bullet 3 (Accreditation information):
Program is preparing for accreditation through the Accreditation Board for Engineering and
Technology.
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 1 Weighted Score: 0.1
- simply claimed that they have experienced a faculty reduction, but no further explanation
- did not identify an effort to improve efficiency
- did not explain how an admin FTE position impacts the efficiency of their program
- added a new course to strengthen the programStrengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.4
The program has experienced employee reduction but has developed a new course designed to
“strengthen” the program.
It is unclear how much this program costs to maintain or how much revenue it brings in.
-Strengths:
Weaknesses:
Page 3 of 14511/13/2017
17Acad AP152 152 Computer Aided Design-Cert Cert
Priority for Substantial Modification
Reviewer: 3 Score: 3 Weighted Score: 0.3
* No specifics given on employee reduction or further explanation how the new course improves
efficiency.
Centralized data:
None provided
Bullet 1 (Impact of changes in revenue or expenses):
* Program has experienced employee reduction.
Bullet 2 (Efforts to improve efficiency):
* A new course has been developed and offered.
Bullet 3 (Administrative FTE information):
* Department shares an administrative staff member with business technology.
Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 1 Weighted Score: 0.15
- does not explain how their program could contribute to the Strategic Vision
- does not explain how their program could contribute to establishing UM as a leader in
interdisciplinary areas of inquiry
- does not explain how their one opportunity for restructuring would promote efficiency or enhance
performance
xStrengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.15
Does not address alignment with UM Strategic Vision.
Does not answer the question regarding opportunity for restructuring.
Does not answer how allocation of additional resources would help.
States that faculty have been working to strengthen the existing certification program.Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.6
Report does not adequately answer the questions posed in bullet 1 of this criteria with respect to the
Strategic opportunities in UM Strategic Vision.
Report does not adequately answer the questions posed in bullet 4 of this criteria with respect to the
allocation of additional resources to the program.
Bullet 2 (Establishing UM as a leader in interdisciplinary areas):
CAD certificate program is inherently interdisciplinary.
Bullet 3 (Restructuring opportunities):
Faculty of this program want to expand it to a full Associate of Applied Science degree.
Strengths:
Weaknesses:
Page 4 of 14511/13/2017
17Acad AP152 152 Computer Aided Design-Cert Cert
Priority for Substantial Modification
Page 5 of 14511/13/2017
17Acad AP153 153 Computer Support-Cert Cert
Priority for Substantial Modification
Average: 1.000 Range: 0.000
1. ALIGNMENT
Reviewer: 1 Score: 1 Weighted Score: 0.2
According to this report, this program should not be assessed. It states "See Unit of Analysis 158
Information Technology."
According to this report, this program should not be assessed. It states "See Unit of Analysis 158
Information Technology."
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
- Report blank, author believes the program should be evaluated as part of AAS degree in Information
Technology (AP #158)
None seenStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
Failed to report
None observedStrengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 1 Weighted Score: 0.15
According to this report, this program should not be assessed. It states "See Unit of Analysis 158
Information Technology."
According to this report, this program should not be assessed. It states "See Unit of Analysis 158
Information Technology."
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.15
- Report blank, author believes the program should be evaluated as part of AAS degree in Information
Technology (AP #158)
None seenStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.15
Failed to report
None observedStrengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 1 0.2 1 0.15 1 0.2 1 0.2 1 0.15Reviewer:
3 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:
2 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:
Ranking Category:
Consider for Development and/or Modification: 2
Priority for Substantial Modification: 13
Priority for Devlopment and Growth: 0
Total Count: 15
Page 6 of 14511/13/2017
17Acad AP153 153 Computer Support-Cert Cert
Priority for Substantial Modification
3. Productivity
Reviewer: 1 Score: 1 Weighted Score: 0.2
According to this report, this program should not be assessed. It states "See Unit of Analysis 158
Information Technology."
According to this report, this program should not be assessed. It states "See Unit of Analysis 158
Information Technology."
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
- Report blank, author believes the program should be evaluated as part of AAS degree in Information
Technology (AP #158)
None seenStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
Failed to report
None observedStrengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 1 Weighted Score: 0.2
According to this report, this program should not be assessed. It states "See Unit of Analysis 158
Information Technology."
According to this report, this program should not be assessed. It states "See Unit of Analysis 158
Information Technology."
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
- Report blank, author believes the program should be evaluated as part of AAS degree in Information
Technology (AP #158)
None seenStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
Failed to report
None observedStrengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: Weighted Score:
According to this report, this program should not be assessed. It states "See Unit of Analysis 158
Information Technology."
According to this report, this program should not be assessed. It states "See Unit of Analysis 158
Information Technology."
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.1
- Report blank, author believes the program should be evaluated as part of AAS degree in Information
Technology (AP #158)
None seenStrengths:
Weaknesses:
Page 7 of 14511/13/2017
17Acad AP153 153 Computer Support-Cert Cert
Priority for Substantial Modification
Reviewer: 3 Score: 1 Weighted Score: 0.1
Failed to report
None observedStrengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 1 Weighted Score: 0.15
According to this report, this program should not be assessed. It states "See Unit of Analysis 158
Information Technology."
According to this report, this program should not be assessed. It states "See Unit of Analysis 158
Information Technology."
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.15
- Report blank, author believes the program should be evaluated as part of AAS degree in Information
Technology (AP #158)
None seenStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.15
Failed to report
None observedStrengths:
Weaknesses:
Page 8 of 14511/13/2017
17Acad AP154 154 Cybersecurity-Cert Cert
Priority for Substantial Modification
Average: 1.000 Range: 0.000
1. ALIGNMENT
Reviewer: 1 Score: 1 Weighted Score: 0.2
No information.
No explanation.Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
Does not describe program.
Explains this is not a standalone program and refers all data to Unit of Analysis 158.Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
N/A
N/A provided no information. I am unable to access the report readers were referred to read.Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 1 Weighted Score: 0.15
Ranked in the 1st quintile for 5ya of SCH for Gen-Ed. 5YA of SCH ratio of non-majors to total in 2nd
quintile.
No valuable information.Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.15
Does not address.
Refers to Unit of Analysis Data 158. Data for 154 is in low quintiles.Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.15
N/A
N/AStrengths:
Weaknesses:
3. Productivity
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
2 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:
3 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:
1 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:
Ranking Category:
Consider for Development and/or Modification: 1
Priority for Substantial Modification: 14
Priority for Devlopment and Growth: 0
Total Count: 15
Page 9 of 14511/13/2017
17Acad AP154 154 Cybersecurity-Cert Cert
Priority for Substantial Modification
Reviewer: 1 Score: 1 Weighted Score: 0.2
No data available.
N/AStrengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
Does not address.
Refers to Unit of Analysis Data 158. Data for 154 is in low quintiles.Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
N/A
too soon to tell.Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 1 Weighted Score: 0.2
No data available.
No information.Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
Does not address.
0's for quintiles. No explanation of data.Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
N/A
N/AStrengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 1 Weighted Score: 0.1
No data available.
No Data Available.Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.1
Does not address.
0's for quintiles. No explanation of data.Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.1
N/A
N/AStrengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 1 Weighted Score: 0.15
No Information.
No Information.Strengths:
Weaknesses:
Page 10 of 14511/13/2017
17Acad AP154 154 Cybersecurity-Cert Cert
Priority for Substantial Modification
Reviewer: 2 Score: 1 Weighted Score: 0.15
Does not address.
Does not address.Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.15
N/A
N/AStrengths:
Weaknesses:
Page 11 of 14511/13/2017
17Acad AP155 155 Electronics Technology-2Y 2Y
Priority for Substantial Modification
Average: 3.750 Range: 4.350
1. ALIGNMENT
Reviewer: 1 Score: 5 Weighted Score: 1
N/A
* Engineering technology emphasisStrengths:
Weaknesses:
Reviewer: 2 Score: 8 Weighted Score: 1.6
•Could have included more specifics on Leadership, Engagement and Sustainability.
•Continuous improvements to Electronics Labs.
•Promote culture outreach and internationalization through the collaboration with the International
Center
•Interdisciplinary STEM program with an engineering technology emphasis at UM.
•Addresses how the program prepares students for workforce needs of the 21st century with clearly
defined objective.
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
•Report does not explain how reduction of resources would weaken UM’s overall ability to achieve its
mission.
•Report suggests program aligns with some aspects of UM’s mission: Program focuses on cutting-edge
technology with a global perspective (Electronics Lab, collaborates with International Center for
outreach, preparing students for 21st-century workforce)
•“Program is one of few STEM programs with engineering technology emphasis at UM.”
•Prepares students for needs of 21st century through abilities to: utilize information technology; to
troubleshoot of electronic components; to solve technical problems involving mathematics; to utilize
instrumentation to measure, calibrate, test, and repair electronic components; to engage in project
management and hands-on skills.
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 4 Weighted Score: 0.6
* Stopped accepting students into the program
N/AStrengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 5 1 4 0.6 1 0.2 3 0.6 3 0.3 4 0.6 3.3Reviewer:
3 5 1 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1.8Reviewer:
2 8 1.6 6 0.9 5 1 7 1.4 5 0.5 5 0.75 6.15Reviewer:
Ranking Category:
Consider for Development and/or Modification: 1
Priority for Substantial Modification: 15
Priority for Devlopment and Growth: 0
Total Count: 16
Page 12 of 14511/13/2017
17Acad AP155 155 Electronics Technology-2Y 2Y
Priority for Substantial Modification
Reviewer: 2 Score: 6 Weighted Score: 0.9
•Could have directly addressed student needs or faculty performance.
•Constant collaborations and interdisciplinary activities with other programs such as energy
technology and industrial technology and departments like media arts, music, and psychology.
•One of the few interdisciplinary STEM programs with an engineering technology emphasis.
Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.15
•Report provides minimal information, addressing certain bullet points with only 1-2 sentences.
•Report does not identify potential impacts on OTHER programs. Only states: “The impacts have
already been seen since the UM stopping accepting new students for the program.”
•Program is an interdisciplinary STEM program, collaborating with energy technology, industrial
technology, media arts, music, psychology.
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 1 Weighted Score: 0.2
No Supporting data
N/AStrengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
•Does not include information on outreach or how the program measures productivity.
•Emphasis on program solving, creative and analytics thinking, hands-on skill and project
management.
•Includes lab courses, course-level projects, capstone projects and internships
Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
* Program includes only one sentence in answer to this criterion.
* N/AStrengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 3 Weighted Score: 0.6
* Not Accredited
* No Student outcome data provided
* Faculty dedicated to maintaining high professional standardsStrengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.4
•Could have included information on student placement of graduates or exit surveys.
•Significant laboratory components for quality teaching, hands-on training and effective learning.
•Provides a solid foundation in analog and digital electronics, extensive knowledge in specialized
fields of electronics, cross discipline knowledge in computer programming, energy tech, IT. Includes
software application and programming.
•Accredited by ABET (Accreditation Board for Engineering and Technology)
Strengths:
Weaknesses:
Page 13 of 14511/13/2017
17Acad AP155 155 Electronics Technology-2Y 2Y
Priority for Substantial Modification
Reviewer: 3 Score: 1 Weighted Score: 0.2
•Report does not provide any evidence of the quality of student or faculty outcomes. Student
outcomes are not discussed at all, while faculty outcomes are touched upon only in the broadest of
terms.
•Program refers to sources outside the report, e.g., “As shown in the [unprovided] biographies of the
faculty members.”
N/AStrengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 3 Weighted Score: 0.3
* Limited quantitative data provided
* Using updated technological resources to improve delivery and efficienciesStrengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 0.5
•Could have provided more information on the duties of the Administrative Associate.
•Provide more examples of collaborations with other departments.
•Use of software for design, analysis and implementation of electronic circuits and systemsStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.1
•Program demonstrates little effort to improve efficiency.
•First bullet point is largely ignored, stating only that the program “has experienced employee
reductions in recent years.”
•Instead of discussing efforts to improve efficiency, report discusses efforts to improve quality of
instruction.
N/AStrengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 4 Weighted Score: 0.6
N/A
* provides unique learning opportunity for studentsStrengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 0.75
•Provide more examples for new strategic opportunities for Criteria 6 – Bullet 1
•Provide more examples of interdisciplinary opportunities.
•Enhance education pathways through Big Sky Pathways to promote students’ continuous education
to 4-year universities.
Strengths:
Weaknesses:
Page 14 of 14511/13/2017
17Acad AP155 155 Electronics Technology-2Y 2Y
Priority for Substantial Modification
Reviewer: 3 Score: 1 Weighted Score: 0.15
•Program offers minimal opportunities to enhance UM.
•Program has copied and pasted entire answer from Bullet 1 Criterion 1 (UM2020) into this criterion
(Creating Change Together), demonstrating it isn’t aware that there are two different mission
statements.
•Program does not discuss how it could contribute to establishing UM as a leader in interdisciplinarity
of state-wide needs; rather, it discusses what it does to improve retention.
•Program does not identify an opportunity for restructuring; rather, it discusses how to improve the
quality of instruction (copied and pasted from answer to Criteria 5, Bullet 2)
N/AStrengths:
Weaknesses:
Page 15 of 14511/13/2017
17Acad AP156 156 Energy Technology-2Y 2Y
Priority for Substantial Modification
Average: 2.800 Range: 4.600
1. ALIGNMENT
Reviewer: 1 Score: 1 Weighted Score: 0.2
The Energy Technology program has no students, no faculty, no graduates and appears to spend more
out of its designated account then it is generating. The program is currently on a moratorium but the
author did not mention that or how the program could be revised and restructured.
The Energy Technology program has no students, no faculty, no graduates and appears to spend more
out of its designated account then it is generating. The program is currently on a moratorium but the
author did not mention that or how the program could be revised and restructured.
Strengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.6
The program does not reference UM2020 or how it aligns with that strategic vision.
The program outlines their goals to fulfill UM's mission- "The curriculum provides hands-on, practical
experience with real-world applications, as well as developmental coursework to ensure that students
are prepared to succeed in the college environment and in the field" This program is a STEM focus.
Strengths:
Weaknesses:
Reviewer: 3 Score: 8 Weighted Score: 1.6
Although the program mentions outreach to local communities and international students, I would
like to see more outreach to the tribal communities.
This is an important vocational program which can produce graduates who can:
1) obtain well-paid employment in the local communities;
2) be on the forefront of energy alternatives
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 1 Weighted Score: 0.15
The Energy Technology program has no students, no faculty, no graduates and appears to spend more
out of its designated account then it is generating. The program is currently on a moratorium but the
author did not mention that or how the program could be revised and restructured.
The Energy Technology program has no students, no faculty, no graduates and appears to spend more
out of its designated account then it is generating. The program is currently on a moratorium but the
author did not mention that or how the program could be revised and restructured.
Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
3 8 1.6 5 0.75 5 1 5 1 5 0.5 5 0.75 5.6Reviewer:
1 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:
2 3 0.6 2 0.3 1 0.2 1 0.2 2 0.2 2 0.3 1.8Reviewer:
Ranking Category:
Consider for Development and/or Modification: 0
Priority for Substantial Modification: 16
Priority for Devlopment and Growth: 0
Total Count: 16
Page 16 of 14511/13/2017
17Acad AP156 156 Energy Technology-2Y 2Y
Priority for Substantial Modification
Reviewer: 2 Score: 2 Weighted Score: 0.3
The program does not describe their internal, or external demands in any depth. They reference
anecdotal evidence of interdisciplinary nature, but nothing specific.
"There are constant collaborations and interdisciplinary activities with other programs (such as
electronics technology, industrial technology), departments (such as physics, chemistry and
biochemistry),, and local industry and community, such as capstone projects, internship, course
sharing, and etc"
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 0.75
See above.
This is confusing, since there is a mention in the narrative about a UM decision not to accept new
students. Was this because of the new construction of MC or another reason?
Just like all vocational programs, the demand is often dependent on the unemployment rate. In times
of high unemployment, students will seek training to make themselves more competitive, and in low
unemployment, if it is possible to get work without formal education, many potential students will
take that route.
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 1 Weighted Score: 0.2
The Energy Technology program has no students, no faculty, no graduates and appears to spend more
out of its designated account then it is generating. The program is currently on a moratorium but the
author did not mention that or how the program could be revised and restructured.
The Energy Technology program has no students, no faculty, no graduates and appears to spend more
out of its designated account then it is generating. The program is currently on a moratorium but the
author did not mention that or how the program could be revised and restructured.
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
There is no explanation of productivity, or data to analyze.
"Dr. Bradley Layton has received a grant from the National Science Foundation."Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
Hard to assess.
NSF grant.
The central data show no contract instructors. Therefore, hard to assess this.
Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 1 Weighted Score: 0.2
The Energy Technology program has no students, no faculty, no graduates and appears to spend more
out of its designated account then it is generating. The program is currently on a moratorium but the
author did not mention that or how the program could be revised and restructured.
The Energy Technology program has no students, no faculty, no graduates and appears to spend more
out of its designated account then it is generating. The program is currently on a moratorium but the
author did not mention that or how the program could be revised and restructured.
Strengths:
Weaknesses:
Page 17 of 14511/13/2017
17Acad AP156 156 Energy Technology-2Y 2Y
Priority for Substantial Modification
Reviewer: 2 Score: 1 Weighted Score: 0.2
The program does not provide any evidence to asses its quality as a program, or any data to analyze.
The program describes their value based on good faculty and hands-on curriculum.Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
See above.
Again, difficult to assess because the structure of the program is not laid out either by central data or
by narrative. The program is preparing for accreditation.
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 1 Weighted Score: 0.1
The Energy Technology program has no students, no faculty, no graduates and appears to spend more
out of its designated account then it is generating. The program is currently on a moratorium but the
author did not mention that or how the program could be revised and restructured.
The Energy Technology program has no students, no faculty, no graduates and appears to spend more
out of its designated account then it is generating. The program is currently on a moratorium but the
author did not mention that or how the program could be revised and restructured.
Strengths:
Weaknesses:
Reviewer: 2 Score: 2 Weighted Score: 0.2
The program does no outline how they have become more efficient with their use of faculty lines.
The program shares 1 administrative service personnel with another program. They have collaborated
with a number of other programs at the Missoula College.
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 0.5
See above.
Since no costs related to faculty are listed, difficult to assess efficiency.Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 1 Weighted Score: 0.15
The Energy Technology program has no students, no faculty, no graduates and appears to spend more
out of its designated account then it is generating. The program is currently on a moratorium but the
author did not mention that or how the program could be revised and restructured.
The Energy Technology program has no students, no faculty, no graduates and appears to spend more
out of its designated account then it is generating. The program is currently on a moratorium but the
author did not mention that or how the program could be revised and restructured.
Strengths:
Weaknesses:
Reviewer: 2 Score: 2 Weighted Score: 0.3
The program did not mention the Strategic Vision 1.1 in the report, or how they would align with this.
The program copy and pasted repeated information in this criteria that was irrelevant.
The program wants to utilize retention methods.Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 0.75
See above.
This program should have strong possibilities, if it has regular staff. Even if it relies on courses and
instructors from outside the program, staff is still necessary to coordinate it.
Strengths:
Weaknesses:
Page 18 of 14511/13/2017
17Acad AP156 156 Energy Technology-2Y 2Y
Priority for Substantial Modification
Page 19 of 14511/13/2017
17Acad AP157 157 Health Information Technology -Cert Cert
Priority for Substantial Modification
Average: 1.600 Range: 1.200
1. ALIGNMENT
Reviewer: 1 Score: 1 Weighted Score: 0.2
-No data, narrative provided to assess strengths or weaknesses.
-The academic curriculum is a subset of courses found in the 2-year AAS degree in Information
Technology.
-No data, narrative provided to assess strengths or weaknesses.
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
I cannot assess this program as it did not respond.
I cannot assess this program as it did not respond.Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
none
Fits well with UMHMStrengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 1 Weighted Score: 0.15
-No data, narrative provided to assess strengths or weaknesses.
-The academic curriculum is a subset of courses found in the 2-year AAS degree in Information
Technology.
-No data, narrative provided to assess strengths or weaknesses.
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.15
I cannot assess this program as it did not respond.
I cannot assess this program as it did not respond.Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.15
All data seems to be zero, authors argues to relate to another unit of analysis
noneStrengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
3 5 1 1 0.15 1 0.2 1 0.2 5 0.5 1 0.15 2.2Reviewer:
2 1 0.2 1 0.15 1 0.2 1 0.2 1 0.15Reviewer:
1 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:
Ranking Category:
Consider for Development and/or Modification: 0
Priority for Substantial Modification: 13
Priority for Devlopment and Growth: 0
Total Count: 13
Page 20 of 14511/13/2017
17Acad AP157 157 Health Information Technology -Cert Cert
Priority for Substantial Modification
3. Productivity
Reviewer: 1 Score: 1 Weighted Score: 0.2
-No data, narrative provided to assess strengths or weaknesses.
-The academic curriculum is a subset of courses found in the 2-year AAS degree in Information
Technology.
-No data, narrative provided to assess strengths or weaknesses.
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
I cannot assess this program as it did not respond.
I cannot assess this program as it did not respond.Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
All data seems to be zero, authors argues to relate to another unit of analysis
noneStrengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 1 Weighted Score: 0.2
-No data, narrative provided to assess strengths or weaknesses.
-The academic curriculum is a subset of courses found in the 2-year AAS degree in Information
Technology.
-No data, narrative provided to assess strengths or weaknesses.
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
I cannot assess this program as it did not respond.
I cannot assess this program as it did not respond.Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
All data seems to be zero, authors argues to relate to another unit of analysis
noneStrengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 1 Weighted Score: 0.1
-No data, narrative provided to assess strengths or weaknesses.
-The academic curriculum is a subset of courses found in the 2-year AAS degree in Information
Technology.
-No data, narrative provided to assess strengths or weaknesses.
Strengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
I cannot assess this program as it did not respond.
I cannot assess this program as it did not respond.Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 0.5
Question is, does anybody get the certificate? Does anybody get a reduced load to help manage the
cert?
noneStrengths:
Weaknesses:
Page 21 of 14511/13/2017
17Acad AP157 157 Health Information Technology -Cert Cert
Priority for Substantial Modification
6. OPPORTUNITY
Reviewer: 1 Score: 1 Weighted Score: 0.15
-No data, narrative provided to assess strengths or weaknesses.
-The academic curriculum is a subset of courses found in the 2-year AAS degree in Information
Technology.
-No data, narrative provided to assess strengths or weaknesses.
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.15
I cannot assess this program as it did not respond.
I cannot assess this program as it did not respond.Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.15
Can't tell from the writeup
noneStrengths:
Weaknesses:
Page 22 of 14511/13/2017
17Acad AP158 158 Information Technology-2Y 2Y
Consider for Development and/or Modification
Average: 5.017 Range: 0.950
1. ALIGNMENT
Reviewer: 1 Score: 6 Weighted Score: 1.2
This program does align with some aspects but is not exemplary in any particular areas
: engaged in dual-enrollment and curriculum sharing with high schools IT provides responsive two-
year programming using partnerships, Discovery and Creativity to Serve Montana and the World,
Computer and Information Technology careers continue to grow at a faster than average rate than
other occupations
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 1.2
•connection between industry certification and creative scholarship is not clear.
•program addresses high area of workforce demand in the region.
•contributes a number of dual enrollment classes
•strong description of the 2-year college contribution to UM2020 strategy
Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.8
Does not address how the program supports the UM2020 core values.
Clearly identifies strategies for supporting the initiatives outline in the UM 2020 Strategic Plan
This program strives to meet the demands of the growing IT field. This sector continues to be in
demand and provides a higher than average wage for professionals.
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 7 Weighted Score: 1.05
: Doesn’t offer any gen-ed courses and doesn’t address demand from students outside of the program,
partnership with Computer Science and the College of Education, program is the first of its kind in the
State and provides students with teacher licensure in the area, partnering with the School of Business
MIS
Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 6 1.2 7 1.05 3 0.6 5 1 7 0.7 6 0.9 5.45Reviewer:
2 6 1.2 6 0.9 5 1 5 1 4 0.4 4 0.6 5.1Reviewer:
3 4 0.8 4 0.6 5 1 4 0.8 4 0.4 6 0.9 4.5Reviewer:
Ranking Category:
Consider for Development and/or Modification: 14
Priority for Substantial Modification: 0
Priority for Devlopment and Growth: 1
Total Count: 15
Page 23 of 14511/13/2017
17Acad AP158 158 Information Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 2 Score: 6 Weighted Score: 0.9
•asserts that reduction of program would limit opportunity for good careers, but lacks support
•collaboration with Computer Science and Education for Comp Sci teaching minor and working to
revise cybersecurity credential with SOBA
•highest number of graduates at MC after Nursing.
Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.6
Data is “difficult to interpret due to its entanglesment with other programs of study in the
Department.” Some of which have been discontinued.
Identifies collaborations with other UM programs.Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 3 Weighted Score: 0.6
uses the CBA, which is not unique to any unit, to define productivity rather than self identifying what
is important to the program and faculty and students in that program
all faculty are required to perform creative scholarship, workloads of 15 credits a semester,Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
•examples of “creative scholarship” are under-developed. need define "creative scholarship and
explain how industry certification contributes to it
•decent examples of service at the college.
•credits of instruction are demanding: 15 per semester with an allowance made for the program
director.
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
The trend indicates a decline in the number of majors and graduates in this program.
An example for each faculty member is included but does not clearly communicate the full effort of
each faculty member in creative scholarship.
The same can be said of service.
No benchmarks provided regarding the instructional component.
Program is among the highest in terms of number of graduates at Missoula College. The graduation
trend and number of majors are in the 5th quintile.
The decline in the number of majors in this program may be impacted by MC students ability to
declare a single major limiting accurate tracking of data for certificates.
Tenured faculty at MC are required to perform creative scholarship and service.
Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 5 Weighted Score: 1
lack of publications as well as conference participation, doesn’t address student or faculty outcomes
Completion of an internship is a gradation requirement for all IT students, Faculty use survey results
to improve instructional design, content, and delivery, external industry advisory committee of
employers meets regularly to provide input and feedback for program of study
Strengths:
Weaknesses:
Page 24 of 14511/13/2017
17Acad AP158 158 Information Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 2 Score: 5 Weighted Score: 1
•limited information about what would be required for accreditation.
•pass rates for external exams are varied and inconclusive without additional detail.
•survey of student performance during an internship indicates well qualified/prepared students.
•completion of industry standards demonstrate faculty outcomes
•would welcome accreditation
Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.8
Student outcomes are reported as good but the assessment of these outcomes are generalized and
estimated. It is unclear how student outcomes compare to national standards.
No benchmarks to compare the quality of faculty outcomes to.
This program does not qualify for accreditation.
On average, it takes more than two years to complete this program. This still puts this program in the
3rd quintile for 5YA time to degree.
Faculty would support the goal of program accreditation.
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 7 Weighted Score: 0.7
47% of course for IIT program is taught by adjunct faculty, Missoula College is nearing a 60% ratio of
adjunct faculty, Budget reductions for the college has jeopardized the quality of programs,
Have made significant efforts to improve efficiencyStrengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.4
•acknowledges significant budget cuts at the college – but generalizes the problems associated with
cuts across the college rather than specifying direct impacts on program.
•no efficiency measures mentioned; points out that the instructional FTE down 50%
•data shows that despite loss of instructional FTE, still numerous students served.Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.4
The need to increase adjunct faculty instructors may have impacted the quality of this program but
lack of assessment history makes this unclear.
Cuts in positions are not equivalent to an increase in efficiency.
Program as inadequate administrative support. Services that have been centralized are not explained.
-Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 6 Weighted Score: 0.9
Program is already struggling significantly due to lack of funds
This program could grow significantly to meet a need in the market as well as provide students to
programs on the mountain campus but struggle die to budgetary restrictions.
Strengths:
Weaknesses:
Page 25 of 14511/13/2017
17Acad AP158 158 Information Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 2 Score: 4 Weighted Score: 0.6
•refers to MUS goals rather than UM Strategic Vision. no details/specifics support the assertion that
the program doesn’t fill workforce demands.
•restructuring: developing a program for cybersecurity credential seems like a strong Criteria 6 Bullet
1 opportunity, but unclear how it represents restructuring.
•designated Cybersecurity Center of Academic Excellence by the NSA and DHS – (would have
expected this to be mentioned also under Quality outcomes?)
•strong case to be made for improving the instructional FTE situation in terms of adjunct vs tt lines.
Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 0.9
It is clear that this program has been negatively impacted by cuts and the decline in enrollment may be
a result of those cuts. Without adequate support this program will likely continue to decline despite
the efforts of the faculty.
Program was recently selected as a Cybersecurity Center. Of Academic Excellence by the National
Security Agency (NSA) and Department of Homeland Security. (DHS)
Plans to restructure the program to award more students a Cybersecurity credential (certificate) and
expanding that opportunity to other UM students.
Strengths:
Weaknesses:
Page 26 of 14511/13/2017
AP159 159 Recycling Technology-Cert Cert
Priority for Substantial Modification
Average: 1.000 Range: 0.000
No Report Submitted Insufficient Evidence
1. ALIGNMENT
Reviewer: 1 Score: 1 Weighted Score: 0.2
· No report submitted
· None seenStrengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
· No abstract provided.
· No abstract provided.Strengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 1 Weighted Score: 0.15
· No report submitted • Departmental metrics for criteria are in Q1 for SCH for GenEd, 0’s for per
instructional FTE, and Q2 for SCH ratio of non-majors
· None seenStrengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.15
· Decrease in students on 5YA. • No GenEd for Instructional FTE
· Quintile score of 1.Strengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 1 Weighted Score: 0.2
· No report submitted • Number of majors 0 over 5 years, however 2 degrees awarded in 2016?
• All quintiles for data are in Q0 due to lacking data for all 5 years
· None seenStrengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:
2 1 0.2 1 0.15 1 0.2 1 0.1 1 0.15Reviewer:
3Reviewer:
Page 27 of 14511/13/2017
AP159 159 Recycling Technology-Cert Cert
Priority for Substantial Modification
Reviewer: 2 Score: Weighted Score:
Strengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 1 Weighted Score: 0.2
· No report submitted • All data 0’s across 5 years
None seenStrengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
· Decrease in 5YA for student FTE/instructional FTE ration from 10.5 in 2013 to 0 in 2015.
· No abstract provided.Strengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 1 Weighted Score: 0.1
· No report submitted • Per FTE metric results only for 2013 then 0’s the rest resulting in Q0 for
all metrics
· None SeenStrengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.1
· There is still $40,460 of Total Personnel Costs (w/o benefits) in 2014 but no Instructional Faculty
FTE. Who is getting paid this?
· No abstract provided.Strengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 1 Weighted Score: 0.15
· No report submitted
None seenStrengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.15
· No abstract provided.
· No abstract provided.Strengths:
Weaknesses:
Page 28 of 14511/13/2017
AP159 159 Recycling Technology-Cert Cert
Priority for Substantial Modification
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Page 29 of 14511/13/2017
17Acad AP160 160 General AA-2Y 2Y
Consider for Development and/or Modification
Average: 5.467 Range: 0.750
1. ALIGNMENT
Reviewer: 1 Score: 4 Weighted Score: 0.8
-Program does not specifically state alignment with plan. Instead it simply implies it by its nature
-Program does not show how changes would affect UM’s ability to complete mission
-Justifies essentialness to UM through potential graduation rate changes if there were a reduction in
resources
-Demonstrates importance in role for setting up social, cultural, and/or workforce needs for future
academic career or in workforce need of 21st century
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.8
•None of the values are addressed in the response.
•Other than preparing students for transferring to UM, no mention is made of preparing students for
the 21st century workforce.
•The large number of degrees awarded is a strength of this program.
•The focus on assessing its courses is a strength of this program.
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.4
•Did not directly address 20/20 plan
•Aligns and supports UM’s general education program
•Supports enrollment and retention
•Offers pathway to degree for diverse non-traditional students
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 7 Weighted Score: 1.05
NA
-Existing specific pathways with other UM departments provide student need for easy transfer of
credits
-Shows substantial evidence for negative impacts to UM graduation rates if program were reduced in
size or curtailed.
Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 4 0.8 7 1.05 5 1 4 0.8 8 0.8 6 0.9 5.35Reviewer:
2 4 0.8 8 1.2 7 1.4 3 0.6 7 0.7 3 0.45 5.15Reviewer:
3 7 1.4 8 1.2 6 1.2 5 1 5 0.5 4 0.6 5.9Reviewer:
Ranking Category:
Consider for Development and/or Modification: 14
Priority for Substantial Modification: 0
Priority for Devlopment and Growth: 1
Total Count: 15
Page 30 of 14511/13/2017
17Acad AP160 160 General AA-2Y 2Y
Consider for Development and/or Modification
Reviewer: 2 Score: 8 Weighted Score: 1.2
•No substantial weaknesses for this criteria.
•The very high number of Gen Ed SCH taught is a strength of this program.
•The collaborations with Mountain Campus programs are strengths of this program.
Strengths:
Weaknesses:
Reviewer: 3 Score: 8 Weighted Score: 1.2
•None.
•Active collaborations with three academic units
•Increases enrollment for UM
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 5 Weighted Score: 1
-No consistent way of measuring scholarly and/or creative components
-No additional instructional component
-Program has some scholarly and/or creative components that lead to local results
-Program has high use service and or outreach components of its mission that lead to local results
measured through enrollment and credential standards
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.4
•The declines in both the number of majors and the number of degrees awarded are a concern.
•The large number of majors and degrees awarded is a strength, especially considering the small size
of the faculty of the program.
•The outreach through the Dual Enrollment program is a strength.
Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 1.2
•Trends indicate decreasing enrollment by nearly 50% since 2013
•Averages over 600 majors per year during 5 year period
•Degrees awarded in 2017 the same as 2013 when enrollment was almost doubled indicating either
better retention or corrupted data
•Growth in SCH
•Engagement with dual enrollment
Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 4 Weighted Score: 0.8
-Low evidence of quality student outcomes (no specific evidence to how many continue on to UM or
other higher education programs)
-Program is not subject to external accreditation beyond UM’s requirements
Various and frequent evidence of quality faculty outcomes (i.e. research, writing contributions,
invitations to various programs)
Strengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.6
•The lack of any evidence of student outcomes is a big weakness. How many of the graduates continue
on to the Mountain Campus? Of those that do go on, how well do they do?
•Nothing is said about the quality of the many adjunct faculty associated with this program.
•There is some evidence of the quality of faculty outcomes but surprisingly little on the teaching
quality.
Strengths:
Weaknesses:
Page 31 of 14511/13/2017
17Acad AP160 160 General AA-2Y 2Y
Consider for Development and/or Modification
Reviewer: 3 Score: 5 Weighted Score: 1
•Not much on student outcomes
•Faculty has good research/professional project experiencesStrengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 8 Weighted Score: 0.8
Does not state FTE funding sources nor whether centralizing some services would be beneficial or
detrimental to the program.
-Negative impacts from revenue or expenses changes leading to decreased tenure-track and non-
tenurable faculty
-Efficiency in matriculation providing students with very economical and efficient pathways into
baccalaureate degree studies.
-Efficiency in curriculum redesigns providing students with preparation for college level mathematics
coursework
-One FTE lengthy duties allows performance efficiently and in high demand/use.
-FTE also takes on responsibilities affecting students and faculty
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 0.7
•No substantial weaknesses on this criteria.
•The very high number of credit hours per instructional FTE is a big strength of this program.
•The cultivation of collaborations with Mountain Campus programs is a strength.
•The work providing the necessary remedial mathematical courses for students is a strength.
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 0.5
•Enrollment has declined precipitously but SCH and graduation has remained level
•Efficient use of staff
•Targeted matriculation efforts in psychology, communications and social work
Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 6 Weighted Score: 0.9
Program doesn’t describe contributions to strategic vision
-Program identifies statewide need for high quality and affordable pathway to transferable core credits
-Program identifies specific restructuring opportunity for enhanced student performance
-Addressed impacts of additional resources as a way of achieving students’ objectives and goals.
Strengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.45
•The response does not articulate how this program could contribute to the Strategic Opportunities in
the UM Strategic Vision.
•The argument for additional resources is weak.
•The goal of increasing the ratio of T/TT faculty to non-tenurable faculty is a worthy goal.Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.6
•Does not really address the “Strategic Vision” document
•Does not address online possibilities
•Possible expansion of collaborations and interdisciplinary pathwaysStrengths:
Weaknesses:
Page 32 of 14511/13/2017
17Acad AP161 161 Accounting Technology-2Y 2Y
Priority for Development and Growth
Average: 7.083 Range: 3.000
1. ALIGNMENT
Reviewer: 1 Score: 8 Weighted Score: 1.6
-No major weaknesses in this category.
-The report presents evidence that the program is strongly aligned with each of the four values in the
UM2020 plan.
-This program provides a way for non-traditional students to ultimately pursue a Bachelor's in
business. The report documents the value of this path via stats based on graduate surveys (30% of their
students move on to SoBA).
-The report provides specific evidence that graduates of this program are in demand
Strengths:
Weaknesses:
Reviewer: 2 Score: 9 Weighted Score: 1.8
n/a
This program is well-aligned with UM's commitment to two-year programs, and workforce
development. Further, the author makes a good case that the program supports the 2020 Strategic Plan.
The program also provides a way for students to gain academic confidence and skills before
transferring to finish a four-year degree.
Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
3 8 1.6 9 1.35 9 1.8 9 1.8 9 0.9 9 1.35 8.8Reviewer:
1 8 1.6 6 0.9 5 1 7 1.4 7 0.7 7 1.05 6.65Reviewer:
2 9 1.8 6 0.9 5 1 3 0.6 3 0.3 8 1.2 5.8Reviewer:
Ranking Category:
Consider for Development and/or Modification: 3
Priority for Substantial Modification: 1
Priority for Devlopment and Growth: 9
Total Count: 13
Page 33 of 14511/13/2017
17Acad AP161 161 Accounting Technology-2Y 2Y
Priority for Development and Growth
Reviewer: 3 Score: 8 Weighted Score: 1.6
N/A
•Many classes (4 specifically listed) address business leadership
•Dual enrollment occurs in these classes for engagement
•Students perform 90-hour internships with local employers
•Community members perform guest lectures in various classes
•Specific classes use smaller sections so that group discussion and preparedness is facilitated
•In the last external review it was stated that this was the only 2-year business degree in the state with
3 credits dedicated to sustainability
•6 credits dedicated to multicultural and intergenerational work places; gender, harassment, empathy
and work place resolution
•Dual enrollment would be impacted by reductions
•First program to register with the state as a formal apprenticeship program in finance with Perkins
funding grated to scale up capacity
•Accounting technicians are identified as undersupplied in MT
•MOU with SoBA to allow for an easier transition into BS degrees
•75% of the last two graduating classes were either high honors grads or first gen college grads and
indicate small classes allowed them to succeed
•Sponsored apprenticeship positions award students with pay increases as new skills are acquired
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 6 Weighted Score: 0.9
-The report argues that the students in the program could not survive in a typical "big classroom," but
it does not discuss the impact of more incremental changes.
-This program is well-integrated with other Business Tech classes and with the School of Business
-The Program Director teaches a Gen Ed class
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 0.9
It is clear that the program does meet some internal demand but it is not clear how compelling or
broad that demand is from this report. The author makes the excellent case that this program supplies
skills for students to earn a living wage, and that there is demand for these students BUT this is a
section on INTERNAL demand.
This program supports other business programs at Missoula College through accounting courses, and
creates some internal demand that supports students moving to SoBA. The author mentions that one
course supports the Climate Change Studies minor, but this is not a particularly significant impact
given the limited number of students.
Strengths:
Weaknesses:
Page 34 of 14511/13/2017
17Acad AP161 161 Accounting Technology-2Y 2Y
Priority for Development and Growth
Reviewer: 3 Score: 9 Weighted Score: 1.35
•Department and program offerings are content specific and few gen eds are taught
•3.9% increase from 2014-2017 in service courses to other programs
•MOU with BoBA
•Sustainable Business is taught by program director – gen ed and service class that would impact the
Climate Change Studies minor
•Moodle class shells are shared with Bitterroot College and dual enrollment teachers
•7 members from UM and the Missoula community to help with student professional and career
development
•Accounting core courses are required for five other Business Tech Department programs
•30% of students in this program indicate they plan to move to main campus to pursue a BS through
the MOU
•A cut would cause a decrease in regional economic growth, where a gap already exists
•Yields immediate living wage jobs for MT population that would decrease with cuts
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 5 Weighted Score: 1
-Numbers indicating the number of students in the program indicate a downward trend. The report
argues, however, that the five year trends are not representative of overall demand.
-The report provides strong evidence of research, service, and instructional productivityStrengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
This section of the report could be more clear, with stronger (and more clear) indicators of the
productivity of the program overall. For example, how many students are doing what post-graduation.
The report, as a whole, suffers from vagueness when compared to others.
The internship component of the program received a high rating from stakeholders -- this is a positive
but no info on how many responded. It would seem that the Program Director has been productive,
teaching ten credits per year and managing the program while also contributing in the area of
scholarship as well.
Strengths:
Weaknesses:
Page 35 of 14511/13/2017
17Acad AP161 161 Accounting Technology-2Y 2Y
Priority for Development and Growth
Reviewer: 3 Score: 9 Weighted Score: 1.8
•A net loss of 20 students across the time frame
•Author mentions a request to change data that was sent to APASP email for trend of 5-Y majors, but
does not provide correct numbers
•Small number of graduates, but the trend slope shows no change across the timeframe in those
graduating, despite an absolute of students majoring in the program
•FTE has decreased, but is still 19:1 with an average of 23.5:1
•Labor force need, so enrollment is often not impacted by UM enrollment or economy
•Applications to the program were up 221% last year
•Program Director teaches 15 credit hours per semester, so there is less research time for this faculty.
However, before the time frame for APASP a book was authored, they helped initiate MC’s first
international faculty exchange, wrote articles and presented at industry conference
•IPRs indicate about normal service based on unit standards with merit in 2014 for outstanding
service; established state’s first Registered Apprenticeship, UM Bookstore board President, Treasurer
MC Faculty Association, finds sponsors for graduate recognition dinner, service on MC metrics ad hoc
committee and service on thesis committees
•Coordinates 90-hour student internship experiences
•Reviews from internship sites indicate an average of 4.85 out of 5 for satisfaction with student interns
•First Accounting Tech Registered Apprenticeship in the state in the Finance category
Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 7 Weighted Score: 1.4
-The time to degree numbers are a little high, but have improved.
-The employment rate for graduates is high
-The report presents strong evidence of faculty quality
-The program has adapted its advising strategy to address weaknesses
Strengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.6
The author provides estimates and opinions -- this is not sufficient to establish the quality of the
program. It looks as if a previous reviewer informed the program about the need to establish some
external indicators of success but this has apparently not been done. Survey data about internship does
not indicate how many responded.
The approach utilized in advising reflect a commitment to students.Strengths:
Weaknesses:
Reviewer: 3 Score: 9 Weighted Score: 1.8
•Students at MC often stay longer to finish gen eds before transferring to main campus, thus
increasing time to graduation
•Many of the assessment tools are embedded in classroom activities
•Average time to degree is 2.8 years. The first year in the time frame was 5.5 years and has decreased
significantly since that time
•The Program Director does all of the advising for these students in order to place students into one of
three appropriate advising tracks to decrease time to graduation
•100% of graduates that want to work in the regional area are hired at a living wage ($15-17/hour)
•30% go on to the BSBA program at UM
•4.85/5.0 satisfaction rating (over four years) for intern students
•Program Director has earned merit 4 times in 25 years
Strengths:
Weaknesses:
Page 36 of 14511/13/2017
17Acad AP161 161 Accounting Technology-2Y 2Y
Priority for Development and Growth
5. EFFICIENCY
Reviewer: 1 Score: 7 Weighted Score: 0.7
-The program seems likely to deteriorate without additional resources for faculty
-The program has taken steps to share administration resources with other programs
-The program has consolidated coursework to cut costs
-The report credits a highly skilled, specialized admin with handling a burdensome and increasing
number of responsibilities
Strengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.3
It is very clear that the program is not happy with their current resources but what is not clear is
whether the bare-boned program has impacted students. In other words, has the (forced) need for
efficiency reduced the quality of instruction/advising/student success? Has the program sought
outside resources to assist? No data to tell us this.
This program is stretched in terms of resources, and the author's frustration is apparent and
understood. In spite of that, it would appear the student numbers are not impacted, although the data
is not clear about this; the author mentions they consistently have 70 - 80 majors but the centralized
data did not separate this out.
Strengths:
Weaknesses:
Reviewer: 3 Score: 9 Weighted Score: 0.9
•No description of program data was provided for SCH per instruction or TT
•Only one TT and one adjunct teach in this program. In 2015 a TT line was lost.
•Faculty teach 8-10 classes per year while engaging in service
•Faculty are only paid once per year for supervising internship, though they supervise all year
•Courses have been consolidated and multiple sections have been combined
•Faculty have worked to increase dual enrollment numbers and students can enter school with 8
credits towards the program completed
•One FTE supports 9 programs across two departments. There are 10 TT and 9 adjuncts who rely on
this one FTE individual
•Admin coordinates scheduling, communications, committee meetings, staff meetings, travel, accounts
payable, IPRs, accounting, copying, mail, etc. There is an intermittent work study who may help with
duties. This can be helpful if it is a long-term hire
•An analysis of centralizing services has happened. Some services were modified or moved.
Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 7 Weighted Score: 1.05
-The special characteristics of this program (the small classes, etc), do not seem to be particularly
translatable into an online program.
-The report provides strong evidence that the program is closely aligned with UM's strategic plan,
particularly the path to four-year programs
-The report argues that the program could be scaled up
Strengths:
Weaknesses:
Page 37 of 14511/13/2017
17Acad AP161 161 Accounting Technology-2Y 2Y
Priority for Development and Growth
Reviewer: 2 Score: 8 Weighted Score: 1.2
This is a program that could serve students and businesses well if properly funded, and it seems like a
program that could enhance UM's reputation as well. Two things -- the program is tied to a single
person, and this can be problematic; additional resources could address this concern. The program is
currently so underfunded that I worry about Quality, especially because we did not really see any
solid indicators of student success that were not primarily anecdotal.
This is a strong section with clear indicators. This program clearly aligns well with the Strategic Vision,
and there are many ways this program services both students and workforce development. The value
of the apprenticeship program is most clearly articulated in this section.
Strengths:
Weaknesses:
Reviewer: 3 Score: 9 Weighted Score: 1.35
•Online technology and delivery could be enhanced (which was noted by the author and steps are
being made to do this in the first year of coursework)
•Many second year courses require face-to-face course work for skill-building
•Students are trained to work locally or regionally
•All individual advising is done within this program
•PD does all internship supervision
•Workforce development is fostered
•An MOU exists with the SoBA on the main campus
•Partnering with rural CPA firms that need trained professionals
•Certificate in Applied science (no additional resources required) was created and an intent to propose
was submitted to ASCRC in May 2017
•Enrollment could be significantly increased by expanding online offerings
•Applications were up 221% this past year. Increased recruiting could help enrollment and meet
employer demands and gap in employment
Strengths:
Weaknesses:
Page 38 of 14511/13/2017
17Acad AP162 162 Administrative Management-2Y 2Y
Consider for Development and/or Modification
Average: 5.150 Range: 1.150
1. ALIGNMENT
Reviewer: 1 Score: 5 Weighted Score: 1
- aligned with some but not all aspects of UM2020
- engage potential students through dual enrollment and transition to college programs
- courses interconnect with 19 certificates and degree programs
- Admin positions open in Missoula and state
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 1.2
•Data includes the entire Business Technology Department rather than just this program.
•Works with high schools through dual credit programs
•First year of the program can be taken online. Sixty-seven percent of all courses are online
•Courses are a part of other Business Technology programs and other Missoula College programs.
•Most students complete internships
•Many of the jobs the program prepares students for are in demand.
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
Overall weakness, the report writing and style made it difficult to score. It changes voices and
perspectives between sections. It is difficult to tell what is in support of the specific program or all six
programs AAS degrees.
Specific to alignment, does not strongly support sustainability. The explanation of market demand for
graduates was confusing.
Strong alignment with serving Diverse students and in engaging students. Great information on
student internships and their successful completion.
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 5 Weighted Score: 0.75
- Departmental data shows most SCH going to majors within program
- external and internal collaborations specifically for internship portion of program
- Oversees dual enrollment courses
Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 5 1 5 0.75 5 1 6 1.2 5 0.5 5 0.75 5.2Reviewer:
2 6 1.2 5 0.75 5 1 5 1 7 0.7 7 1.05 5.7Reviewer:
3 5 1 4 0.6 5 1 4 0.8 4 0.4 5 0.75 4.55Reviewer:
Ranking Category:
Consider for Development and/or Modification: 16
Priority for Substantial Modification: 0
Priority for Devlopment and Growth: 0
Total Count: 16
Page 39 of 14511/13/2017
17Acad AP162 162 Administrative Management-2Y 2Y
Consider for Development and/or Modification
Reviewer: 2 Score: 5 Weighted Score: 0.75
•Reduction would affect courses in multiple other programs as many courses are shared among
programs.
•Strong collaboration with employers and Career Services
•High school collaboration through dual credit programs
Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.6
Stating that all programs are interrelated does not help in the reviewers understanding what are
dedicated classes to this program versus the others. I wonder how many classes required by this
program are offered in the Mountain campus's business school. (or similar classes.)
Make an argument for the reliance of all programs on any one program. This is an argument for
internal demand within the business technology programs.
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 5 Weighted Score: 1
- total number of majors and degrees awarded in lower quartile (Q2)
- Trend of number of majors and degrees awarded relatively steady, in quintile 4 and 5 respectively
- Multiple UM/Missoula College committees served by facutly
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
•This program’s data is not isolated from the entire department.
•Measures include merit awards and promotions, as well as committee work and recruiting work.
•Student performance on internships measured through supervisor feedback.
•Students also take the Microsoft Word Specialist National Certification, reaching a 100% passage rate
in 2016/17.
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
It is difficult to separate the number of graduates with the Associates and the Social Media programs
from the total. The number of graduates seems low.
Faculty and instructors have higher teaching loads. The time to degree makes sense with the need for
development course offerings.
Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 6 Weighted Score: 1.2
- 5YA of time to degree in lowested quintile (3.1 years in a 2 year program) but circumstances behind
numbers described
-2013 program review had 48 interns scored at good to outstanding (average 4.7/5) from external
supervisors
- Report author 2 UM merit awards
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
•No outside accreditation
•Positive outcomes noted by inside and outside program reviewers.
•Social media certificate for faculty member along with two merit awards and promotion to associate
professor.
Strengths:
Weaknesses:
Page 40 of 14511/13/2017
17Acad AP162 162 Administrative Management-2Y 2Y
Consider for Development and/or Modification
Reviewer: 3 Score: 4 Weighted Score: 0.8
Outcomes for all students are not clear. Survey data provided, but the response rate is not disclosed.
The development of internships for students and the faculty outreach to promote the programs.Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 5 Weighted Score: 0.5
- reliant on adjunct faculty (self reported that creates instability and has ripple effect through the whole
program)
- Raised caps for course and allowed all overrides to accommodate students
- Courses taught outside workload (for free) for students
- Admin oversees 2 departments (more efficient but overburdened with responsibilities)
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 0.7
•This program’s data is not isolated from the entire department.
•Heavily dependent on adjuncts
•Administrator appears overworked
•For efficiency, nine program courses are taught only once a year.
•Use of Google Hangouts to facilitate distance learning
•Moved popular classes to larger classrooms and removed enrollment caps
•One administrative FTE shared between two departments and nine programs
Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.4
I wonder about courses that could be shared between the River and Mountain campuses and if there
are efficiencies to be gained. The Media Design,Communications, Journalism, and Marketing programs
on the Mountain campus may have courses that could overlap with offerings on the River campus.
This is not addressed.
Successfully navigating cuts and difficulties in finding instructors.Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 5 Weighted Score: 0.75
None to report
- Continue to engage potential students through Dual Enrollment
- Meeting state and local needs, with admin management jobs numerous and staying open for longer
periods
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.05
•No restructuring ideas that appear workable.
•Well aligned with strategic vision based on multiple concrete examples
•Program prepares students for real world jobs that are in demand
•Additional resources: Develop courses to focus on soft skills like professionalism and emotional
intelligence
•Additional resources: Promote dual credit courses and develop fully-online certificates.
•Additional resources: Develop administrative management curriculum
Strengths:
Weaknesses:
Page 41 of 14511/13/2017
17Acad AP162 162 Administrative Management-2Y 2Y
Consider for Development and/or Modification
Reviewer: 3 Score: 5 Weighted Score: 0.75
The facts used to support demand for graduates are unclear if the demand is for associate graduates in
those positions.
Aligns with opportunities to meet students where they are in their preparation for further education.
Also, partners with place in the development of internship opportunities. Responded to cuts by
combining Biz Tech and ACET functions within one admin assistant position. Good suggestions to
help develop students' soft skills if allowed more investment.
Strengths:
Weaknesses:
Page 42 of 14511/13/2017
17Acad AP163 163 Business Media Design-Cert Cert
Insufficient Evidence
Average: 5.767 Range: 0.150
Insufficient Evidence
1. ALIGNMENT
Reviewer: 1 Score: 5 Weighted Score: 1
1. Offers inadequate examples of leadership and diversity
1. Engages with high school students through dual enrollment
2. Offers 24/33 courses online
3. Predicted to have 107 DE students by spring 2018
4. 64% of courses fill gen ed requirements
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.4
NA
•Well-aligned ot UM 2020.
•Is a certificate that easily translates to transfer into other programs.
•Excellent record of dual enrollment.
Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 1.2
•Data for this program is not separated from the entire department
•The response to Criteria 1-bullet 3 does not seem to match the question
•Engages high school students through dual enrollment classes
•74% of the certificate’s credits are offered online
•Several of the certificate’s classes are required in other programs
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 8 Weighted Score: 1.2
1. N/A
1. Many of the courses are in other programs- reducing funding for these would impact more than one
program
2. Dual enrollment courses for this degree apply to 29 concentrations
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.05
NA
•They produce a lot of General Education credit through online offerings at Missoula College,
traditional courses, and Dual Enrollment.
•They provide a direct pathway for transfer to programs on the mountain campus.
Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 5 1 8 1.2 5 1 6 1.2 7 0.7 5 0.75 5.85Reviewer:
2 7 1.4 7 1.05 4 0.8 6 1.2 4 0.4 6 0.9 5.75Reviewer:
3 6 1.2 7 1.05 5 1 4 0.8 6 0.6 7 1.05 5.7Reviewer:
Page 43 of 14511/13/2017
17Acad AP163 163 Business Media Design-Cert Cert
Insufficient Evidence
Reviewer: 3 Score: 7 Weighted Score: 1.05
•Data for this program is not separated from the entire department
•Reduced funding would hurt multiple Missoula College programs because the course work is “highly
interconnected.”
•Reduced funding would threaten transferability because 21 of 33 credits meet General Education
requirements.
•The program shares content with high schools through dual enrollment
•Faculty collaborate with high school faculty
•Faculty learning AdobeMax software
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 5 Weighted Score: 1
1. Lack of achievement compared to other programs, but it is hard for a new program to get as much
done in a short amount of time
1. Participation in green thread
2. Variety of funding awards
2. Service on university committees
3. Got coupons for students to Loose Caboose and Hoagieville
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.8
•Who the faculty are and how they measure productivity does not go beyond the unit standards.
•This is a new program so there are no numbers yet.
•The instruction is responsive to innovative methods in the field.Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
•This is a new program with essentially no data
•Additional graduate course work and awards cited for faculty
•Faculty serve on college and university committees and participate in service related to recruiting and
promotion.
•Merit awards and promotion to associate professor cited for instructional component
Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 6 Weighted Score: 1.2
N/A
1. Innovative social media management courses
2. Access to internships for students
3. Chair was promoted to associate professor
4. Made marketing materials for the program
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 1.2
NA
•The sole faculty member has a strong record of achievement.Strengths:
Weaknesses:
Page 44 of 14511/13/2017
17Acad AP163 163 Business Media Design-Cert Cert
Insufficient Evidence
Reviewer: 3 Score: 4 Weighted Score: 0.8
•No outside accreditation
•Evidence is limited, but the program is new
•Internal and external program reviews quoted are positive and include some suggestions for
improvement in marketing and assessment.
•Bullet 2 shows faculty response to improving marketing through radio spots and other marketing
materials
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 7 Weighted Score: 0.7
N/A
1. At bare minimum for number of sections and how often some courses are offered- have cut as much
as possible already
2. Schedules high demand courses in larger classrooms
3. Researches course substitutions for students
4. Shares 1 FTE with 2 departments
5 1 administrative assistant works at full capacity with occasional work study help
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.4
•Faculty and adjuncts are not sustainable in numbers and that has an adverse effect on advising,
retention, graduation.
•Flexible innovative and collegial in regards to scheduling, advising, and coordinating dual
enrollment.
Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 0.6
•The program relies heavily on adjuncts
•Class sizes up because of reduced faculty
•Multiple sections of course have been combined
•Some courses have been reduced to once per year.
•High demand classes are now scheduled for larger classrooms
•The program has removed or raised some course caps
•Duel enrollment and Media Arts courses on the mountain campus have also helped increase
efficiency.
•Administrator: one FTE- works with two departments and nine programs
•Some centralization of services
Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 5 Weighted Score: 0.75
1. Does not provide enough examples of how the program could change or cut back
1. Enables employment in middle-skills jobs, a large portion of the workforce
2. Could develop a partnership with media arts
3. Allow audits for employers to send their employees to for job training
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 0.9
•The program will have to be resourceful and nimble enough to change and reinvent itself every few
years as technology and best practices evolve. That will require significant resources or innovation.
•This program aligns perfectly with the Strategic Vision and is in tune with 21st century skills.Strengths:
Weaknesses:
Page 45 of 14511/13/2017
17Acad AP163 163 Business Media Design-Cert Cert
Insufficient Evidence
Reviewer: 3 Score: 7 Weighted Score: 1.05
•No restructuring ideas that the author finds workable.
•The program shows strong alignment with the strategic plan and supplies examples to back it up.
•Program trains students for available jobs that are in demand.
•The program has strong integration with high schools and supplies a path to college.
•Add curriculum focusing on professionalism, business culture and emotional intelligence.
•Partner with Media Arts to increase transfers
•Promote online course more heavily
•Explore employer-subsidized training
Strengths:
Weaknesses:
Page 46 of 14511/13/2017
17Acad AP164 164 Customer Relations-Cert Cert
Consider for Development and/or Modification
Average: 6.167 Range: 1.850
1. ALIGNMENT
Reviewer: 1 Score: 7 Weighted Score: 1.4
None noted.
Offers dual enrollment to high school students; this is a first year certificate program offered entirely
online; several courses in this program are required for the five MC programs in Business Technology;
appears that there is a projected 17% growth rate for customer service representatives through 2025.
Local demand for customer service representatives is high.
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.4
1) Ties to 2020 plan would be even stronger if its claims were quantified numerically
2) program does not address how it meets the cultural or social needs of the 21st century.
1) demonstrates significant ties to the strategic plan (2020) in the areas of engagement, sustainability,
leadership, and diversity as demonstrated by: dual enrollment efforts, online course offerings, course
sharing within the MUS, and curricular foci.
2) adequately justifies its essentiality by listing the number of programs that depend on Customer
Relations courses (a total of 15 other certificates and associates degrees) and dual enrollment offerings
(approximately 110 per year).
3) conveys an excellent connection to addressing workforce needs, by explaining the unmet demand
for customer service representatives, their average salaries/benefits, advancement opportunities, and
pay-off timeline for the degree (all quantified).
Strengths:
Weaknesses:
Reviewer: 3 Score: 8 Weighted Score: 1.6
B1-Sustainability-Misses the mark with this response. Focused on sustainability of program as
opposed to environmental focus. I must admit though the 2020 wording is a bit unclear.
B1-Engage-Active dual enrollment program that facilitates high school student transition to Missoula
College/UM. Leadership&Development-Models professional workplace etiquette and theory.
B2-Many programs in Business Technology and Missoula College requires courses from Customer
Service program. Also would negatively impact Dual enrollment.
B3-Compelling data and research of demand provided.
Strengths:
Weaknesses:
2. Demand
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
3 8 1.6 6 0.9 5 1 6 1.2 8 0.8 9 1.35 6.85Reviewer:
2 7 1.4 5 0.75 5 1 3 0.6 8 0.8 3 0.45 5Reviewer:
1 7 1.4 7 1.05 5 1 6 1.2 8 0.8 8 1.2 6.65Reviewer:
Ranking Category:
Consider for Development and/or Modification: 15
Priority for Substantial Modification: 0
Priority for Devlopment and Growth: 0
Total Count: 15
Page 47 of 14511/13/2017
17Acad AP164 164 Customer Relations-Cert Cert
Consider for Development and/or Modification
Reviewer: 1 Score: 7 Weighted Score: 1.05
Author notes this program is interconnected with other programs--and notes that a reduction in
students would impact courses in Business Technology and Applied Arts, both of whom contribute to
this particular certificate. That said, the data provided merges program data with the Administrative
Management Program, so specific demand is not clear.
Program collaborates with internal and external partners--Hospitality Management and Medical
Information Technology to create apprenticeships on campus and with Allegiance Benefits (off
campus) respectively.
Courses offered through this program are interconnected with at least 18 other MC programs. Ranks
in 3rd quintile for SCH for GenEd courses.
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 0.75
1) ranks in the third quintile for SCH for Gen-Ed courses offered.
2) second lowest quintile for SCH of Gen-Ed courses per instructional FTE, and percentage of non-
majors to total. The program notes that it is possible that RevUp or other grants could be responsible
for teaching some of the Gen-Ed courses for the degree, which would account for the low ranking.
1) ranks in the third quintile for SCH for Gen-Ed courses offered.
2) strong connection to dual enrollment, hospitality management, and medical information technology,
though this exhausts their interdisciplinary efforts. These efforts include: sharing course content,
teaching materials, and online shells, creation of apprenticeships , and creating curricular connections.
3) notes ties to 18 programs across Missoula College, as well as dual enrollment and transfer work
(approximately 37% of the courses are Gen-Eds for transfer)– all of which would be effected if the
program were reduced.
Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 0.9
DATA-Mid-range to lower end quintiles, but explains data pertains to six individual programs in
Business Technology department and not just Customer Relations Certificate.
B1-Existing collaborations. Shares student advising load of director among faculty. Demonstrates
shared programmatic resources with other programs.
B2-Highly interconnected with other Missoula College programs. Also negative impact on Dual
Enrollment.
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 5 Weighted Score: 1
Unfortunately, the data do not allow for identification of work done by faculty who contribute to this
particular program, as data are provided at only the department level. The author does provide info
on her/his productivity, which meets the mission. Productivity of other faculty contributing to the
program not noted. The 5YA of student FTE and trend for this particular program ranks in the 2nd
quintile with a downward slope of .8, placing it in the lowest quintile.
The department appears to meet its mission and demonstrate adequate productivity. Data for degrees
awarded rank the program in quintile 4, with some downward slope.
Strengths:
Weaknesses:
Page 48 of 14511/13/2017
17Acad AP164 164 Customer Relations-Cert Cert
Consider for Development and/or Modification
Reviewer: 2 Score: 5 Weighted Score: 1
1) ranks in the second lowest quintile for student FTE/instructional FTE (at an average of 23.5) and in
the lowest quintile for the trend (at -0.8) though the program notes that these are departmental metrics
and cannot be determined exactly.
2) all of these areas that indicate productivity could be better tracked, quantified, and defended.
1) program ranks in the fourth (second highest) quintile for number of degrees awarded (at an average
of 10.8 per year) and in the third quintile for the trend over five years (-0.22)
2) program’s service outcomes include serving on university committees, attending university
functions, and rendering public service in the area of professional competences. Some of the
achievements in this area include: marketing program and partnership with local business for reward
coupons for students.
3) teaching effectiveness is demonstrated by two merit awards and a promotion to Associate Professor
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
DATA-Pertains to all Business Technology programs, but explains data for Customer Relations
program.
B2-Service/Outreach productivity measured by number of activities/committees and
student/community outreach. Not fully addressed.
B1-No research. Has earned some scholarly wards for program development and leadership.
B3-Measures through merit awards and promotions.
Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 6 Weighted Score: 1.2
Data suggest that time to degree ranks in the lowest quintile, but it is noted that many students do not
decide to apply for the certificate until their second year of the AAS program, thereby skewing the data.
2016 Program Reviewer notes that teaching is excellent, students benefit from internships and real-
world projects, and offers an innovative social media management course; suggestions for
improvement are being acted upon (i.e., assessing student learning outcomes, enhancing marketing for
the program).
Strengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.6
1) bottom quintile for time-to-degree, but provides several explanations to rectify this negative score,
such as: math requirement completed in year two for most students, need for remedial math/writing,
33% of students come from other programs or are earning second/third degrees, number of classes
offered each semester reduced, and one student took four years to graduate and skewed the average.
2) Limited evidence to suggest number of graduates with jobs, or placements/transfers to other schools
or UM.
3) No outcomes for faculty other than the author are listed, and provided examples are not
exceptionally robust or comprehensive.
1) used an external and internal program review to demonstrate its evidence of the quality of student
outcomes, some of which include: internships earned, portfolio projects, hands-on experiences,
workforce preparedness, hybrid online/in-person curriculum, graduate salaries/benefits.
2) notes awards granted to one of its faculty members, crafting marketing materials for the program,
conferences attended, and collaboration with pathways/dual-enrollment, and community partnerships
as evidence of faculty quality.
Strengths:
Weaknesses:
Page 49 of 14511/13/2017
17Acad AP164 164 Customer Relations-Cert Cert
Consider for Development and/or Modification
Reviewer: 3 Score: 6 Weighted Score: 1.2
DATA-Pertains to all Business Technology programs. Explains data for Customer Relations program.
Essentially mixed quintile scores.
B3-Not accredited.
B1-Provided internal and external reviews of student outcomes/impacts. Overall positive information
on student outcomes with job placement and preparation for entering workforce
B2-Merit awards and promotions used for faculty outcomes. Acted on internal and external
recommendations effectively with 33% increase in FY17 enrollment.
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 8 Weighted Score: 0.8
None noted.
UG SCH per instructional FTE and T/TT FTE place the department in quintile 4. Program is one of 6
administered in Business Technology. Program has taken steps to improve efficiency.
Strengths:
Weaknesses:
Reviewer: 2 Score: 8 Weighted Score: 0.8
None found.
1) ranks in the fourth quintile for SCH per instructional FTE (average of 704.7 per year, though this
number is steadily declining), and in the fourth quintile for SCH per T/TT faculty.
2) impact of cuts to the program include increased time to degree, lower retention rates, and fewer
completions. The program notes that it has lost a tenure track faculty, and has therefore been heavily
reliant on adjuncts.
3) moderate attempts to improve efficiency, such as offering courses once per year rather than once per
semester, other classroom adjustments, and researching course substitutions for students.
4) program’s one administrative assistant covers two departments and nine programs (and
approximately 10 TT faculty and 9 adjuncts) and the program has already explored centralizing
services, and notes that some were replaced/modified/moved.
Strengths:
Weaknesses:
Reviewer: 3 Score: 8 Weighted Score: 0.8
DATA-Pertains to Business Technology in general.
B1-Impact has extended time to degree and retention. TT/T FTE has been reduced in recent Fiscal
Years. Adjuncts do well but are limited in advising and responsibilities outside of classroom. Resulted
in combining sections for increased class size, but lessens quality of student experience.
B2-Moved program courses from every semester to once per year. Schedules high demand courses in
larger classrooms (easier with new Missoula College labs).
B3-Shares 1.0 FTE administrative assistant with two departments (totaling 9 programs). Shared
Administrative assistant supports 10 TT/T and 9 adjuncts.
Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 8 Weighted Score: 1.2
None noted.
The program is accessible and affordable, meets the MUS and economic goal training, and enables
employment into middle-skills jobs. Restructuring already in process to combine departments. Plan to
expand dual enrollment and widely recruit more applicants to the program
Strengths:
Weaknesses:
Page 50 of 14511/13/2017
17Acad AP164 164 Customer Relations-Cert Cert
Consider for Development and/or Modification
Reviewer: 2 Score: 3 Weighted Score: 0.45
1) the program mistakenly addresses the MUS strategic plan instead of the UM Strategic Vision, and
distinguishes its ties to access/affordability, workforce development, and efficiency/effectiveness.
2) does not address the question of contributions to interdisciplinary areas of inquiry, but instead
discusses the National Skills Coalition recommendation to develop a Skills Equity Policy
3) notes one opportunity for restructuring the program (combining Business Technology and Applied
Computing and Electronics Technology under one department) but then proceeds to list the reasons
why such a restructuring would be detrimental to the University of Montana.
1) demonstrates ties to only “Engage Students Where They Are” in the new strategic vision document,
as demonstrated by their dual-enrollment and online/hybrid delivery curriculum.
2) notes some opportunities for growth in the areas of soft-skills development, promoting dual
enrollment, and partnerships with potential intern/apprenticeship partners through online course
training.
Strengths:
Weaknesses:
Reviewer: 3 Score: 9 Weighted Score: 1.35
B3-Restructuring opportunities are limited. Essentially has already maxed out restructuring
opportunities.
B1-Access/Affordability-"Engages students where they are" through Dual Enrollment, Pathways, and
online options. Workforce/Economic Development-Matches program with Department of Labor
statistics for growth and demand. Efficiency/Effectiveness-Instructionally efficient with General
Education and inter-program support.
B2-Fulfills need of "middle-skills" job needs in labor market. Contributes to "stack-able" credentials
where multiple qualifications are achieved in a single program. Serves rural areas in state through
100% online offerings.
B4-"Soft-Skills" curriculum as identified by industrial research reports are an opportunity for
investment. Could promote Dual Enrollment as natural pipeline for students to come to Missoula
College after high school. Possibility of providing customer relations professional development
courses for Missoula College and University of Montana personnel.
Strengths:
Weaknesses:
Page 51 of 14511/13/2017
17Acad AP165 165 Food Service Management-2Y 2Y
Priority for Substantial Modification
Average: 6.150 Range: 0.000
1. ALIGNMENT
Reviewer: 1 Score: 1 Weighted Score: 0.2
Cant' comment
Chef Campbell has appealed for an extension, given his heavy workload in hiring for, outfitting, and
setting up 3 new dining areas and 4 completely new kitchens. Although this is not my call, his request
seems reasonable given the recent expansion of his program and move to new facilities.
Numbers provided are default scores, and not ones that I have assigned as reviewer.
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.4
The program has gone through a rough patch with the transition to the new facility, but now that its
feet are on firm ground, it appears that it will regain and develop its institutional superiority.
Strong alignment, providing students with exceptional vocational possibilities. This program produces
professionals who can provide leadership in the local food service industry, with an emphasis on
cultural diversity and sustainability.
Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
Weaknesses:
•No information provided
Strengths:
•N/A
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 1 Weighted Score: 0.15
Can't comment
Can't commentStrengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 1 0.2 1 0.15 1 0.2 1 0.2 1 0.15Reviewer:
2 7 1.4 6 0.9 5 1 6 1.2 6 0.6 7 1.05 6.15Reviewer:
3 1 0.2 1 0.15 1 0.2 1 0.2 1 0.15Reviewer:
Ranking Category:
Consider for Development and/or Modification: 3
Priority for Substantial Modification: 14
Priority for Devlopment and Growth: 0
Total Count: 17
Page 52 of 14511/13/2017
17Acad AP165 165 Food Service Management-2Y 2Y
Priority for Substantial Modification
Reviewer: 2 Score: 6 Weighted Score: 0.9
Certificate vocational programs are always subject to the vicissitudes of the unemployment rate. When
unemployment increases, demand goes up as people see the advantage in gaining the degree. When it
goes down, people can get employment without the degree. However, because the degree can give
people a leg up over on-the-job training, it will continue to draw students.
This has always been a popular program, and enrollment figures show a markedly decreased demand.Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.15
•No information provided
•Data for Business Technology program and explanation doesn’t provide clarification
N/AStrengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 1 Weighted Score: 0.2
Can't comment
Can't commentStrengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
As noted, productivity had taken a hit in the last couple of years, but appears now to be on the right
track.
Not mentioned in the summary above are the efforts to focus on sustainability in food service
management.
Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
•No information provided
•Data for Business Technology program and explanation doesn’t provide clarification
•Any data on numbers of students waiting so to speak or is this anecdotal?
•Where is the data coming from on decline in the FSM and Culinary Arts, nothing identified.
N/AStrengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 1 Weighted Score: 0.2
Can't comment
Students have won numerous awards for their culinary skillsStrengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 1.2
The summary did not note whether the program offers training in local foods.
As seen by the numerous awards above, the program has offered a high quality training to its students.Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
•No information provided
•Data for Business Technology program and explanation doesn’t provide clarification
•Author responded to preferred bullets, but not overall
N/AStrengths:
Weaknesses:
Page 53 of 14511/13/2017
17Acad AP165 165 Food Service Management-2Y 2Y
Priority for Substantial Modification
5. EFFICIENCY
Reviewer: 1 Score: Weighted Score:
Can't comment
Can't commentStrengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 0.6
Difficult to say given the cursory summary.
By holding fundraisers, the program is able to increase its efficiency.Strengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
•No information provided
•Data for Business Technology program and explanation doesn’t provide clarification
N/AStrengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 1 Weighted Score: 0.15
Can't comment
Can't commentStrengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.05
I'm wondering if it's adequately staffed.
This program is properly situated to provide superior training to meet the needs of Montana
professionals in food service management. It has the facilities and the demand. I would like to see
more emphasis in its mission to train in local foods for cultural and sustainability reasons.
Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.15
•No information provided
•Data for Business Technology program and explanation doesn’t provide clarification
N/AStrengths:
Weaknesses:
Page 54 of 14511/13/2017
AP166 166 Hospitality Management-2Y 2Y
Priority for Substantial Modification
Average: 2.700 Range: 3.400
No Report Submitted Insufficient Evidence
1. ALIGNMENT
Reviewer: 1 Score: 1 Weighted Score: 0.2
· No abstract provided.
· No abstract provided.Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
Nothing to go on
Nothing to go onStrengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 1 Weighted Score: 0.15
· Decrease in Non-majory SCH from 4,019 in 2013 to 2,451 in 2017.
· Increase in GenEd 5YA Average. Quintile 3.Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 0.75
· 5YA of SCH for gen ed per instructional FTE: 2, with big dips for 2015 and 2016, but significant
recovery in 2017. • 5YA of SCH ratio of non-majors to total: 5.
· 5YA of SCH for Gen-Ed: 3Strengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 1 Weighted Score: 0.2
· Decrease in Number of Majors from 63 in 2013 to 38.0 with the lowest at 4.0 in 2015.
· No abstract provided.Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:
2 1 0.2 5 0.75 7 1.4 7 1.4 5 0.5 1 0.15 4.4Reviewer:
3Reviewer:
Page 55 of 14511/13/2017
AP166 166 Hospitality Management-2Y 2Y
Priority for Substantial Modification
Reviewer: 2 Score: 7 Weighted Score: 1.4
· No degrees awarded. ????
· Quintile 5 for number of majors. • Student FTE/instructional FTE ratio at quintile 4Strengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 1 Weighted Score: 0.2
· No abstract provided. • Scored 0 on sophomore persistence rates.
· No abstract provided.Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.4
· No data for time to degree or sophomore persistence. ?????
Strengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 1 Weighted Score: 0.1
· Despite decrease in Instructional Faculty FTE, personnel costs increased.
· Decreases in Instructional Faculty FTE in the past five years.Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 0.5
· No grants or contracts. Data: contract faculty from 9.1 to 8.3 but general fund dollars 659,000 to
769,000. No other major sources of revenue.
· SCH per instructional FTE: 3 • UG SCH per T/TT Faculty FTE: 3Strengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 1 Weighted Score: 0.15
· No abstract provided.
· No abstract provided.Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.15
· Nothing to go on.
Strengths:
Weaknesses:
Page 56 of 14511/13/2017
AP166 166 Hospitality Management-2Y 2Y
Priority for Substantial Modification
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Page 57 of 14511/13/2017
17Acad AP167 167 Medical Reception-Cert Cert
Consider for Development and/or Modification
Average: 1.083 Range: 0.250
1. ALIGNMENT
Reviewer: 1 Score: 1 Weighted Score: 0.2
The unit fails to respond to any of the questions within this criterion, and asks the reader to “review
Unit 169” as this certificate is a “subunit” of the AAS degrees. This should have been distinguished
when the list of units of analysis were published.
NONEStrengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
•Did not submit anything – said to see Unit 169
•Did not submit anything – said to see Unit 169Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
Failed to complete report
None observedStrengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 2 Weighted Score: 0.3
The unit fails to respond to any of the questions within this criterion.
1) second lowest quintile for Gen-Ed SCH per instructional FTE
2) second lowest quintile for ratio of non-majors to total
1) The DEPARTMENT scores in the middle quintile for SCH for Gen-Ed courses.
2)
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.15
•Did not submit anything – said to see Unit 169
•Did not submit anything – said to see Unit 169Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.15
Failed to complete report
None observedStrengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 1 0.2 2 0.3 1 0.2 1 0.2 2 0.2 1 0.15 1.25Reviewer:
2 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:
3 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:
Ranking Category:
Consider for Development and/or Modification: 3
Priority for Substantial Modification: 10
Priority for Devlopment and Growth: 0
Total Count: 13
Page 58 of 14511/13/2017
17Acad AP167 167 Medical Reception-Cert Cert
Consider for Development and/or Modification
3. Productivity
Reviewer: 1 Score: 1 Weighted Score: 0.2
The unit fails to respond to any of the questions within this criterion.
1) falls in the second lowest criterion for number of majors.
2) program falls in the second lowest criterion degrees awarded (around 6.8 on average).
1) The program is in the second highest quintile in the five year average for student FTE to
instructional FTE.
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
•Did not submit anything – said to see Unit 169
•Did not submit anything – said to see Unit 169Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
Failed to complete report
None observedStrengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 1 Weighted Score: 0.2
The unit fails to respond to any of the questions within this criterion.
1) The unit is in the second lowest quintile for time to degree.
NONEStrengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
•Did not submit anything – said to see Unit 169
•Did not submit anything – said to see Unit 169Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
Failed to complete report
None observedStrengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 2 Weighted Score: 0.2
The unit fails to respond to any of the questions within this criterion.
1) does not produce any grant dollars or IDC.
1) top quintile for SCH per T/TT faculty FTE.
2) second highest quintile for SCH per instructional FTE.
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.1
•Did not submit anything – said to see Unit 169
•Did not submit anything – said to see Unit 169Strengths:
Weaknesses:
Page 59 of 14511/13/2017
17Acad AP167 167 Medical Reception-Cert Cert
Consider for Development and/or Modification
Reviewer: 3 Score: 1 Weighted Score: 0.1
Failed to complete report
None observedStrengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 1 Weighted Score: 0.15
The unit fails to respond to any of the questions within this criterion.
NONEStrengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.15
•Did not submit anything – said to see Unit 169
•Did not submit anything – said to see Unit 169Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.15
Failed to complete report
None observedStrengths:
Weaknesses:
Page 60 of 14511/13/2017
17Acad AP168 168 Management-2Y 2Y
Consider for Development and/or Modification
Average: 4.733 Range: 2.400
1. ALIGNMENT
Reviewer: 1 Score: 3 Weighted Score: 0.6
Program responses to address sustainability, leadership, and diversity are unsubstantial.
Program does not justify essentiality to UM in terms of achieving mission.
Program does not adequately respond to bullet 3.
Program demonstrates engagement through dual enrollment offerings.
Program demonstrates high workforce demand and impact on various programs if reduced.
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.4
Data presented in argument does not align with APASP data.
Program offers dual enrollment and transition to college coursework in partnership with K-12
educators. Students in either of these options (Entrepreneurship or Sales/Marketing) can earn almost
40% of their credits through dual enrollment. Options meet the mission and values outlined in UM
Strategic Plan. While data for these specific options unavailable, management courses (of which these
options are a part), "rank in quintile 5 for growth and demand." These options are highly
interconnected with other MC courses.
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.4
-No discussion of how faculty/program engages in UM2020 Strategic Plan on a broader level, although
evidence of ways in which program supports students/institution/community is clear
-STrong argument for engagement, capturing students/engaging them in the curriculum while still in
high school and aiding in transition to college
-Tuition-friendly, online course offerings support sustainability - reaching students locally, regionally,
nationally, internationally
-MUS course-sharing
-Supports student leadership development that filters directly into workforce
-High demand, quintile 5, with demand and growth
-Evidence of interconnectedness
Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
3 7 1.4 7 1.05 4 0.8 4 0.8 4 0.4 7 1.05 5.5Reviewer:
2 7 1.4 6 0.9 5 1 4 0.8 7 0.7 5 0.75 5.55Reviewer:
1 3 0.6 3 0.45 3 0.6 2 0.4 5 0.5 4 0.6 3.15Reviewer:
Ranking Category:
Consider for Development and/or Modification: 10
Priority for Substantial Modification: 5
Priority for Devlopment and Growth: 0
Total Count: 15
Page 61 of 14511/13/2017
17Acad AP168 168 Management-2Y 2Y
Consider for Development and/or Modification
2. Demand
Reviewer: 1 Score: 3 Weighted Score: 0.45
No program specific metrics provided, all departmental.
Program does not justify collaborations that enhance faculty performance.
Program lists Missoula College programs that would be negatively impacted but is not explicit about
how and to what extent this impact would occur.
Program has a generally insufficient response to all of criteria 2 but demonstrates interdependence.
Program demonstrate activities that address student needs through dual enrollment offerings and
shared course content with other programs.
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 0.9
5YA for SCH for GenEd total and per instructional FTE rank department in quintiles 3 and 2
respectively. Data for the two options specified for this review are not available in APASP.
By all accounts, program has high student demand, Program is highly interdisciplinary, and
accessible--50% can be completed online. An MOU has been established with Great Falls to allow
students there to enroll in Entrepreneurship classes.
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.05
NA -reduction in size or curtailment would negatively impact DE and enrollment in Missoula College
-Steady increase in department service to other programs from 2014-2017
-Gen ed department efficiencies demonstrated by increase in SCH from 2016-2017 - 32% increase
-Evidence of existing collaborations with DE faculty affiliates with whom they share course content,
teaching materials.
-Course sharing
-Evidence of local relationships that will feed students into program enrollment
-High demand, quintile 5
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 3 Weighted Score: 0.6
Number of majors in quintile 5 with declining # of majors. 5YA degrees awarded/5 years in quintile 3
with significant decrease in 2017 from 2016.
Program put N/A for bullets 1-3 and stated that it could not provide measures or information.
Student-instructional FTE/5Y in quintile 4.Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
Little data available to assess productivity, either through ASPAP or internal documentation of student
placement and success, apparently due to turnover of interim program director.
Number of majors for program ranks in the top quintile (quintile #5), with a downward slope. Degrees
awarded for program place it in quintile #3, while Instructional FTE rank program in quintile #4.
Program has suffered a bit due to turnover and interim chairs, but appears back on track.
Strengths:
Weaknesses:
Page 62 of 14511/13/2017
17Acad AP168 168 Management-2Y 2Y
Consider for Development and/or Modification
Reviewer: 3 Score: 4 Weighted Score: 0.8
-Non-hire of program director and ensuing issues resulted in significant downward trend in majors in
2016-2017 - incomplete internships and failed communication efforts to students
-Management Interim Program Director no longer under contract, cannot provide measurement/data.
-Qunitile 5, significant number of majorsStrengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 2 Weighted Score: 0.4
5YA time to degree in quintile 2
Program does not have any available evidence of quality of student outcomes.
Faculty list of accomplishment does not provide sufficient evidence of quality of outcomes.
Program is not accredited.
Program lists accomplishments of its interim director to demonstrate faculty outcomes.
Program explains resource and personnel constraints that led to ineffective tracking of student
outcomes
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.8
Unfortunately, little assessment data available for reasons already discussed. "[the] Management
[Program] has been in the state of disarray for some years," but with the appointment of a new interim
program director, appears to be on more solid footing. APASP data indicate that 5YA time to degree
places options in 2nd quintile.
Faculty have participated in outreach activities and now appear to be functioning at an adequate level
of quality.
Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.8
-Increase in time to degree by limited course offerings
-Decreased course options for students, fill quickly
-Incomplete internships
-No assessment data available due to program's "state of disarray for some years" - short history
provided
-Some evidence of faculty outcomes despite little/no trackingStrengths:
Weaknesses:
5. EFFICIENCY
Page 63 of 14511/13/2017
17Acad AP168 168 Management-2Y 2Y
Consider for Development and/or Modification
Reviewer: 1 Score: 5 Weighted Score: 0.5
Only department metrics are provided for criteria 5.
Impact of decreasing enrollment and lack of non-adjunct faculty to accommodate student needs, there
has been an increase in class sizes that is undesirable and inconsistent advising.
Hiring of new personnel projects a program upswing and more positive programmatic efficiency.
Program demonstrates efficiency through a significant increase in class sizes and increase in caps in
order to accommodate the most amount of students.
Program shares one FTE with 9 programs. Program states that this specific individual is highly
efficient due to knowledge and expertise in the fields.
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 0.7
None noted.
UG SCH place program in 4th quintile for both instructional and T/TT FTE. Steps have been taken to
improve efficiency such as raising course caps, and prompting dual enrollment with high schools and
establishing MOU with Great Falls.
Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.4
-Hhard hit by reduced personnel cost in Program Direction.
-Major numbers decreased significantly, degree awards decreased significantly, and time to
completion increased.
-Rely heavily on adjuncts
-Increased class sizes
-Some evidence of centralizing, though specifics not provided
-The department has become more efficient with costs trending down in every category except
benefits, “Total Personnel Benefit Cost”.
-The Business Technology Department Chair schedules required courses and department faculty to
maximize efficiencies in program offerings, enrollment projections, course minimums, and college
demand. -
-One administrative assistant and limited work study while increasing workload due to recent
University administrative budget constraints and downsizing.
-Quality in new hires in spite of decrease in TT/T Faculty FTE
-Methods to improve efficiency are identified
-Some evidence of centralizing, though specifics not provided
Strengths:
Weaknesses:
6. OPPORTUNITY
Page 64 of 14511/13/2017
17Acad AP168 168 Management-2Y 2Y
Consider for Development and/or Modification
Reviewer: 1 Score: 4 Weighted Score: 0.6
Program could provide additional evidence or suggestions to contribute to the strategic opportunities.
Program should provide greater evidence to support its statewide service and additional ideas for
contribution.
Program demonstrates engagement with students where they are through dual enrollment courses
providing greater accessibility and affordability and trains a needed workforce.
Programs demonstrate its service to statewide needs through training a needed workforce and
engaging with high schoolers.
Program states restructuring is not feasible within the department with adequate justification.
Program suggests the development of soft skills curriculum, greater dual enrollment expansion, and
promotion of certificate programs.
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 0.75
None noted.
Offering additional dual enrollment courses will ultimately make college more affordable, provide a
pipeline for students, and allow for education in place. Development of soft skills curriculum,
expanding online offerings, pursuing additional MOU opportunities and developing additional
certificate programs offers some opportunities to enhance UM.
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.05
-Analysis of restructuring determined further restructuring would not be beneficial to program, MC or
UM
-National Skills Coalition Skills Equity Policy
-Soft skills curriculum development
-DE promotion MOU opportunities
-Certificate programs
-Opportunities for investment to enhance program and contribute to UM are articulated and relatively
attainable goals/initiatives (given resources). Such initiatives would be sustainable and contribute to
UM positively.
Strengths:
Weaknesses:
Page 65 of 14511/13/2017
17Acad AP169 169 Medical Information Technology-2Y 2Y
Consider for Development and/or Modification
Average: 4.683 Range: 1.450
1. ALIGNMENT
Reviewer: 1 Score: 2 Weighted Score: 0.4
-Program does not successfully aligns itself with multiple Strategic Plan’s values
-Does not explain essentialness to UM nor how cuts would affect UM’s mission
-Does not show HOW program prepares students with needs of 21st century.
-Program offers how educational opportunities for students and other constituencies about specific
values
-Program aligns itself with multiple Strategic Plan’s value of engagement
Strengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.6
Does not align well with the values in the 2020 Strategy for Leadership, Diversity, and Sustainability.
Achieve economic and social improvements for graduatesStrengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
Description of links to sustainability and diversity not well thought out.
Clearly described alignment with the UM 2020 strategic plan. Specific emphasis on workforce
development. Increasing demand for students with this type of training.
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 6 Weighted Score: 0.9
NA
-Interdisciplinary activities at local and state level address student needs for real-world experience,
placement, and skill development
-Shows how reduction in size or curtailment would negatively impact skill/interest specific education
in other programs resulting in reduced performance
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 0.75
Given report, it is difficult to determine how much integration and shared courses are offered such that
it is difficult to determine true detrimental impact from curtailment.
Course sharing with other Associates degrees helps with demand.Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 2 0.4 6 0.9 2 0.4 2 0.4 7 0.7 7 1.05 3.85Reviewer:
2 3 0.6 5 0.75 4 0.8 7 1.4 6 0.6 5 0.75 4.9Reviewer:
3 5 1 4 0.6 6 1.2 5 1 6 0.6 6 0.9 5.3Reviewer:
Ranking Category:
Consider for Development and/or Modification: 14
Priority for Substantial Modification: 0
Priority for Devlopment and Growth: 1
Total Count: 15
Page 66 of 14511/13/2017
17Acad AP169 169 Medical Information Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 3 Score: 4 Weighted Score: 0.6
Low SCH in gen ed courses and for non-majors.
Significant recent increase in SCH in gen ed courses. Collaborations in other health profession degree
programs at Missoula College and with College of Great Falls. Internships allow for further
collaboration with community. A reduction in this program would impact health profession in region
and several other programs on campus.
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 2 Weighted Score: 0.4
-No research, scholarly and/or creative component
-Outreach component mentioned does not impact mission of program
-No additional instructional component
Outreach component measured through successful completion of internshipsStrengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.8
The number of majors and graduates are trending downward. Perhaps the demand for this degree by
students is declining.
As described it is an efficient program, it appears that there is only one dedicated required course, but
that is not clearly stated.
Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 1.2
Declining trend in majors and degrees awarded. No scholarly activities.
Strong numbers of majors annually (115) and good number of degrees awarded annually (~13). Good
values for student FTE per instructional FTE (23.5:1). Internships provide outreach opportunities with
students integrating with health profession community.
Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 2 Weighted Score: 0.4
-Low evidence of quality student outcomes
-No innovative or frequent evidence of quality faculty outcomes
-No accreditation evidence given
Post-grad survey showed positive outcomes (i.e. job placement, quality of job)Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.4
A survey of employer measures of quality based on internships and employees would have helped to
determine quality. It can also help improve the program.
Internships built into the program produces quality outcomes for the graduates.Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
Time to degree relatively long for a two year program. Few specifics on faculty outcomes
Grad surveys show very positive outcomes for students. Nearly 70% went on for certification in their
field and 80-100% felt that the degree program influenced their employment and wage earnings. Good
quality instructors
Strengths:
Weaknesses:
5. EFFICIENCY
Page 67 of 14511/13/2017
17Acad AP169 169 Medical Information Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 1 Score: 7 Weighted Score: 0.7
NA
-Negative impacts from revenue or expenses changes leading to student graduation risk due to
autumn offering and unavailable access to course
-Program works closely with other academic programs in the state to create efficiency in shared
resources and universal program preparation
-One FTE lengthy experience allows her to perform efficiently and in high demand/use.
centralizing some services would be detrimental as a burden to the faculty
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 0.6
Although nine programs with one staff person is quite a few, it exists in other areas of the university.
Without more information, it is hard to understand how this is a problem. I read that six of the nine
degrees are intertwined to a high degree such that a cut to one is a cut to all, but then I read that nine
programs is an undue burden. For Bullet 6, you state faculty are being asked to teach without pay, can
you be more specific?
Course sharing with Great Falls is a good example of efficiency.Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 0.6
No grant expenditures or IDC generated.
Strong numbers for SCH per instructional FTE and per tenure track FTE. A lack of rehiring of a key
position is directly impacting the quality of offerings for students in coding. Efforts being made to
improve efficiency and reduce redundancy via collaborative arrangements in College and with Great
Falls. Program relies on a part time work study student for administrative duties.
Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 7 Weighted Score: 1.05
-Program fails to recognize what they “could contribute” to the strategic plan to strengthen and or
further it.
-No specific opportunity for restructuring for efficiency or enhanced performance
-Program describes pre-existing contributions to strategic vision
-Program identifies and amplifies UM position to be a leader in such an innovative model nationally
-Program identifies statewide interdisciplinary areas of inquiry for workforce preparation
-Addressed impacts of additional resources as a way of achieving or aiding UM’s objectives and goals.
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 0.75
Meet some of the areas for Strategic Opportunities, but do not address the majority. The report states
faculty are being forced to teach above load without compensation. I am assuming that is the need for
Independent Study of AHMS 216 offered to allow students to graduate. Why this happened is not
clear, could an adjunct not be found? Why is the faculty not being paid extra to load, is the class size
too small? I applaud the search for a solution, but the way the information is provided creates
concerns.
Good recommendations for areas to relocate the program or share courses with the Mountain campus.Strengths:
Weaknesses:
Page 68 of 14511/13/2017
17Acad AP169 169 Medical Information Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 3 Score: 6 Weighted Score: 0.9
Could elaborate more on how program fits with the strategic vision.
Partial alignment with Strategic Vision, focus on workforce development. A program with potential to
grow into the future. Allegiance partnership will be the first nationally approved apprenticeship in the
area of medical insurance claims in US. Strategic yet modest investments in the program would have
beneficial impacts.
Strengths:
Weaknesses:
Page 69 of 14511/13/2017
17Acad AP170 170 Paralegal Studies-2Y 2Y
Priority for Substantial Modification
Average: 2.817 Range: 1.600
1. ALIGNMENT
Reviewer: 1 Score: 1 Weighted Score: 0.2
1. Mostly vague, salty, and unhelpful answers
1. Emphasizes one on one engagement
2. Steady employment opportunities for students
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.8
Focused on big-picture concepts, more specifics about how the unit itself aligns would have
strengthened the answer.
Only partially answered 1.2.
Good leadership-related information/alignment.
Good information regarding how important it is to have people who are trained in law.
Strengths:
Weaknesses:
Reviewer: 3 Score: 3 Weighted Score: 0.6
* Most of the responses did not adequately address the questions asked for this criteria.
Bullet 1 (UM 2020 Strategic Plan Values):
* Report adequately addresses 2 out of the 4 Strategic Plan Values.
Bullet 2 (How essential program is to UM):
* Report uses ABA reporting on student and faculty performance to back up how essential it is to UM.
Bullet 3: (Importance of program):
* Report discusses how paralegals help to keep legal costs down for clients when they are used
efficiently.
Strengths:
Weaknesses:
2. Demand
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
3 3 0.6 4 0.6 1 0.2 3 0.6 7 0.7 3 0.45 3.15Reviewer:
2 4 0.8 3 0.45 1 0.2 5 1 4 0.4 4 0.6 3.45Reviewer:
1 1 0.2 3 0.45 1 0.2 2 0.4 3 0.3 2 0.3 1.85Reviewer:
Ranking Category:
Consider for Development and/or Modification: 3
Priority for Substantial Modification: 14
Priority for Devlopment and Growth: 0
Total Count: 17
Page 70 of 14511/13/2017
17Acad AP170 170 Paralegal Studies-2Y 2Y
Priority for Substantial Modification
Reviewer: 1 Score: 3 Weighted Score: 0.45
1. Overall, the information provided in this section was unhelpful
1. Contributes to Law School enrollmentStrengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.45
More detail about enhancing faculty performance would have strengthened the answer.
Partnership with Great Falls Paralegal program.Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.6
* Response could have used more hard data in bullet two.
Centralized data:
* All centralized data was only provided for the department in which the paralegal program is
housed.
Bullet 1 (Existing collaborations or interdisciplinary activities):
* From the report: “The Paralegal Studies Program has an articulation agreement with the University
of Great Falls Paralegal Studies Program.”
Bullet 2 (Impacts on other programs if program was reduced):
* Enrollment in general education courses by paralegal students would decrease.
* Enrollment in law school could decrease.
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 1 Weighted Score: 0.2
1. Did not provide any information
1. N/AStrengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
Wasn't sure how to score--no information provided for Criterion 3.
Negative trend for number of majors.
N/AStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
No information given for research, service, or additional instruction data.
No supplied centralized data.Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 2 Weighted Score: 0.4
1. While students may be very successful out of this program, no convincing evidence was produced
1. Accredited by the American Bar AssociationStrengths:
Weaknesses:
Page 71 of 14511/13/2017
17Acad AP170 170 Paralegal Studies-2Y 2Y
Priority for Substantial Modification
Reviewer: 2 Score: 5 Weighted Score: 1
Again, more details/new information would have been helpful.
Faculty both licensed lawyers--participate in annual continuing education.
Positive anecdotal information about graduates employment/outcomes.
Accredited by ABA in Spring 2014.
Strengths:
Weaknesses:
Reviewer: 3 Score: 3 Weighted Score: 0.6
Report does not adequately address centralized data or bullets 1 and 2 of this criteria.
Centralized data:
None given as part of report.
Bullet 3 (Accreditation information):
American Bar Association accredited this program in Spring of 2014.
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 3 Weighted Score: 0.3
1. The author speaks to some sort of change or modification in service but provides no evidence
1. The administrative assistant works very hard and takes on a lot of duties
2. Faculty has taken on administrative burden
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.4
5.2 seems somewhat non-responsive.
One Admin Assoc supporting 19 faculty and adjuncts is beyond efficient.Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 0.7
This program is understaffed.
Centralized data:
Not applicable or not supplied to department.
Bullet 1 (Impact of changes in revenue or expenses):
An adjunct faculty member teaches 12-16 credits of this program per year while the only other faculty
member, also the program director, teaches the other credits (26-30) per year.
Bullet 2 (Efforts to increase efficiency):
Program is still running with very few human resources.
Bullet 3 (Administrative FTE information):
Program shares 1.0 FTE administrative assistant with 9 other programs.
Strengths:
Weaknesses:
6. OPPORTUNITY
Page 72 of 14511/13/2017
17Acad AP170 170 Paralegal Studies-2Y 2Y
Priority for Substantial Modification
Reviewer: 1 Score: 2 Weighted Score: 0.3
1. Read this entire report
1. Could work to help students join 4 year programs
2. Could strengthen recruiting efforts
3. Could pay faculty members more
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.6
Could have provided more information regarding alignment with the Strategic Vision document.
No information provided for 6.2.
Online course offerings, one-on-one student advising.
Potential for combined course in collaboration with the Law School and elective courses.
Strengths:
Weaknesses:
Reviewer: 3 Score: 3 Weighted Score: 0.45
* Report doesn’t address the strategic vision but it does address MUS’ Goals 1-3.
* Report doesn’t address how program could contribute to making UM a leader in interdisciplinary
programs. This is likely to program and ABA requirements though.
Bullet 4 (Allocation of additional resources):
Program could offer more elective courses and increase salaries of faculty to be more on par with
faculty members on the Mountain Campus. Recruitment efforts could also be improved through
hiring someone to carry out such duties.
Strengths:
Weaknesses:
Page 73 of 14511/13/2017
17Acad AP171 171 Sales and Marketing-Cert Cert
Priority for Substantial Modification
Average: 3.933 Range: 2.000
1. ALIGNMENT
Reviewer: 1 Score: 2 Weighted Score: 0.4
Don’t address any connections to the um mission or vision
economic need and viability for this program, interdisciplinary benefitsStrengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.8
•Centralized data is limited because data provided is for the entire Business Technology Applied
Science faculty and degree but author attempted to provide information where possible in report.
•Remains unclear who the actually are who teach in the certificate (all Business tech or subset).
•Fails to address Diversity in program efforts.
•SM Certificate has clearly stated alignments and actions with 3 of 4 Strategic plan 2020 areas.
•This certificate program is embedded within the Management sub-area with an addition of 4 credits
required (30 AAS, 34 SM Cert.).
•13 of the 34 credits appeal to Dual enrollment and Transition to College High School students.
•Efforts made to offer 21 of 34 credits online (70%)as sustainability effort.
•Sales and marketing data for job and careers is seen as a growth area ranging from 6>3% to 16.3%
depending on job specific areas.
•Provided nice data on affordability of degree and payback.
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
•Certain claims made in this section with regard to the alignment with the UM 2020 strategic vision
seem to be left fairly ambiguous, and do not adequately describe any sort of actionable steps being
taken or planned to further this alignment
•Adequately illustrates the interconnectivity between this certificate program and other degree
programs currently in existence
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 3 Weighted Score: 0.45
don’t effectively communicate their importance and demand in the Missoula college
would widely impact Missoula college in that it is a high student demand area, program contributes
classes to 5 Missoula college areas of concentration,
Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
2 4 0.8 5 0.75 1 0.2 3 0.6 4 0.4 5 0.75 3.5Reviewer:
1 2 0.4 3 0.45 3 0.6 2 0.4 4 0.4 6 0.9 3.15Reviewer:
3 5 1 7 1.05 3 0.6 4 0.8 5 0.5 8 1.2 5.15Reviewer:
Ranking Category:
Consider for Development and/or Modification: 2
Priority for Substantial Modification: 13
Priority for Devlopment and Growth: 0
Total Count: 15
Page 74 of 14511/13/2017
17Acad AP171 171 Sales and Marketing-Cert Cert
Priority for Substantial Modification
Reviewer: 2 Score: 5 Weighted Score: 0.75
•Central data not specifically available for this UOA.
•Because all data are for entire Business Technology, only idea is that 30% of courses serve out of
major students overall, and central data for Bus Tech show 40%+.
•This certificate was developed to enhance employability and knowledge in Sales and Marketing
within Management majors.
•States that Management area is a high (Q5) enrollment area in Business Technology (not sure where
this comes from-data provided shows criteria 2 Q’s to be 3,2,3).
•SM Cert. has relationships outside MC with programs such as Hellgate Finance Academy.
•Faculty in Management teach 11 courses across Business Technology areas; certificate is within these.
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.05
•States certain actions taken that seem to have been planned with the intention of further driving
demand, but fails to follow-up on the results (or anticipated results) of said actions leaving some
unnecessary vagueness in this section
•Sufficiently demonstrates high level demand for the program, supporting these claims with
quantifiable data
•Draws a clear connection between proliferated success of and support for this certificate program,
and the continued growth of enrollment figures (citing Missoula College as an area of significant
impact)
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 3 Weighted Score: 0.6
doesn’t relate anything to their mission, or the university mission statement
provides little to no information,Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
•As certificate program no central data on certificates provided in first part of worksheet.
•In 3.5 there is a low number of degrees awarded with highest number in 5 years being 6 lowest 1,
(Q1).
•No productivity data provided for faculty (unclear why others who teach courses in the area weren’t
discussed).
•There has been a Director (until 2015), and Interim Director (until 2017) but not evident in discussion
that any specific courses or faculty are otherwise dedicated to this certificate.
•Attributes declines and quintile of trend to popular appeal of retired Director and failures of Interim
Director.
•SCH/TT for quintile department level are quintile 4.Strengths:
Weaknesses:
Reviewer: 3 Score: 3 Weighted Score: 0.6
•Cites ineffective program direction as the reason behind what is noted as a significant drop in degrees
awarded in 2017, but fails to expound upon more specific, rectifiable difficulties where this is
concerned, or ways in which this recognized weakness is being addressed moving forward
None observed - inadequate information providedStrengths:
Weaknesses:
4. QUALITY
Page 75 of 14511/13/2017
17Acad AP171 171 Sales and Marketing-Cert Cert
Priority for Substantial Modification
Reviewer: 1 Score: 2 Weighted Score: 0.4
program shave been in state of disarray, in need of curriculum update,
provides no evidenced promoting the quality of their programStrengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.6
•Time to degree metric influenced by outlier in 2013 and not possible to interpret.
•Program has been in disarray since sudden retirement of Director and thus no assessment being done
although it was initiated.
•No advisory committee or curriculum updates.
•Some evidence students go on the UM BA in business and succeed (UM Business Plan Competition).
•Efforts were made to recruit students though outreach to local schools, radio spots, and phoning of
potential students at MC.
Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.8
•Information presented in this section seems to be heavily focused on lamenting difficulties incurred
as a result of personnel issues with individuals involved with the program over the last several years,
and how this has negatively impacted the ability to deliver programmatic quality, as opposed to
presenting ways in which potential or planned changes could help to address such issues
•Interim Program Director seems to demonstrate an interest in marketing the program through a
variety of means
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 4 Weighted Score: 0.4
student to faculty ratio may be an issue with raised class caps
making active efforts to be more efficient by increasing class sizes and offering a stricter and more
regimented schedule of courses
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.4
•No data on student metrics- all department level data.
•IDC etc. not relevant and Q1.
•Efficiencies in course offerings (merging of duplicate courses, offering courses once a year).
•Staffing cut and now 1 FTE serves 10 Department level faculty.
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 0.5
•In large part, the information presented in this section seems heavily weighted toward the negative
observations of the report author regarding changes that have occurred over the last several years,
which are supported by generalities in most cases – this as opposed to focusing upon how the program
could/should maximize efficiencies
•There is one bullet point at the end of the third portion of this criteria section in which the reporting
author references an analysis centralizing services: “An analysis of centralizing services has taken
place. Some services were modified or moved.” Failure to expound upon this seems like an
unfortunate missed opportunity
•Demonstrates the ability to utilize minimal administrative staff support FTE as efficiently as possible,
maximizing the return on investment in this individual and capitalizing upon this person’s capabilities
to the fullest extent
Strengths:
Weaknesses:
Page 76 of 14511/13/2017
17Acad AP171 171 Sales and Marketing-Cert Cert
Priority for Substantial Modification
6. OPPORTUNITY
Reviewer: 1 Score: 6 Weighted Score: 0.9
program is already struggling and has been on the decline for a few years
Making distinct efforts to “engage students where they are” lots of opportunity for online classes and
offerings, program meets a economic need so there may be room for growth as the need and market
grows, could merge with Electronics Technology into Business technology as the program was once
structured lessening the need for certain administration positions
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 0.75
•There appears to be a strong need for this certificate to have assigned faculty director to promote,
support and advise this program for students
•Strategic Vision evident in Management area where certificate supports specific expertise in Sales and
Marketing.
•Online, Dual Enrollment, and Transition to college opportunities are all working to reach students
where they are.
•National data support employment opportunities for mid level, 2-year degree training in business as
well as employee education for those already employed.
•Efficiencies have resulted in adjuncts with excellent skills and experience.
•Other opportunities exist that might allow greater recruiting and outreach for students and working
more closely with industry.
•Some feedback from industry was obtained at department level external review.
Strengths:
Weaknesses:
Reviewer: 3 Score: 8 Weighted Score: 1.2
None observed
•Provides tremendously detailed examples of ways in which the program could be expanded if
provided the necessary resources, using specific examples that seem pragmatic and exciting for the
potential future of the program at the same time
•Seems to realistically envision a path by which this certificate program fits within the scope of a more
ambitious vision in which Missoula College is leveraged as a premier provider of both training and
long-term support for the regional business community
Strengths:
Weaknesses:
Page 77 of 14511/13/2017
17Acad AP172 172 Computed Tomography-Cert Cert
Insufficient Evidence
Average: 4.467 Range: 1.200
Insufficient Evidence
1. ALIGNMENT
Reviewer: 1 Score: 7 Weighted Score: 1.4
None seen
- Directly responding to workforce need in Montana (rural)
- CT program only one in the state
- Fairly aligned with UM2020
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
•Limited description, how many students do the CT program, no data reported and statement
indicates incorrect data, but no explanation or details
•What is the contribution to state workforce development, how many are employed ie: into the
community and state following completion of the two courses
•Only program available in MTStrengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
"Meeting workforce demand" isn't really the same thing as sustainability.
This is the only "Computed Tomography" program in the state.Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 5 Weighted Score: 0.75
- Exploring external collabs but nothing concrete
- CT certificate vital part of radiological tech programStrengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.6
•What is a “large majority”? 5 people of 10 or 25 of 30?
•Collaboration efforts are being considered but no details describe that currently address student
needs or enhance faculty performance
•Option of a clinical rotation elementStrengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.05
Given the program's mission and objectives, there aren't any major weaknesses in this area.
This seems to be an "add-on" certificate to the Radiologic Technologist program, and adds to those
students qualifications in a positive way.
Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
2 5 1 4 0.6 3 0.6 5 1 4 0.4 4 0.6 4.2Reviewer:
1 7 1.4 5 0.75 3 0.6 6 1.2 5 0.5 5 0.75 5.2Reviewer:
3 5 1 7 1.05 2 0.4 3 0.6 5 0.5 3 0.45 4Reviewer:
Page 78 of 14511/13/2017
17Acad AP172 172 Computed Tomography-Cert Cert
Insufficient Evidence
3. Productivity
Reviewer: 1 Score: 3 Weighted Score: 0.6
- N/A in all response boxes and new program so no data
- Self reported increase in students in one semester certificate from 2016 (8 students) to 2017 (10
students) which would be quintile 1 for certificates
Strengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.6
•No information shared
N/AStrengths:
Weaknesses:
Reviewer: 3 Score: 2 Weighted Score: 0.4
The report didn't really say anything about the program's productivity. All three bullet points were
listed as "N/A", with no research, outreach, or instructional components. If they aren't doing ANY of
those three things, what are they doing?
The program seems to be growing (though we only have two years' worth of data).Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 6 Weighted Score: 1.2
- New as of 2016 so no students have completed national boards for student outcomes
- Self reported all participants in the 1 semester certificate program graduated
- Society of Radiologic Technologist compliant (not accreditation body but standard of industry)
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
Program is only 2 years old, not penalized for this
Certified CT radiologistStrengths:
Weaknesses:
Reviewer: 3 Score: 3 Weighted Score: 0.6
"Evidence suggests that students who have completed the CT program are more likely to find
employment." Only one example of this is given. Nothing is mentioned about overall placement rates,
either for those with the certificate or without. Can we really say that the evidence suggests this?
No particular strengths are mentioned, other than that the program meets national standards.Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 5 Weighted Score: 0.5
- Self reported SCH/FTE for 2016, 2017 would put in the first quintile
- New program so recruitment efforts and currently courses delivered via onlineStrengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.4
•N/A, not enough information, 2 years of details
•N/A, not enough information, 2 years of detailsStrengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 0.5
The program has one faculty member--will the program continue if this faculty member were to leave?
The program seems to operate very efficiently, as an additional component of a larger program.Strengths:
Weaknesses:
Page 79 of 14511/13/2017
17Acad AP172 172 Computed Tomography-Cert Cert
Insufficient Evidence
6. OPPORTUNITY
Reviewer: 1 Score: 5 Weighted Score: 0.75
- Response that the program is too small to contribute to the strategic vision of UM
- Opportunity to house within radiologic tech program (certificate is only one semester and 2 courses)
- Provides graduates in a sector that is needed in the state
- CT program recognized as state-wide leader as only program of its kind in MUS, has potential to
grow
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.6
•Demand in all areas not described, vague generalizations
•Workforce importance and reference to rural communities, need clarification and data identifying the
state demand though
Strengths:
Weaknesses:
Reviewer: 3 Score: 3 Weighted Score: 0.45
"As a stand-alone Certificate Program consisting of only two courses, the CT Program has limited
capacity to contribute to this Vision document." Everything that an organization does should
contribute to achieving its mission, even if only in small ways. I suspect that this certificate actually
DOES contribute to UM's mission, even if the author doesn't believe so. But if the author is correct in
saying that this program does not contribute to the mission, it begs the question: why are we doing it?
Health care workers are in demand.Strengths:
Weaknesses:
Page 80 of 14511/13/2017
17Acad AP173 173 Medical Assisting-2Y 2Y
Consider for Development and/or Modification
Average: 4.775 Range: 4.950
1. ALIGNMENT
Reviewer: 1 Score: 6 Weighted Score: 1.2
n/a
Criteria 1 - Bullet 1: excellent response
Criteria 1 - Bullet 2: very good response
Criteria 1 - Bullet 1: solid response
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
•None seen.
•The program promotes the UM2020 values of leadership, engagement, diversity, and sustainability,
emphasizing interpersonal skills.
•This program responds to workforce needs in the state. Reduction of resources would affect the
ability to respond to these needs, in addition to potentially affecting patient safety.
Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
No Answer
No AnswerStrengths:
Weaknesses:
Reviewer: 4 Score: 7 Weighted Score: 1.4
-
This program supports the core values Leadership, Engagement, and Diversity.
Reduction would impact the University contribution to the workforce.
Externships help prepare these students for future employment.
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 5 Weighted Score: 0.75
n/a
Criteria 2 - Bullet 1: solid response
Criteria 2 - Bullet 2: solid response
Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
2 5 1 7 1.05 4 0.8 4 0.8 3 0.3 8 1.2 5.15Reviewer:
3 1 0.2 3 0.45 2 0.4 1 0.2 1 0.1 1 0.15 1.5Reviewer:
4 7 1.4 5 0.75 5 1 7 1.4 7 0.7 8 1.2 6.45Reviewer:
1 6 1.2 5 0.75 6 1.2 6 1.2 6 0.6 7 1.05 6Reviewer:
Ranking Category:
Consider for Development and/or Modification: 9
Priority for Substantial Modification: 0
Priority for Devlopment and Growth: 3
Total Count: 12
Page 81 of 14511/13/2017
17Acad AP173 173 Medical Assisting-2Y 2Y
Consider for Development and/or Modification
Reviewer: 2 Score: 7 Weighted Score: 1.05
•None seen.
•The medical assisting program is intrinsically interdisciplinary, collaborating with other fields to
provide the necessary complement of courses to complete the program.
•The program shares many courses with other health care training programs. Curtailment would
affect many more programs than just this one.
Strengths:
Weaknesses:
Reviewer: 3 Score: 3 Weighted Score: 0.45
No contextual information available.
They produce a lot of General Education credit but I’m not sure with what programs they were
quintiled. Since it is a much lower number than other larger programs on campus.
Strengths:
Weaknesses:
Reviewer: 4 Score: 5 Weighted Score: 0.75
Additional reduction or curtailment of this program would impact its ability to continue.
The demand for this program is. Difficult to assess partially because the program was in moratorium
for three years. This program lacks the data to necessary to evaluate the enrollment trends.
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 6 Weighted Score: 1.2
N/A
Criteria 3 - Bullet 1 and 3 : thank you for noticing that a program only should respond to this if they are
applicable
Criteria 3 - Bullet 2: excellent response
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.8
•The lack of program faculty inhibit the program’s ability to keep up with demand for students.
•A very strong service learning program benefits both students and the medical facilities in which they
are placed.
•This program was pulled out of moratorium in response to workforce needs.
Strengths:
Weaknesses:
Reviewer: 3 Score: 2 Weighted Score: 0.4
No indication of a graduation rate.
They have a steady number of students enrolled as majors.Strengths:
Weaknesses:
Reviewer: 4 Score: 5 Weighted Score: 1
Lack of dedicated FTE makes it difficult for the program to reach its potential in the area of service and
outreach.
Data indicates an increase in enrollment but the two years it has not been in moratorium is not
adequate to establish a trend
Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 6 Weighted Score: 1.2
N/A
Criteria 4 - Bullet 1: excellent response with very good supporting data
Criteria 4 - Bullet 2: appropriate response
Strengths:
Weaknesses:
Page 82 of 14511/13/2017
17Acad AP173 173 Medical Assisting-2Y 2Y
Consider for Development and/or Modification
Reviewer: 2 Score: 4 Weighted Score: 0.8
•This program is provided through faculty at Great Falls College and a clinical site at Western
Montana Clinic. There are no UM faculty.
•A UM program director must be hired in order to be eligible for national accreditation.
•100% of graduates passed the national boards.
•The curriculum has been designed to be compliant with national accreditation standards.
Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
Central data provides no information in this category.
N/AStrengths:
Weaknesses:
Reviewer: 4 Score: 7 Weighted Score: 1.4
There is no dedicated faculty for this program.
The program can be completed within two years.
This program has a higher than average pass rate for students in national testing.
Although this program is not currently accredited, it has been working on goals to meet the
requirements. The position of Program Director has not been filled and this is the primary obstacle to
accreditation.
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 6 Weighted Score: 0.6
N/A
Criteria 5 - Bullet 1: a solid (though disappointing to see the facts) response
Criteria 5 - Bullet 2: good response
Criteria 5 - Bullet 3: excellent response
Strengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.3
•There is only one admin associate for six health science programs – unsustainable.
•No dedicated faculty – need to hire a director and a laboratory faculty.
The program is hanging on with borrowed faculty and a slice of administrative support.Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.1
No central data available.
N/AStrengths:
Weaknesses:
Reviewer: 4 Score: 7 Weighted Score: 0.7
Loss of Administrative support has created an unsustainable situation for the department. If additional
staff cannot be added, then the department may have to downsize.
There is a critical need for additional administrative support.
This program has effectively partnered with Gt Falls College and Western Montana Clinic to sustain
itself but if it is to continue, this program requires additional resources.
Strengths:
Weaknesses:
6. OPPORTUNITY
Page 83 of 14511/13/2017
17Acad AP173 173 Medical Assisting-2Y 2Y
Consider for Development and/or Modification
Reviewer: 1 Score: 7 Weighted Score: 1.05
(It looks like there was some duplication of responses here)
Criteria 6 - Bullet 1: excellent response
Criteria 6 - Bullet 2: superb response
Criteria 6 - Bullet 3: solid response
Criteria 6 - Bullet 4: excellent response
Strengths:
Weaknesses:
Reviewer: 2 Score: 8 Weighted Score: 1.2
•None seen here – only opportunities.
•This is a program in great need of strengthening to fulfill its potential. Providing these health care
professionals will fulfill a need in the Montana workforce.
•The opportunities to revive a health professional program, if possible, with be able to address the
Strategic Vision.
•Additional resources are necessary to allow this program to fulfill its potential.
Strengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.15
No responses provided.
N/AStrengths:
Weaknesses:
Reviewer: 4 Score: 8 Weighted Score: 1.2
If this program is to continue, UM must invest in a Program Director. This program should continue to
try and fulfill its goal for accreditation. Additional collaboration could potentially bring life to this
program with minimal investment. However, this program needs more than a Program Director. It
needs a sustainable plan for outreach, service, and administrative support.
This program is in alignment with Strategic Opportunity 1: Engage students where they are & Strategic
Opportunity 3: Partner with Place
This program provides an opportunity to the community to gain skills in support of the medical fields,
an occupational area that has always been strong. Eliminating this program would require students to
leave the community to study in programs elsewhere.
The program provides externships where students can work in the community and build the
relationships they need to find employment.
Based on student testing, compared to national standards, this program has the potential to be a
national leader in the area. Investing in this program and developing on-line content, as suggested,
could further UM’s recognition a program leader in the state.
Strengths:
Weaknesses:
Page 84 of 14511/13/2017
17Acad AP174 174 Pharmacy Technology-Cert Cert
Consider for Development and/or Modification
Average: 5.850 Range: 3.450
1. ALIGNMENT
Reviewer: 1 Score: 8 Weighted Score: 1.6
-The report asserts that demand for Pharmacy techs is strong, but does not provide evidence that this
field will continue to grow.
-The program provides students with hands-on experience working with members of other disciplines,
which aligns with the goals of UM2020.
-The program fills a need for pharmacy techs in the community and across Montana.
-The program adapts to changes in the field. Students are well-prepared for their certification exams
Strengths:
Weaknesses:
Reviewer: 2 Score: 8 Weighted Score: 1.6
No excess faculty. Any cuts to program would result in loss of accreditation.
Only program of its type in the state; collaborates with MSU-B City College to deliver courses in
Eastern Montana. Prepares students for long-term economic and workforce needs. Certificate pass
rate is 94%, compared with approximately at 60% rate nationwide. Demand for Pharm Techs is high.
Clearly aligns with UM 2020 Strategic Plan
Strengths:
Weaknesses:
Reviewer: 3 Score: 3 Weighted Score: 0.6
Limited direct reference to UM 2020, no specific reference to cultural objectives, diversity or
engagement.
Alignment with mission focused around workforce development and leadership. Direct opportunities
for employment. The program runs about as lean as possible, a reduction in funds would end the
program. High rate of pass on certification exam.
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 5 Weighted Score: 0.75
-The is little evidence of interdisciplinary collaborations
-The program provides a course for Medical Coders and TranscriptionStrengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 8 1.6 5 0.75 4 0.8 4 0.8 8 0.8 7 1.05 5.8Reviewer:
2 8 1.6 6 0.9 7 1.4 8 1.6 9 0.9 8 1.2 7.6Reviewer:
3 3 0.6 4 0.6 3 0.6 6 1.2 4 0.4 5 0.75 4.15Reviewer:
Ranking Category:
Consider for Development and/or Modification: 14
Priority for Substantial Modification: 1
Priority for Devlopment and Growth: 1
Total Count: 16
Page 85 of 14511/13/2017
17Acad AP174 174 Pharmacy Technology-Cert Cert
Consider for Development and/or Modification
Reviewer: 2 Score: 6 Weighted Score: 0.9
Ranks in quintile #2 for demand, but this is understandable given that this is a highly specialized
program.
Provides a dual credit course with high schools. Program has an 82% retention rate; current
employment rate in the field is 64%. Program graduates roughly 10 certified tech students yearly.
Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.6
No gen ed courses, and low contribution to non-majors.
Noted collaboration with community and regional health providers as well as opportunity for
interaction with regional high schools.
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 4 Weighted Score: 0.8
-The employment rate (64%) seems low, though the report does not specify a time period for that
number
-The report highlights an issue with the centralized data, which is that the certification exam pass rate
may be a better measure of student success than the certificate of completion rates
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.4
Program ranks in the 2nd quintile for number of majors, 5 YA of degrees awarded, and in the lowest
quintile for student FTE/instructional FTE ratio.
Program is now sharing online classes with MSU-B City College, expanding their reach by providing
classes to more students. Opportunity for expansion is great.
Strengths:
Weaknesses:
Reviewer: 3 Score: 3 Weighted Score: 0.6
Low number of majors and a strong downward trend in majors and graduation rates (potentially
skewed by fact that this is a two year program). Low student FTE per instructional FTE, but strong
downward trend.
Very high level of student retention and success. Certification exam scores at 94% where national
average is below 60%. Working with MSU Billings with on line offerings. Could have described
service and outreach to community as described above.
Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 4 Weighted Score: 0.8
-The report again cites exam pass rates and employment rates as evidence of the quality of student
outcomes, yet the employment numbers seem weak (again, depending on the time period). Additional
information (comparison data, for example) would be helpful.
-The report provides strong evidence of faculty qualityStrengths:
Weaknesses:
Reviewer: 2 Score: 8 Weighted Score: 1.6
None found.
Program ranks in the 4the quintile for time to degree. Student outcomes excellent, with 94% passing
the national certification exam. Program has been consistently accredited since 1996 and is accredited
through 2020.
Strengths:
Weaknesses:
Page 86 of 14511/13/2017
17Acad AP174 174 Pharmacy Technology-Cert Cert
Consider for Development and/or Modification
Reviewer: 3 Score: 6 Weighted Score: 1.2
No specific weakness on quality
Time to degree is actually closer to 2 semesters, skewed by the fact that students don’t sign up
immediately. Good reputation with employers and stake holders. High retention rates and as noted
above, high pass rates on certificates. Award winning primary instructor.
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 8 Weighted Score: 0.8
-Because the project with Billings is new, it is difficult to assess how successful that program will be
-The program has increased revenue by collaborating with City College in Billings.
-Program costs are low
Strengths:
Weaknesses:
Reviewer: 2 Score: 9 Weighted Score: 0.9
None found.
Shares Intro to Pharmacy course with other medical training programs; 1.1 faculty FTE devoted to the
program, which is entirely online.
Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.4
No grant expenditures or IDC generated
One to 0.5 FTE instructor with 10 – 25 majors. On-line courses being gained by sharing the online
program with City College in Billings.
Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 7 Weighted Score: 1.05
-The program does not contribute to general education, and it does not propose any way that it might
begin contributing
-There seems to be potential for growth in the program, if the Billings collaboration is successfulStrengths:
Weaknesses:
Reviewer: 2 Score: 8 Weighted Score: 1.2
None found.
New partnership with MSU-B City College may serve as a model for the state, since the program is
online. UM/MC could offer this course throughout the state.
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 0.75
No sense of how additional resources would improve student enrollment or success.
Good alignment with Strategic Vision, focus on students, place and workforce development. On-line
format yields numerous opportunities for sharing and collaboration.
Strengths:
Weaknesses:
Page 87 of 14511/13/2017
17Acad AP175 175 Radiologic Technology-2Y 2Y
Consider for Development and/or Modification
Average: 5.567 Range: 0.350
1. ALIGNMENT
Reviewer: 1 Score: 7 Weighted Score: 1.4
No apparent weaknesses.
"The Program is essential to UM and Missoula College because it is the state’s first, largest and most
successful such program, one of only four in total"- The program does a good job explaining in detail
how it fits the UM mission through engagement and leadership.
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.4
The relationship to sustainability (broadly defined) could be more effectively explained.
It was unclear how workforce needs may change in the years to come.
Connections were made with each of UM's four core values.
The Radiologic Technologist program is the state's first, largest, and most successful such program.
Montana's health care facilities rely on the program's graduates.
Social and cultural aspects of the students' preparation are well addressed within the program.
Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.8
•Only a very small percentage of graduates are reported to actually move into the more advanced
fields.
•A number of claims go unsubstantiated, for example, with reference to interdisciplinary curriculum,
diversity, intercultural sensitivity, and compassionate patient care.
• Work force preparation is purpose of the program. This program not only produced qualified
radiologic technologists but is gateway to more advanced programs in radiation therapy, Nuclear
Medicine, Ultra-sound, etc.
Strengths:
Weaknesses:
2. Demand
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 7 1.4 4 0.6 6 1.2 4 0.8 6 0.6 8 1.2 5.8Reviewer:
2 7 1.4 4 0.6 5 1 4 0.8 6 0.6 7 1.05 5.45Reviewer:
3 4 0.8 6 0.9 6 1.2 5 1 5 0.5 7 1.05 5.45Reviewer:
Ranking Category:
Consider for Development and/or Modification: 15
Priority for Substantial Modification: 0
Priority for Devlopment and Growth: 1
Total Count: 16
Page 88 of 14511/13/2017
17Acad AP175 175 Radiologic Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 1 Score: 4 Weighted Score: 0.6
The programs ranked in the 2nd quintile for SCH for gen-ed course, 1st on sch for gen-ed per
instructor, and 2nd in sch for non-majors.
(The Radiologic Technologist Program accepts a cohort of students each year, and does not offer
classes to non-majors)
The program does not explain well how it is high demand, but does state that they advise 100 students
a year on entering the program.
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.6
The Radiologic Technologist program does not offer classes to non-majors, so the metrics for this
criteria were in the bottom two quintiles.
The program is running at capacity, and the faculty advise over 100 prospective students each
semester.
This program collaborates with five other Health Profession programs to provide a "Trauma Day," and
also partners with organizations in the community (e.g., Missoula Bone and Joint).
Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 0.9
N/A
The clinical program is said in report to run at capacity. More resources would allow them to expand
the number of students admitted into the program.
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 6 Weighted Score: 1.2
Ranked in the 1st quintile for number of Majors.
ranked in 5th quintile for trend over 5 years. 4th quintile for degrees awarded and 5th for trend over 5
years. "each of the 12 students in a yearly cohort performs over 1,000 hours of dedicated service in
health care facilities including hospitals, critical care facilities and outpatient clinics."
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
The Number of Majors was in the lowest quintile. However, there is only room for 12-14 students, so
there are always more students interested in the program than they are able to accept.
The productivity of the Instructional Component of the program was not well defined.
The 5YA of degrees awarded was in the 4th quintile.
The service components for this program were well articulated. Service learning is a core aspect of the
program, and very positive feedback has been received for the service rendered in clinical rotations.
Each of the 12 students in a yearly cohort performs over 1,000 hours of dedicated service in health care
facilities.
Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 1.2
N/A
•N/A in research, publication, and creative activity because this is stated not to be a part of the
program mission
•Clinical students provide many hours of service to medical facilities.
Strengths:
Weaknesses:
4. QUALITY
Page 89 of 14511/13/2017
17Acad AP175 175 Radiologic Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 1 Score: 4 Weighted Score: 0.8
5YA time to degree Is in the 1st quintile. No other data provided for this criteria.
"Our student headcount maintains a constant number with an average of 1% attrition rate over the last
5 years".
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.8
The time to degree was in the lowest quintile.
More details could have been provided about the quality of faculty outcomes.
Test scores on national exams were high, with 87% of students passing on the first time. 77% of
graduates are working within the field.
Two of the faculty were appointed by Montana's Governor to the Montana State Board of Radiologic
Technologists.
Although the program is not officially accredited, it is in compliance with all of the accreditation
standards.
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
N/A
•Job placement for 77% of graduates.
•Both of the two core faculty have been appointed by the governor to the state board that oversees
licensing in this field.
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 6 Weighted Score: 0.6
No data provided. The program has not seen major reduction, mostly because of accreditation
requirements.
The program recognized their strict faculty requirements for accreditation and found a way to
restructure the curriculum to add more students without adding more faculty.
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 0.6
The decreased administrative support is a significant challenge to this program. However, the report
did not highlight many efforts to improve efficiencies.
The program's faculty have taken on additional responsibilities as one of the administrative associate
positions was eliminated.
A curriculum restructuring occurred in 2015 that allowed the program enrollment to expand from 12
to 14 students.
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 0.5
•The number of administrative staff that serve all the health related programs at Missoula College has
been reduced from two to 1, putting extra pressure on faculty to do routine administrative functions.
•The willingness and ability of faculty to make up for the loss of administrative staff described below
in this section as a program weakness.
•Centrally generated data was unable to report for this program. Report estimates that SCH/Faculty
FTE at about 150.
Strengths:
Weaknesses:
6. OPPORTUNITY
Page 90 of 14511/13/2017
17Acad AP175 175 Radiologic Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 1 Score: 8 Weighted Score: 1.2
no obvious weakness.
"Investing in the Program by developing advanced degrees in CT, Ultrasound or MRI would attract
new students and retain many UM graduates who currently leave the state for these advanced
degrees."
The program has strong alignment with the strategic vision 1.1, and a well laid plan for expansion.
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.05
Interdisciplinary and other collaborative initiatives could be explored more extensively.
This section of the report was very well written, with concrete ideas for moving the program forward.
Four of the five strategic opportunities were addressed very effectively.
The program fulfills a demonstrated state-wide need in the health care sector.
The report included an innovative proposal to restructure the Rad Tech program to include the
Computed Tomography (CT) certificate.
Investing in adjunct faculty would allow the program to grow to 18-20 students.
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.05
•Training constrained currently by lack of adequate lab technology, which is expensive to purchase.
•Already doing outreach to rural clinics, where the need is high. This outreach also allows for more
job placements of graduates.
•Potential exists for online courses that would expand access to students.
•Integrating computerized tomography, for which there already exists a stand alone certificate, into
the core program would make graduates even more competitive in the job market.
Strengths:
Weaknesses:
Page 91 of 14511/13/2017
17Acad AP176 176 Respiratory Care-2Y 2Y
Consider for Development and/or Modification
Average: 5.417 Range: 1.850
1. ALIGNMENT
Reviewer: 1 Score: 4 Weighted Score: 0.8
-The report does not provide much specific information about workforce demand; overall, this section
did not provide much detail or evidence
-The authors argue that the program meets workforce demand, but do not provide other arguments
for why this program is essential to UM.
-The report presents strong evidence that the program promotes engagement with the community,
which aligns with UM2020
-The report states that there is excess demand for the program, and that it fills a crucial need
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
No specific information was provided on coursework or field placements that align with the
universities overall mission.
The Respiratory Care Program (RCP) provides students with Leadership, Engagement, Diversity, and
sustainability by way of presentations at statewide conferences, health fairs, coursework on diverse
populations and by exceeding standards in the health care field. Reductions would make it impossible
to meet workforce demands and graduate students. The RCP maintains close working relationships
with the professional community.
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
•Justification of essentiality to UM is minimal.
•Demonstration of how program prepares students for 21st-century needs lacks specificity.
•Program aligns with some aspects of UM’s vision, such as engagement, leadership, and diversity.
•Program contributes to 21st-century needs both by emphasizing “rapid change experienced in
medicine today” and by faculty remaining “current with literature and technological developments in
the field.”
Strengths:
Weaknesses:
2. Demand
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 4 0.8 5 0.75 6 1.2 9 1.8 7 0.7 8 1.2 6.45Reviewer:
3 5 1 3 0.45 5 1 5 1 7 0.7 7 1.05 5.2Reviewer:
2 5 1 4 0.6 5 1 5 1 4 0.4 4 0.6 4.6Reviewer:
Ranking Category:
Consider for Development and/or Modification: 16
Priority for Substantial Modification: 0
Priority for Devlopment and Growth: 0
Total Count: 16
Page 92 of 14511/13/2017
17Acad AP176 176 Respiratory Care-2Y 2Y
Consider for Development and/or Modification
Reviewer: 1 Score: 5 Weighted Score: 0.75
- There isn't evidence that this program promotes interactions outside of the Health Professions
programs
-The program seems reasonably well-integrated with other Health Professions programsStrengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.6
No metrics given on the number of applicants vs those accepted.
Number of Majors and Metric 2: Trend over 5 years was in the first quintile. All other metrics were in
the second quintile.
RCP collaborations includes regular lectures to Nursing, Radiologic Technology, Medical Assisting,
Physical Therapy and partnerships with Missoula Bone and Joint. RCP hosts "Trauma Day", which
brings together students from 5 Health Professions programs to perform a trauma simulation with a
mock assessment, diagnosis and treatment on a hypothetical patient. Reductions to the RCP would
cause the program to decrease the number of students it accepts.
Strengths:
Weaknesses:
Reviewer: 3 Score: 3 Weighted Score: 0.45
•Program has minimal interdependence/collaboration with other programs at UM. Reduction in size
would have limited impact on the university.
•Program does not identify potential impacts on other programs
•Program participates in Trauma Day: “an integrated training day that brings together students from 5
Health Professions programs to perform a trauma simulation.”
• “Faculty routinely give lectures to Nursing, Radiologic Technology, Medical Assisting, and Physical
Therapy students across multiple campuses.”
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 6 Weighted Score: 1.2
-The authors are not able to provide evidence of quality instruction
-The program appears to effectively measure the benefits of its students' clinical rotations. These
rotations seems to be useful both to students and the patients they servce
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
Specific data on productivity for the RCP is available on request and not provided by the author for
this report. The author noted that is difficult to obtain feedback measures on the work that students
perform.
The Respiratory Care Program has a significant (720 hr.) service learning component centered around
bedside clinical rotations that provide direct benefits to students as well as the facilities that host them
and the patients they serve. All measures have been beyond satisfactory and are reported out to the
RCP's Accreditation Organization on an annual basis. Copies of all relevant data are archived and
available from multiple sources upon request. RCP's 5 year average Time to Degree is 2.5 years for a
72 Credit A.A.S. Degree
Strengths:
Weaknesses:
Page 93 of 14511/13/2017
17Acad AP176 176 Respiratory Care-2Y 2Y
Consider for Development and/or Modification
Reviewer: 3 Score: 5 Weighted Score: 1
•Report lacks specific evidence and refers to sources “upon request.”
•Report does not demonstrate any measurement of the instructional component of its mission, stating
only “it is extremely difficult to measure the quality of compassionate patient care that our students
provide.”
•Centralized data scores are low (although trend of student/instructional ration is good)
* Program appears to meet its mission.
* Missoula College Health Professions do not contain a Research, Scholarly, or Creative component
* Program “has a significant (720 hr.) service learning component centered around bedside clinical
rotations. […] All measures have been beyond satisfactory and are reported out to our Accreditation
Organization on an annual basis. Copies of all relevant data are archieved [sic!] and available from
multiple sources upon request.”
Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 9 Weighted Score: 1.8
-None
-Graduates of this program do well on certification exams and in the job market.
-Strong evidence of faculty performance
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
No information on placements of graduates.
RCP's graduates are passing their NBRC (National Board of Respiratory Care) Credentialing exams
with an average score approaching 150% of the national mean score and have been doing so,
consistently, for the past 5 years.
Students first time pass rates on national credentialing examinations have been 100% for the past 5
years.
Faculty IPR's are extremely positive
Continuing Education Units (CEU's) required for maintenance of professional licensure.
Respiratory Care Faculty served as the Health Programs department Chair for 3 of last 5 years
Student Course Evaluations are consistently 4+/5
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
•Evidence of faculty outcomes is meager. Report lacks evidence, is overly vague, e.g. “Faculty IPR's
are extremely positively reviewed.”
•Report refers to outside data (“available for review”)
•Program demonstrates some strong student outcomes: 1.) Graduates pass their credentialing exams
with an average score approaching 150% of the national mean score; 2.) Student first-time pass rates on
national credentialing examinations have been 100% for the past 5 years.
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 7 Weighted Score: 0.7
-The program requires additional funds to continue to be effective, because the single admin is unable
to meet demands
-The program has found ways to share costs of equipment and administrationStrengths:
Weaknesses:
Page 94 of 14511/13/2017
17Acad AP176 176 Respiratory Care-2Y 2Y
Consider for Development and/or Modification
Reviewer: 2 Score: 4 Weighted Score: 0.4
Faculty and non-faculty expenses have trended downward for the Respiratory Care program over the
past 5 years due to very aggressive measures taken by the Program. However, there is no mentions of
what these aggressive measures taken by the RCP are or how they compare nationally.
In June 2017 Administrative Associate support was reduced from 2 FTE to 1 FTE for the entire Health
Professions Department, leaving one person to support all six Health Programs. This has created an
untenable situation for the entire Department, and our single Admin Assistant is unable to meet the
demands for all of our Health Programs. This has burdened Program faculty with many routine
administrative tasks and is presenting a great challenge to our Program’s efficiency. Administrative
support for the program is already shared.
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 0.7
N/A
•Program has undertaken some efforts to improve efficiency.
•Program reports it has taken “aggressive measures” with expenses: Administrative Associate support
reduced from 2 to 1 FTE for all six Health Programs, burdening faculty with routine administrative
tasks (unclear whether this came from within the program or from the Dean)
•Program “heavily leaverages [sic!] community partnerships in order to secure cutting edge
equipment and expertise at reduced or typically no cost to the students or the University.”
•“Acquisition of new equipment and/or supplies is prioritized based upon its utility to multiple
diciplines [sic!].”
Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 8 Weighted Score: 1.2
-The report does not project future workforce needs.
-The program aligns with UM's goals of partnering with place and meeting students where they are
-The program provides needed services in rural areas
-The report suggests that very modest investments could add substantial value to the program
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.6
No mention of what it would take to improve graduation rates or student retention.
The RCP by accreditation standards could not be combined with other programs. The workforce needs
of Montana’s Healthcare sector are well documented, and Missoula College’s Health Professions
Programs have been a major provider of emerging talent to fill those needs for decades.Our Programs,
including Respiratory Care, are already recognized as state-wide leaders in this effort. With only
modest investment in laboratory equipment for the Program, the RCP could more efficiently teach
students the hands-on skills needed in the profession.
Strengths:
Weaknesses:
Page 95 of 14511/13/2017
17Acad AP176 176 Respiratory Care-2Y 2Y
Consider for Development and/or Modification
Reviewer: 3 Score: 7 Weighted Score: 1.05
•Program does not offer opportunity for restructuring (due to specific requirements of accreditation
and credentialling, restructuring is “challenging.”)
•Program offers some significant opportunities to enhance UM.
•Program offers significant contributions to UM’s new Strategic Opportunities:
1.)Program “engages students where they are […], through advising and career counseling, blending
modes of educational delivery, and linking students with job opportunites [sic!] ”.
2.)Program “invests in Leadership and Professional Development by aligning
students [with] working professionals as well as future Health students, and by supporting faculty as
they engage with state and national associations.”
3.)“By supporting student rotations in rural areas, the Program Partners With Place.”
•Program contributes to state-wide needs.
•Requests “modest investment in laboratory equipment” to teach more efficiently.
Strengths:
Weaknesses:
Page 96 of 14511/13/2017
17Acad AP177 177 Registered Nursing-2Y 2Y
Consider for Development and/or Modification
Average: 5.733 Range: 2.050
1. ALIGNMENT
Reviewer: 1 Score: 8 Weighted Score: 1.6
Program should provide more substantial evidence for essentiality to UM.
Program enacts leadership skills and engagement with the nursing field through clinical rotations and
laboratory practice. The program enacts the value of diversity through weaving cultural sensitivity in
the nursing curriculum for diverse patients. Program provides strong response to bullet 1.
Program demonstrates alignment with UM mission and provides argument for its essentiality to UM
through workforce demand and student demand.
Program prepares students to be registered nurses for a diverse set of patients. Program demonstrates
a preparation clear workforce need with sufficient evidence.
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
Listing the number of graduates each year doesn't address whether/how the program contributes to
sustainability.
The "cultural diversity component" of this program, if done well, certainly contributes to UM's goals
for diversity.
There are opportunities in the field of nursing for which this program can help prepare students.
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.4
No specific weakness in alignment
Clearly described alignment with the UM 2020 strategic plan. Specific emphasis on unique
educational experiences through clinical placement, workforce development, and cultural diversity
training. Generate a high quality product with a high demand for nurses in the state and the profession
places ethical trustable individuals within communities. Clear future demand for these grads.
Strengths:
Weaknesses:
2. Demand
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
2 5 1 4 0.6 4 0.8 5 1 4 0.4 5 0.75 4.55Reviewer:
3 7 1.4 6 0.9 7 1.4 7 1.4 6 0.6 6 0.9 6.6Reviewer:
1 8 1.6 6 0.9 6 1.2 6 1.2 4 0.4 5 0.75 6.05Reviewer:
Ranking Category:
Consider for Development and/or Modification: 14
Priority for Substantial Modification: 0
Priority for Devlopment and Growth: 1
Total Count: 15
Page 97 of 14511/13/2017
17Acad AP177 177 Registered Nursing-2Y 2Y
Consider for Development and/or Modification
Reviewer: 1 Score: 6 Weighted Score: 0.9
Program does not address how collaboration has enhanced faculty performance.
Program should provide greater detail about existing collaborations.
Data sheet info regarding gen-ed courses is incorrect as the nursing program does not teach any
general education courses. Program does not offer courses to non-majors countering its placement in
quintile 2 for this metric.
Program demonstrates collaboration with other UM programs that practically address student needs
in their education.
Program provides evidence that the number of nursing students enrolled in other missoula college
courses is great and that this decline in enrollment through curtailment of the nursing program would
impact other programs.
Program demonstrates high demand in applicants.
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.6
Internal (within-UM) demand for this program doesn't seem to be especially strong. But this is a
specialized program--I wouldn't EXPECT the internal demand to be strong.
Students in this program take gen-eds and other courses from other programs.Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 0.9
No gen ed courses and no courses for non-majors. No collaborations described outside of Missoula
College, but just an oversight as there is a large medical community level collaboration (as described in
Productivity).
No centralized data for any of the demand criteria. Noted collaboration in other health profession
degree programs at Missoula College. A loss of this major would have a big impact on biology and
chemistry offerings (RN students number about 110) and additional impacts on psychology and
sociology courses where RN students make up a good portion of those as well. RN program admits 18
students each semester.
Strengths:
Weaknesses:
3. Productivity
Page 98 of 14511/13/2017
17Acad AP177 177 Registered Nursing-2Y 2Y
Consider for Development and/or Modification
Reviewer: 1 Score: 6 Weighted Score: 1.2
Program put N/A and stated that it does not have a research, scholarly, or creative component.
Program does not provide sufficient measure of productivity of outreach.
Program does not provide sufficient evidence of performing outreach.
Program does not provide clear evidence of this additional instructional component such as logged
hours but merely states this component.
Program demonstrates steady number of degrees awarded and is in quintile 5. Program has a steady
number of “majors” and sees a drastic increase in number in 2017, placed in quintile 3.
Program engages in health related community outreach such as flu shots and blood pressure clinics.
Students and the elderly provide positive feedback about this outreach through word of mouth.
Program demonstrates additional instructional components being additional clinical instructor hours
logged due to a required faculty ratio of 10:1 and decreased patient numbers. Instructors are stated to
be working twice as hard as students.
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.8
The report states: "The Registered Nursing Program does not have a research, scholarly or creative
mission." It seems unusual for a program (even at the 2-year-college level) to have NO aspirations for
advancing the knowledge in their field.
Outreach for the Nursing Program is very strong.Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.4
No scholarly or creative activities.
Good number of majors annually (72). Consistent rate of degrees awarded and a relatively high
number for 5YA for degrees awarded. Students and faculty participate in various community outreach
activities in the health profession. State board limits the student to faculty ration to 10:1 in the
hospital. The program maintains 18:1, thus students divided into two groups for hospital rotations.
Large demand on instructor time.
Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 6 Weighted Score: 1.2
Program provides insufficient evidence to demonstrate quality of faculty outcomes.
Program placed in quintile 4 for 5ya time to degree.
Program demonstrates clear evidence of high quality of student outcomes (ex: Nursing Program
NCLEX-RN pass rate for first time test takers this year is 93.3%. The national average is 88.4%).
Program was accredited in 2016 and was awarded accreditation until 2024. Eight years of continued
accreditation is the longest period of time ACEN will award to a nursing program which demonstrates
the quality of nursing program.
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
When discussing the quality of faculty outcomes, the report says that faculty "maintain competence in
our clinical areas of expertise." Do any of the faculty go beyond "maintaining competence"?
Scores on licensing exams (NCLEX-RN) are above the national average--great job! And congrats to
those students.
Strengths:
Weaknesses:
Page 99 of 14511/13/2017
17Acad AP177 177 Registered Nursing-2Y 2Y
Consider for Development and/or Modification
Reviewer: 3 Score: 7 Weighted Score: 1.4
No specific weaknesses
High rate of pass on the standardized testing, 93% pass versus a national average of 88%. Good wages
and good job placement. Instructors are high quality and have to maintain certifications to be in the
program. Program fully accredited for 10 years. Good rate on time to degree completion.
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 4 Weighted Score: 0.4
Program has no central data provided for all of criteria 5.
Program lost the tenured director of the program caused a rivet in adequate programmatic
directorship and the program is unable to hire another tenured faculty to fill position.
Program vaguely describes efforts to improve efficiency but does not do so in an adequate manner.
Program should be more specific and provide evidence.
Program does not demonstrate how administrative reduction will impact teaching or outreach.
Program does not address centralization of administrative duties.
Program states that competition between two other nursing programs limits availability in local
hospitals for clinical hours so contracts with rural hospitals allow interested students to complete
hours outside of Missoula.
Administrative FTE recently reduced from 1.0 to .5. This caused additional administrative work for the
program director. Program argues that this will have a “trickle down effect” causing students to have
more difficulty navigating the program.
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.4
A lot of the quantitative data is missing for this criteria, which makes judgments regarding efficiency
difficult. (The data is missing from the centralized data, and the program seems to have made no effort
to find or provide that data.)
Like many programs on campus, this program seems to have managed to "do more with less" over the
last few years.
Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 0.6
Basically no grant expenditures or IDC generated.
No centralized data on any of the efficiency metrics. Received a small amount of external funding.
Loss of one tenure track position has created a hardship for the program. Shifted to a partial online
format to improve efficiency and delivery, this really helps with the clinical students. Program lost 0.5
of an admin assistant due to budget cuts.
Strengths:
Weaknesses:
6. OPPORTUNITY
Page 100 of 14511/13/2017
17Acad AP177 177 Registered Nursing-2Y 2Y
Consider for Development and/or Modification
Reviewer: 1 Score: 5 Weighted Score: 0.75
Program does not provide additional innovative ideas for contribution or engagement with strategic
opportunities.
Program does not provide additional or innovative suggestions for establishing UM as a leader.
Program demonstrates contributions to engagement of students where they are through educating
nurses in rural communities and meeting workforce demand as well as providing an accessible and
affordable curriculum.
Program demonstrates establishment of UM as a leader in the nursing profession through meeting
workforce needs and engaging with other health profession programs.
Program proposes the offering of online nursing courses to accommodate rural students.
Program states that investment in the program would allow for an increase in registered nurses due to
acceptance of more students to meet the growing workforce demand.
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 0.75
The majority of this report stressed the importance of one-on-one (or few-on-one) contact hours with
students. Is a distance-learning model really appropriate, given the importance of that contact time?
The nursing program has explored (and implemented) great options for students, including distance
education for aspiring nurses in rural areas, and new state-wide nursing curricula.
Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 0.9
Could have elaborated on how the program fits the broader strategic vision
Partial alignment with Strategic Vision, focus on partnering with place. An important program for
rural Montana and for students. On-line format provides opportunities for future development of the
program. Undersupply of nurses is forthcoming, an investment in the program could help achieve an
adequate supply of nurses for Montana.
Strengths:
Weaknesses:
Page 101 of 14511/13/2017
17Acad AP178 178 Surgical Technology-2Y 2Y
Consider for Development and/or Modification
Average: 6.567 Range: 1.550
1. ALIGNMENT
Reviewer: 1 Score: 8 Weighted Score: 1.6
- not a clear explanation for how they address sustainability
- didn't clearly connect how a reduction in their resources would weaken UM's Mission
- the program addresses all of the values in the 2020 Plan through classroom work and outside
experiences
- thorough explanations of their unique educational experiences
- a reduction of their resources would negatively effect Montana's workforce
- their program prepares its students well for the cultural, social and workforce needs through didactic
education, clinical rotations, and by partnering with health care facilities and managers
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 1.2
•Limited explanation of essential to UM’s Mission, and how reduction weaken’s the mission
•Samples of engagement on program alignment with UM 2020 Strategic Plan
•Explanation of important in preparing students for social, cultural, and/or workforce needs of the 21st
century
Strengths:
Weaknesses:
Reviewer: 3 Score: 8 Weighted Score: 1.6
The program size is capped because of accreditation and staffing restrictions
The program appears to align well with UM2020 providing much needed health services training.
Students completing this degree are in high demand and well prepared for their field.
The program reinforces UM's core values.
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 8 Weighted Score: 1.2
- not evident how their program would impact other programs if its size were reduced
- high demand from students that are not measured, such as the number of students (100) that the
faculty advises each semester and how competitive their application process is
- the program offers multiple ways in which they collaborate to address student needs; to include
Trauma Day, cadaver labs, internships, and clinical rotations with regional/local health care facilities
Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
2 6 1.2 6 0.9 5 1 6 1.2 4 0.4 6 0.9 5.6Reviewer:
3 8 1.6 7 1.05 7 1.4 7 1.4 6 0.6 6 0.9 6.95Reviewer:
1 8 1.6 8 1.2 6 1.2 7 1.4 7 0.7 7 1.05 7.15Reviewer:
Ranking Category:
Consider for Development and/or Modification: 11
Priority for Substantial Modification: 0
Priority for Devlopment and Growth: 3
Total Count: 14
Page 102 of 14511/13/2017
17Acad AP178 178 Surgical Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 2 Score: 6 Weighted Score: 0.9
• Does the data accurately reflect the centralized data, because explanation does not offer specifics
or details on numbers other than the centralized data and generalization of statements without specifics
•Collaborative efforts with Trauma Day as well as medical entities throughout the communityStrengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.05
There should be better data kept at the program level
Reduction or elimination of this program would result in higher demand for other health profession
programs that are already operating at capacity.
Some of the data appears to be departmental and not program specific. The Quintiles appear to be low
to average (1-3), but it should be noted that the program is capped at 28 students for accreditation and
staffing restrictions.
The program appears to operate at capacity with excess demand - some students wait two years for
admittance.
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 6 Weighted Score: 1.2
- no examples of creative scholarship activities, which is required by the Faculty Professional
Continuing Education
- they are not expected to engage in research opportunities due to their degree type ( Associates)
- students perform 600 hours and at least 120 scrubbed surgeries, which can be a valuable service to
hospitals and clinics
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
•Engagement in professional education, but nothing listed or described
•Demand is showing stable in 69 – 70 majors each year, but number of degrees awarded averages 17.4
doesn’t reflect 28 in cohort group, uncertain here.
•Details of state and local clinical rotations demonstrate hours of productivity and the effort involved,
as well as increase in site locations
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.4
The faculty SCH to FTE ratio is on the lower side (2nd Quintile) but is consistent with an accredited
Health profession program meeting accreditation standards.
The program is at it maximum size unless additional clinical sites can be identified.
The program graduates around 17 students per year which ranks in the 4th Quintile. The trend is flat -
which is expected for a program operating at capacity.
Faculty are not required to engage in scholarly research, but must participate in continuing education.
Strengths:
Weaknesses:
4. QUALITY
Page 103 of 14511/13/2017
17Acad AP178 178 Surgical Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 1 Score: 7 Weighted Score: 1.4
- no data on faculty outcomes
- students exceed the national exam pass rate and graduate placement rate set by the ARC/STSA
- a large portion (95%) of St. Patrick Hospital surgical techs were trained at Missoula College
- their program is currently accredited
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 1.2
•No faculty outcomes for current faculty? Only reference to additional new faculty outcomes not
available yet
•ARC/STSA results comparisons share higher levels of student outcomes, employer feedback on
surveys
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.4
Program may be at feasible capacity - due to lack of additional clinical sites.
95% pass rate on certification exam
89% job placement
Program is accredited
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 7 Weighted Score: 0.7
- the loss of an FTE admin assistant has hurt their program and other health care programs
- increased the number of final internship clinical sites from 22 to 25 and have developed online classes
to help reach remotely located students
- no losses to their program's faculty
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.4
•Reference to the data sheet lacking real data, but no real description on the content or errors of the
content
•Efforts to improve efficiency reference loss in FTE, but no other efforts demonstrated – notation of on-
line class options
•how does the program compare with other Surgical Tech programs for efficiency
Increase in clinical sites for surgical technologyStrengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 0.6
reduced support to department
Instructional costs have remained relatively flat (per author)
Administrative support is provided through Health profession programs and support has been cut
from 2 FTE to 1 FTE
Clinical sites have been increased from 22 to 25
Strengths:
Weaknesses:
6. OPPORTUNITY
Page 104 of 14511/13/2017
17Acad AP178 178 Surgical Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 1 Score: 7 Weighted Score: 1.05
- the program lacks in contributing to interdisciplinary areas of inquiry
- the program already contributes to UM's Vision through advising, providing job opportunities, extra-
curricular activities and supporting student rotations in rural areas
- the program greatly contributes to state-wide needs
- their one opportunity for restructuring will help reach more students and can improve other health
care departments
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 0.9
•Who is providing the “well-documented information on workforce needs of Montana’s Healthcare
sector”, generalization
•Creativity in Core Curriculum Model
•Innovative ideas with certifications of surgical services model that could offer some opportunities to
enhance UM and relations with medical programs in the community
•Contributes to the UM Strategic Vision
Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 0.9
Appears to have limited local growth opportunities
On line instruction offers the opportunity for growth. Creating outreach programs and course sharing
with other MUS colleges offers opportunity for significant growth
Implementing a Core Curriculum Model could improve efficiency department wide.
Improved laboratory equipment would improve student experience and outcomes at small cost.
Strengths:
Weaknesses:
Page 105 of 14511/13/2017
17Acad AP181 181 Diesel Equipment Technology-2Y 2Y
Consider for Development and/or Modification
Average: 5.433 Range: 1.700
1. ALIGNMENT
Reviewer: 1 Score: 4 Weighted Score: 0.8
Doesn't address bullet 1
N/AStrengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
No statement on 2020 strategic plan (not the goal)
•Certification of Student in Brakes and Air Conditioning
•Diesel Equipment Technology is essential training program for state and nation because of workforce
shortages.
•MC program survives primarily on donations from industry (all engines but 1 donated in 27 years).
•Almost 100% placement of students
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
Criteria 1 - Bullet 1 - did not answer question clearly or link to the UM Strategic Plan on the
dimensions required.
Criteria 1 - Bullet 2 - good response
Criteria 1 - Bullet 3 - great response
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 3 Weighted Score: 0.45
Lowest quintile score for metric 3
Doesn't address bullet 1
if cuts are made, other programs would lose studentsStrengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 4 0.8 3 0.45 2 0.4 7 1.4 5 0.5 6 0.9 4.45Reviewer:
2 5 1 7 1.05 6 1.2 6 1.2 8 0.8 6 0.9 6.15Reviewer:
3 5 1 5 0.75 5 1 6 1.2 7 0.7 7 1.05 5.7Reviewer:
Ranking Category:
Consider for Development and/or Modification: 11
Priority for Substantial Modification: 0
Priority for Devlopment and Growth: 3
Total Count: 14
Page 106 of 14511/13/2017
17Acad AP181 181 Diesel Equipment Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 2 Score: 7 Weighted Score: 1.05
•None observed
•Limited enrollment doesn’t allow for other students to be in courses.
•Appears to be high demand with limited admissions (wait list; largest program on west campus).
•Diesel Technology encourages students work part-time in placements in community as apprentices.
•Students are encouraged to complement the training with business education, welding or heavy
equipment operation training.
•The courses (7) their student take outside of area would be down 25 students if cut.
•Quintile 1 on non-majors-but not their intent.
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 0.75
N/A
Criteria 2 - Bullet 1 - solid response
Criteria 2 - Bullet 2: solid response
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 2 Weighted Score: 0.4
doesn't answer bullets
4th quintile for metric 1
trending towards higher metrics for 5th and 8th metrics
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 1.2
•SCH to Instructional and TT FTE quintile 2 (not clear how certification or training plays a role in
SCH/faculty ratio (only 2 faculty-not sure if weakness).
•R,T, S not relevant to this specific 2 year program
•Majors are quintile 4.
•Graduates are Q3.
•Faculty productivity appears connected to training, outreach to industry (apprenticeships,
donations), and placement (~100% placement).
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
Criteria 3 - Bullet 2: This is applicable to this program and a little explanation would have helped.
Criteria 3 - Bullet 1: not applicable to this program.
Criteria 3 - Bullet 2: not applicable to this program.
Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 7 Weighted Score: 1.4
N/A
100% job placement out of graduationStrengths:
Weaknesses:
Page 107 of 14511/13/2017
17Acad AP181 181 Diesel Equipment Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 2 Score: 6 Weighted Score: 1.2
•No formal survey process of alumni.
•Time to degree quintile 5.
•Job placement local and national and almost 100%.
•Students also move into 4-year degree programs.
•Faculty are certified in numerous certifications relevant to training by manufacturers.
•Students praise program (no formal survey).
•Industry seeks to continue to hire graduates year after year.
Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 1.2
n/a
Criteria 4 - Bullet 1: excellent response
Criteria 4 - Bullet 2: good response actually focused on the quality of faculty as it relates to the
program under review
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 5 Weighted Score: 0.5
relies on money from lab fees
Many donations to assist in costsStrengths:
Weaknesses:
Reviewer: 2 Score: 8 Weighted Score: 0.8
•As stated above SCH to instructional /TT FTE is Q2 (shouldn't be counted against twice).
•No grants or IDCs- not weakness per se, but no one is tracking their donations from industry which
appear meaningful and substantial to their functioning. (our MISTAKE apparent on quintile of 2 for
zeros).
•Risks, recruitment and advising have been impacted with loss of 1 FTE staff on West Campus.
•Making a lot of an extremely restricted and cut budget despite the impact of these costs on education
and training.
•The program is surviving on lab fees and donations primarily.
•Collaboration with other programs also appears to help with meeting training needs.
•Program uses centralized assistance where it can for needs (Business Office, Registrar’s Office, full-
time staff now part-time work study on west campus).
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 0.7
n/a
Criteria 5 - Bullet 1: excellent response
Criteria 5 - Bullet 2: excellent response
Criteria 5 - Bullet 3: excellent response
Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 6 Weighted Score: 0.9
doesn't address um 2020 plan
Potential for students to specialize with certificatesStrengths:
Weaknesses:
Page 108 of 14511/13/2017
17Acad AP181 181 Diesel Equipment Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 2 Score: 6 Weighted Score: 0.9
•Program doesn’t have adequate storage or space for equipment and taking on more students-not
clear where this would come from.
•Program would need more faculty for above ideas as well.
•Program has wait-listed students and clear opportunity for growth.
•Ideas for 3-year degree that would integrate heavy equipment and welding.
•Ideas for grant/foundation seeking more money would need relief time for faculty.
•Summer school programs in Power generation and Refrigeration might yield increased students
needed in the trucking and rail industry areas.
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.05
n/a
Criteria 6 - Bullet 1: excellent response
Criteria 6 - Bullet 2: superb response
Criteria 6 - Bullet 3: solid response
Criteria 6 - Bullet 4: good response
Strengths:
Weaknesses:
Page 109 of 14511/13/2017
17Acad AP184 184 Heavy Equipment Operation-Cert Cert
Consider for Development and/or Modification
Average: 4.533 Range: 1.050
1. ALIGNMENT
Reviewer: 1 Score: 4 Weighted Score: 0.8
•No mention is made of the values or even the UM2020 Strategic Plan.
•The preparation of students for the 21st century workforce is a strength.Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
I do not see any references to whether or not this program supports the mission and vision of UM
The program works with local businesses and contractors. Students come from local, national and
international areas.
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
The report did not specify how the program is related to Leadership, Engagement, Sustainability, or
Diversity.
The Heavy Equipment Operations program provides training that directly meets workforce needs
within the state. The program is well connected to many employers. Out-of-state students are also
attracted to this certificate, because of the shortage of qualified operators and grade setters/surveyors
in all areas of the country.
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 2 Weighted Score: 0.3
•There are no Gen Ed courses associated with this program.
•The response to impacts if this program were cut simply lists courses.
•There are no strengths for this program on this criteria.Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 0.75
I don't necessarily see an internal demand for the program, but a certificate of this type is not like
general university programs and should not be graded as such.
We are seeing a huge demand in the industry for Heavy Equipment Operators, both locally and
nationally. The Civil Construction Industry is experiencing a shortage of qualified operators and grade
setters/surveyors in all areas of the country. The program receives calls and emails from multiple
entities asking to hire their graduates.
Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
3 5 1 3 0.45 1 0.2 5 1 7 0.7 4 0.6 3.95Reviewer:
2 5 1 5 0.75 5 1 5 1 5 0.5 5 0.75 5Reviewer:
1 4 0.8 2 0.3 7 1.4 5 1 7 0.7 3 0.45 4.65Reviewer:
Ranking Category:
Consider for Development and/or Modification: 14
Priority for Substantial Modification: 1
Priority for Devlopment and Growth: 0
Total Count: 15
Page 110 of 14511/13/2017
17Acad AP184 184 Heavy Equipment Operation-Cert Cert
Consider for Development and/or Modification
Reviewer: 3 Score: 3 Weighted Score: 0.45
There did not seem to be interdisciplinary initiatives in this program.
The report listed five other courses at the university that would suffer in enrollment if this program
were curtailed.
Students are encouraged to take courses in the Diesel Program, Welding Program, and other online
courses.
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 7 Weighted Score: 1.4
•While the program does not have a scholarly or research component, it should have a service and
outreach component.
•This program produces a fairly regular number of graduates.Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
There is no information provided for productivity
There is no information provided for productivityStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
N/A was listed for all three bullets--it would seem that there would at least be an instructional
component to this program.
Not sure--nothing was included in the report.Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 5 Weighted Score: 1
•The evidence of faculty outcomes is anecdotal.
•The high job placement rate is a strength of this program.Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
I don't see any weaknesses
Students that graduate and want to work have 100% job placement. Those that want to continue their
education go to Missoula College or the main UM campus. Faculty evals come back with high marks.
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 1
Besides job placements, it would be helpful to have other data on student outcomes.
No faculty awards or other recognition was listed.
Every year the program has 100% job placement for its students.
Faculty evaluations have high marks, and the two instructors have 45 years of experience.
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 7 Weighted Score: 0.7
•No substantial weaknesses on this criteria.
•The reliance on donated equipment is an efficiency.
•The generation of funds through contracted jobs is an efficiency.
Strengths:
Weaknesses:
Page 111 of 14511/13/2017
17Acad AP184 184 Heavy Equipment Operation-Cert Cert
Consider for Development and/or Modification
Reviewer: 2 Score: 5 Weighted Score: 0.5
I don't see Matrix data added to the report, so I don't know about FTEs, etc...
The program has to be efficient because they rely on their own money to fund projects.This makes it
difficult to repair machinery or upgrade to newer products. They have had to be creative in fixing
existing machinery by having the diesel and welding programs help with repairs.
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 0.7
It was not clear whether the program has any administrative support.
Benchmarks with other programs were not provided.
The program asserts that it relies solely on its own accounts that it generates by doing contracted jobs
in the community.
The instructors work with the Diesel and Welding programs to make repairs on its equipment.
The program has seen a reduction in support for helping students register and receive financial aid.
Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 3 Weighted Score: 0.45
•The argument for additional resources is weak.
•The response does not address the Strategic Vision.
•The request of more scheduling authority for the program director seems reasonable.Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 0.75
I do not see weaknesses regarding this opportunity analysis
The program needs to restructure the registration process and have one registration for the full year. If
they created a three year degree, which would consist of two programs back to back, they would be at
full capacity and students would be guaranteed spots in the program.
Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.6
The new Strategic Opportunities were not addressed.
Ways to enhance interdisciplinarity and serve statewide needs were not directly explained.
The high demand for Operators and Gradesetters/Surveyors provides opportunities to grow this
program.
A potential three-year degree was proposed.
Strengths:
Weaknesses:
Page 112 of 14511/13/2017
AP185 185 HVAC Technician-Cert Cert
Priority for Substantial Modification
Average: 2.350 Range: 0.000
No Report Submitted Insufficient Evidence
1. ALIGNMENT
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
· No report submitted
· No report submittedStrengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 2 Weighted Score: 0.3
· Quintile 1 – SCH ratio non-majors to total
· NoneStrengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
2Reviewer:
3 1 0.2 2 0.3 5 1 3 0.6 1 0.1 1 0.15 2.35Reviewer:
1Reviewer:
Page 113 of 14511/13/2017
AP185 185 HVAC Technician-Cert Cert
Priority for Substantial Modification
Reviewer: 3 Score: 5 Weighted Score: 1
· No report submitted
· Moderate five year average for certificatesStrengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 3 Weighted Score: 0.6
· No report submitted
· No report submittedStrengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.1
· No report submitted
· No report submittedStrengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.15
· No report submitted
· No report submittedStrengths:
Weaknesses:
Page 114 of 14511/13/2017
17Acad AP186 186 Precision Machine Technology-Cert Cert
Insufficient Evidence
Average: 3.767 Range: 1.500
Insufficient Evidence
1. ALIGNMENT
Reviewer: 1 Score: 4 Weighted Score: 0.8
- aligned with some of UM's mission, vision and values (new program less than 2 years old)
- Engagement of students through hands on experiences
- Help student integrate into job market in local and state level
- Gives students base in manufacturing fabrication and communication
Strengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.6
Didn't directly address alignment.
Didn't clearly connect answers to question content.
N/AStrengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.8
•bullet 1 doesn’t address the UM2020 strategic plan, but does illustrate how the program offers a path
to further career development
•is the program essential to UM (bullet 2): demonstrates that the program is essential to
manufacturing process development, mechanical and structural engineering.
•good explanation of what types of skills are developed in the program and their contribution to
workforce needs.
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 4 Weighted Score: 0.6
- new program so not a whole lot to go off of, departmental data shows SCH generated mostly via
students within department
- Job market expected to grow 6% for 2014-2024, constant contact with local businesses about needStrengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.15
Information provided in 2.1 was more relevant for 1.3.
N/AStrengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
3 4 0.8 5 0.75 3 0.6 4 0.8 6 0.6 3 0.45 4Reviewer:
2 3 0.6 1 0.15 5 1 1 0.2 5 0.5 3 0.45 2.9Reviewer:
1 4 0.8 4 0.6 5 1 4 0.8 6 0.6 4 0.6 4.4Reviewer:
Page 115 of 14511/13/2017
17Acad AP186 186 Precision Machine Technology-Cert Cert
Insufficient Evidence
Reviewer: 3 Score: 5 Weighted Score: 0.75
•more specifics about how many graduates the region could support would strengthen the report
dramatically
•program is new and already seeing growth in the number of students
•good support through Bureau of Labor Stats job outlook.
•local industry asking for qualified graduates.
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 5 Weighted Score: 1
- 4 withdrew, new program so tough to judge on just first year, ~50% completion
- Working with local/state employers to refine curriculum
- 10 students in first year, 4 graduated in 1 year certificate program
-100% (4/4 graduates) placement filled via local demand
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
N/A
Provided information regarding steps to advanced program credentialing/certification.
Outreach to local manufacturers for feedback about program and workforce needs.
Strengths:
Weaknesses:
Reviewer: 3 Score: 3 Weighted Score: 0.6
•response in bullet 3 does not explain how program measures aspects of the curriculum such how
ethical and professional demeanor are conveyed.
is the program too new to be able to illustrate productivity?
•outreach with local industry to understand workforce needs to develop the curriculum.
•continually developing curriculum based on feedback from employers
•100% student employment rate from local demand.
•plans to develop program into 2-year with accreditation through NIMS.
Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 4 Weighted Score: 0.8
- new program so again no data and not much to go off of
- 4 graduates and employed (10 students to begin with)Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.2
Only 50% of students graduated.
100% employment for graduates.Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.8
•program is too new for data to reveal trends
•no response for faculty outcomes (N/A)
•program explains additional required resources to meet accreditation standards through NIMSStrengths:
Weaknesses:
5. EFFICIENCY
Page 116 of 14511/13/2017
17Acad AP186 186 Precision Machine Technology-Cert Cert
Insufficient Evidence
Reviewer: 1 Score: 6 Weighted Score: 0.6
- no available data on FTE or anything for program
- worked with local employers to have materials and equipment donated to help keep program
relevant without ability to upgrade purchase equipment
- share budget with welding which has been cut, offset partially via student fees
- currently looking for partnership to generate revenue
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 0.5
No specific information about efforts toward efficiency, but it's a new program and has experienced
reductions.
Collaborations/cost sharing with local manufacturers.Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 0.6
•need to support claim that the program can only sustain 12 students per year at current budget levels.
•suggests that program could earn revenue to support the program by contracting with local
manufacturers to produce machine parts.
•suggests partnerships with local industry to “underwrite” (the reader’s term, not the author’s) the
cost of the program
Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 4 Weighted Score: 0.6
- New program and issues need to be addressed for program to be recognized in the state which will
require investment
- no indication of contributions to strategic vision of UM
- graduates employable locally and instruction prepares students to continue in a wide range of
opportunities
Strengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.45
Didn't make clear connections to alignment or enhancing UM.
Didn't connect some of the information provided with the question content.
Some specific examples of potential/needed improvements to move the program forward.Strengths:
Weaknesses:
Reviewer: 3 Score: 3 Weighted Score: 0.45
•something seems to be missing from the response for criteria 6, bullet 1. as it is, doesn’t address
strategic vision
•good explanation for what the program could potentially support for mechanical engineering thereby
implying establishing a role as leader in interdisciplinary areas. (doesn’t specifically address bullet 2,
but you can read between the lines).
Strengths:
Weaknesses:
Page 117 of 14511/13/2017
AP187 187 Recreational Power Equipment-Cert Cert
Priority for Substantial Modification
Average: 1.000 Range: 0.000
No Report Submitted
1. ALIGNMENT
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
No Information Provided
No Information ProvidedStrengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.15
No Information Provided
No information provided – Q1 for non-majors to totalStrengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1Reviewer:
2Reviewer:
3 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:
Page 118 of 14511/13/2017
AP187 187 Recreational Power Equipment-Cert Cert
Priority for Substantial Modification
Reviewer: 3 Score: 1 Weighted Score: 0.2
3.8. (5YA – student/instruction FTE ratio) – Q2 3.9. (trend) – Q2 – .67 3.5. (Degrees Awarded) –
Q3 FY13: 12.0 FY14: 12.0 FY15:6.0 FY17:2.0 5YA: 8.0 3.6. (Trend) – Q1 - 0.74
3.5. (Degrees Awarded) – Q3 FY13: 12.0 FY14: 12.0 FY15:6.0 FY17:2.0 3.6. (Trend) – Q1 -
0.74
Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
No other information regarding the quality of the program
Q5 on time to degreeStrengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.1
Q2 – 5YA of SCH for undergrad per instructional FTE No information provided
No information providedStrengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.15
No information provided
No information providedStrengths:
Weaknesses:
Page 119 of 14511/13/2017
AP187 187 Recreational Power Equipment-Cert Cert
Priority for Substantial Modification
Page 120 of 14511/13/2017
17Acad AP188 179 Carpentry-Cert Cert
Insufficient Evidence
Average: 5.250 Range: 3.050
Insufficient Evidence
1. ALIGNMENT
Reviewer: 1 Score: 4 Weighted Score: 0.8
Weaknesses:
•Carpentry has data; FM-no data specific to program-NO SCT data and thus will be in group 1.
•Second year merge of Carpentry and Facilities MGT
•Appear to be addressing LESD in strategic plan, even increasing diversity of students.
•SCT came from idea on how to reinvigorate both.
•Appears to be high need niche area; students can get hired away prior to finishing, or just take
courses to increase knowledge base.
Strengths:
Weaknesses:
Reviewer: 2 Score: 8 Weighted Score: 1.6
The program has become much more diverse, but more information could be provided on how the
cultural needs of the 21st century are being addressed.
This program showed strong connections with Leadership, Engagement, Sustainability, and Diversity.
Sustainability is an obvious strength.
The program fulfills the professional training aspect of UM's mission.
Students in the program have 100% job placement, and the report claims that number of students could
be doubled and there would still be 100% job placement.
Students develop strong soft skills in this degree.
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.4
B2-Not fully addressed.
B1-leadership, engagement, sustainability, and diversity clearly part of mission.
B2-Community would lose public service aspect.
B3-Meets workforce needs.
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 2 Weighted Score: 0.3
•Carpentry has student data; none for FMgt; no SCT data (GE generation not the goal of this program).
•Students work with other campus and community programs assisting in building projects
•SCT students take GE, and come from EVST, and other areas with sustainability interests
Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 4 0.8 2 0.3 3 0.6 4 0.8 4 0.4 5 0.75 3.65Reviewer:
2 8 1.6 6 0.9 4 0.8 5 1 5 0.5 4 0.6 5.4Reviewer:
3 7 1.4 7 1.05 6 1.2 7 1.4 6 0.6 7 1.05 6.7Reviewer:
Page 121 of 14511/13/2017
17Acad AP188 179 Carpentry-Cert Cert
Insufficient Evidence
Reviewer: 2 Score: 6 Weighted Score: 0.9
The report said that the data do not represent the current reality, but what the actual numbers are were
not provided.
Collaborations are occurring with many departments, including Theatre, Business, the Glacier
Institute, Food Service, and the Energy Program.
This program has also reached out to Botany and Chemistry for possible collaborations.
Several areas were listed that would be adversely affected by cuts in Sustainable Construction.
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.05
Data difficult to use since SCT is new program and was result of merge of carpentry and FME. I'm not
counting this as a strength or weakness.
B1-Collaborates with other programs and community in a unique way through SCT.
B2-Elective options for other programs would be reduced.
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 3 Weighted Score: 0.6
•Carpentry has stable student numbers; #’s in last two years for Facilities Mgt to zero- not clear if now
in SCT- no SCT data.
•Program students and faculty build 1 new home a year.
•Service to community as time allows (playhouse, concrete floor, senior home safety upgrades, etc.).
•Teaching goals identified in strategic plan are met.
Weaknesses:
•Carpentry has stable student numbers; #’s in last two years for Facilities Mgt to zero- not clear if now
in SCT- no SCT data
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.8
The number of majors is relatively low.
The program asserts that it has met its instructional program goals, but data/evidence are not
presented for this.
The department acknowledged that productivity isn't measured.
in the Creative domain, the program generates one new home a year and improves numerous existing
structures.
Service is provided in the many structures that are built around the community.
Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 1.2
B2&3-Does not measure "productivity."
B1&2-Build one house per year. Potential revenue when they sell a home. Also, other campus and
community projects as resources allow.
Strengths:
Weaknesses:
4. QUALITY
Page 122 of 14511/13/2017
17Acad AP188 179 Carpentry-Cert Cert
Insufficient Evidence
Reviewer: 1 Score: 4 Weighted Score: 0.8
•Data not across programs.
Carpentry has stable student numbers; #’s in last two years for Facilities Mgt to zero- not clear if now
in SCT- no SCT data
•Reports 100% job placement that appears to be in carpentry.
•3-4 Faculty have numerous certifications in relevant trade areas; awards and honors evident.
•Green building and specialty expertise represented.Program students and faculty build 1 new home a
year.
•Service to community as time allows (playhouse, concrete floor, senior home safety upgrades, etc.).
•Teaching goals identified in strategic plan are met.
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
More evidence of the quality of student outcomes could be highlighted (e.g., assessment reports, exit
and alumni surveys).
Faculty credentials were provided, but more description/explanation of quality would would have
been helpful.
As noted above, job placement is 100%.
The time to degree data were good.
Faculty have won several awards related to building.
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.4
B3-Not applicable.
None found.
B1-100% job placement rate. Has a "Mike Rowe" scholar in program.
B2-Highly qualified and active faculty.
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 4 Weighted Score: 0.4
•Efficiency has created class sizes that exceed OSHA recommendations.
•No other data.Data not across programs.
•
•Merge based on efficiency appears to have good basis.
•Goals are to serve more students with better combination of skills and their impression is this is so
(double the students), as well as increase recruitment and retention.
•Able to retain FTE with no increases planned.
•Program uses centralized assistance where it can for needs (Business Office, Registrar’s Office, full-
time staff now work study on west campus).
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 0.5
There were not any examples of collaborating with other units to improve efficiency.
By merging a number of areas, this program has been able to improve enrollments.
Despite losing its administrative associate, the program faculty have taken on additional
responsibilities and worked to maintain quality.
Strengths:
Weaknesses:
Page 123 of 14511/13/2017
17Acad AP188 179 Carpentry-Cert Cert
Insufficient Evidence
Reviewer: 3 Score: 6 Weighted Score: 0.6
B1- Classroom safety put at risk due to larger classes sizes.
B1-Operations budget completely eliminated.
B3-Admin position eliminated in FY17.
B1-Reacting to budget reductions by increasing section sizes.
B2-Merged carpentry and FME to create new SCT program.
B3-Faculty fulfill administrative duties since admin position was eliminated.
Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 5 Weighted Score: 0.75
•None apparent
•
•Program has wait-listed students.
•Ideas for program match UMVision in several areas.
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.6
The ideas presented in this section were good, but very few details were provided about how these
might be accomplished.
Besides the "Teaching in Place Goal," the other strategic opportunities were not addressed, and state-
wide needs were not discussed.
The program is working toward increasing online learning.
Interdisciplinarity is built into the degree.
As noted earlier, the report confidently asserts that the number of students could be doubled, and they
would still have 100% job placement.
The faculty's goal is to create a regional destination campus for building science and sustainable
construction techniques.
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.05
B3-Not addressed.
B1-Using strengths and expertise of program. Unit built sound booth to record courses to teach online.
B2-"Creation of shelter" is a universal concept.
B4-Increase size of program with high success rate (job placement).
Strengths:
Weaknesses:
Page 124 of 14511/13/2017
17Acad AP188 180 Electrician Helper-Cert Cert
Insufficient Evidence
Average: 3.450 Range: 2.700
Insufficient Evidence
1. ALIGNMENT
Reviewer: 1 Score: 6 Weighted Score: 1.2
N/A
Criteria1Bullet1-Excellent response
Criteria1Bullet2-reasonable response
Criteria1Bullet3-Excellent response
Strengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.6
Does not even mention the unit of analysis (Electrician Helper) by its title or explain how it fits into this
larger AAS.
•Does an excellent job of addressing the alignment for the umbrella degree.Strengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 5 Weighted Score: 0.75
n/a
Criteria2Bullet1-solid response
Criteria2Bullet2-okay response
Strengths:
Weaknesses:
Reviewer: 2 Score: 3 Weighted Score: 0.45
•Not sure where electrician helper fits into all of this.
Again, good explanation of the Sustainable Construction unit and its demand and interdisciplinary
collaborations but not this particular unit of analysis or how it fits.
Strengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
3. Productivity
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
2 3 0.6 3 0.45 2 0.4 2 0.4 1 0.1 1 0.15 2.1Reviewer:
3Reviewer:
1 6 1.2 5 0.75 4 0.8 4 0.8 5 0.5 5 0.75 4.8Reviewer:
Page 125 of 14511/13/2017
17Acad AP188 180 Electrician Helper-Cert Cert
Insufficient Evidence
Reviewer: 1 Score: 4 Weighted Score: 0.8
Criteria3Bullet1-no response needed
Criteria3Bullet2-need to measure
Criteria3Bullet3-does not show how goals were "met or exceeded".
n/aStrengths:
Weaknesses:
Reviewer: 2 Score: 2 Weighted Score: 0.4
•Uploaded the wrong central data sheet. The sheet for this unit of analysis shows no enrollment and
no explanation is offered.
•Compelling outcomes of the sustainable construction side of things.Strengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 4 Weighted Score: 0.8
Criteria 4 - Bullet 2 states that the "consider[ing] the quality of program outcomes" the program should
"provide evidence of the quality of faculty outcomes" - the report provides no connection between the
faculty listed and the "quality of program outcomes".
Criteria4-Bullet1: This could have used more detail and support.Strengths:
Weaknesses:
Reviewer: 2 Score: 2 Weighted Score: 0.4
•Again, nothing to address this Unit of Analysis.
•Faculty are well-credentialed.Strengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 5 Weighted Score: 0.5
n/a
Criteria 5 - Bullet 1 - good answer
Criteria 5 - Bullet 2 - excellent answer
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.1
•Does not address electrician helper at all.
•None provided for this Unit of AnalysisStrengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
6. OPPORTUNITY
Page 126 of 14511/13/2017
17Acad AP188 180 Electrician Helper-Cert Cert
Insufficient Evidence
Reviewer: 1 Score: 5 Weighted Score: 0.75
Criteria 6 - Bullet 2 - did not answer question
Criteria 6 - Bullet 4 - would have benefited with a stronger answer
Criteria 6 - Bullet 1 - good answer
Criteria 6 - Bullet 3 - reasonable answer
Strengths:
Weaknesses:
Reviewer: 2 Score: 1 Weighted Score: 0.15
•No mention of the certificate being reviewed.
•Sustainable construction aligns to the strategic vision.Strengths:
Weaknesses:
Reviewer: 3 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Page 127 of 14511/13/2017
17Acad AP188 182 Facility Management-Cert Cert
Insufficient Evidence
Average: 6.033 Range: 3.550
Insufficient Evidence
1. ALIGNMENT
Reviewer: 1 Score: 6 Weighted Score: 1.2
1) ties to leadership and diversity are underdeveloped, and none of the four 2020 values has quantified
data to support it.
2) does not extensively detail how reductions would truly impact the rest of the university, besides a
diminishment of the areas outlined.
1) strong ties to strategic values of engagement and sustainability through its curriculum, service-
learning focus, hands-on experiences, and mission statement.
2) cites the university mission, specifically the areas of professional training, basic/applied research,
and service as reasons for its essentiality.
3) demonstrates adequate ties to social and cultural needs of the 21st century (specifically with regards
to “soft-skills” such as team-building, collaboration, diversity, and cultural awareness).
4) notes its 100% job placement rate to emphasize its workforce development efforts, and notes that
one of its biggest problems is that students are being hired before they can complete the two-year
program.
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 1.2
•Loss of funding would reduce the university’s commitment to service and technology transfer.
•Labs involved team leaders overseeing work groups
•The program serves the community by building affordable housing, repairing indigent housing and
providing accessibility modifications
•The program’s mission is building sustainable housing
•Vigorous recruitment has increased diversity in the program.
•The program provides professional training.
•Students develop social cohesion and teamwork skills
•The program has reached 100% employment for students who want to enter the labor market.
Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 6 1.2 3 0.45 2 0.4 5 1 6 0.6 3 0.45 4.1Reviewer:
3 8 1.6 6 0.9 7 1.4 9 1.8 9 0.9 7 1.05 7.65Reviewer:
2 6 1.2 6 0.9 7 1.4 6 1.2 6 0.6 7 1.05 6.35Reviewer:
Page 128 of 14511/13/2017
17Acad AP188 182 Facility Management-Cert Cert
Insufficient Evidence
Reviewer: 3 Score: 8 Weighted Score: 1.6
•The industry hires students about ½ through the program and leads to higher attrition
•The necessity of the certificates was not addressed, which would be interesting to know since
students are being hired without completion
•Labs are structured with teams of students with leaders. Faculty coach cooperation and leadership
•Students build affordable housing, reroofed housing, and remodel homes with safety concerns
•Sustainability is in the core of the program. Core competencies remain the same but new sustainable
technologies evolve and are taught to stay relevant. Graduates should know sustainability techniques
but recognize it as essential
•Students enrolling and recruited into the program have changed in the last decade and diversity
within the program has increased
•Professional training is provided in this program, students learn to provide shelter, in a sustainable
and ecological way
•If the program were cut UM would struggle to provide technology transfer and service benefitting
local, region, state, nation and the world
•Due to the community nature of study there is social cohesion and awareness of ethnic, racial, gender
and cultural awareness follows
•Workforce development is primary goal and the program has consistently had 100% job placement in
grads wanting to enter the workforce. Workforce needs could allow for a double in enrollment and
they could maintain 100% job placement
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 3 Weighted Score: 0.45
1) no data available for SCH for Gen-Ed courses, nor SCH for GE courses per FTE, as the program
recently (2015) merged several smaller programs together to form Sustainable Construction
Technology.
2) does not extensively detail how reductions would affect other programs, other than listing lower
“students in all general education courses [for which there is no data], the welding program, and
elective options for students [in other fields]”.
1) no data available for SCH for Gen-Ed courses, nor SCH for GE courses per FTE, as the program
recently (2015) merged several smaller programs together to form Sustainable Construction
Technology.
2) notes that it has shared “students, equipment, and faculty expertise” with the following other
campus units: Theater, Business, Glacier Institute, Food Service, Facility Services, and Energy
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 0.9
•New, consolidated program has little data
•Reduction of funding would affect the welding, EVST, and reduced choices for students in EVST,
NRGY and other programs.
•The program works with the Theatre Department, the Business Entrepreneur program, Food Services,
Facility Services and others.
•Faculty members have expertise in different areas
Strengths:
Weaknesses:
Page 129 of 14511/13/2017
17Acad AP188 182 Facility Management-Cert Cert
Insufficient Evidence
Reviewer: 3 Score: 6 Weighted Score: 0.9
•Each faculty is necessary for the program to continue to exist in its current state
•By merging into SCT there are more certificates and more pathways to an AAS
•Enrollment has increased because of more diverse offerings
•Changes were made with no increases to FTE
•Students, equipment and faculty expertise have been shared with Theater, Business, Glacier Institute,
Food Service, Facility Services and the Energy Program
•Reductions would reduce elective options for the entire program
•Each faculty has specific skills and expertise and reductions would impact the entire program and the
holistic approach
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 2 Weighted Score: 0.4
1) ranks in the lowest quintile for number of majors, with an average of 48 students per year.
2) very low five-year average of degrees awarded (0.6) and a low average student FTE/instructional
FTE ratio of 7.3.
3) The program simply notes that drops in enrollment may have coincided with a decrease in
unemployment.
4) lists some of its service achievements and projects (such as building a community playhouse or
installing handicapped ramps), but fails to list how these are tracked or measured against expectations.
5) None of the information in this section is quantified.
1) The program simply notes that drops in enrollment may have coincided with a decrease in
unemployment.
2) lists some of its service achievements and projects (such as building a community playhouse or
installing handicapped ramps), but fails to list how these are tracked or measured against expectations.
3) explains its instructional mission and objectives (e.g. “provide hands-on training programs in skilled
trades), and explains that in recent years it has met all of its goals and measures in this area.
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.4
•Resources limit how much service the program can perform.
•Program completes at least one new home a year, as well as improving numerous other buildings.
•The program's mission is to teach students and serve the community. The report has numerous
examples of ongoing construction projects in the community.
•The program as specific, program goals for instruction.
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.4
N/A
•Consistent enrollment, despite a recent dip due to anecdotal comments of uncertainty of the program
and recent changes that have been implemented and a dip in unemployment.
•At least one new home per year is created and improvements are made to other buildings
•Heavily involved in service in Missoula and the UM campus. Service with Missoula Parks and Rec, a
ramp at Fort Missoula, a concrete ramp for Facilities Services, Missoula Urban Demonstration, Human
Resource Council with affordable housing and private outreach
•Instruction meets all of the program goals for student learning objectives
Strengths:
Weaknesses:
4. QUALITY
Page 130 of 14511/13/2017
17Acad AP188 182 Facility Management-Cert Cert
Insufficient Evidence
Reviewer: 1 Score: 5 Weighted Score: 1
1) These outcomes could be better qualified, and many suggested areas such as assessment data or
alumni surveys are ignored.
2) Limited development to suggest the quality of faculty and students is at capacity.
1) demonstrates an average time-to-degree of 1.9 years, which would place it in the highest quintile.
2) notes its 100% placement into the workforce, and lists other achievements of its graduates,
including: creation of construction firms, one Mike Rowe Scholar, and some transfer to a four-year
program.
3) program notes some of the achievements of its faculty, including awards earned, degree
qualifications, and certifications secured.
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 1.2
•No specific tools to measure outcomes
•One-hundred percent employment for those looking for jobs
•Students have started their own construction firms and become employers
•Faculty members have multiple degrees and certifications in their fields
Strengths:
Weaknesses:
Reviewer: 3 Score: 9 Weighted Score: 1.8
N/A
•Time to degree averages right at 2 years
•100% job placement amongst graduates who want to enter the workforce
•Graduates have gone on to own their own construction firms and become MT employers
•One student who is a Mike Rowe scholar
•A few students have gone on to earn 4-year degrees, but most enter the workforce
•All faculty have received a number of professional certifications or awards in their field
•Every faculty has external recognition
Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 6 Weighted Score: 0.6
1) ranks in the lowest quintile for UG SCH per instructional FTE (at an average of 218) and in the
second lowest for SCH per T/TT faculty (at an average of 564.6).
2) notes that none of the data in this section is relevant, as the Sustainable Construction Technology
degree is only in its second year after the merger.
1) notes that none of the data in this section is relevant, as the Sustainable Construction Technology
degree is only in its second year after the merger.
2) explains that it has lost an administrative associate, has dealt with increased courses sizes (which it
notes creates an unsafe environment for students), and has no operating budget.
3) demonstrated exceptional innovation in its decision to merge Carpentry with Facilities Management
Engineering to create the Sustainable Construction Technology program
4) is “on track to improve graduation rates and retention” but cannot verify this with data due to its
status as a new program.
5) currently only has one work study position to fulfill its administrative duties.
Strengths:
Weaknesses:
Page 131 of 14511/13/2017
17Acad AP188 182 Facility Management-Cert Cert
Insufficient Evidence
Reviewer: 2 Score: 6 Weighted Score: 0.6
•Increased class sizes because of budget cuts could be a safety issue
•No operating budget means the program can’t purchase or replace tools and supplies.
•Loss of an administrative associate in Industrial Technology has affected the program
•The program is the result of a merger, which has improved enrollment without an increase in FTE.
•Faculty have absorbed the loss of the administrative FTE by taking on additional duties.
Strengths:
Weaknesses:
Reviewer: 3 Score: 9 Weighted Score: 0.9
N/A
•The program has maintained 4.0 FTE, but has had to increase size which can create unsafe classroom
environments
•Zero operating budget means no new tools, equipment or supplies
•Administrative Assistant III was lost due to budget cuts
•With the new merge enrollment is up and the program is on track to improve graduation rates and
retention and improvements come with no increase in faculty FTE. Increased enrollment and revenue
with no increase in FTE
•One work study helps to answer the phone and direct students, but with the loss of the one Admin
Assistant there is no liaison with main campus or the Dean’s Office
Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 3 Weighted Score: 0.45
1) does not demonstrate strong capacity to establish UM as an interdisciplinary leader
2) does not identify one opportunity for restructuring to improve its efficiency/collaborations.
3) Specific ideas for implementation are not provided.
1) program notes its tie to the new strategic value to “meet students where they are” by providing
more online courses and lectures, and says that it generally connects well with the ‘economic
development goals” of the plan.
2) states that it could double its enrollment and maintain its 100% job placement, and simply needs
resources for recruitment and potentially faculty/facilities if successful.
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.05
•N/A
•The program is developing online courses.
•The program serves a community need for shelter
•The program could become the hub of a regional center for building science and sustainable
construction.
•The program says with additional resources, faculty and facilities, it could double its enrollment and
still not fully meet the demand for construction workers.
Strengths:
Weaknesses:
Page 132 of 14511/13/2017
17Acad AP188 182 Facility Management-Cert Cert
Insufficient Evidence
Reviewer: 3 Score: 7 Weighted Score: 1.05
•Only one of the Strategic Vision pieces addressed
•No tangible evidence or ideas in how they plan to achieve goals were provided
•Working to increase online learning (students created a studio to record lectures)
•State wide needs are met by creating graduates who can provide shelter through sustainable means.
This is also done through interdisciplinary models within the program
•Goal is to create a regional destination campus for building science and sustainable construction
•If the program doubled in size job placement could remain at 100%, but they need additional
resources to help with recruitment and additional faculty lines to support the program
Strengths:
Weaknesses:
Page 133 of 14511/13/2017
17Acad AP188 183 Green Building-Cert Cert
Insufficient Evidence
Average: 3.450 Range: 1.900
Insufficient Evidence
1. ALIGNMENT
Reviewer: 1 Score: 3 Weighted Score: 0.6
Lack of justification overall for need of program to meet UM's mission.
Program aligns well with sustainability efforts of UM2020. Also aligns with mission for professional
training. Program also demonstrates anecdotally the improvement in diversity recruitment.
Strengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 1.2
NM
The program appears to align with UM2020. It provides a dynamic learning environment and engages
students in sustainable construction practice.
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 2 Weighted Score: 0.3
The is still overall low enrollment and use of SCH in an interdisciplinary sense.
The demand of the program seems to be trending upwards with declining enrollment.Strengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.6
SCT is only in its 2nd year and is missing support data. Since SCT merged with FME there should be a
way to collect some data for the aspects of this program that existed previously.
Author indicates reduction in students. May be result of strong economy (low unemployment),
uncertainty in program survival due to budget cuts, or a combination of both.
Appears to be economic demand for graduates in the construction industry.Strengths:
Weaknesses:
3. Productivity
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
2Reviewer:
3 6 1.2 4 0.6 4 0.8 4 0.8 4 0.4 4 0.6 4.4Reviewer:
1 3 0.6 2 0.3 2 0.4 2 0.4 5 0.5 2 0.3 2.5Reviewer:
Page 134 of 14511/13/2017
17Acad AP188 183 Green Building-Cert Cert
Insufficient Evidence
Reviewer: 1 Score: 2 Weighted Score: 0.4
There is no depth or data to prove productivity. Also, the author states ,any students don't complete
program because they entire workforce without a degree.
The job placement rate that is also anecdotal is 100%.Strengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.8
Missing centralized data to support one way or the other.
Authors claim strength in time to graduation - no evidence provided.Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 2 Weighted Score: 0.4
No depth to explanation of time to degree, or job placement assessment.
Some years the average was at or below 2 years.Strengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.8
not much data or evidence provided.
Author claims 100 percent placement - seems reasonable in current construction environment.Strengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 5 Weighted Score: 0.5
Lack of depth in assessment,
Increased course size with fewer faculty and staff for program. Combined with other programs to form
current program. This is a good indicator if efficiency efforts.
Strengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.4
reductions in general funding limit the programs ability to acquire needed tools for training.
combined the SCT and FME programs into one department.
Program is only in second year so data is limited.
Strengths:
Weaknesses:
6. OPPORTUNITY
Page 135 of 14511/13/2017
17Acad AP188 183 Green Building-Cert Cert
Insufficient Evidence
Reviewer: 1 Score: 2 Weighted Score: 0.3
Did not reference strategic vision 1.1 or possible efforts to align with new vision.
Could double number of students in program and keep job placement rating.Strengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.6
any expansion would appear to need financial support in a time when financial support has been
reduced.
According to author, demand for graduates is high and resources might allow program to expand - but
supporting data is weak or non-existent.
Program is only two years old, program would have been vetted in the ASCRC approval process -
more time is needed to collect information on demand, productivity, efficiency and quality.
Strengths:
Weaknesses:
Page 136 of 14511/13/2017
17Acad AP188 188 Sustainable Construction Technology-2Y 2Y
Insufficient Evidence
Average: 5.900 Range: 2.700
Insufficient Evidence
1. ALIGNMENT
Reviewer: 1 Score: 7 Weighted Score: 1.4
•None seen.
•The Sustainable Construction Technology program aligns very well with all values of UM2020.
•The SCT program provides essential training in creating Shelter, with various aspects supporting
UM’s mission.
•The nature of team building in SCT brings together diverse students who bond in social as well as
professional groups.
•The program provides skilled, well-trained workers for the workforce needs.
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 1.4
50% attrition as students are hired before they finish the program.
Aligned well with UM2020, i.e. leadership, engagement, sustainability, diversity.
100% job placement for graduates.
Definitely meeting local workforce needs.
Strengths:
Weaknesses:
Reviewer: 3 Score: 7 Weighted Score: 1.4
would have liked more details on actually how many women and students of color are in the program;
would have liked more robust discussion of connection to UM mission; would have liked to have seen
more discussion of full sets of skills developed in program;
good evidence of service learning; strong connection to sustainability; good connection to diversity;
solid connection to UM mission; strong placement record;
Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 7 Weighted Score: 1.05
•None seen.
•The program was created last year by the combination of Carpentry and facilities management
engineering, so central data are limited.
•Collaborations exist with several departments on the Mountain campus (Theater, Business, etc.).
Additional opportunities would be possible with increased funding.
•Because of the collaborative nature of the program, a decrease in funding would have a wide-spread
inpact.
Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1 7 1.4 7 1.05 7 1.4 8 1.6 6 0.6 8 1.2 7.25Reviewer:
2 7 1.4 6 0.9 6 1.2 5 1 5 0.5 6 0.9 5.9Reviewer:
3 7 1.4 5 0.75 3 0.6 3 0.6 9 0.9 2 0.3 4.55Reviewer:
Page 137 of 14511/13/2017
17Acad AP188 188 Sustainable Construction Technology-2Y 2Y
Insufficient Evidence
Reviewer: 2 Score: 6 Weighted Score: 0.9
N/A
Merging Carpentry and Facilities Management Education (FME) created more career
options/pathways for students.
Program collaborates with several UM departments on building projects.
Reductions would impact several other departments.
Strengths:
Weaknesses:
Reviewer: 3 Score: 5 Weighted Score: 0.75
would have liked to have seen much more discussion of negative impacts; very thin treatment
solid connection to other programs; solid discussion of impact;Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 7 Weighted Score: 1.4
•No clear, objective measurements can be enumerated other than project completions.
•The ability of this program to provide service to UM and the community is only limited by time and
resources. Several projects are completed every year benefitting several public resources.
•The instructional objectives are being met.
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 1.2
Datasheet information is only from Carpentry.
Important service/outreach activities that have positive impact for on-and off-campus entities.Strengths:
Weaknesses:
Reviewer: 3 Score: 3 Weighted Score: 0.6
very hard to assess productivity; how does one home a year compare to other comparable programs?;
need more discussion of actually how many projects are done on an annual basis; very thin discussion
of meeting program goals; needs evidence of how those goals have been met
good evidence of connection to the community;Strengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 8 Weighted Score: 1.6
•None seen.
•100% of graduates who want to enter workforce are employed, some becoming employers
themselves. Other students have won awards.
•Faculty are recognized for their excellence in their fields.
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
N/A
Employment outcomes very positive (100%).
Graduates participating in entrepreneurship activities/small business ownership.
Well-qualified faculty.
Strengths:
Weaknesses:
Reviewer: 3 Score: 3 Weighted Score: 0.6
need much more detail on specifics of student outcomes; lists of certification does not seem an
adequate measure of out comes
evidence in student outcomes includes some specifics; glad to see mention of one award in faculty
outcomes; great job placement rate
Strengths:
Weaknesses:
Page 138 of 14511/13/2017
17Acad AP188 188 Sustainable Construction Technology-2Y 2Y
Insufficient Evidence
5. EFFICIENCY
Reviewer: 1 Score: 6 Weighted Score: 0.6
•Budget cuts have forced an increase in class size to where it impacts student safety.
•Lack of budget has limited the ability to purchase supplies, reducing the instructional opportunities
fro students.
•Admin cuts negatively affected the ability for the West Campus to communicate with the East
Campus.
•Budget cuts at MC created the need to combine programs, with a good outcome in the form of this
new program.
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 0.5
N/A
Merging Carpentry and FME programs (with no extra FTE) increased enrollment and created more
options for students.
Faculty have taken on administrative responsibilities because of loss of Administrative support FTE.
Strengths:
Weaknesses:
Reviewer: 3 Score: 9 Weighted Score: 0.9
none noticeable – clearly doing very important work with very little
impacts on instruction is very disturbing; appear to be doing very much with very littleStrengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 8 Weighted Score: 1.2
•None seen.
•Increased on-line learning is a goal to allow learning in place.
•Improved ability to create shelter using sustainable construction techniques addresses the new Vision
as well.
•The program is fully enrolled. Increased resources would provide training for additional students in
this 100% of graduates employed program.
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 0.9
Partially addressed contributing to the Strategic Vision document, i.e. briefly mentioned partner with
place and meeting workforce needs. More information would have provided more context.
Built a recording studio to record lectures and increase online learning.
Potential to become regional destination campus and increase enrollment.
Strengths:
Weaknesses:
Reviewer: 3 Score: 2 Weighted Score: 0.3
need much more robust discussion, discussion of restructuring and allocation of additional resources
very thin; needs much more discussion and attention in all bullet points in this section
good to see movement toward on-line instruction;Strengths:
Weaknesses:
Page 139 of 14511/13/2017
17Acad AP189 189 Welding Technology-2Y 2Y
Consider for Development and/or Modification
Average: 4.933 Range: 2.450
1. ALIGNMENT
Reviewer: 1 Score: 4 Weighted Score: 0.8
1. Provides a lot of non-specific information
1. Works to make students more employable by emphasizing critical thinking
2. Students are awarded technical endorsements
Strengths:
Weaknesses:
Reviewer: 2 Score: 5 Weighted Score: 1
Nothing on sustainability or diversity.
The report writer does not consider the program in alignment with the UM Mission.
Leadership and engagement addressed.
Although the author does not address diversity in this section, it is partially addressed under
productivity as Outreach. There are two programs that are meant to empower women and girls to
pursue this trade. Since the outreach efforts started, the number of women enrolled in this program
tripled from 2 to 6.
This program is aimed to address workforce needs.
Strengths:
Weaknesses:
Reviewer: 3 Score: 2 Weighted Score: 0.4
discussion of leadership and engagement is very general and does not address all the elements of the
strategic plan; discussion of mission does not directly address how the program is essential to UM as a
school; section has several grammatical errors; discussion of workforce needs very thin; again includes
several grammatical errors
nice connection with Harris Thermal;Strengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: 6 Weighted Score: 0.9
1. Weak cross disciplinary demand- however that is difficult for a small, specialized program to achieve
1. Courses contribute to 3 other technical programs
2. Has dual enrollment credit for high schoolers
Strengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
3 2 0.4 3 0.45 4 0.8 4 0.8 6 0.6 2 0.3 3.35Reviewer:
1 4 0.8 6 0.9 7 1.4 5 1 8 0.8 6 0.9 5.8Reviewer:
2 5 1 5 0.75 4 0.8 6 1.2 7 0.7 8 1.2 5.65Reviewer:
Ranking Category:
Consider for Development and/or Modification: 14
Priority for Substantial Modification: 1
Priority for Devlopment and Growth: 0
Total Count: 15
Page 140 of 14511/13/2017
17Acad AP189 189 Welding Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 2 Score: 5 Weighted Score: 0.75
-
Collaboration with local high schools to offer dual credit.
The skills offered in this program add value to other programs by providing an additional training
component.
Strengths:
Weaknesses:
Reviewer: 3 Score: 3 Weighted Score: 0.45
very low participation rates from local high schools; discussion of impact cursory and needs much
more development.
helpful description of credentials;Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: 7 Weighted Score: 1.4
1. Small, specialized programs are hard to track- the quintiles are low, but show strong improvement
in their trends for this criteria
1. Works to encourage women to join the trade by partnering with the YMCA- overall, 8 students were
enrolled as a result
2. Many students receive American Welding Society Certificates
Strengths:
Weaknesses:
Reviewer: 2 Score: 4 Weighted Score: 0.8
Low number of majors, degree awarded, and. student FTE/instructional FTE ratio. (2, 2, 1)
5 YR trend in all areas are in the 5th quintile.
The outreach programs UTS and GRIT have stimulated an increase of women participating in this
program. The report writer states that the AWS certificates awarded has tripled in the last 5 years.
Central data does not match this with the number of students who have completed the program.
Strengths:
Weaknesses:
Reviewer: 3 Score: 4 Weighted Score: 0.8
very low enrollment numbers overall; missing any discussion of professional or scholarly productivity
great program serving girls in the field; good growth in completion of certificatesStrengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: 5 Weighted Score: 1
1. N/A
1. Several student's capstone projects have won the Lincoln Electric Career Project Competition
2. Faculty members are certified welding inspectors by the American Welding Society
Strengths:
Weaknesses:
Reviewer: 2 Score: 6 Weighted Score: 1.2
-
This is a 2 year degree and on average, students complete this just under 2 years.
Students regularly win in the Lincoln Electric Career Project competition.
There is a certification standard for instructors and local industry has a “high degree of input and
participation in relation to the welding program development.”
Strengths:
Weaknesses:
Page 141 of 14511/13/2017
17Acad AP189 189 Welding Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 3 Score: 4 Weighted Score: 0.8
but the competition is entirely internal to the program, thus not a clear indicator of success in the larger
welding community; but missing a sense of the larger accomplishments of the welding faculty
good discussion of competition; good discussion of certification and accreditation of instructorsStrengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: 8 Weighted Score: 0.8
N/A
1. Partnering with Miller Electric was beneficial to students and saved a lot of money for the program
2. See criteria 5, bullet 2
Strengths:
Weaknesses:
Reviewer: 2 Score: 7 Weighted Score: 0.7
This. Program is falling behind in maintaining necessary equipment. Money raised to support this
program has been siphoned to “cover additional expenses not related to the Missoula Welding
Program.”
Partnership has been created between Miller Electric and Missoula College Welding that has enabled
the program to become a
Miller Welding Testing Center”. This provides students access to state of the art equipment at no cost
while potential customers of Miller distributors are able to try the equipment.
Strengths:
Weaknesses:
Reviewer: 3 Score: 6 Weighted Score: 0.6
missing any discussion of administrative FTE
strong evidence of collaboration with Miller Welding; great cost savings; impressive that the program
has found a way to move forward without the benefit of state funds for purchasing and repairing
equipment
Strengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: 6 Weighted Score: 0.9
1. Provides little information about how they could cut costs- however, they already have saved a vast
amount of money by partnering with Miller electric
1. Could offer an introductory class available to all students
2. Could allow students to achieve a credential in one semester
Strengths:
Weaknesses:
Reviewer: 2 Score: 8 Weighted Score: 1.2
-
This program provides a rounded skill set so that students are not “constrained to one position in a
workplace” once they complete the program. Program provides several examples where they already
partner with Place.
There is an opportunity to restructure the program to meet Gen-Ed requirements and open this skill up
to all students at UM. This could also provide an opportunity to expose welding student to higher
education.
Strengths:
Weaknesses:
Page 142 of 14511/13/2017
17Acad AP189 189 Welding Technology-2Y 2Y
Consider for Development and/or Modification
Reviewer: 3 Score: 2 Weighted Score: 0.3
does not discuss the creating change together document; section has multiple grammatical errors; not
clear how bullet labeled “restructuring the program” is actually restructuring; no discussion of
allocation of additional resources or interdisciplinary inquiry
great anecdote about making a menorah for the local Jewish communityStrengths:
Weaknesses:
Page 143 of 14511/13/2017
AP197 197 Entrepreneurship-Cert Cert
Priority for Substantial Modification
Average: 1.150 Range: 0.000
No Report Submitted
1. ALIGNMENT
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
No information provided
No information providedStrengths:
Weaknesses:
2. Demand
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 2 Weighted Score: 0.3
Trend for metric 3 is declining, drop from 9104 in 2013 to 5474 in 2017. • No other information on
FTE data sheet
· Quintile 3 for 5 YA of SCH for Gen-Ed courses, 2017 highest with 900, up from 681 in 2016 •
Quintile 3 for 5 YA of SCH ratio of non-majors to total –Weaknesses:
Strengths:
Weaknesses:
3. Productivity
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore
Alignment Demand OpportunityProductivity Quality Efficiency
1Reviewer:
2Reviewer:
3 1 0.2 2 0.3 1 0.2 1 0.2 1 0.1 1 0.15 1.15Reviewer:
Page 144 of 14511/13/2017
AP197 197 Entrepreneurship-Cert Cert
Priority for Substantial Modification
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
· No information provided
· No information providedStrengths:
Weaknesses:
4. QUALITY
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.2
· No information provided
· No information providedStrengths:
Weaknesses:
5. EFFICIENCY
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 3 Score: 1 Weighted Score: 0.1
· No information provided
· No information providedStrengths:
Weaknesses:
6. OPPORTUNITY
Reviewer: 1 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Reviewer: 2 Score: Weighted Score:
No review
No reviewStrengths:
Weaknesses:
Page 145 of 14511/13/2017
AP197 197 Entrepreneurship-Cert Cert
Priority for Substantial Modification
Reviewer: 3 Score: 1 Weighted Score: 0.15
· No information provided
· No information providedStrengths:
Weaknesses:
Page 146 of 14511/13/2017