Total Count: 16 - University of Montana · Reviewer Score Weight Score Weight Score Weight Score Weight Score Weight Score Weight Total ... Technology (AP #158) Strengths: None seen

17Acad AP152 152 Computer Aided Design-Cert Cert

Priority for Substantial Modification

Average: 2.550 Range: 1.550

1. ALIGNMENT

Reviewer: 1 Score: 3 Weighted Score: 0.6

- the program claims to align with the Plans's Values but does not provide evidence or further

explanation

- does not explain how a reduction of their resources would weaken the University's ability to achieve

its mission

- doesn't fully explain how they are essential to UM

- the CAD program aligns with the UM2020 Plan by providing hands-on practical experience with

business and industry to prepare their students for a global society

- explains in great detail how their program prepares students for the cultural, social and workforce

needs of the 21st century

Strengths:

Weaknesses:


Does not address how the program has addressed the UM2020 Strategic Plan. This report does not

explain how essential this program is to UM or how reduction of resources would weaken the

University’s ability to achieve its mission

Addresses how this program prepares students with skills needed for the workforce.Strengths:

Weaknesses:


* Report does not adequately address the UM 2020 values of diversity and sustainability.

* Could have used more specific examples of how program addresses UM 2020 values of leadership

and engagement.

* Could have specifically addressed how CAD certificate program is essential to UM "to achieve its

mission."

* Report adequately addresses the UM 2020 values of leadership and engagement.

* CAD certificate program provides students with a set of highly desired skills.

Strengths:

Weaknesses:

2. Demand

Reviewer Score Weight Score Weight Weight Score Weight Score Weight Score Weight TotalScore

Alignment Demand OpportunityProductivity Quality Efficiency

2 2 0.4 3 0.45 3 0.6 3 0.6 4 0.4 1 0.15 2.6Reviewer:

1 3 0.6 2 0.3 1 0.2 2 0.4 1 0.1 1 0.15 1.75Reviewer:

3 4 0.8 4 0.6 1 0.2 4 0.8 3 0.3 4 0.6 3.3Reviewer:

Ranking Category:

Consider for Development and/or Modification: 1

Priority for Substantial Modification: 15

Priority for Devlopment and Growth: 0

Total Count: 16

Page 1 of 14511/13/2017




- does not provide evidence for its existing collaborations or interdisciplinary activities

- does not show how STEM programs will be impacted by a reduction in size

- collaborates with other STEM programsStrengths:

Weaknesses:


The quintile for non-majors is 2. Assessment does not explain how or what programs would be

impacted if it were reduced or curtailed.

-Strengths:

Weaknesses:


* Report does not adequately address the questions for bullet 2 of this criteria (Impacts on other

programs if program was reduced).

Centralized data:

None provided

Bullet 1 (Existing collaborations or interdisciplinary activities):

* Students in electronics, arts and sciences, and industrial technology at MC also take CAD courses.

* Technical drafting course fulfills a general education requirement.

Strengths:

Weaknesses:

3. Productivity


- responded N/A for all bullets, though they mention research by faculty members in Criteria 4

- responded with N/A for all bulletsStrengths:

Weaknesses:


Trends on number of majors rank this program in the 2nd quintile. There is no statement of whether to

expect this program to grow or continue to shrink in number of students.

Number of majors place this program in the 4th quintile.

Number of certificates awarded and the 5 yr trend indicates that the number remains consistent with

no significant increase or decrease in numbers.

Strengths:

Weaknesses:


No responses given for this criteria.

No centralized data

No responses

Strengths:

Weaknesses:

4. QUALITY


- no evidence provided for student outcomes

- no evidence provided for faculty outcomes

- the program is preparing for the Accreditation Board for Engineering and Technology accreditation,

but does not say if it currently is

Strengths:

Weaknesses:

Page 2 of 14511/13/2017




Central data is unable to provide information on the time it takes for a student to complete this “1 yr”

certificate and this is not addressed by the report writer.

Unclear how close the program is to meeting the ABET accreditation requirements.

Student outcomes are fair.

Report indicates ongoing professional development for faculty. No benchmarks noted. States that there

are collaborations with other programs but is not specific.

The program has been preparing for the ABET accreditation.

Strengths:

Weaknesses:


* I’m not sure if this program is currently accredited.

* I would have liked to see a breakdown or specific numbers with respect to faculty research in this

program-- a more direct response to the question of the quality of faculty outcomes.

* I would have liked to see a breakdown or specific numbers on student outcome quality.

Centralized data:

None provided

Bullet 1 (Quality of student outcomes):

* Most graduates of this program go on to work in engineering fields and/or go on to bachelors or

masters programs in engineering.

Bullet 2 (Quality of faculty outcomes):

* Faculty participate in conferences, workshops, and certification programs

* One faculty member serves as an examination administrator for the Electronics Technician

Association International certificate test.

Bullet 3 (Accreditation information):

Program is preparing for accreditation through the Accreditation Board for Engineering and

Technology.

Strengths:

Weaknesses:

5. EFFICIENCY


- simply claimed that they have experienced a faculty reduction, but no further explanation

- did not identify an effort to improve efficiency

- did not explain how an admin FTE position impacts the efficiency of their program

- added a new course to strengthen the programStrengths:

Weaknesses:


The program has experienced employee reduction but has developed a new course designed to

“strengthen” the program.

It is unclear how much this program costs to maintain or how much revenue it brings in.

-Strengths:

Weaknesses:

Page 3 of 14511/13/2017




* No specifics given on employee reduction or further explanation how the new course improves

efficiency.

Centralized data:

None provided

Bullet 1 (Impact of changes in revenue or expenses):

* Program has experienced employee reduction.

Bullet 2 (Efforts to improve efficiency):

* A new course has been developed and offered.

Bullet 3 (Administrative FTE information):

* Department shares an administrative staff member with business technology.

Strengths:

Weaknesses:

6. OPPORTUNITY


- does not explain how their program could contribute to the Strategic Vision

- does not explain how their program could contribute to establishing UM as a leader in

interdisciplinary areas of inquiry

- does not explain how their one opportunity for restructuring would promote efficiency or enhance

performance

xStrengths:

Weaknesses:


Does not address alignment with UM Strategic Vision.

Does not answer the question regarding opportunity for restructuring.

Does not answer how allocation of additional resources would help.

States that faculty have been working to strengthen the existing certification program.Strengths:

Weaknesses:


Report does not adequately answer the questions posed in bullet 1 of this criteria with respect to the

Strategic opportunities in UM Strategic Vision.

Report does not adequately answer the questions posed in bullet 4 of this criteria with respect to the

allocation of additional resources to the program.

Bullet 2 (Establishing UM as a leader in interdisciplinary areas):

CAD certificate program is inherently interdisciplinary.

Bullet 3 (Restructuring opportunities):

Faculty of this program want to expand it to a full Associate of Applied Science degree.

Strengths:

Weaknesses:

Page 4 of 14511/13/2017



Page 5 of 14511/13/2017

17Acad AP153 153 Computer Support-Cert Cert



1. ALIGNMENT


According to this report, this program should not be assessed. It states "See Unit of Analysis 158

Information Technology."



Strengths:

Weaknesses:


- Report blank, author believes the program should be evaluated as part of AAS degree in Information

Technology (AP #158)

None seenStrengths:

Weaknesses:


Failed to report

None observedStrengths:

Weaknesses:

2. Demand






Strengths:

Weaknesses:




None seenStrengths:

Weaknesses:


Failed to report


Weaknesses:



1 1 0.2 1 0.15 1 0.2 1 0.2 1 0.15Reviewer:

3 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:

2 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:

Ranking Category:




Total Count: 15

Page 6 of 14511/13/2017



3. Productivity






Strengths:

Weaknesses:




None seenStrengths:

Weaknesses:


Failed to report


Weaknesses:

4. QUALITY






Strengths:

Weaknesses:




None seenStrengths:

Weaknesses:


Failed to report


Weaknesses:

5. EFFICIENCY

Reviewer: 1 Score: Weighted Score:





Strengths:

Weaknesses:




None seenStrengths:

Weaknesses:

Page 7 of 14511/13/2017




Failed to report


Weaknesses:

6. OPPORTUNITY






Strengths:

Weaknesses:




None seenStrengths:

Weaknesses:


Failed to report


Weaknesses:

Page 8 of 14511/13/2017

17Acad AP154 154 Cybersecurity-Cert Cert



1. ALIGNMENT


No information.

No explanation.Strengths:

Weaknesses:


Does not describe program.

Explains this is not a standalone program and refers all data to Unit of Analysis 158.Strengths:

Weaknesses:


N/A

N/A provided no information. I am unable to access the report readers were referred to read.Strengths:

Weaknesses:

2. Demand


Ranked in the 1st quintile for 5ya of SCH for Gen-Ed. 5YA of SCH ratio of non-majors to total in 2nd

quintile.

No valuable information.Strengths:

Weaknesses:


Does not address.

Refers to Unit of Analysis Data 158. Data for 154 is in low quintiles.Strengths:

Weaknesses:


N/A

N/AStrengths:

Weaknesses:

3. Productivity



2 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:

3 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:

1 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:

Ranking Category:




Total Count: 15

Page 9 of 14511/13/2017




No data available.

N/AStrengths:

Weaknesses:


Does not address.

Refers to Unit of Analysis Data 158. Data for 154 is in low quintiles.Strengths:

Weaknesses:


N/A

too soon to tell.Strengths:

Weaknesses:

4. QUALITY


No data available.

No information.Strengths:

Weaknesses:


Does not address.

0's for quintiles. No explanation of data.Strengths:

Weaknesses:


N/A

N/AStrengths:

Weaknesses:

5. EFFICIENCY


No data available.

No Data Available.Strengths:

Weaknesses:


Does not address.

0's for quintiles. No explanation of data.Strengths:

Weaknesses:


N/A

N/AStrengths:

Weaknesses:

6. OPPORTUNITY


No Information.

No Information.Strengths:

Weaknesses:

Page 10 of 14511/13/2017




Does not address.

Does not address.Strengths:

Weaknesses:


N/A

N/AStrengths:

Weaknesses:

Page 11 of 14511/13/2017

17Acad AP155 155 Electronics Technology-2Y 2Y



1. ALIGNMENT

Reviewer: 1 Score: 5 Weighted Score: 1

N/A

* Engineering technology emphasisStrengths:

Weaknesses:


•Could have included more specifics on Leadership, Engagement and Sustainability.

•Continuous improvements to Electronics Labs.

•Promote culture outreach and internationalization through the collaboration with the International

Center

•Interdisciplinary STEM program with an engineering technology emphasis at UM.

•Addresses how the program prepares students for workforce needs of the 21st century with clearly

defined objective.

Strengths:

Weaknesses:


•Report does not explain how reduction of resources would weaken UM’s overall ability to achieve its

mission.

•Report suggests program aligns with some aspects of UM’s mission: Program focuses on cutting-edge

technology with a global perspective (Electronics Lab, collaborates with International Center for

outreach, preparing students for 21st-century workforce)

•“Program is one of few STEM programs with engineering technology emphasis at UM.”

•Prepares students for needs of 21st century through abilities to: utilize information technology; to

troubleshoot of electronic components; to solve technical problems involving mathematics; to utilize

instrumentation to measure, calibrate, test, and repair electronic components; to engage in project

management and hands-on skills.

Strengths:

Weaknesses:

2. Demand


* Stopped accepting students into the program

N/AStrengths:

Weaknesses:



1 5 1 4 0.6 1 0.2 3 0.6 3 0.3 4 0.6 3.3Reviewer:

3 5 1 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1.8Reviewer:

2 8 1.6 6 0.9 5 1 7 1.4 5 0.5 5 0.75 6.15Reviewer:

Ranking Category:




Total Count: 16

Page 12 of 14511/13/2017




•Could have directly addressed student needs or faculty performance.

•Constant collaborations and interdisciplinary activities with other programs such as energy

technology and industrial technology and departments like media arts, music, and psychology.

•One of the few interdisciplinary STEM programs with an engineering technology emphasis.

Strengths:

Weaknesses:


•Report provides minimal information, addressing certain bullet points with only 1-2 sentences.

•Report does not identify potential impacts on OTHER programs. Only states: “The impacts have

already been seen since the UM stopping accepting new students for the program.”

•Program is an interdisciplinary STEM program, collaborating with energy technology, industrial

technology, media arts, music, psychology.

Strengths:

Weaknesses:

3. Productivity


No Supporting data

N/AStrengths:

Weaknesses:


•Does not include information on outreach or how the program measures productivity.

•Emphasis on program solving, creative and analytics thinking, hands-on skill and project

management.

•Includes lab courses, course-level projects, capstone projects and internships

Strengths:

Weaknesses:


* Program includes only one sentence in answer to this criterion.

* N/AStrengths:

Weaknesses:

4. QUALITY


* Not Accredited

* No Student outcome data provided

* Faculty dedicated to maintaining high professional standardsStrengths:

Weaknesses:


•Could have included information on student placement of graduates or exit surveys.

•Significant laboratory components for quality teaching, hands-on training and effective learning.

•Provides a solid foundation in analog and digital electronics, extensive knowledge in specialized

fields of electronics, cross discipline knowledge in computer programming, energy tech, IT. Includes

software application and programming.

•Accredited by ABET (Accreditation Board for Engineering and Technology)

Strengths:

Weaknesses:

Page 13 of 14511/13/2017




•Report does not provide any evidence of the quality of student or faculty outcomes. Student

outcomes are not discussed at all, while faculty outcomes are touched upon only in the broadest of

terms.

•Program refers to sources outside the report, e.g., “As shown in the [unprovided] biographies of the

faculty members.”

N/AStrengths:

Weaknesses:

5. EFFICIENCY


* Limited quantitative data provided

* Using updated technological resources to improve delivery and efficienciesStrengths:

Weaknesses:


•Could have provided more information on the duties of the Administrative Associate.

•Provide more examples of collaborations with other departments.

•Use of software for design, analysis and implementation of electronic circuits and systemsStrengths:

Weaknesses:


•Program demonstrates little effort to improve efficiency.

•First bullet point is largely ignored, stating only that the program “has experienced employee

reductions in recent years.”

•Instead of discussing efforts to improve efficiency, report discusses efforts to improve quality of

instruction.

N/AStrengths:

Weaknesses:

6. OPPORTUNITY


N/A

* provides unique learning opportunity for studentsStrengths:

Weaknesses:


•Provide more examples for new strategic opportunities for Criteria 6 – Bullet 1

•Provide more examples of interdisciplinary opportunities.

•Enhance education pathways through Big Sky Pathways to promote students’ continuous education

to 4-year universities.

Strengths:

Weaknesses:

Page 14 of 14511/13/2017




•Program offers minimal opportunities to enhance UM.

•Program has copied and pasted entire answer from Bullet 1 Criterion 1 (UM2020) into this criterion

(Creating Change Together), demonstrating it isn’t aware that there are two different mission

statements.

•Program does not discuss how it could contribute to establishing UM as a leader in interdisciplinarity

of state-wide needs; rather, it discusses what it does to improve retention.

•Program does not identify an opportunity for restructuring; rather, it discusses how to improve the

quality of instruction (copied and pasted from answer to Criteria 5, Bullet 2)

N/AStrengths:

Weaknesses:

Page 15 of 14511/13/2017

17Acad AP156 156 Energy Technology-2Y 2Y



1. ALIGNMENT


The Energy Technology program has no students, no faculty, no graduates and appears to spend more

out of its designated account then it is generating. The program is currently on a moratorium but the

author did not mention that or how the program could be revised and restructured.




Strengths:

Weaknesses:


The program does not reference UM2020 or how it aligns with that strategic vision.

The program outlines their goals to fulfill UM's mission- "The curriculum provides hands-on, practical

experience with real-world applications, as well as developmental coursework to ensure that students

are prepared to succeed in the college environment and in the field" This program is a STEM focus.

Strengths:

Weaknesses:


Although the program mentions outreach to local communities and international students, I would

like to see more outreach to the tribal communities.

This is an important vocational program which can produce graduates who can:

1) obtain well-paid employment in the local communities;

2) be on the forefront of energy alternatives

Strengths:

Weaknesses:

2. Demand








Strengths:

Weaknesses:



3 8 1.6 5 0.75 5 1 5 1 5 0.5 5 0.75 5.6Reviewer:

1 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:

2 3 0.6 2 0.3 1 0.2 1 0.2 2 0.2 2 0.3 1.8Reviewer:

Ranking Category:




Total Count: 16

Page 16 of 14511/13/2017




The program does not describe their internal, or external demands in any depth. They reference

anecdotal evidence of interdisciplinary nature, but nothing specific.

"There are constant collaborations and interdisciplinary activities with other programs (such as

electronics technology, industrial technology), departments (such as physics, chemistry and

biochemistry),, and local industry and community, such as capstone projects, internship, course

sharing, and etc"

Strengths:

Weaknesses:


See above.

This is confusing, since there is a mention in the narrative about a UM decision not to accept new

students. Was this because of the new construction of MC or another reason?

Just like all vocational programs, the demand is often dependent on the unemployment rate. In times

of high unemployment, students will seek training to make themselves more competitive, and in low

unemployment, if it is possible to get work without formal education, many potential students will

take that route.

Strengths:

Weaknesses:

3. Productivity








Strengths:

Weaknesses:


There is no explanation of productivity, or data to analyze.

"Dr. Bradley Layton has received a grant from the National Science Foundation."Strengths:

Weaknesses:


Hard to assess.

NSF grant.

The central data show no contract instructors. Therefore, hard to assess this.

Strengths:

Weaknesses:

4. QUALITY








Strengths:

Weaknesses:

Page 17 of 14511/13/2017




The program does not provide any evidence to asses its quality as a program, or any data to analyze.

The program describes their value based on good faculty and hands-on curriculum.Strengths:

Weaknesses:


See above.

Again, difficult to assess because the structure of the program is not laid out either by central data or

by narrative. The program is preparing for accreditation.

Strengths:

Weaknesses:

5. EFFICIENCY








Strengths:

Weaknesses:


The program does no outline how they have become more efficient with their use of faculty lines.

The program shares 1 administrative service personnel with another program. They have collaborated

with a number of other programs at the Missoula College.

Strengths:

Weaknesses:


See above.

Since no costs related to faculty are listed, difficult to assess efficiency.Strengths:

Weaknesses:

6. OPPORTUNITY








Strengths:

Weaknesses:


The program did not mention the Strategic Vision 1.1 in the report, or how they would align with this.

The program copy and pasted repeated information in this criteria that was irrelevant.

The program wants to utilize retention methods.Strengths:

Weaknesses:


See above.

This program should have strong possibilities, if it has regular staff. Even if it relies on courses and

instructors from outside the program, staff is still necessary to coordinate it.

Strengths:

Weaknesses:

Page 18 of 14511/13/2017



Page 19 of 14511/13/2017

17Acad AP157 157 Health Information Technology -Cert Cert



1. ALIGNMENT


-No data, narrative provided to assess strengths or weaknesses.

-The academic curriculum is a subset of courses found in the 2-year AAS degree in Information

Technology.


Strengths:

Weaknesses:


I cannot assess this program as it did not respond.

I cannot assess this program as it did not respond.Strengths:

Weaknesses:


none

Fits well with UMHMStrengths:

Weaknesses:

2. Demand




Technology.


Strengths:

Weaknesses:




Weaknesses:


All data seems to be zero, authors argues to relate to another unit of analysis

noneStrengths:

Weaknesses:



3 5 1 1 0.15 1 0.2 1 0.2 5 0.5 1 0.15 2.2Reviewer:

2 1 0.2 1 0.15 1 0.2 1 0.2 1 0.15Reviewer:

1 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:

Ranking Category:




Total Count: 13

Page 20 of 14511/13/2017



3. Productivity




Technology.


Strengths:

Weaknesses:




Weaknesses:



noneStrengths:

Weaknesses:

4. QUALITY




Technology.


Strengths:

Weaknesses:




Weaknesses:



noneStrengths:

Weaknesses:

5. EFFICIENCY




Technology.


Strengths:

Weaknesses:




Weaknesses:


Question is, does anybody get the certificate? Does anybody get a reduced load to help manage the

cert?

noneStrengths:

Weaknesses:

Page 21 of 14511/13/2017



6. OPPORTUNITY




Technology.


Strengths:

Weaknesses:




Weaknesses:


Can't tell from the writeup

noneStrengths:

Weaknesses:

Page 22 of 14511/13/2017

17Acad AP158 158 Information Technology-2Y 2Y

Consider for Development and/or Modification


1. ALIGNMENT


This program does align with some aspects but is not exemplary in any particular areas

: engaged in dual-enrollment and curriculum sharing with high schools IT provides responsive two-

year programming using partnerships, Discovery and Creativity to Serve Montana and the World,

Computer and Information Technology careers continue to grow at a faster than average rate than

other occupations

Strengths:

Weaknesses:


•connection between industry certification and creative scholarship is not clear.

•program addresses high area of workforce demand in the region.

•contributes a number of dual enrollment classes

•strong description of the 2-year college contribution to UM2020 strategy

Strengths:

Weaknesses:


Does not address how the program supports the UM2020 core values.

Clearly identifies strategies for supporting the initiatives outline in the UM 2020 Strategic Plan

This program strives to meet the demands of the growing IT field. This sector continues to be in

demand and provides a higher than average wage for professionals.

Strengths:

Weaknesses:

2. Demand


: Doesn’t offer any gen-ed courses and doesn’t address demand from students outside of the program,

partnership with Computer Science and the College of Education, program is the first of its kind in the

State and provides students with teacher licensure in the area, partnering with the School of Business

MIS

Strengths:

Weaknesses:



1 6 1.2 7 1.05 3 0.6 5 1 7 0.7 6 0.9 5.45Reviewer:

2 6 1.2 6 0.9 5 1 5 1 4 0.4 4 0.6 5.1Reviewer:

3 4 0.8 4 0.6 5 1 4 0.8 4 0.4 6 0.9 4.5Reviewer:

Ranking Category:




Total Count: 15

Page 23 of 14511/13/2017




•asserts that reduction of program would limit opportunity for good careers, but lacks support

•collaboration with Computer Science and Education for Comp Sci teaching minor and working to

revise cybersecurity credential with SOBA

•highest number of graduates at MC after Nursing.

Strengths:

Weaknesses:


Data is “difficult to interpret due to its entanglesment with other programs of study in the

Department.” Some of which have been discontinued.

Identifies collaborations with other UM programs.Strengths:

Weaknesses:

3. Productivity


uses the CBA, which is not unique to any unit, to define productivity rather than self identifying what

is important to the program and faculty and students in that program

all faculty are required to perform creative scholarship, workloads of 15 credits a semester,Strengths:

Weaknesses:


•examples of “creative scholarship” are under-developed. need define "creative scholarship and

explain how industry certification contributes to it

•decent examples of service at the college.

•credits of instruction are demanding: 15 per semester with an allowance made for the program

director.

Strengths:

Weaknesses:


The trend indicates a decline in the number of majors and graduates in this program.

An example for each faculty member is included but does not clearly communicate the full effort of

each faculty member in creative scholarship.

The same can be said of service.

No benchmarks provided regarding the instructional component.

Program is among the highest in terms of number of graduates at Missoula College. The graduation

trend and number of majors are in the 5th quintile.

The decline in the number of majors in this program may be impacted by MC students ability to

declare a single major limiting accurate tracking of data for certificates.

Tenured faculty at MC are required to perform creative scholarship and service.

Strengths:

Weaknesses:

4. QUALITY


lack of publications as well as conference participation, doesn’t address student or faculty outcomes

Completion of an internship is a gradation requirement for all IT students, Faculty use survey results

to improve instructional design, content, and delivery, external industry advisory committee of

employers meets regularly to provide input and feedback for program of study

Strengths:

Weaknesses:

Page 24 of 14511/13/2017




•limited information about what would be required for accreditation.

•pass rates for external exams are varied and inconclusive without additional detail.

•survey of student performance during an internship indicates well qualified/prepared students.

•completion of industry standards demonstrate faculty outcomes

•would welcome accreditation

Strengths:

Weaknesses:


Student outcomes are reported as good but the assessment of these outcomes are generalized and

estimated. It is unclear how student outcomes compare to national standards.

No benchmarks to compare the quality of faculty outcomes to.

This program does not qualify for accreditation.

On average, it takes more than two years to complete this program. This still puts this program in the

3rd quintile for 5YA time to degree.

Faculty would support the goal of program accreditation.

Strengths:

Weaknesses:

5. EFFICIENCY


47% of course for IIT program is taught by adjunct faculty, Missoula College is nearing a 60% ratio of

adjunct faculty, Budget reductions for the college has jeopardized the quality of programs,

Have made significant efforts to improve efficiencyStrengths:

Weaknesses:


•acknowledges significant budget cuts at the college – but generalizes the problems associated with

cuts across the college rather than specifying direct impacts on program.

•no efficiency measures mentioned; points out that the instructional FTE down 50%

•data shows that despite loss of instructional FTE, still numerous students served.Strengths:

Weaknesses:


The need to increase adjunct faculty instructors may have impacted the quality of this program but

lack of assessment history makes this unclear.

Cuts in positions are not equivalent to an increase in efficiency.

Program as inadequate administrative support. Services that have been centralized are not explained.

-Strengths:

Weaknesses:

6. OPPORTUNITY


Program is already struggling significantly due to lack of funds

This program could grow significantly to meet a need in the market as well as provide students to

programs on the mountain campus but struggle die to budgetary restrictions.

Strengths:

Weaknesses:

Page 25 of 14511/13/2017




•refers to MUS goals rather than UM Strategic Vision. no details/specifics support the assertion that

the program doesn’t fill workforce demands.

•restructuring: developing a program for cybersecurity credential seems like a strong Criteria 6 Bullet

1 opportunity, but unclear how it represents restructuring.

•designated Cybersecurity Center of Academic Excellence by the NSA and DHS – (would have

expected this to be mentioned also under Quality outcomes?)

•strong case to be made for improving the instructional FTE situation in terms of adjunct vs tt lines.

Strengths:

Weaknesses:


It is clear that this program has been negatively impacted by cuts and the decline in enrollment may be

a result of those cuts. Without adequate support this program will likely continue to decline despite

the efforts of the faculty.

Program was recently selected as a Cybersecurity Center. Of Academic Excellence by the National

Security Agency (NSA) and Department of Homeland Security. (DHS)

Plans to restructure the program to award more students a Cybersecurity credential (certificate) and

expanding that opportunity to other UM students.

Strengths:

Weaknesses:

Page 26 of 14511/13/2017

AP159 159 Recycling Technology-Cert Cert



No Report Submitted Insufficient Evidence

1. ALIGNMENT


· No report submitted

· None seenStrengths:

Weaknesses:


· No abstract provided.

· No abstract provided.Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:

2. Demand


· No report submitted • Departmental metrics for criteria are in Q1 for SCH for GenEd, 0’s for per

instructional FTE, and Q2 for SCH ratio of non-majors


Weaknesses:


· Decrease in students on 5YA. • No GenEd for Instructional FTE

· Quintile score of 1.Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:

3. Productivity


· No report submitted • Number of majors 0 over 5 years, however 2 degrees awarded in 2016?

• All quintiles for data are in Q0 due to lacking data for all 5 years


Weaknesses:



1 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:

2 1 0.2 1 0.15 1 0.2 1 0.1 1 0.15Reviewer:

3Reviewer:

Page 27 of 14511/13/2017




Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:

4. QUALITY


· No report submitted • All data 0’s across 5 years

None seenStrengths:

Weaknesses:


· Decrease in 5YA for student FTE/instructional FTE ration from 10.5 in 2013 to 0 in 2015.


Weaknesses:


No review

No reviewStrengths:

Weaknesses:

5. EFFICIENCY


· No report submitted • Per FTE metric results only for 2013 then 0’s the rest resulting in Q0 for

all metrics

· None SeenStrengths:

Weaknesses:


· There is still $40,460 of Total Personnel Costs (w/o benefits) in 2014 but no Instructional Faculty

FTE. Who is getting paid this?


Weaknesses:


No review

No reviewStrengths:

Weaknesses:

6. OPPORTUNITY



None seenStrengths:

Weaknesses:




Weaknesses:

Page 28 of 14511/13/2017




No review

No reviewStrengths:

Weaknesses:

Page 29 of 14511/13/2017

17Acad AP160 160 General AA-2Y 2Y



1. ALIGNMENT


-Program does not specifically state alignment with plan. Instead it simply implies it by its nature

-Program does not show how changes would affect UM’s ability to complete mission

-Justifies essentialness to UM through potential graduation rate changes if there were a reduction in

resources

-Demonstrates importance in role for setting up social, cultural, and/or workforce needs for future

academic career or in workforce need of 21st century

Strengths:

Weaknesses:


•None of the values are addressed in the response.

•Other than preparing students for transferring to UM, no mention is made of preparing students for

the 21st century workforce.

•The large number of degrees awarded is a strength of this program.

•The focus on assessing its courses is a strength of this program.

Strengths:

Weaknesses:


•Did not directly address 20/20 plan

•Aligns and supports UM’s general education program

•Supports enrollment and retention

•Offers pathway to degree for diverse non-traditional students

Strengths:

Weaknesses:

2. Demand


NA

-Existing specific pathways with other UM departments provide student need for easy transfer of

credits

-Shows substantial evidence for negative impacts to UM graduation rates if program were reduced in

size or curtailed.

Strengths:

Weaknesses:



1 4 0.8 7 1.05 5 1 4 0.8 8 0.8 6 0.9 5.35Reviewer:

2 4 0.8 8 1.2 7 1.4 3 0.6 7 0.7 3 0.45 5.15Reviewer:

3 7 1.4 8 1.2 6 1.2 5 1 5 0.5 4 0.6 5.9Reviewer:

Ranking Category:




Total Count: 15

Page 30 of 14511/13/2017




•No substantial weaknesses for this criteria.

•The very high number of Gen Ed SCH taught is a strength of this program.

•The collaborations with Mountain Campus programs are strengths of this program.

Strengths:

Weaknesses:


•None.

•Active collaborations with three academic units

•Increases enrollment for UM

Strengths:

Weaknesses:

3. Productivity


-No consistent way of measuring scholarly and/or creative components

-No additional instructional component

-Program has some scholarly and/or creative components that lead to local results

-Program has high use service and or outreach components of its mission that lead to local results

measured through enrollment and credential standards

Strengths:

Weaknesses:


•The declines in both the number of majors and the number of degrees awarded are a concern.

•The large number of majors and degrees awarded is a strength, especially considering the small size

of the faculty of the program.

•The outreach through the Dual Enrollment program is a strength.

Strengths:

Weaknesses:


•Trends indicate decreasing enrollment by nearly 50% since 2013

•Averages over 600 majors per year during 5 year period

•Degrees awarded in 2017 the same as 2013 when enrollment was almost doubled indicating either

better retention or corrupted data

•Growth in SCH

•Engagement with dual enrollment

Strengths:

Weaknesses:

4. QUALITY


-Low evidence of quality student outcomes (no specific evidence to how many continue on to UM or

other higher education programs)

-Program is not subject to external accreditation beyond UM’s requirements

Various and frequent evidence of quality faculty outcomes (i.e. research, writing contributions,

invitations to various programs)

Strengths:

Weaknesses:


•The lack of any evidence of student outcomes is a big weakness. How many of the graduates continue

on to the Mountain Campus? Of those that do go on, how well do they do?

•Nothing is said about the quality of the many adjunct faculty associated with this program.

•There is some evidence of the quality of faculty outcomes but surprisingly little on the teaching

quality.

Strengths:

Weaknesses:

Page 31 of 14511/13/2017




•Not much on student outcomes

•Faculty has good research/professional project experiencesStrengths:

Weaknesses:

5. EFFICIENCY


Does not state FTE funding sources nor whether centralizing some services would be beneficial or

detrimental to the program.

-Negative impacts from revenue or expenses changes leading to decreased tenure-track and non-

tenurable faculty

-Efficiency in matriculation providing students with very economical and efficient pathways into

baccalaureate degree studies.

-Efficiency in curriculum redesigns providing students with preparation for college level mathematics

coursework

-One FTE lengthy duties allows performance efficiently and in high demand/use.

-FTE also takes on responsibilities affecting students and faculty

Strengths:

Weaknesses:


•No substantial weaknesses on this criteria.

•The very high number of credit hours per instructional FTE is a big strength of this program.

•The cultivation of collaborations with Mountain Campus programs is a strength.

•The work providing the necessary remedial mathematical courses for students is a strength.

Strengths:

Weaknesses:


•Enrollment has declined precipitously but SCH and graduation has remained level

•Efficient use of staff

•Targeted matriculation efforts in psychology, communications and social work

Strengths:

Weaknesses:

6. OPPORTUNITY


Program doesn’t describe contributions to strategic vision

-Program identifies statewide need for high quality and affordable pathway to transferable core credits

-Program identifies specific restructuring opportunity for enhanced student performance

-Addressed impacts of additional resources as a way of achieving students’ objectives and goals.

Strengths:

Weaknesses:


•The response does not articulate how this program could contribute to the Strategic Opportunities in

the UM Strategic Vision.

•The argument for additional resources is weak.

•The goal of increasing the ratio of T/TT faculty to non-tenurable faculty is a worthy goal.Strengths:

Weaknesses:


•Does not really address the “Strategic Vision” document

•Does not address online possibilities

•Possible expansion of collaborations and interdisciplinary pathwaysStrengths:

Weaknesses:

Page 32 of 14511/13/2017

17Acad AP161 161 Accounting Technology-2Y 2Y

Priority for Development and Growth


1. ALIGNMENT


-No major weaknesses in this category.

-The report presents evidence that the program is strongly aligned with each of the four values in the

UM2020 plan.

-This program provides a way for non-traditional students to ultimately pursue a Bachelor's in

business. The report documents the value of this path via stats based on graduate surveys (30% of their

students move on to SoBA).

-The report provides specific evidence that graduates of this program are in demand

Strengths:

Weaknesses:


n/a

This program is well-aligned with UM's commitment to two-year programs, and workforce

development. Further, the author makes a good case that the program supports the 2020 Strategic Plan.

The program also provides a way for students to gain academic confidence and skills before

transferring to finish a four-year degree.

Strengths:

Weaknesses:



3 8 1.6 9 1.35 9 1.8 9 1.8 9 0.9 9 1.35 8.8Reviewer:

1 8 1.6 6 0.9 5 1 7 1.4 7 0.7 7 1.05 6.65Reviewer:

2 9 1.8 6 0.9 5 1 3 0.6 3 0.3 8 1.2 5.8Reviewer:

Ranking Category:




Total Count: 13

Page 33 of 14511/13/2017




N/A

•Many classes (4 specifically listed) address business leadership

•Dual enrollment occurs in these classes for engagement

•Students perform 90-hour internships with local employers

•Community members perform guest lectures in various classes

•Specific classes use smaller sections so that group discussion and preparedness is facilitated

•In the last external review it was stated that this was the only 2-year business degree in the state with

3 credits dedicated to sustainability

•6 credits dedicated to multicultural and intergenerational work places; gender, harassment, empathy

and work place resolution

•Dual enrollment would be impacted by reductions

•First program to register with the state as a formal apprenticeship program in finance with Perkins

funding grated to scale up capacity

•Accounting technicians are identified as undersupplied in MT

•MOU with SoBA to allow for an easier transition into BS degrees

•75% of the last two graduating classes were either high honors grads or first gen college grads and

indicate small classes allowed them to succeed

•Sponsored apprenticeship positions award students with pay increases as new skills are acquired

Strengths:

Weaknesses:

2. Demand


-The report argues that the students in the program could not survive in a typical "big classroom," but

it does not discuss the impact of more incremental changes.

-This program is well-integrated with other Business Tech classes and with the School of Business

-The Program Director teaches a Gen Ed class

Strengths:

Weaknesses:


It is clear that the program does meet some internal demand but it is not clear how compelling or

broad that demand is from this report. The author makes the excellent case that this program supplies

skills for students to earn a living wage, and that there is demand for these students BUT this is a

section on INTERNAL demand.

This program supports other business programs at Missoula College through accounting courses, and

creates some internal demand that supports students moving to SoBA. The author mentions that one

course supports the Climate Change Studies minor, but this is not a particularly significant impact

given the limited number of students.

Strengths:

Weaknesses:

Page 34 of 14511/13/2017




•Department and program offerings are content specific and few gen eds are taught

•3.9% increase from 2014-2017 in service courses to other programs

•MOU with BoBA

•Sustainable Business is taught by program director – gen ed and service class that would impact the

Climate Change Studies minor

•Moodle class shells are shared with Bitterroot College and dual enrollment teachers

•7 members from UM and the Missoula community to help with student professional and career

development

•Accounting core courses are required for five other Business Tech Department programs

•30% of students in this program indicate they plan to move to main campus to pursue a BS through

the MOU

•A cut would cause a decrease in regional economic growth, where a gap already exists

•Yields immediate living wage jobs for MT population that would decrease with cuts

Strengths:

Weaknesses:

3. Productivity


-Numbers indicating the number of students in the program indicate a downward trend. The report

argues, however, that the five year trends are not representative of overall demand.

-The report provides strong evidence of research, service, and instructional productivityStrengths:

Weaknesses:


This section of the report could be more clear, with stronger (and more clear) indicators of the

productivity of the program overall. For example, how many students are doing what post-graduation.

The report, as a whole, suffers from vagueness when compared to others.

The internship component of the program received a high rating from stakeholders -- this is a positive

but no info on how many responded. It would seem that the Program Director has been productive,

teaching ten credits per year and managing the program while also contributing in the area of

scholarship as well.

Strengths:

Weaknesses:

Page 35 of 14511/13/2017




•A net loss of 20 students across the time frame

•Author mentions a request to change data that was sent to APASP email for trend of 5-Y majors, but

does not provide correct numbers

•Small number of graduates, but the trend slope shows no change across the timeframe in those

graduating, despite an absolute of students majoring in the program

•FTE has decreased, but is still 19:1 with an average of 23.5:1

•Labor force need, so enrollment is often not impacted by UM enrollment or economy

•Applications to the program were up 221% last year

•Program Director teaches 15 credit hours per semester, so there is less research time for this faculty.

However, before the time frame for APASP a book was authored, they helped initiate MC’s first

international faculty exchange, wrote articles and presented at industry conference

•IPRs indicate about normal service based on unit standards with merit in 2014 for outstanding

service; established state’s first Registered Apprenticeship, UM Bookstore board President, Treasurer

MC Faculty Association, finds sponsors for graduate recognition dinner, service on MC metrics ad hoc

committee and service on thesis committees

•Coordinates 90-hour student internship experiences

•Reviews from internship sites indicate an average of 4.85 out of 5 for satisfaction with student interns

•First Accounting Tech Registered Apprenticeship in the state in the Finance category

Strengths:

Weaknesses:

4. QUALITY


-The time to degree numbers are a little high, but have improved.

-The employment rate for graduates is high

-The report presents strong evidence of faculty quality

-The program has adapted its advising strategy to address weaknesses

Strengths:

Weaknesses:


The author provides estimates and opinions -- this is not sufficient to establish the quality of the

program. It looks as if a previous reviewer informed the program about the need to establish some

external indicators of success but this has apparently not been done. Survey data about internship does

not indicate how many responded.

The approach utilized in advising reflect a commitment to students.Strengths:

Weaknesses:


•Students at MC often stay longer to finish gen eds before transferring to main campus, thus

increasing time to graduation

•Many of the assessment tools are embedded in classroom activities

•Average time to degree is 2.8 years. The first year in the time frame was 5.5 years and has decreased

significantly since that time

•The Program Director does all of the advising for these students in order to place students into one of

three appropriate advising tracks to decrease time to graduation

•100% of graduates that want to work in the regional area are hired at a living wage ($15-17/hour)

•30% go on to the BSBA program at UM

•4.85/5.0 satisfaction rating (over four years) for intern students

•Program Director has earned merit 4 times in 25 years

Strengths:

Weaknesses:

Page 36 of 14511/13/2017



5. EFFICIENCY


-The program seems likely to deteriorate without additional resources for faculty

-The program has taken steps to share administration resources with other programs

-The program has consolidated coursework to cut costs

-The report credits a highly skilled, specialized admin with handling a burdensome and increasing

number of responsibilities

Strengths:

Weaknesses:


It is very clear that the program is not happy with their current resources but what is not clear is

whether the bare-boned program has impacted students. In other words, has the (forced) need for

efficiency reduced the quality of instruction/advising/student success? Has the program sought

outside resources to assist? No data to tell us this.

This program is stretched in terms of resources, and the author's frustration is apparent and

understood. In spite of that, it would appear the student numbers are not impacted, although the data

is not clear about this; the author mentions they consistently have 70 - 80 majors but the centralized

data did not separate this out.

Strengths:

Weaknesses:


•No description of program data was provided for SCH per instruction or TT

•Only one TT and one adjunct teach in this program. In 2015 a TT line was lost.

•Faculty teach 8-10 classes per year while engaging in service

•Faculty are only paid once per year for supervising internship, though they supervise all year

•Courses have been consolidated and multiple sections have been combined

•Faculty have worked to increase dual enrollment numbers and students can enter school with 8

credits towards the program completed

•One FTE supports 9 programs across two departments. There are 10 TT and 9 adjuncts who rely on

this one FTE individual

•Admin coordinates scheduling, communications, committee meetings, staff meetings, travel, accounts

payable, IPRs, accounting, copying, mail, etc. There is an intermittent work study who may help with

duties. This can be helpful if it is a long-term hire

•An analysis of centralizing services has happened. Some services were modified or moved.

Strengths:

Weaknesses:

6. OPPORTUNITY


-The special characteristics of this program (the small classes, etc), do not seem to be particularly

translatable into an online program.

-The report provides strong evidence that the program is closely aligned with UM's strategic plan,

particularly the path to four-year programs

-The report argues that the program could be scaled up

Strengths:

Weaknesses:

Page 37 of 14511/13/2017




This is a program that could serve students and businesses well if properly funded, and it seems like a

program that could enhance UM's reputation as well. Two things -- the program is tied to a single

person, and this can be problematic; additional resources could address this concern. The program is

currently so underfunded that I worry about Quality, especially because we did not really see any

solid indicators of student success that were not primarily anecdotal.

This is a strong section with clear indicators. This program clearly aligns well with the Strategic Vision,

and there are many ways this program services both students and workforce development. The value

of the apprenticeship program is most clearly articulated in this section.

Strengths:

Weaknesses:


•Online technology and delivery could be enhanced (which was noted by the author and steps are

being made to do this in the first year of coursework)

•Many second year courses require face-to-face course work for skill-building

•Students are trained to work locally or regionally

•All individual advising is done within this program

•PD does all internship supervision

•Workforce development is fostered

•An MOU exists with the SoBA on the main campus

•Partnering with rural CPA firms that need trained professionals

•Certificate in Applied science (no additional resources required) was created and an intent to propose

was submitted to ASCRC in May 2017

•Enrollment could be significantly increased by expanding online offerings

•Applications were up 221% this past year. Increased recruiting could help enrollment and meet

employer demands and gap in employment

Strengths:

Weaknesses:

Page 38 of 14511/13/2017

17Acad AP162 162 Administrative Management-2Y 2Y



1. ALIGNMENT


- aligned with some but not all aspects of UM2020

- engage potential students through dual enrollment and transition to college programs

- courses interconnect with 19 certificates and degree programs

- Admin positions open in Missoula and state

Strengths:

Weaknesses:


•Data includes the entire Business Technology Department rather than just this program.

•Works with high schools through dual credit programs

•First year of the program can be taken online. Sixty-seven percent of all courses are online

•Courses are a part of other Business Technology programs and other Missoula College programs.

•Most students complete internships

•Many of the jobs the program prepares students for are in demand.

Strengths:

Weaknesses:


Overall weakness, the report writing and style made it difficult to score. It changes voices and

perspectives between sections. It is difficult to tell what is in support of the specific program or all six

programs AAS degrees.

Specific to alignment, does not strongly support sustainability. The explanation of market demand for

graduates was confusing.

Strong alignment with serving Diverse students and in engaging students. Great information on

student internships and their successful completion.

Strengths:

Weaknesses:

2. Demand


- Departmental data shows most SCH going to majors within program

- external and internal collaborations specifically for internship portion of program

- Oversees dual enrollment courses

Strengths:

Weaknesses:



1 5 1 5 0.75 5 1 6 1.2 5 0.5 5 0.75 5.2Reviewer:

2 6 1.2 5 0.75 5 1 5 1 7 0.7 7 1.05 5.7Reviewer:

3 5 1 4 0.6 5 1 4 0.8 4 0.4 5 0.75 4.55Reviewer:

Ranking Category:




Total Count: 16

Page 39 of 14511/13/2017




•Reduction would affect courses in multiple other programs as many courses are shared among

programs.

•Strong collaboration with employers and Career Services

•High school collaboration through dual credit programs

Strengths:

Weaknesses:


Stating that all programs are interrelated does not help in the reviewers understanding what are

dedicated classes to this program versus the others. I wonder how many classes required by this

program are offered in the Mountain campus's business school. (or similar classes.)

Make an argument for the reliance of all programs on any one program. This is an argument for

internal demand within the business technology programs.

Strengths:

Weaknesses:

3. Productivity


- total number of majors and degrees awarded in lower quartile (Q2)

- Trend of number of majors and degrees awarded relatively steady, in quintile 4 and 5 respectively

- Multiple UM/Missoula College committees served by facutly

Strengths:

Weaknesses:


•This program’s data is not isolated from the entire department.

•Measures include merit awards and promotions, as well as committee work and recruiting work.

•Student performance on internships measured through supervisor feedback.

•Students also take the Microsoft Word Specialist National Certification, reaching a 100% passage rate

in 2016/17.

Strengths:

Weaknesses:


It is difficult to separate the number of graduates with the Associates and the Social Media programs

from the total. The number of graduates seems low.

Faculty and instructors have higher teaching loads. The time to degree makes sense with the need for

development course offerings.

Strengths:

Weaknesses:

4. QUALITY


- 5YA of time to degree in lowested quintile (3.1 years in a 2 year program) but circumstances behind

numbers described

-2013 program review had 48 interns scored at good to outstanding (average 4.7/5) from external

supervisors

- Report author 2 UM merit awards

Strengths:

Weaknesses:


•No outside accreditation

•Positive outcomes noted by inside and outside program reviewers.

•Social media certificate for faculty member along with two merit awards and promotion to associate

professor.

Strengths:

Weaknesses:

Page 40 of 14511/13/2017




Outcomes for all students are not clear. Survey data provided, but the response rate is not disclosed.

The development of internships for students and the faculty outreach to promote the programs.Strengths:

Weaknesses:

5. EFFICIENCY


- reliant on adjunct faculty (self reported that creates instability and has ripple effect through the whole

program)

- Raised caps for course and allowed all overrides to accommodate students

- Courses taught outside workload (for free) for students

- Admin oversees 2 departments (more efficient but overburdened with responsibilities)

Strengths:

Weaknesses:


•This program’s data is not isolated from the entire department.

•Heavily dependent on adjuncts

•Administrator appears overworked

•For efficiency, nine program courses are taught only once a year.

•Use of Google Hangouts to facilitate distance learning

•Moved popular classes to larger classrooms and removed enrollment caps

•One administrative FTE shared between two departments and nine programs

Strengths:

Weaknesses:


I wonder about courses that could be shared between the River and Mountain campuses and if there

are efficiencies to be gained. The Media Design,Communications, Journalism, and Marketing programs

on the Mountain campus may have courses that could overlap with offerings on the River campus.

This is not addressed.

Successfully navigating cuts and difficulties in finding instructors.Strengths:

Weaknesses:

6. OPPORTUNITY


None to report

- Continue to engage potential students through Dual Enrollment

- Meeting state and local needs, with admin management jobs numerous and staying open for longer

periods

Strengths:

Weaknesses:


•No restructuring ideas that appear workable.

•Well aligned with strategic vision based on multiple concrete examples

•Program prepares students for real world jobs that are in demand

•Additional resources: Develop courses to focus on soft skills like professionalism and emotional

intelligence

•Additional resources: Promote dual credit courses and develop fully-online certificates.

•Additional resources: Develop administrative management curriculum

Strengths:

Weaknesses:

Page 41 of 14511/13/2017




The facts used to support demand for graduates are unclear if the demand is for associate graduates in

those positions.

Aligns with opportunities to meet students where they are in their preparation for further education.

Also, partners with place in the development of internship opportunities. Responded to cuts by

combining Biz Tech and ACET functions within one admin assistant position. Good suggestions to

help develop students' soft skills if allowed more investment.

Strengths:

Weaknesses:

Page 42 of 14511/13/2017

17Acad AP163 163 Business Media Design-Cert Cert

Insufficient Evidence



1. ALIGNMENT


1. Offers inadequate examples of leadership and diversity

1. Engages with high school students through dual enrollment

2. Offers 24/33 courses online

3. Predicted to have 107 DE students by spring 2018

4. 64% of courses fill gen ed requirements

Strengths:

Weaknesses:


NA

•Well-aligned ot UM 2020.

•Is a certificate that easily translates to transfer into other programs.

•Excellent record of dual enrollment.

Strengths:

Weaknesses:


•Data for this program is not separated from the entire department

•The response to Criteria 1-bullet 3 does not seem to match the question

•Engages high school students through dual enrollment classes

•74% of the certificate’s credits are offered online

•Several of the certificate’s classes are required in other programs

Strengths:

Weaknesses:

2. Demand


1. N/A

1. Many of the courses are in other programs- reducing funding for these would impact more than one

program

2. Dual enrollment courses for this degree apply to 29 concentrations

Strengths:

Weaknesses:


NA

•They produce a lot of General Education credit through online offerings at Missoula College,

traditional courses, and Dual Enrollment.

•They provide a direct pathway for transfer to programs on the mountain campus.

Strengths:

Weaknesses:



1 5 1 8 1.2 5 1 6 1.2 7 0.7 5 0.75 5.85Reviewer:

2 7 1.4 7 1.05 4 0.8 6 1.2 4 0.4 6 0.9 5.75Reviewer:

3 6 1.2 7 1.05 5 1 4 0.8 6 0.6 7 1.05 5.7Reviewer:

Page 43 of 14511/13/2017




•Data for this program is not separated from the entire department

•Reduced funding would hurt multiple Missoula College programs because the course work is “highly

interconnected.”

•Reduced funding would threaten transferability because 21 of 33 credits meet General Education

requirements.

•The program shares content with high schools through dual enrollment

•Faculty collaborate with high school faculty

•Faculty learning AdobeMax software

Strengths:

Weaknesses:

3. Productivity


1. Lack of achievement compared to other programs, but it is hard for a new program to get as much

done in a short amount of time

1. Participation in green thread

2. Variety of funding awards

2. Service on university committees

3. Got coupons for students to Loose Caboose and Hoagieville

Strengths:

Weaknesses:


•Who the faculty are and how they measure productivity does not go beyond the unit standards.

•This is a new program so there are no numbers yet.

•The instruction is responsive to innovative methods in the field.Strengths:

Weaknesses:


•This is a new program with essentially no data

•Additional graduate course work and awards cited for faculty

•Faculty serve on college and university committees and participate in service related to recruiting and

promotion.

•Merit awards and promotion to associate professor cited for instructional component

Strengths:

Weaknesses:

4. QUALITY


N/A

1. Innovative social media management courses

2. Access to internships for students

3. Chair was promoted to associate professor

4. Made marketing materials for the program

Strengths:

Weaknesses:


NA

•The sole faculty member has a strong record of achievement.Strengths:

Weaknesses:

Page 44 of 14511/13/2017




•No outside accreditation

•Evidence is limited, but the program is new

•Internal and external program reviews quoted are positive and include some suggestions for

improvement in marketing and assessment.

•Bullet 2 shows faculty response to improving marketing through radio spots and other marketing

materials

Strengths:

Weaknesses:

5. EFFICIENCY


N/A

1. At bare minimum for number of sections and how often some courses are offered- have cut as much

as possible already

2. Schedules high demand courses in larger classrooms

3. Researches course substitutions for students

4. Shares 1 FTE with 2 departments

5 1 administrative assistant works at full capacity with occasional work study help

Strengths:

Weaknesses:


•Faculty and adjuncts are not sustainable in numbers and that has an adverse effect on advising,

retention, graduation.

•Flexible innovative and collegial in regards to scheduling, advising, and coordinating dual

enrollment.

Strengths:

Weaknesses:


•The program relies heavily on adjuncts

•Class sizes up because of reduced faculty

•Multiple sections of course have been combined

•Some courses have been reduced to once per year.

•High demand classes are now scheduled for larger classrooms

•The program has removed or raised some course caps

•Duel enrollment and Media Arts courses on the mountain campus have also helped increase

efficiency.

•Administrator: one FTE- works with two departments and nine programs

•Some centralization of services

Strengths:

Weaknesses:

6. OPPORTUNITY


1. Does not provide enough examples of how the program could change or cut back

1. Enables employment in middle-skills jobs, a large portion of the workforce

2. Could develop a partnership with media arts

3. Allow audits for employers to send their employees to for job training

Strengths:

Weaknesses:


•The program will have to be resourceful and nimble enough to change and reinvent itself every few

years as technology and best practices evolve. That will require significant resources or innovation.

•This program aligns perfectly with the Strategic Vision and is in tune with 21st century skills.Strengths:

Weaknesses:

Page 45 of 14511/13/2017




•No restructuring ideas that the author finds workable.

•The program shows strong alignment with the strategic plan and supplies examples to back it up.

•Program trains students for available jobs that are in demand.

•The program has strong integration with high schools and supplies a path to college.

•Add curriculum focusing on professionalism, business culture and emotional intelligence.

•Partner with Media Arts to increase transfers

•Promote online course more heavily

•Explore employer-subsidized training

Strengths:

Weaknesses:

Page 46 of 14511/13/2017

17Acad AP164 164 Customer Relations-Cert Cert



1. ALIGNMENT


None noted.

Offers dual enrollment to high school students; this is a first year certificate program offered entirely

online; several courses in this program are required for the five MC programs in Business Technology;

appears that there is a projected 17% growth rate for customer service representatives through 2025.

Local demand for customer service representatives is high.

Strengths:

Weaknesses:


1) Ties to 2020 plan would be even stronger if its claims were quantified numerically

2) program does not address how it meets the cultural or social needs of the 21st century.

1) demonstrates significant ties to the strategic plan (2020) in the areas of engagement, sustainability,

leadership, and diversity as demonstrated by: dual enrollment efforts, online course offerings, course

sharing within the MUS, and curricular foci.

2) adequately justifies its essentiality by listing the number of programs that depend on Customer

Relations courses (a total of 15 other certificates and associates degrees) and dual enrollment offerings

(approximately 110 per year).

3) conveys an excellent connection to addressing workforce needs, by explaining the unmet demand

for customer service representatives, their average salaries/benefits, advancement opportunities, and

pay-off timeline for the degree (all quantified).

Strengths:

Weaknesses:


B1-Sustainability-Misses the mark with this response. Focused on sustainability of program as

opposed to environmental focus. I must admit though the 2020 wording is a bit unclear.

B1-Engage-Active dual enrollment program that facilitates high school student transition to Missoula

College/UM. Leadership&Development-Models professional workplace etiquette and theory.

B2-Many programs in Business Technology and Missoula College requires courses from Customer

Service program. Also would negatively impact Dual enrollment.

B3-Compelling data and research of demand provided.

Strengths:

Weaknesses:

2. Demand



3 8 1.6 6 0.9 5 1 6 1.2 8 0.8 9 1.35 6.85Reviewer:

2 7 1.4 5 0.75 5 1 3 0.6 8 0.8 3 0.45 5Reviewer:

1 7 1.4 7 1.05 5 1 6 1.2 8 0.8 8 1.2 6.65Reviewer:

Ranking Category:




Total Count: 15

Page 47 of 14511/13/2017




Author notes this program is interconnected with other programs--and notes that a reduction in

students would impact courses in Business Technology and Applied Arts, both of whom contribute to

this particular certificate. That said, the data provided merges program data with the Administrative

Management Program, so specific demand is not clear.

Program collaborates with internal and external partners--Hospitality Management and Medical

Information Technology to create apprenticeships on campus and with Allegiance Benefits (off

campus) respectively.

Courses offered through this program are interconnected with at least 18 other MC programs. Ranks

in 3rd quintile for SCH for GenEd courses.

Strengths:

Weaknesses:


1) ranks in the third quintile for SCH for Gen-Ed courses offered.

2) second lowest quintile for SCH of Gen-Ed courses per instructional FTE, and percentage of non-

majors to total. The program notes that it is possible that RevUp or other grants could be responsible

for teaching some of the Gen-Ed courses for the degree, which would account for the low ranking.

1) ranks in the third quintile for SCH for Gen-Ed courses offered.

2) strong connection to dual enrollment, hospitality management, and medical information technology,

though this exhausts their interdisciplinary efforts. These efforts include: sharing course content,

teaching materials, and online shells, creation of apprenticeships , and creating curricular connections.

3) notes ties to 18 programs across Missoula College, as well as dual enrollment and transfer work

(approximately 37% of the courses are Gen-Eds for transfer)– all of which would be effected if the

program were reduced.

Strengths:

Weaknesses:


DATA-Mid-range to lower end quintiles, but explains data pertains to six individual programs in

Business Technology department and not just Customer Relations Certificate.

B1-Existing collaborations. Shares student advising load of director among faculty. Demonstrates

shared programmatic resources with other programs.

B2-Highly interconnected with other Missoula College programs. Also negative impact on Dual

Enrollment.

Strengths:

Weaknesses:

3. Productivity


Unfortunately, the data do not allow for identification of work done by faculty who contribute to this

particular program, as data are provided at only the department level. The author does provide info

on her/his productivity, which meets the mission. Productivity of other faculty contributing to the

program not noted. The 5YA of student FTE and trend for this particular program ranks in the 2nd

quintile with a downward slope of .8, placing it in the lowest quintile.

The department appears to meet its mission and demonstrate adequate productivity. Data for degrees

awarded rank the program in quintile 4, with some downward slope.

Strengths:

Weaknesses:

Page 48 of 14511/13/2017




1) ranks in the second lowest quintile for student FTE/instructional FTE (at an average of 23.5) and in

the lowest quintile for the trend (at -0.8) though the program notes that these are departmental metrics

and cannot be determined exactly.

2) all of these areas that indicate productivity could be better tracked, quantified, and defended.

1) program ranks in the fourth (second highest) quintile for number of degrees awarded (at an average

of 10.8 per year) and in the third quintile for the trend over five years (-0.22)

2) program’s service outcomes include serving on university committees, attending university

functions, and rendering public service in the area of professional competences. Some of the

achievements in this area include: marketing program and partnership with local business for reward

coupons for students.

3) teaching effectiveness is demonstrated by two merit awards and a promotion to Associate Professor

Strengths:

Weaknesses:


DATA-Pertains to all Business Technology programs, but explains data for Customer Relations

program.

B2-Service/Outreach productivity measured by number of activities/committees and

student/community outreach. Not fully addressed.

B1-No research. Has earned some scholarly wards for program development and leadership.

B3-Measures through merit awards and promotions.

Strengths:

Weaknesses:

4. QUALITY


Data suggest that time to degree ranks in the lowest quintile, but it is noted that many students do not

decide to apply for the certificate until their second year of the AAS program, thereby skewing the data.

2016 Program Reviewer notes that teaching is excellent, students benefit from internships and real-

world projects, and offers an innovative social media management course; suggestions for

improvement are being acted upon (i.e., assessing student learning outcomes, enhancing marketing for

the program).

Strengths:

Weaknesses:


1) bottom quintile for time-to-degree, but provides several explanations to rectify this negative score,

such as: math requirement completed in year two for most students, need for remedial math/writing,

33% of students come from other programs or are earning second/third degrees, number of classes

offered each semester reduced, and one student took four years to graduate and skewed the average.

2) Limited evidence to suggest number of graduates with jobs, or placements/transfers to other schools

or UM.

3) No outcomes for faculty other than the author are listed, and provided examples are not

exceptionally robust or comprehensive.

1) used an external and internal program review to demonstrate its evidence of the quality of student

outcomes, some of which include: internships earned, portfolio projects, hands-on experiences,

workforce preparedness, hybrid online/in-person curriculum, graduate salaries/benefits.

2) notes awards granted to one of its faculty members, crafting marketing materials for the program,

conferences attended, and collaboration with pathways/dual-enrollment, and community partnerships

as evidence of faculty quality.

Strengths:

Weaknesses:

Page 49 of 14511/13/2017




DATA-Pertains to all Business Technology programs. Explains data for Customer Relations program.

Essentially mixed quintile scores.

B3-Not accredited.

B1-Provided internal and external reviews of student outcomes/impacts. Overall positive information

on student outcomes with job placement and preparation for entering workforce

B2-Merit awards and promotions used for faculty outcomes. Acted on internal and external

recommendations effectively with 33% increase in FY17 enrollment.

Strengths:

Weaknesses:

5. EFFICIENCY


None noted.

UG SCH per instructional FTE and T/TT FTE place the department in quintile 4. Program is one of 6

administered in Business Technology. Program has taken steps to improve efficiency.

Strengths:

Weaknesses:


None found.

1) ranks in the fourth quintile for SCH per instructional FTE (average of 704.7 per year, though this

number is steadily declining), and in the fourth quintile for SCH per T/TT faculty.

2) impact of cuts to the program include increased time to degree, lower retention rates, and fewer

completions. The program notes that it has lost a tenure track faculty, and has therefore been heavily

reliant on adjuncts.

3) moderate attempts to improve efficiency, such as offering courses once per year rather than once per

semester, other classroom adjustments, and researching course substitutions for students.

4) program’s one administrative assistant covers two departments and nine programs (and

approximately 10 TT faculty and 9 adjuncts) and the program has already explored centralizing

services, and notes that some were replaced/modified/moved.

Strengths:

Weaknesses:


DATA-Pertains to Business Technology in general.

B1-Impact has extended time to degree and retention. TT/T FTE has been reduced in recent Fiscal

Years. Adjuncts do well but are limited in advising and responsibilities outside of classroom. Resulted

in combining sections for increased class size, but lessens quality of student experience.

B2-Moved program courses from every semester to once per year. Schedules high demand courses in

larger classrooms (easier with new Missoula College labs).

B3-Shares 1.0 FTE administrative assistant with two departments (totaling 9 programs). Shared

Administrative assistant supports 10 TT/T and 9 adjuncts.

Strengths:

Weaknesses:

6. OPPORTUNITY


None noted.

The program is accessible and affordable, meets the MUS and economic goal training, and enables

employment into middle-skills jobs. Restructuring already in process to combine departments. Plan to

expand dual enrollment and widely recruit more applicants to the program

Strengths:

Weaknesses:

Page 50 of 14511/13/2017




1) the program mistakenly addresses the MUS strategic plan instead of the UM Strategic Vision, and

distinguishes its ties to access/affordability, workforce development, and efficiency/effectiveness.

2) does not address the question of contributions to interdisciplinary areas of inquiry, but instead

discusses the National Skills Coalition recommendation to develop a Skills Equity Policy

3) notes one opportunity for restructuring the program (combining Business Technology and Applied

Computing and Electronics Technology under one department) but then proceeds to list the reasons

why such a restructuring would be detrimental to the University of Montana.

1) demonstrates ties to only “Engage Students Where They Are” in the new strategic vision document,

as demonstrated by their dual-enrollment and online/hybrid delivery curriculum.

2) notes some opportunities for growth in the areas of soft-skills development, promoting dual

enrollment, and partnerships with potential intern/apprenticeship partners through online course

training.

Strengths:

Weaknesses:


B3-Restructuring opportunities are limited. Essentially has already maxed out restructuring

opportunities.

B1-Access/Affordability-"Engages students where they are" through Dual Enrollment, Pathways, and

online options. Workforce/Economic Development-Matches program with Department of Labor

statistics for growth and demand. Efficiency/Effectiveness-Instructionally efficient with General

Education and inter-program support.

B2-Fulfills need of "middle-skills" job needs in labor market. Contributes to "stack-able" credentials

where multiple qualifications are achieved in a single program. Serves rural areas in state through

100% online offerings.

B4-"Soft-Skills" curriculum as identified by industrial research reports are an opportunity for

investment. Could promote Dual Enrollment as natural pipeline for students to come to Missoula

College after high school. Possibility of providing customer relations professional development

courses for Missoula College and University of Montana personnel.

Strengths:

Weaknesses:

Page 51 of 14511/13/2017

17Acad AP165 165 Food Service Management-2Y 2Y



1. ALIGNMENT


Cant' comment

Chef Campbell has appealed for an extension, given his heavy workload in hiring for, outfitting, and

setting up 3 new dining areas and 4 completely new kitchens. Although this is not my call, his request

seems reasonable given the recent expansion of his program and move to new facilities.

Numbers provided are default scores, and not ones that I have assigned as reviewer.

Strengths:

Weaknesses:


The program has gone through a rough patch with the transition to the new facility, but now that its

feet are on firm ground, it appears that it will regain and develop its institutional superiority.

Strong alignment, providing students with exceptional vocational possibilities. This program produces

professionals who can provide leadership in the local food service industry, with an emphasis on

cultural diversity and sustainability.

Strengths:

Weaknesses:


Weaknesses:

•No information provided

Strengths:

•N/A

Strengths:

Weaknesses:

2. Demand


Can't comment

Can't commentStrengths:

Weaknesses:



1 1 0.2 1 0.15 1 0.2 1 0.2 1 0.15Reviewer:

2 7 1.4 6 0.9 5 1 6 1.2 6 0.6 7 1.05 6.15Reviewer:

3 1 0.2 1 0.15 1 0.2 1 0.2 1 0.15Reviewer:

Ranking Category:




Total Count: 17

Page 52 of 14511/13/2017




Certificate vocational programs are always subject to the vicissitudes of the unemployment rate. When

unemployment increases, demand goes up as people see the advantage in gaining the degree. When it

goes down, people can get employment without the degree. However, because the degree can give

people a leg up over on-the-job training, it will continue to draw students.

This has always been a popular program, and enrollment figures show a markedly decreased demand.Strengths:

Weaknesses:



•Data for Business Technology program and explanation doesn’t provide clarification

N/AStrengths:

Weaknesses:

3. Productivity


Can't comment


Weaknesses:


As noted, productivity had taken a hit in the last couple of years, but appears now to be on the right

track.

Not mentioned in the summary above are the efforts to focus on sustainability in food service

management.

Strengths:

Weaknesses:




•Any data on numbers of students waiting so to speak or is this anecdotal?

•Where is the data coming from on decline in the FSM and Culinary Arts, nothing identified.

N/AStrengths:

Weaknesses:

4. QUALITY


Can't comment

Students have won numerous awards for their culinary skillsStrengths:

Weaknesses:


The summary did not note whether the program offers training in local foods.

As seen by the numerous awards above, the program has offered a high quality training to its students.Strengths:

Weaknesses:




•Author responded to preferred bullets, but not overall

N/AStrengths:

Weaknesses:

Page 53 of 14511/13/2017



5. EFFICIENCY


Can't comment


Weaknesses:


Difficult to say given the cursory summary.

By holding fundraisers, the program is able to increase its efficiency.Strengths:

Weaknesses:




N/AStrengths:

Weaknesses:

6. OPPORTUNITY


Can't comment


Weaknesses:


I'm wondering if it's adequately staffed.

This program is properly situated to provide superior training to meet the needs of Montana

professionals in food service management. It has the facilities and the demand. I would like to see

more emphasis in its mission to train in local foods for cultural and sustainability reasons.

Strengths:

Weaknesses:




N/AStrengths:

Weaknesses:

Page 54 of 14511/13/2017

AP166 166 Hospitality Management-2Y 2Y




1. ALIGNMENT




Weaknesses:


Nothing to go on

Nothing to go onStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:

2. Demand


· Decrease in Non-majory SCH from 4,019 in 2013 to 2,451 in 2017.

· Increase in GenEd 5YA Average. Quintile 3.Strengths:

Weaknesses:


· 5YA of SCH for gen ed per instructional FTE: 2, with big dips for 2015 and 2016, but significant

recovery in 2017. • 5YA of SCH ratio of non-majors to total: 5.

· 5YA of SCH for Gen-Ed: 3Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:

3. Productivity


· Decrease in Number of Majors from 63 in 2013 to 38.0 with the lowest at 4.0 in 2015.


Weaknesses:



1 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:

2 1 0.2 5 0.75 7 1.4 7 1.4 5 0.5 1 0.15 4.4Reviewer:

3Reviewer:

Page 55 of 14511/13/2017




· No degrees awarded. ????

· Quintile 5 for number of majors. • Student FTE/instructional FTE ratio at quintile 4Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:

4. QUALITY


· No abstract provided. • Scored 0 on sophomore persistence rates.


Weaknesses:


· No data for time to degree or sophomore persistence. ?????

Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:

5. EFFICIENCY


· Despite decrease in Instructional Faculty FTE, personnel costs increased.

· Decreases in Instructional Faculty FTE in the past five years.Strengths:

Weaknesses:


· No grants or contracts. Data: contract faculty from 9.1 to 8.3 but general fund dollars 659,000 to

769,000. No other major sources of revenue.

· SCH per instructional FTE: 3 • UG SCH per T/TT Faculty FTE: 3Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:

6. OPPORTUNITY




Weaknesses:


· Nothing to go on.

Strengths:

Weaknesses:

Page 56 of 14511/13/2017




No review

No reviewStrengths:

Weaknesses:

Page 57 of 14511/13/2017

17Acad AP167 167 Medical Reception-Cert Cert



1. ALIGNMENT


The unit fails to respond to any of the questions within this criterion, and asks the reader to “review

Unit 169” as this certificate is a “subunit” of the AAS degrees. This should have been distinguished

when the list of units of analysis were published.

NONEStrengths:

Weaknesses:


•Did not submit anything – said to see Unit 169

•Did not submit anything – said to see Unit 169Strengths:

Weaknesses:


Failed to complete report


Weaknesses:

2. Demand


The unit fails to respond to any of the questions within this criterion.

1) second lowest quintile for Gen-Ed SCH per instructional FTE

2) second lowest quintile for ratio of non-majors to total

1) The DEPARTMENT scores in the middle quintile for SCH for Gen-Ed courses.

2)

Strengths:

Weaknesses:




Weaknesses:




Weaknesses:



1 1 0.2 2 0.3 1 0.2 1 0.2 2 0.2 1 0.15 1.25Reviewer:

2 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:

3 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:

Ranking Category:




Total Count: 13

Page 58 of 14511/13/2017



3. Productivity



1) falls in the second lowest criterion for number of majors.

2) program falls in the second lowest criterion degrees awarded (around 6.8 on average).

1) The program is in the second highest quintile in the five year average for student FTE to

instructional FTE.

Strengths:

Weaknesses:




Weaknesses:




Weaknesses:

4. QUALITY



1) The unit is in the second lowest quintile for time to degree.

NONEStrengths:

Weaknesses:




Weaknesses:




Weaknesses:

5. EFFICIENCY



1) does not produce any grant dollars or IDC.

1) top quintile for SCH per T/TT faculty FTE.

2) second highest quintile for SCH per instructional FTE.

Strengths:

Weaknesses:




Weaknesses:

Page 59 of 14511/13/2017






Weaknesses:

6. OPPORTUNITY



NONEStrengths:

Weaknesses:




Weaknesses:




Weaknesses:

Page 60 of 14511/13/2017

17Acad AP168 168 Management-2Y 2Y



1. ALIGNMENT


Program responses to address sustainability, leadership, and diversity are unsubstantial.

Program does not justify essentiality to UM in terms of achieving mission.

Program does not adequately respond to bullet 3.

Program demonstrates engagement through dual enrollment offerings.

Program demonstrates high workforce demand and impact on various programs if reduced.

Strengths:

Weaknesses:


Data presented in argument does not align with APASP data.

Program offers dual enrollment and transition to college coursework in partnership with K-12

educators. Students in either of these options (Entrepreneurship or Sales/Marketing) can earn almost

40% of their credits through dual enrollment. Options meet the mission and values outlined in UM

Strategic Plan. While data for these specific options unavailable, management courses (of which these

options are a part), "rank in quintile 5 for growth and demand." These options are highly

interconnected with other MC courses.

Strengths:

Weaknesses:


-No discussion of how faculty/program engages in UM2020 Strategic Plan on a broader level, although

evidence of ways in which program supports students/institution/community is clear

-STrong argument for engagement, capturing students/engaging them in the curriculum while still in

high school and aiding in transition to college

-Tuition-friendly, online course offerings support sustainability - reaching students locally, regionally,

nationally, internationally

-MUS course-sharing

-Supports student leadership development that filters directly into workforce

-High demand, quintile 5, with demand and growth

-Evidence of interconnectedness

Strengths:

Weaknesses:



3 7 1.4 7 1.05 4 0.8 4 0.8 4 0.4 7 1.05 5.5Reviewer:

2 7 1.4 6 0.9 5 1 4 0.8 7 0.7 5 0.75 5.55Reviewer:

1 3 0.6 3 0.45 3 0.6 2 0.4 5 0.5 4 0.6 3.15Reviewer:

Ranking Category:




Total Count: 15

Page 61 of 14511/13/2017



2. Demand


No program specific metrics provided, all departmental.

Program does not justify collaborations that enhance faculty performance.

Program lists Missoula College programs that would be negatively impacted but is not explicit about

how and to what extent this impact would occur.

Program has a generally insufficient response to all of criteria 2 but demonstrates interdependence.

Program demonstrate activities that address student needs through dual enrollment offerings and

shared course content with other programs.

Strengths:

Weaknesses:


5YA for SCH for GenEd total and per instructional FTE rank department in quintiles 3 and 2

respectively. Data for the two options specified for this review are not available in APASP.

By all accounts, program has high student demand, Program is highly interdisciplinary, and

accessible--50% can be completed online. An MOU has been established with Great Falls to allow

students there to enroll in Entrepreneurship classes.

Strengths:

Weaknesses:


NA -reduction in size or curtailment would negatively impact DE and enrollment in Missoula College

-Steady increase in department service to other programs from 2014-2017

-Gen ed department efficiencies demonstrated by increase in SCH from 2016-2017 - 32% increase

-Evidence of existing collaborations with DE faculty affiliates with whom they share course content,

teaching materials.

-Course sharing

-Evidence of local relationships that will feed students into program enrollment

-High demand, quintile 5

Strengths:

Weaknesses:

3. Productivity


Number of majors in quintile 5 with declining # of majors. 5YA degrees awarded/5 years in quintile 3

with significant decrease in 2017 from 2016.

Program put N/A for bullets 1-3 and stated that it could not provide measures or information.

Student-instructional FTE/5Y in quintile 4.Strengths:

Weaknesses:


Little data available to assess productivity, either through ASPAP or internal documentation of student

placement and success, apparently due to turnover of interim program director.

Number of majors for program ranks in the top quintile (quintile #5), with a downward slope. Degrees

awarded for program place it in quintile #3, while Instructional FTE rank program in quintile #4.

Program has suffered a bit due to turnover and interim chairs, but appears back on track.

Strengths:

Weaknesses:

Page 62 of 14511/13/2017




-Non-hire of program director and ensuing issues resulted in significant downward trend in majors in

2016-2017 - incomplete internships and failed communication efforts to students

-Management Interim Program Director no longer under contract, cannot provide measurement/data.

-Qunitile 5, significant number of majorsStrengths:

Weaknesses:

4. QUALITY


5YA time to degree in quintile 2

Program does not have any available evidence of quality of student outcomes.

Faculty list of accomplishment does not provide sufficient evidence of quality of outcomes.

Program is not accredited.

Program lists accomplishments of its interim director to demonstrate faculty outcomes.

Program explains resource and personnel constraints that led to ineffective tracking of student

outcomes

Strengths:

Weaknesses:


Unfortunately, little assessment data available for reasons already discussed. "[the] Management

[Program] has been in the state of disarray for some years," but with the appointment of a new interim

program director, appears to be on more solid footing. APASP data indicate that 5YA time to degree

places options in 2nd quintile.

Faculty have participated in outreach activities and now appear to be functioning at an adequate level

of quality.

Strengths:

Weaknesses:


-Increase in time to degree by limited course offerings

-Decreased course options for students, fill quickly

-Incomplete internships

-No assessment data available due to program's "state of disarray for some years" - short history

provided

-Some evidence of faculty outcomes despite little/no trackingStrengths:

Weaknesses:

5. EFFICIENCY

Page 63 of 14511/13/2017




Only department metrics are provided for criteria 5.

Impact of decreasing enrollment and lack of non-adjunct faculty to accommodate student needs, there

has been an increase in class sizes that is undesirable and inconsistent advising.

Hiring of new personnel projects a program upswing and more positive programmatic efficiency.

Program demonstrates efficiency through a significant increase in class sizes and increase in caps in

order to accommodate the most amount of students.

Program shares one FTE with 9 programs. Program states that this specific individual is highly

efficient due to knowledge and expertise in the fields.

Strengths:

Weaknesses:


None noted.

UG SCH place program in 4th quintile for both instructional and T/TT FTE. Steps have been taken to

improve efficiency such as raising course caps, and prompting dual enrollment with high schools and

establishing MOU with Great Falls.

Strengths:

Weaknesses:


-Hhard hit by reduced personnel cost in Program Direction.

-Major numbers decreased significantly, degree awards decreased significantly, and time to

completion increased.

-Rely heavily on adjuncts

-Increased class sizes

-Some evidence of centralizing, though specifics not provided

-The department has become more efficient with costs trending down in every category except

benefits, “Total Personnel Benefit Cost”.

-The Business Technology Department Chair schedules required courses and department faculty to

maximize efficiencies in program offerings, enrollment projections, course minimums, and college

demand. -

-One administrative assistant and limited work study while increasing workload due to recent

University administrative budget constraints and downsizing.

-Quality in new hires in spite of decrease in TT/T Faculty FTE

-Methods to improve efficiency are identified

-Some evidence of centralizing, though specifics not provided

Strengths:

Weaknesses:

6. OPPORTUNITY

Page 64 of 14511/13/2017




Program could provide additional evidence or suggestions to contribute to the strategic opportunities.

Program should provide greater evidence to support its statewide service and additional ideas for

contribution.

Program demonstrates engagement with students where they are through dual enrollment courses

providing greater accessibility and affordability and trains a needed workforce.

Programs demonstrate its service to statewide needs through training a needed workforce and

engaging with high schoolers.

Program states restructuring is not feasible within the department with adequate justification.

Program suggests the development of soft skills curriculum, greater dual enrollment expansion, and

promotion of certificate programs.

Strengths:

Weaknesses:


None noted.

Offering additional dual enrollment courses will ultimately make college more affordable, provide a

pipeline for students, and allow for education in place. Development of soft skills curriculum,

expanding online offerings, pursuing additional MOU opportunities and developing additional

certificate programs offers some opportunities to enhance UM.

Strengths:

Weaknesses:


-Analysis of restructuring determined further restructuring would not be beneficial to program, MC or

UM

-National Skills Coalition Skills Equity Policy

-Soft skills curriculum development

-DE promotion MOU opportunities

-Certificate programs

-Opportunities for investment to enhance program and contribute to UM are articulated and relatively

attainable goals/initiatives (given resources). Such initiatives would be sustainable and contribute to

UM positively.

Strengths:

Weaknesses:

Page 65 of 14511/13/2017

17Acad AP169 169 Medical Information Technology-2Y 2Y



1. ALIGNMENT


-Program does not successfully aligns itself with multiple Strategic Plan’s values

-Does not explain essentialness to UM nor how cuts would affect UM’s mission

-Does not show HOW program prepares students with needs of 21st century.

-Program offers how educational opportunities for students and other constituencies about specific

values

-Program aligns itself with multiple Strategic Plan’s value of engagement

Strengths:

Weaknesses:


Does not align well with the values in the 2020 Strategy for Leadership, Diversity, and Sustainability.

Achieve economic and social improvements for graduatesStrengths:

Weaknesses:


Description of links to sustainability and diversity not well thought out.

Clearly described alignment with the UM 2020 strategic plan. Specific emphasis on workforce

development. Increasing demand for students with this type of training.

Strengths:

Weaknesses:

2. Demand


NA

-Interdisciplinary activities at local and state level address student needs for real-world experience,

placement, and skill development

-Shows how reduction in size or curtailment would negatively impact skill/interest specific education

in other programs resulting in reduced performance

Strengths:

Weaknesses:


Given report, it is difficult to determine how much integration and shared courses are offered such that

it is difficult to determine true detrimental impact from curtailment.

Course sharing with other Associates degrees helps with demand.Strengths:

Weaknesses:



1 2 0.4 6 0.9 2 0.4 2 0.4 7 0.7 7 1.05 3.85Reviewer:

2 3 0.6 5 0.75 4 0.8 7 1.4 6 0.6 5 0.75 4.9Reviewer:

3 5 1 4 0.6 6 1.2 5 1 6 0.6 6 0.9 5.3Reviewer:

Ranking Category:




Total Count: 15

Page 66 of 14511/13/2017




Low SCH in gen ed courses and for non-majors.

Significant recent increase in SCH in gen ed courses. Collaborations in other health profession degree

programs at Missoula College and with College of Great Falls. Internships allow for further

collaboration with community. A reduction in this program would impact health profession in region

and several other programs on campus.

Strengths:

Weaknesses:

3. Productivity


-No research, scholarly and/or creative component

-Outreach component mentioned does not impact mission of program

-No additional instructional component

Outreach component measured through successful completion of internshipsStrengths:

Weaknesses:


The number of majors and graduates are trending downward. Perhaps the demand for this degree by

students is declining.

As described it is an efficient program, it appears that there is only one dedicated required course, but

that is not clearly stated.

Strengths:

Weaknesses:


Declining trend in majors and degrees awarded. No scholarly activities.

Strong numbers of majors annually (115) and good number of degrees awarded annually (~13). Good

values for student FTE per instructional FTE (23.5:1). Internships provide outreach opportunities with

students integrating with health profession community.

Strengths:

Weaknesses:

4. QUALITY


-Low evidence of quality student outcomes

-No innovative or frequent evidence of quality faculty outcomes

-No accreditation evidence given

Post-grad survey showed positive outcomes (i.e. job placement, quality of job)Strengths:

Weaknesses:


A survey of employer measures of quality based on internships and employees would have helped to

determine quality. It can also help improve the program.

Internships built into the program produces quality outcomes for the graduates.Strengths:

Weaknesses:


Time to degree relatively long for a two year program. Few specifics on faculty outcomes

Grad surveys show very positive outcomes for students. Nearly 70% went on for certification in their

field and 80-100% felt that the degree program influenced their employment and wage earnings. Good

quality instructors

Strengths:

Weaknesses:

5. EFFICIENCY

Page 67 of 14511/13/2017




NA

-Negative impacts from revenue or expenses changes leading to student graduation risk due to

autumn offering and unavailable access to course

-Program works closely with other academic programs in the state to create efficiency in shared

resources and universal program preparation

-One FTE lengthy experience allows her to perform efficiently and in high demand/use.

centralizing some services would be detrimental as a burden to the faculty

Strengths:

Weaknesses:


Although nine programs with one staff person is quite a few, it exists in other areas of the university.

Without more information, it is hard to understand how this is a problem. I read that six of the nine

degrees are intertwined to a high degree such that a cut to one is a cut to all, but then I read that nine

programs is an undue burden. For Bullet 6, you state faculty are being asked to teach without pay, can

you be more specific?

Course sharing with Great Falls is a good example of efficiency.Strengths:

Weaknesses:


No grant expenditures or IDC generated.

Strong numbers for SCH per instructional FTE and per tenure track FTE. A lack of rehiring of a key

position is directly impacting the quality of offerings for students in coding. Efforts being made to

improve efficiency and reduce redundancy via collaborative arrangements in College and with Great

Falls. Program relies on a part time work study student for administrative duties.

Strengths:

Weaknesses:

6. OPPORTUNITY


-Program fails to recognize what they “could contribute” to the strategic plan to strengthen and or

further it.

-No specific opportunity for restructuring for efficiency or enhanced performance

-Program describes pre-existing contributions to strategic vision

-Program identifies and amplifies UM position to be a leader in such an innovative model nationally

-Program identifies statewide interdisciplinary areas of inquiry for workforce preparation

-Addressed impacts of additional resources as a way of achieving or aiding UM’s objectives and goals.

Strengths:

Weaknesses:


Meet some of the areas for Strategic Opportunities, but do not address the majority. The report states

faculty are being forced to teach above load without compensation. I am assuming that is the need for

Independent Study of AHMS 216 offered to allow students to graduate. Why this happened is not

clear, could an adjunct not be found? Why is the faculty not being paid extra to load, is the class size

too small? I applaud the search for a solution, but the way the information is provided creates

concerns.

Good recommendations for areas to relocate the program or share courses with the Mountain campus.Strengths:

Weaknesses:

Page 68 of 14511/13/2017




Could elaborate more on how program fits with the strategic vision.

Partial alignment with Strategic Vision, focus on workforce development. A program with potential to

grow into the future. Allegiance partnership will be the first nationally approved apprenticeship in the

area of medical insurance claims in US. Strategic yet modest investments in the program would have

beneficial impacts.

Strengths:

Weaknesses:

Page 69 of 14511/13/2017

17Acad AP170 170 Paralegal Studies-2Y 2Y



1. ALIGNMENT


1. Mostly vague, salty, and unhelpful answers

1. Emphasizes one on one engagement

2. Steady employment opportunities for students

Strengths:

Weaknesses:


Focused on big-picture concepts, more specifics about how the unit itself aligns would have

strengthened the answer.

Only partially answered 1.2.

Good leadership-related information/alignment.

Good information regarding how important it is to have people who are trained in law.

Strengths:

Weaknesses:


* Most of the responses did not adequately address the questions asked for this criteria.

Bullet 1 (UM 2020 Strategic Plan Values):

* Report adequately addresses 2 out of the 4 Strategic Plan Values.

Bullet 2 (How essential program is to UM):

* Report uses ABA reporting on student and faculty performance to back up how essential it is to UM.

Bullet 3: (Importance of program):

* Report discusses how paralegals help to keep legal costs down for clients when they are used

efficiently.

Strengths:

Weaknesses:

2. Demand



3 3 0.6 4 0.6 1 0.2 3 0.6 7 0.7 3 0.45 3.15Reviewer:

2 4 0.8 3 0.45 1 0.2 5 1 4 0.4 4 0.6 3.45Reviewer:

1 1 0.2 3 0.45 1 0.2 2 0.4 3 0.3 2 0.3 1.85Reviewer:

Ranking Category:




Total Count: 17

Page 70 of 14511/13/2017




1. Overall, the information provided in this section was unhelpful

1. Contributes to Law School enrollmentStrengths:

Weaknesses:


More detail about enhancing faculty performance would have strengthened the answer.

Partnership with Great Falls Paralegal program.Strengths:

Weaknesses:


* Response could have used more hard data in bullet two.

Centralized data:

* All centralized data was only provided for the department in which the paralegal program is

housed.

Bullet 1 (Existing collaborations or interdisciplinary activities):

* From the report: “The Paralegal Studies Program has an articulation agreement with the University

of Great Falls Paralegal Studies Program.”

Bullet 2 (Impacts on other programs if program was reduced):

* Enrollment in general education courses by paralegal students would decrease.

* Enrollment in law school could decrease.

Strengths:

Weaknesses:

3. Productivity


1. Did not provide any information

1. N/AStrengths:

Weaknesses:


Wasn't sure how to score--no information provided for Criterion 3.

Negative trend for number of majors.

N/AStrengths:

Weaknesses:


No information given for research, service, or additional instruction data.

No supplied centralized data.Strengths:

Weaknesses:

4. QUALITY


1. While students may be very successful out of this program, no convincing evidence was produced

1. Accredited by the American Bar AssociationStrengths:

Weaknesses:

Page 71 of 14511/13/2017




Again, more details/new information would have been helpful.

Faculty both licensed lawyers--participate in annual continuing education.

Positive anecdotal information about graduates employment/outcomes.

Accredited by ABA in Spring 2014.

Strengths:

Weaknesses:


Report does not adequately address centralized data or bullets 1 and 2 of this criteria.

Centralized data:

None given as part of report.

Bullet 3 (Accreditation information):

American Bar Association accredited this program in Spring of 2014.

Strengths:

Weaknesses:

5. EFFICIENCY


1. The author speaks to some sort of change or modification in service but provides no evidence

1. The administrative assistant works very hard and takes on a lot of duties

2. Faculty has taken on administrative burden

Strengths:

Weaknesses:


5.2 seems somewhat non-responsive.

One Admin Assoc supporting 19 faculty and adjuncts is beyond efficient.Strengths:

Weaknesses:


This program is understaffed.

Centralized data:

Not applicable or not supplied to department.

Bullet 1 (Impact of changes in revenue or expenses):

An adjunct faculty member teaches 12-16 credits of this program per year while the only other faculty

member, also the program director, teaches the other credits (26-30) per year.

Bullet 2 (Efforts to increase efficiency):

Program is still running with very few human resources.

Bullet 3 (Administrative FTE information):

Program shares 1.0 FTE administrative assistant with 9 other programs.

Strengths:

Weaknesses:

6. OPPORTUNITY

Page 72 of 14511/13/2017




1. Read this entire report

1. Could work to help students join 4 year programs

2. Could strengthen recruiting efforts

3. Could pay faculty members more

Strengths:

Weaknesses:


Could have provided more information regarding alignment with the Strategic Vision document.

No information provided for 6.2.

Online course offerings, one-on-one student advising.

Potential for combined course in collaboration with the Law School and elective courses.

Strengths:

Weaknesses:


* Report doesn’t address the strategic vision but it does address MUS’ Goals 1-3.

* Report doesn’t address how program could contribute to making UM a leader in interdisciplinary

programs. This is likely to program and ABA requirements though.

Bullet 4 (Allocation of additional resources):

Program could offer more elective courses and increase salaries of faculty to be more on par with

faculty members on the Mountain Campus. Recruitment efforts could also be improved through

hiring someone to carry out such duties.

Strengths:

Weaknesses:

Page 73 of 14511/13/2017

17Acad AP171 171 Sales and Marketing-Cert Cert



1. ALIGNMENT


Don’t address any connections to the um mission or vision

economic need and viability for this program, interdisciplinary benefitsStrengths:

Weaknesses:


•Centralized data is limited because data provided is for the entire Business Technology Applied

Science faculty and degree but author attempted to provide information where possible in report.

•Remains unclear who the actually are who teach in the certificate (all Business tech or subset).

•Fails to address Diversity in program efforts.

•SM Certificate has clearly stated alignments and actions with 3 of 4 Strategic plan 2020 areas.

•This certificate program is embedded within the Management sub-area with an addition of 4 credits

required (30 AAS, 34 SM Cert.).

•13 of the 34 credits appeal to Dual enrollment and Transition to College High School students.

•Efforts made to offer 21 of 34 credits online (70%)as sustainability effort.

•Sales and marketing data for job and careers is seen as a growth area ranging from 6>3% to 16.3%

depending on job specific areas.

•Provided nice data on affordability of degree and payback.

Strengths:

Weaknesses:


•Certain claims made in this section with regard to the alignment with the UM 2020 strategic vision

seem to be left fairly ambiguous, and do not adequately describe any sort of actionable steps being

taken or planned to further this alignment

•Adequately illustrates the interconnectivity between this certificate program and other degree

programs currently in existence

Strengths:

Weaknesses:

2. Demand


don’t effectively communicate their importance and demand in the Missoula college

would widely impact Missoula college in that it is a high student demand area, program contributes

classes to 5 Missoula college areas of concentration,

Strengths:

Weaknesses:



2 4 0.8 5 0.75 1 0.2 3 0.6 4 0.4 5 0.75 3.5Reviewer:

1 2 0.4 3 0.45 3 0.6 2 0.4 4 0.4 6 0.9 3.15Reviewer:

3 5 1 7 1.05 3 0.6 4 0.8 5 0.5 8 1.2 5.15Reviewer:

Ranking Category:




Total Count: 15

Page 74 of 14511/13/2017




•Central data not specifically available for this UOA.

•Because all data are for entire Business Technology, only idea is that 30% of courses serve out of

major students overall, and central data for Bus Tech show 40%+.

•This certificate was developed to enhance employability and knowledge in Sales and Marketing

within Management majors.

•States that Management area is a high (Q5) enrollment area in Business Technology (not sure where

this comes from-data provided shows criteria 2 Q’s to be 3,2,3).

•SM Cert. has relationships outside MC with programs such as Hellgate Finance Academy.

•Faculty in Management teach 11 courses across Business Technology areas; certificate is within these.

Strengths:

Weaknesses:


•States certain actions taken that seem to have been planned with the intention of further driving

demand, but fails to follow-up on the results (or anticipated results) of said actions leaving some

unnecessary vagueness in this section

•Sufficiently demonstrates high level demand for the program, supporting these claims with

quantifiable data

•Draws a clear connection between proliferated success of and support for this certificate program,

and the continued growth of enrollment figures (citing Missoula College as an area of significant

impact)

Strengths:

Weaknesses:

3. Productivity


doesn’t relate anything to their mission, or the university mission statement

provides little to no information,Strengths:

Weaknesses:


•As certificate program no central data on certificates provided in first part of worksheet.

•In 3.5 there is a low number of degrees awarded with highest number in 5 years being 6 lowest 1,

(Q1).

•No productivity data provided for faculty (unclear why others who teach courses in the area weren’t

discussed).

•There has been a Director (until 2015), and Interim Director (until 2017) but not evident in discussion

that any specific courses or faculty are otherwise dedicated to this certificate.

•Attributes declines and quintile of trend to popular appeal of retired Director and failures of Interim

Director.

•SCH/TT for quintile department level are quintile 4.Strengths:

Weaknesses:


•Cites ineffective program direction as the reason behind what is noted as a significant drop in degrees

awarded in 2017, but fails to expound upon more specific, rectifiable difficulties where this is

concerned, or ways in which this recognized weakness is being addressed moving forward

None observed - inadequate information providedStrengths:

Weaknesses:

4. QUALITY

Page 75 of 14511/13/2017




program shave been in state of disarray, in need of curriculum update,

provides no evidenced promoting the quality of their programStrengths:

Weaknesses:


•Time to degree metric influenced by outlier in 2013 and not possible to interpret.

•Program has been in disarray since sudden retirement of Director and thus no assessment being done

although it was initiated.

•No advisory committee or curriculum updates.

•Some evidence students go on the UM BA in business and succeed (UM Business Plan Competition).

•Efforts were made to recruit students though outreach to local schools, radio spots, and phoning of

potential students at MC.

Strengths:

Weaknesses:


•Information presented in this section seems to be heavily focused on lamenting difficulties incurred

as a result of personnel issues with individuals involved with the program over the last several years,

and how this has negatively impacted the ability to deliver programmatic quality, as opposed to

presenting ways in which potential or planned changes could help to address such issues

•Interim Program Director seems to demonstrate an interest in marketing the program through a

variety of means

Strengths:

Weaknesses:

5. EFFICIENCY


student to faculty ratio may be an issue with raised class caps

making active efforts to be more efficient by increasing class sizes and offering a stricter and more

regimented schedule of courses

Strengths:

Weaknesses:


•No data on student metrics- all department level data.

•IDC etc. not relevant and Q1.

•Efficiencies in course offerings (merging of duplicate courses, offering courses once a year).

•Staffing cut and now 1 FTE serves 10 Department level faculty.

Strengths:

Weaknesses:


•In large part, the information presented in this section seems heavily weighted toward the negative

observations of the report author regarding changes that have occurred over the last several years,

which are supported by generalities in most cases – this as opposed to focusing upon how the program

could/should maximize efficiencies

•There is one bullet point at the end of the third portion of this criteria section in which the reporting

author references an analysis centralizing services: “An analysis of centralizing services has taken

place. Some services were modified or moved.” Failure to expound upon this seems like an

unfortunate missed opportunity

•Demonstrates the ability to utilize minimal administrative staff support FTE as efficiently as possible,

maximizing the return on investment in this individual and capitalizing upon this person’s capabilities

to the fullest extent

Strengths:

Weaknesses:

Page 76 of 14511/13/2017



6. OPPORTUNITY


program is already struggling and has been on the decline for a few years

Making distinct efforts to “engage students where they are” lots of opportunity for online classes and

offerings, program meets a economic need so there may be room for growth as the need and market

grows, could merge with Electronics Technology into Business technology as the program was once

structured lessening the need for certain administration positions

Strengths:

Weaknesses:


•There appears to be a strong need for this certificate to have assigned faculty director to promote,

support and advise this program for students

•Strategic Vision evident in Management area where certificate supports specific expertise in Sales and

Marketing.

•Online, Dual Enrollment, and Transition to college opportunities are all working to reach students

where they are.

•National data support employment opportunities for mid level, 2-year degree training in business as

well as employee education for those already employed.

•Efficiencies have resulted in adjuncts with excellent skills and experience.

•Other opportunities exist that might allow greater recruiting and outreach for students and working

more closely with industry.

•Some feedback from industry was obtained at department level external review.

Strengths:

Weaknesses:


None observed

•Provides tremendously detailed examples of ways in which the program could be expanded if

provided the necessary resources, using specific examples that seem pragmatic and exciting for the

potential future of the program at the same time

•Seems to realistically envision a path by which this certificate program fits within the scope of a more

ambitious vision in which Missoula College is leveraged as a premier provider of both training and

long-term support for the regional business community

Strengths:

Weaknesses:

Page 77 of 14511/13/2017

17Acad AP172 172 Computed Tomography-Cert Cert




1. ALIGNMENT


None seen

- Directly responding to workforce need in Montana (rural)

- CT program only one in the state

- Fairly aligned with UM2020

Strengths:

Weaknesses:


•Limited description, how many students do the CT program, no data reported and statement

indicates incorrect data, but no explanation or details

•What is the contribution to state workforce development, how many are employed ie: into the

community and state following completion of the two courses

•Only program available in MTStrengths:

Weaknesses:


"Meeting workforce demand" isn't really the same thing as sustainability.

This is the only "Computed Tomography" program in the state.Strengths:

Weaknesses:

2. Demand


- Exploring external collabs but nothing concrete

- CT certificate vital part of radiological tech programStrengths:

Weaknesses:


•What is a “large majority”? 5 people of 10 or 25 of 30?

•Collaboration efforts are being considered but no details describe that currently address student

needs or enhance faculty performance

•Option of a clinical rotation elementStrengths:

Weaknesses:


Given the program's mission and objectives, there aren't any major weaknesses in this area.

This seems to be an "add-on" certificate to the Radiologic Technologist program, and adds to those

students qualifications in a positive way.

Strengths:

Weaknesses:



2 5 1 4 0.6 3 0.6 5 1 4 0.4 4 0.6 4.2Reviewer:

1 7 1.4 5 0.75 3 0.6 6 1.2 5 0.5 5 0.75 5.2Reviewer:

3 5 1 7 1.05 2 0.4 3 0.6 5 0.5 3 0.45 4Reviewer:

Page 78 of 14511/13/2017



3. Productivity


- N/A in all response boxes and new program so no data

- Self reported increase in students in one semester certificate from 2016 (8 students) to 2017 (10

students) which would be quintile 1 for certificates

Strengths:

Weaknesses:


•No information shared

N/AStrengths:

Weaknesses:


The report didn't really say anything about the program's productivity. All three bullet points were

listed as "N/A", with no research, outreach, or instructional components. If they aren't doing ANY of

those three things, what are they doing?

The program seems to be growing (though we only have two years' worth of data).Strengths:

Weaknesses:

4. QUALITY


- New as of 2016 so no students have completed national boards for student outcomes

- Self reported all participants in the 1 semester certificate program graduated

- Society of Radiologic Technologist compliant (not accreditation body but standard of industry)

Strengths:

Weaknesses:


Program is only 2 years old, not penalized for this

Certified CT radiologistStrengths:

Weaknesses:


"Evidence suggests that students who have completed the CT program are more likely to find

employment." Only one example of this is given. Nothing is mentioned about overall placement rates,

either for those with the certificate or without. Can we really say that the evidence suggests this?

No particular strengths are mentioned, other than that the program meets national standards.Strengths:

Weaknesses:

5. EFFICIENCY


- Self reported SCH/FTE for 2016, 2017 would put in the first quintile

- New program so recruitment efforts and currently courses delivered via onlineStrengths:

Weaknesses:


•N/A, not enough information, 2 years of details

•N/A, not enough information, 2 years of detailsStrengths:

Weaknesses:


The program has one faculty member--will the program continue if this faculty member were to leave?

The program seems to operate very efficiently, as an additional component of a larger program.Strengths:

Weaknesses:

Page 79 of 14511/13/2017



6. OPPORTUNITY


- Response that the program is too small to contribute to the strategic vision of UM

- Opportunity to house within radiologic tech program (certificate is only one semester and 2 courses)

- Provides graduates in a sector that is needed in the state

- CT program recognized as state-wide leader as only program of its kind in MUS, has potential to

grow

Strengths:

Weaknesses:


•Demand in all areas not described, vague generalizations

•Workforce importance and reference to rural communities, need clarification and data identifying the

state demand though

Strengths:

Weaknesses:


"As a stand-alone Certificate Program consisting of only two courses, the CT Program has limited

capacity to contribute to this Vision document." Everything that an organization does should

contribute to achieving its mission, even if only in small ways. I suspect that this certificate actually

DOES contribute to UM's mission, even if the author doesn't believe so. But if the author is correct in

saying that this program does not contribute to the mission, it begs the question: why are we doing it?

Health care workers are in demand.Strengths:

Weaknesses:

Page 80 of 14511/13/2017

17Acad AP173 173 Medical Assisting-2Y 2Y



1. ALIGNMENT


n/a

Criteria 1 - Bullet 1: excellent response

Criteria 1 - Bullet 2: very good response

Criteria 1 - Bullet 1: solid response

Strengths:

Weaknesses:


•None seen.

•The program promotes the UM2020 values of leadership, engagement, diversity, and sustainability,

emphasizing interpersonal skills.

•This program responds to workforce needs in the state. Reduction of resources would affect the

ability to respond to these needs, in addition to potentially affecting patient safety.

Strengths:

Weaknesses:


No Answer

No AnswerStrengths:

Weaknesses:


-

This program supports the core values Leadership, Engagement, and Diversity.

Reduction would impact the University contribution to the workforce.

Externships help prepare these students for future employment.

Strengths:

Weaknesses:

2. Demand


n/a



Strengths:

Weaknesses:



2 5 1 7 1.05 4 0.8 4 0.8 3 0.3 8 1.2 5.15Reviewer:

3 1 0.2 3 0.45 2 0.4 1 0.2 1 0.1 1 0.15 1.5Reviewer:

4 7 1.4 5 0.75 5 1 7 1.4 7 0.7 8 1.2 6.45Reviewer:

1 6 1.2 5 0.75 6 1.2 6 1.2 6 0.6 7 1.05 6Reviewer:

Ranking Category:




Total Count: 12

Page 81 of 14511/13/2017




•None seen.

•The medical assisting program is intrinsically interdisciplinary, collaborating with other fields to

provide the necessary complement of courses to complete the program.

•The program shares many courses with other health care training programs. Curtailment would

affect many more programs than just this one.

Strengths:

Weaknesses:


No contextual information available.

They produce a lot of General Education credit but I’m not sure with what programs they were

quintiled. Since it is a much lower number than other larger programs on campus.

Strengths:

Weaknesses:


Additional reduction or curtailment of this program would impact its ability to continue.

The demand for this program is. Difficult to assess partially because the program was in moratorium

for three years. This program lacks the data to necessary to evaluate the enrollment trends.

Strengths:

Weaknesses:

3. Productivity


N/A

Criteria 3 - Bullet 1 and 3 : thank you for noticing that a program only should respond to this if they are

applicable


Strengths:

Weaknesses:


•The lack of program faculty inhibit the program’s ability to keep up with demand for students.

•A very strong service learning program benefits both students and the medical facilities in which they

are placed.

•This program was pulled out of moratorium in response to workforce needs.

Strengths:

Weaknesses:


No indication of a graduation rate.

They have a steady number of students enrolled as majors.Strengths:

Weaknesses:


Lack of dedicated FTE makes it difficult for the program to reach its potential in the area of service and

outreach.

Data indicates an increase in enrollment but the two years it has not been in moratorium is not

adequate to establish a trend

Strengths:

Weaknesses:

4. QUALITY


N/A

Criteria 4 - Bullet 1: excellent response with very good supporting data

Criteria 4 - Bullet 2: appropriate response

Strengths:

Weaknesses:

Page 82 of 14511/13/2017




•This program is provided through faculty at Great Falls College and a clinical site at Western

Montana Clinic. There are no UM faculty.

•A UM program director must be hired in order to be eligible for national accreditation.

•100% of graduates passed the national boards.

•The curriculum has been designed to be compliant with national accreditation standards.

Strengths:

Weaknesses:


Central data provides no information in this category.

N/AStrengths:

Weaknesses:


There is no dedicated faculty for this program.

The program can be completed within two years.

This program has a higher than average pass rate for students in national testing.

Although this program is not currently accredited, it has been working on goals to meet the

requirements. The position of Program Director has not been filled and this is the primary obstacle to

accreditation.

Strengths:

Weaknesses:

5. EFFICIENCY


N/A

Criteria 5 - Bullet 1: a solid (though disappointing to see the facts) response

Criteria 5 - Bullet 2: good response


Strengths:

Weaknesses:


•There is only one admin associate for six health science programs – unsustainable.

•No dedicated faculty – need to hire a director and a laboratory faculty.

The program is hanging on with borrowed faculty and a slice of administrative support.Strengths:

Weaknesses:


No central data available.

N/AStrengths:

Weaknesses:


Loss of Administrative support has created an unsustainable situation for the department. If additional

staff cannot be added, then the department may have to downsize.

There is a critical need for additional administrative support.

This program has effectively partnered with Gt Falls College and Western Montana Clinic to sustain

itself but if it is to continue, this program requires additional resources.

Strengths:

Weaknesses:

6. OPPORTUNITY

Page 83 of 14511/13/2017




(It looks like there was some duplication of responses here)


Criteria 6 - Bullet 2: superb response



Strengths:

Weaknesses:


•None seen here – only opportunities.

•This is a program in great need of strengthening to fulfill its potential. Providing these health care

professionals will fulfill a need in the Montana workforce.

•The opportunities to revive a health professional program, if possible, with be able to address the

Strategic Vision.

•Additional resources are necessary to allow this program to fulfill its potential.

Strengths:

Weaknesses:


No responses provided.

N/AStrengths:

Weaknesses:


If this program is to continue, UM must invest in a Program Director. This program should continue to

try and fulfill its goal for accreditation. Additional collaboration could potentially bring life to this

program with minimal investment. However, this program needs more than a Program Director. It

needs a sustainable plan for outreach, service, and administrative support.

This program is in alignment with Strategic Opportunity 1: Engage students where they are & Strategic

Opportunity 3: Partner with Place

This program provides an opportunity to the community to gain skills in support of the medical fields,

an occupational area that has always been strong. Eliminating this program would require students to

leave the community to study in programs elsewhere.

The program provides externships where students can work in the community and build the

relationships they need to find employment.

Based on student testing, compared to national standards, this program has the potential to be a

national leader in the area. Investing in this program and developing on-line content, as suggested,

could further UM’s recognition a program leader in the state.

Strengths:

Weaknesses:

Page 84 of 14511/13/2017

17Acad AP174 174 Pharmacy Technology-Cert Cert



1. ALIGNMENT


-The report asserts that demand for Pharmacy techs is strong, but does not provide evidence that this

field will continue to grow.

-The program provides students with hands-on experience working with members of other disciplines,

which aligns with the goals of UM2020.

-The program fills a need for pharmacy techs in the community and across Montana.

-The program adapts to changes in the field. Students are well-prepared for their certification exams

Strengths:

Weaknesses:


No excess faculty. Any cuts to program would result in loss of accreditation.

Only program of its type in the state; collaborates with MSU-B City College to deliver courses in

Eastern Montana. Prepares students for long-term economic and workforce needs. Certificate pass

rate is 94%, compared with approximately at 60% rate nationwide. Demand for Pharm Techs is high.

Clearly aligns with UM 2020 Strategic Plan

Strengths:

Weaknesses:


Limited direct reference to UM 2020, no specific reference to cultural objectives, diversity or

engagement.

Alignment with mission focused around workforce development and leadership. Direct opportunities

for employment. The program runs about as lean as possible, a reduction in funds would end the

program. High rate of pass on certification exam.

Strengths:

Weaknesses:

2. Demand


-The is little evidence of interdisciplinary collaborations

-The program provides a course for Medical Coders and TranscriptionStrengths:

Weaknesses:



1 8 1.6 5 0.75 4 0.8 4 0.8 8 0.8 7 1.05 5.8Reviewer:

2 8 1.6 6 0.9 7 1.4 8 1.6 9 0.9 8 1.2 7.6Reviewer:

3 3 0.6 4 0.6 3 0.6 6 1.2 4 0.4 5 0.75 4.15Reviewer:

Ranking Category:




Total Count: 16

Page 85 of 14511/13/2017




Ranks in quintile #2 for demand, but this is understandable given that this is a highly specialized

program.

Provides a dual credit course with high schools. Program has an 82% retention rate; current

employment rate in the field is 64%. Program graduates roughly 10 certified tech students yearly.

Strengths:

Weaknesses:


No gen ed courses, and low contribution to non-majors.

Noted collaboration with community and regional health providers as well as opportunity for

interaction with regional high schools.

Strengths:

Weaknesses:

3. Productivity


-The employment rate (64%) seems low, though the report does not specify a time period for that

number

-The report highlights an issue with the centralized data, which is that the certification exam pass rate

may be a better measure of student success than the certificate of completion rates

Strengths:

Weaknesses:


Program ranks in the 2nd quintile for number of majors, 5 YA of degrees awarded, and in the lowest

quintile for student FTE/instructional FTE ratio.

Program is now sharing online classes with MSU-B City College, expanding their reach by providing

classes to more students. Opportunity for expansion is great.

Strengths:

Weaknesses:


Low number of majors and a strong downward trend in majors and graduation rates (potentially

skewed by fact that this is a two year program). Low student FTE per instructional FTE, but strong

downward trend.

Very high level of student retention and success. Certification exam scores at 94% where national

average is below 60%. Working with MSU Billings with on line offerings. Could have described

service and outreach to community as described above.

Strengths:

Weaknesses:

4. QUALITY


-The report again cites exam pass rates and employment rates as evidence of the quality of student

outcomes, yet the employment numbers seem weak (again, depending on the time period). Additional

information (comparison data, for example) would be helpful.

-The report provides strong evidence of faculty qualityStrengths:

Weaknesses:


None found.

Program ranks in the 4the quintile for time to degree. Student outcomes excellent, with 94% passing

the national certification exam. Program has been consistently accredited since 1996 and is accredited

through 2020.

Strengths:

Weaknesses:

Page 86 of 14511/13/2017




No specific weakness on quality

Time to degree is actually closer to 2 semesters, skewed by the fact that students don’t sign up

immediately. Good reputation with employers and stake holders. High retention rates and as noted

above, high pass rates on certificates. Award winning primary instructor.

Strengths:

Weaknesses:

5. EFFICIENCY


-Because the project with Billings is new, it is difficult to assess how successful that program will be

-The program has increased revenue by collaborating with City College in Billings.

-Program costs are low

Strengths:

Weaknesses:


None found.

Shares Intro to Pharmacy course with other medical training programs; 1.1 faculty FTE devoted to the

program, which is entirely online.

Strengths:

Weaknesses:


No grant expenditures or IDC generated

One to 0.5 FTE instructor with 10 – 25 majors. On-line courses being gained by sharing the online

program with City College in Billings.

Strengths:

Weaknesses:

6. OPPORTUNITY


-The program does not contribute to general education, and it does not propose any way that it might

begin contributing

-There seems to be potential for growth in the program, if the Billings collaboration is successfulStrengths:

Weaknesses:


None found.

New partnership with MSU-B City College may serve as a model for the state, since the program is

online. UM/MC could offer this course throughout the state.

Strengths:

Weaknesses:


No sense of how additional resources would improve student enrollment or success.

Good alignment with Strategic Vision, focus on students, place and workforce development. On-line

format yields numerous opportunities for sharing and collaboration.

Strengths:

Weaknesses:

Page 87 of 14511/13/2017

17Acad AP175 175 Radiologic Technology-2Y 2Y



1. ALIGNMENT


No apparent weaknesses.

"The Program is essential to UM and Missoula College because it is the state’s first, largest and most

successful such program, one of only four in total"- The program does a good job explaining in detail

how it fits the UM mission through engagement and leadership.

Strengths:

Weaknesses:


The relationship to sustainability (broadly defined) could be more effectively explained.

It was unclear how workforce needs may change in the years to come.

Connections were made with each of UM's four core values.

The Radiologic Technologist program is the state's first, largest, and most successful such program.

Montana's health care facilities rely on the program's graduates.

Social and cultural aspects of the students' preparation are well addressed within the program.

Strengths:

Weaknesses:


•Only a very small percentage of graduates are reported to actually move into the more advanced

fields.

•A number of claims go unsubstantiated, for example, with reference to interdisciplinary curriculum,

diversity, intercultural sensitivity, and compassionate patient care.

• Work force preparation is purpose of the program. This program not only produced qualified

radiologic technologists but is gateway to more advanced programs in radiation therapy, Nuclear

Medicine, Ultra-sound, etc.

Strengths:

Weaknesses:

2. Demand



1 7 1.4 4 0.6 6 1.2 4 0.8 6 0.6 8 1.2 5.8Reviewer:

2 7 1.4 4 0.6 5 1 4 0.8 6 0.6 7 1.05 5.45Reviewer:

3 4 0.8 6 0.9 6 1.2 5 1 5 0.5 7 1.05 5.45Reviewer:

Ranking Category:




Total Count: 16

Page 88 of 14511/13/2017




The programs ranked in the 2nd quintile for SCH for gen-ed course, 1st on sch for gen-ed per

instructor, and 2nd in sch for non-majors.

(The Radiologic Technologist Program accepts a cohort of students each year, and does not offer

classes to non-majors)

The program does not explain well how it is high demand, but does state that they advise 100 students

a year on entering the program.

Strengths:

Weaknesses:


The Radiologic Technologist program does not offer classes to non-majors, so the metrics for this

criteria were in the bottom two quintiles.

The program is running at capacity, and the faculty advise over 100 prospective students each

semester.

This program collaborates with five other Health Profession programs to provide a "Trauma Day," and

also partners with organizations in the community (e.g., Missoula Bone and Joint).

Strengths:

Weaknesses:


N/A

The clinical program is said in report to run at capacity. More resources would allow them to expand

the number of students admitted into the program.

Strengths:

Weaknesses:

3. Productivity


Ranked in the 1st quintile for number of Majors.

ranked in 5th quintile for trend over 5 years. 4th quintile for degrees awarded and 5th for trend over 5

years. "each of the 12 students in a yearly cohort performs over 1,000 hours of dedicated service in

health care facilities including hospitals, critical care facilities and outpatient clinics."

Strengths:

Weaknesses:


The Number of Majors was in the lowest quintile. However, there is only room for 12-14 students, so

there are always more students interested in the program than they are able to accept.

The productivity of the Instructional Component of the program was not well defined.

The 5YA of degrees awarded was in the 4th quintile.

The service components for this program were well articulated. Service learning is a core aspect of the

program, and very positive feedback has been received for the service rendered in clinical rotations.

Each of the 12 students in a yearly cohort performs over 1,000 hours of dedicated service in health care

facilities.

Strengths:

Weaknesses:


N/A

•N/A in research, publication, and creative activity because this is stated not to be a part of the

program mission

•Clinical students provide many hours of service to medical facilities.

Strengths:

Weaknesses:

4. QUALITY

Page 89 of 14511/13/2017




5YA time to degree Is in the 1st quintile. No other data provided for this criteria.

"Our student headcount maintains a constant number with an average of 1% attrition rate over the last

5 years".

Strengths:

Weaknesses:


The time to degree was in the lowest quintile.

More details could have been provided about the quality of faculty outcomes.

Test scores on national exams were high, with 87% of students passing on the first time. 77% of

graduates are working within the field.

Two of the faculty were appointed by Montana's Governor to the Montana State Board of Radiologic

Technologists.

Although the program is not officially accredited, it is in compliance with all of the accreditation

standards.

Strengths:

Weaknesses:


N/A

•Job placement for 77% of graduates.

•Both of the two core faculty have been appointed by the governor to the state board that oversees

licensing in this field.

Strengths:

Weaknesses:

5. EFFICIENCY


No data provided. The program has not seen major reduction, mostly because of accreditation

requirements.

The program recognized their strict faculty requirements for accreditation and found a way to

restructure the curriculum to add more students without adding more faculty.

Strengths:

Weaknesses:


The decreased administrative support is a significant challenge to this program. However, the report

did not highlight many efforts to improve efficiencies.

The program's faculty have taken on additional responsibilities as one of the administrative associate

positions was eliminated.

A curriculum restructuring occurred in 2015 that allowed the program enrollment to expand from 12

to 14 students.

Strengths:

Weaknesses:


•The number of administrative staff that serve all the health related programs at Missoula College has

been reduced from two to 1, putting extra pressure on faculty to do routine administrative functions.

•The willingness and ability of faculty to make up for the loss of administrative staff described below

in this section as a program weakness.

•Centrally generated data was unable to report for this program. Report estimates that SCH/Faculty

FTE at about 150.

Strengths:

Weaknesses:

6. OPPORTUNITY

Page 90 of 14511/13/2017




no obvious weakness.

"Investing in the Program by developing advanced degrees in CT, Ultrasound or MRI would attract

new students and retain many UM graduates who currently leave the state for these advanced

degrees."

The program has strong alignment with the strategic vision 1.1, and a well laid plan for expansion.

Strengths:

Weaknesses:


Interdisciplinary and other collaborative initiatives could be explored more extensively.

This section of the report was very well written, with concrete ideas for moving the program forward.

Four of the five strategic opportunities were addressed very effectively.

The program fulfills a demonstrated state-wide need in the health care sector.

The report included an innovative proposal to restructure the Rad Tech program to include the

Computed Tomography (CT) certificate.

Investing in adjunct faculty would allow the program to grow to 18-20 students.

Strengths:

Weaknesses:


•Training constrained currently by lack of adequate lab technology, which is expensive to purchase.

•Already doing outreach to rural clinics, where the need is high. This outreach also allows for more

job placements of graduates.

•Potential exists for online courses that would expand access to students.

•Integrating computerized tomography, for which there already exists a stand alone certificate, into

the core program would make graduates even more competitive in the job market.

Strengths:

Weaknesses:

Page 91 of 14511/13/2017

17Acad AP176 176 Respiratory Care-2Y 2Y



1. ALIGNMENT


-The report does not provide much specific information about workforce demand; overall, this section

did not provide much detail or evidence

-The authors argue that the program meets workforce demand, but do not provide other arguments

for why this program is essential to UM.

-The report presents strong evidence that the program promotes engagement with the community,

which aligns with UM2020

-The report states that there is excess demand for the program, and that it fills a crucial need

Strengths:

Weaknesses:


No specific information was provided on coursework or field placements that align with the

universities overall mission.

The Respiratory Care Program (RCP) provides students with Leadership, Engagement, Diversity, and

sustainability by way of presentations at statewide conferences, health fairs, coursework on diverse

populations and by exceeding standards in the health care field. Reductions would make it impossible

to meet workforce demands and graduate students. The RCP maintains close working relationships

with the professional community.

Strengths:

Weaknesses:


•Justification of essentiality to UM is minimal.

•Demonstration of how program prepares students for 21st-century needs lacks specificity.

•Program aligns with some aspects of UM’s vision, such as engagement, leadership, and diversity.

•Program contributes to 21st-century needs both by emphasizing “rapid change experienced in

medicine today” and by faculty remaining “current with literature and technological developments in

the field.”

Strengths:

Weaknesses:

2. Demand



1 4 0.8 5 0.75 6 1.2 9 1.8 7 0.7 8 1.2 6.45Reviewer:

3 5 1 3 0.45 5 1 5 1 7 0.7 7 1.05 5.2Reviewer:

2 5 1 4 0.6 5 1 5 1 4 0.4 4 0.6 4.6Reviewer:

Ranking Category:




Total Count: 16

Page 92 of 14511/13/2017




- There isn't evidence that this program promotes interactions outside of the Health Professions

programs

-The program seems reasonably well-integrated with other Health Professions programsStrengths:

Weaknesses:


No metrics given on the number of applicants vs those accepted.

Number of Majors and Metric 2: Trend over 5 years was in the first quintile. All other metrics were in

the second quintile.

RCP collaborations includes regular lectures to Nursing, Radiologic Technology, Medical Assisting,

Physical Therapy and partnerships with Missoula Bone and Joint. RCP hosts "Trauma Day", which

brings together students from 5 Health Professions programs to perform a trauma simulation with a

mock assessment, diagnosis and treatment on a hypothetical patient. Reductions to the RCP would

cause the program to decrease the number of students it accepts.

Strengths:

Weaknesses:


•Program has minimal interdependence/collaboration with other programs at UM. Reduction in size

would have limited impact on the university.

•Program does not identify potential impacts on other programs

•Program participates in Trauma Day: “an integrated training day that brings together students from 5

Health Professions programs to perform a trauma simulation.”

• “Faculty routinely give lectures to Nursing, Radiologic Technology, Medical Assisting, and Physical

Therapy students across multiple campuses.”

Strengths:

Weaknesses:

3. Productivity


-The authors are not able to provide evidence of quality instruction

-The program appears to effectively measure the benefits of its students' clinical rotations. These

rotations seems to be useful both to students and the patients they servce

Strengths:

Weaknesses:


Specific data on productivity for the RCP is available on request and not provided by the author for

this report. The author noted that is difficult to obtain feedback measures on the work that students

perform.

The Respiratory Care Program has a significant (720 hr.) service learning component centered around

bedside clinical rotations that provide direct benefits to students as well as the facilities that host them

and the patients they serve. All measures have been beyond satisfactory and are reported out to the

RCP's Accreditation Organization on an annual basis. Copies of all relevant data are archived and

available from multiple sources upon request. RCP's 5 year average Time to Degree is 2.5 years for a

72 Credit A.A.S. Degree

Strengths:

Weaknesses:

Page 93 of 14511/13/2017




•Report lacks specific evidence and refers to sources “upon request.”

•Report does not demonstrate any measurement of the instructional component of its mission, stating

only “it is extremely difficult to measure the quality of compassionate patient care that our students

provide.”

•Centralized data scores are low (although trend of student/instructional ration is good)

* Program appears to meet its mission.

* Missoula College Health Professions do not contain a Research, Scholarly, or Creative component

* Program “has a significant (720 hr.) service learning component centered around bedside clinical

rotations. […] All measures have been beyond satisfactory and are reported out to our Accreditation

Organization on an annual basis. Copies of all relevant data are archieved [sic!] and available from

multiple sources upon request.”

Strengths:

Weaknesses:

4. QUALITY


-None

-Graduates of this program do well on certification exams and in the job market.

-Strong evidence of faculty performance

Strengths:

Weaknesses:


No information on placements of graduates.

RCP's graduates are passing their NBRC (National Board of Respiratory Care) Credentialing exams

with an average score approaching 150% of the national mean score and have been doing so,

consistently, for the past 5 years.

Students first time pass rates on national credentialing examinations have been 100% for the past 5

years.

Faculty IPR's are extremely positive

Continuing Education Units (CEU's) required for maintenance of professional licensure.

Respiratory Care Faculty served as the Health Programs department Chair for 3 of last 5 years

Student Course Evaluations are consistently 4+/5

Strengths:

Weaknesses:


•Evidence of faculty outcomes is meager. Report lacks evidence, is overly vague, e.g. “Faculty IPR's

are extremely positively reviewed.”

•Report refers to outside data (“available for review”)

•Program demonstrates some strong student outcomes: 1.) Graduates pass their credentialing exams

with an average score approaching 150% of the national mean score; 2.) Student first-time pass rates on

national credentialing examinations have been 100% for the past 5 years.

Strengths:

Weaknesses:

5. EFFICIENCY


-The program requires additional funds to continue to be effective, because the single admin is unable

to meet demands

-The program has found ways to share costs of equipment and administrationStrengths:

Weaknesses:

Page 94 of 14511/13/2017




Faculty and non-faculty expenses have trended downward for the Respiratory Care program over the

past 5 years due to very aggressive measures taken by the Program. However, there is no mentions of

what these aggressive measures taken by the RCP are or how they compare nationally.

In June 2017 Administrative Associate support was reduced from 2 FTE to 1 FTE for the entire Health

Professions Department, leaving one person to support all six Health Programs. This has created an

untenable situation for the entire Department, and our single Admin Assistant is unable to meet the

demands for all of our Health Programs. This has burdened Program faculty with many routine

administrative tasks and is presenting a great challenge to our Program’s efficiency. Administrative

support for the program is already shared.

Strengths:

Weaknesses:


N/A

•Program has undertaken some efforts to improve efficiency.

•Program reports it has taken “aggressive measures” with expenses: Administrative Associate support

reduced from 2 to 1 FTE for all six Health Programs, burdening faculty with routine administrative

tasks (unclear whether this came from within the program or from the Dean)

•Program “heavily leaverages [sic!] community partnerships in order to secure cutting edge

equipment and expertise at reduced or typically no cost to the students or the University.”

•“Acquisition of new equipment and/or supplies is prioritized based upon its utility to multiple

diciplines [sic!].”

Strengths:

Weaknesses:

6. OPPORTUNITY


-The report does not project future workforce needs.

-The program aligns with UM's goals of partnering with place and meeting students where they are

-The program provides needed services in rural areas

-The report suggests that very modest investments could add substantial value to the program

Strengths:

Weaknesses:


No mention of what it would take to improve graduation rates or student retention.

The RCP by accreditation standards could not be combined with other programs. The workforce needs

of Montana’s Healthcare sector are well documented, and Missoula College’s Health Professions

Programs have been a major provider of emerging talent to fill those needs for decades.Our Programs,

including Respiratory Care, are already recognized as state-wide leaders in this effort. With only

modest investment in laboratory equipment for the Program, the RCP could more efficiently teach

students the hands-on skills needed in the profession.

Strengths:

Weaknesses:

Page 95 of 14511/13/2017




•Program does not offer opportunity for restructuring (due to specific requirements of accreditation

and credentialling, restructuring is “challenging.”)

•Program offers some significant opportunities to enhance UM.

•Program offers significant contributions to UM’s new Strategic Opportunities:

1.)Program “engages students where they are […], through advising and career counseling, blending

modes of educational delivery, and linking students with job opportunites [sic!] ”.

2.)Program “invests in Leadership and Professional Development by aligning

students [with] working professionals as well as future Health students, and by supporting faculty as

they engage with state and national associations.”

3.)“By supporting student rotations in rural areas, the Program Partners With Place.”

•Program contributes to state-wide needs.

•Requests “modest investment in laboratory equipment” to teach more efficiently.

Strengths:

Weaknesses:

Page 96 of 14511/13/2017

17Acad AP177 177 Registered Nursing-2Y 2Y



1. ALIGNMENT


Program should provide more substantial evidence for essentiality to UM.

Program enacts leadership skills and engagement with the nursing field through clinical rotations and

laboratory practice. The program enacts the value of diversity through weaving cultural sensitivity in

the nursing curriculum for diverse patients. Program provides strong response to bullet 1.

Program demonstrates alignment with UM mission and provides argument for its essentiality to UM

through workforce demand and student demand.

Program prepares students to be registered nurses for a diverse set of patients. Program demonstrates

a preparation clear workforce need with sufficient evidence.

Strengths:

Weaknesses:


Listing the number of graduates each year doesn't address whether/how the program contributes to

sustainability.

The "cultural diversity component" of this program, if done well, certainly contributes to UM's goals

for diversity.

There are opportunities in the field of nursing for which this program can help prepare students.

Strengths:

Weaknesses:


No specific weakness in alignment

Clearly described alignment with the UM 2020 strategic plan. Specific emphasis on unique

educational experiences through clinical placement, workforce development, and cultural diversity

training. Generate a high quality product with a high demand for nurses in the state and the profession

places ethical trustable individuals within communities. Clear future demand for these grads.

Strengths:

Weaknesses:

2. Demand



2 5 1 4 0.6 4 0.8 5 1 4 0.4 5 0.75 4.55Reviewer:

3 7 1.4 6 0.9 7 1.4 7 1.4 6 0.6 6 0.9 6.6Reviewer:

1 8 1.6 6 0.9 6 1.2 6 1.2 4 0.4 5 0.75 6.05Reviewer:

Ranking Category:




Total Count: 15

Page 97 of 14511/13/2017




Program does not address how collaboration has enhanced faculty performance.

Program should provide greater detail about existing collaborations.

Data sheet info regarding gen-ed courses is incorrect as the nursing program does not teach any

general education courses. Program does not offer courses to non-majors countering its placement in

quintile 2 for this metric.

Program demonstrates collaboration with other UM programs that practically address student needs

in their education.

Program provides evidence that the number of nursing students enrolled in other missoula college

courses is great and that this decline in enrollment through curtailment of the nursing program would

impact other programs.

Program demonstrates high demand in applicants.

Strengths:

Weaknesses:


Internal (within-UM) demand for this program doesn't seem to be especially strong. But this is a

specialized program--I wouldn't EXPECT the internal demand to be strong.

Students in this program take gen-eds and other courses from other programs.Strengths:

Weaknesses:


No gen ed courses and no courses for non-majors. No collaborations described outside of Missoula

College, but just an oversight as there is a large medical community level collaboration (as described in

Productivity).

No centralized data for any of the demand criteria. Noted collaboration in other health profession

degree programs at Missoula College. A loss of this major would have a big impact on biology and

chemistry offerings (RN students number about 110) and additional impacts on psychology and

sociology courses where RN students make up a good portion of those as well. RN program admits 18

students each semester.

Strengths:

Weaknesses:

3. Productivity

Page 98 of 14511/13/2017




Program put N/A and stated that it does not have a research, scholarly, or creative component.

Program does not provide sufficient measure of productivity of outreach.

Program does not provide sufficient evidence of performing outreach.

Program does not provide clear evidence of this additional instructional component such as logged

hours but merely states this component.

Program demonstrates steady number of degrees awarded and is in quintile 5. Program has a steady

number of “majors” and sees a drastic increase in number in 2017, placed in quintile 3.

Program engages in health related community outreach such as flu shots and blood pressure clinics.

Students and the elderly provide positive feedback about this outreach through word of mouth.

Program demonstrates additional instructional components being additional clinical instructor hours

logged due to a required faculty ratio of 10:1 and decreased patient numbers. Instructors are stated to

be working twice as hard as students.

Strengths:

Weaknesses:


The report states: "The Registered Nursing Program does not have a research, scholarly or creative

mission." It seems unusual for a program (even at the 2-year-college level) to have NO aspirations for

advancing the knowledge in their field.

Outreach for the Nursing Program is very strong.Strengths:

Weaknesses:


No scholarly or creative activities.

Good number of majors annually (72). Consistent rate of degrees awarded and a relatively high

number for 5YA for degrees awarded. Students and faculty participate in various community outreach

activities in the health profession. State board limits the student to faculty ration to 10:1 in the

hospital. The program maintains 18:1, thus students divided into two groups for hospital rotations.

Large demand on instructor time.

Strengths:

Weaknesses:

4. QUALITY


Program provides insufficient evidence to demonstrate quality of faculty outcomes.

Program placed in quintile 4 for 5ya time to degree.

Program demonstrates clear evidence of high quality of student outcomes (ex: Nursing Program

NCLEX-RN pass rate for first time test takers this year is 93.3%. The national average is 88.4%).

Program was accredited in 2016 and was awarded accreditation until 2024. Eight years of continued

accreditation is the longest period of time ACEN will award to a nursing program which demonstrates

the quality of nursing program.

Strengths:

Weaknesses:


When discussing the quality of faculty outcomes, the report says that faculty "maintain competence in

our clinical areas of expertise." Do any of the faculty go beyond "maintaining competence"?

Scores on licensing exams (NCLEX-RN) are above the national average--great job! And congrats to

those students.

Strengths:

Weaknesses:

Page 99 of 14511/13/2017




No specific weaknesses

High rate of pass on the standardized testing, 93% pass versus a national average of 88%. Good wages

and good job placement. Instructors are high quality and have to maintain certifications to be in the

program. Program fully accredited for 10 years. Good rate on time to degree completion.

Strengths:

Weaknesses:

5. EFFICIENCY


Program has no central data provided for all of criteria 5.

Program lost the tenured director of the program caused a rivet in adequate programmatic

directorship and the program is unable to hire another tenured faculty to fill position.

Program vaguely describes efforts to improve efficiency but does not do so in an adequate manner.

Program should be more specific and provide evidence.

Program does not demonstrate how administrative reduction will impact teaching or outreach.

Program does not address centralization of administrative duties.

Program states that competition between two other nursing programs limits availability in local

hospitals for clinical hours so contracts with rural hospitals allow interested students to complete

hours outside of Missoula.

Administrative FTE recently reduced from 1.0 to .5. This caused additional administrative work for the

program director. Program argues that this will have a “trickle down effect” causing students to have

more difficulty navigating the program.

Strengths:

Weaknesses:


A lot of the quantitative data is missing for this criteria, which makes judgments regarding efficiency

difficult. (The data is missing from the centralized data, and the program seems to have made no effort

to find or provide that data.)

Like many programs on campus, this program seems to have managed to "do more with less" over the

last few years.

Strengths:

Weaknesses:


Basically no grant expenditures or IDC generated.

No centralized data on any of the efficiency metrics. Received a small amount of external funding.

Loss of one tenure track position has created a hardship for the program. Shifted to a partial online

format to improve efficiency and delivery, this really helps with the clinical students. Program lost 0.5

of an admin assistant due to budget cuts.

Strengths:

Weaknesses:

6. OPPORTUNITY

Page 100 of 14511/13/2017




Program does not provide additional innovative ideas for contribution or engagement with strategic

opportunities.

Program does not provide additional or innovative suggestions for establishing UM as a leader.

Program demonstrates contributions to engagement of students where they are through educating

nurses in rural communities and meeting workforce demand as well as providing an accessible and

affordable curriculum.

Program demonstrates establishment of UM as a leader in the nursing profession through meeting

workforce needs and engaging with other health profession programs.

Program proposes the offering of online nursing courses to accommodate rural students.

Program states that investment in the program would allow for an increase in registered nurses due to

acceptance of more students to meet the growing workforce demand.

Strengths:

Weaknesses:


The majority of this report stressed the importance of one-on-one (or few-on-one) contact hours with

students. Is a distance-learning model really appropriate, given the importance of that contact time?

The nursing program has explored (and implemented) great options for students, including distance

education for aspiring nurses in rural areas, and new state-wide nursing curricula.

Strengths:

Weaknesses:


Could have elaborated on how the program fits the broader strategic vision

Partial alignment with Strategic Vision, focus on partnering with place. An important program for

rural Montana and for students. On-line format provides opportunities for future development of the

program. Undersupply of nurses is forthcoming, an investment in the program could help achieve an

adequate supply of nurses for Montana.

Strengths:

Weaknesses:

Page 101 of 14511/13/2017

17Acad AP178 178 Surgical Technology-2Y 2Y



1. ALIGNMENT


- not a clear explanation for how they address sustainability

- didn't clearly connect how a reduction in their resources would weaken UM's Mission

- the program addresses all of the values in the 2020 Plan through classroom work and outside

experiences

- thorough explanations of their unique educational experiences

- a reduction of their resources would negatively effect Montana's workforce

- their program prepares its students well for the cultural, social and workforce needs through didactic

education, clinical rotations, and by partnering with health care facilities and managers

Strengths:

Weaknesses:


•Limited explanation of essential to UM’s Mission, and how reduction weaken’s the mission

•Samples of engagement on program alignment with UM 2020 Strategic Plan

•Explanation of important in preparing students for social, cultural, and/or workforce needs of the 21st

century

Strengths:

Weaknesses:


The program size is capped because of accreditation and staffing restrictions

The program appears to align well with UM2020 providing much needed health services training.

Students completing this degree are in high demand and well prepared for their field.

The program reinforces UM's core values.

Strengths:

Weaknesses:

2. Demand


- not evident how their program would impact other programs if its size were reduced

- high demand from students that are not measured, such as the number of students (100) that the

faculty advises each semester and how competitive their application process is

- the program offers multiple ways in which they collaborate to address student needs; to include

Trauma Day, cadaver labs, internships, and clinical rotations with regional/local health care facilities

Strengths:

Weaknesses:



2 6 1.2 6 0.9 5 1 6 1.2 4 0.4 6 0.9 5.6Reviewer:

3 8 1.6 7 1.05 7 1.4 7 1.4 6 0.6 6 0.9 6.95Reviewer:

1 8 1.6 8 1.2 6 1.2 7 1.4 7 0.7 7 1.05 7.15Reviewer:

Ranking Category:




Total Count: 14

Page 102 of 14511/13/2017




• Does the data accurately reflect the centralized data, because explanation does not offer specifics

or details on numbers other than the centralized data and generalization of statements without specifics

•Collaborative efforts with Trauma Day as well as medical entities throughout the communityStrengths:

Weaknesses:


There should be better data kept at the program level

Reduction or elimination of this program would result in higher demand for other health profession

programs that are already operating at capacity.

Some of the data appears to be departmental and not program specific. The Quintiles appear to be low

to average (1-3), but it should be noted that the program is capped at 28 students for accreditation and

staffing restrictions.

The program appears to operate at capacity with excess demand - some students wait two years for

admittance.

Strengths:

Weaknesses:

3. Productivity


- no examples of creative scholarship activities, which is required by the Faculty Professional

Continuing Education

- they are not expected to engage in research opportunities due to their degree type ( Associates)

- students perform 600 hours and at least 120 scrubbed surgeries, which can be a valuable service to

hospitals and clinics

Strengths:

Weaknesses:


•Engagement in professional education, but nothing listed or described

•Demand is showing stable in 69 – 70 majors each year, but number of degrees awarded averages 17.4

doesn’t reflect 28 in cohort group, uncertain here.

•Details of state and local clinical rotations demonstrate hours of productivity and the effort involved,

as well as increase in site locations

Strengths:

Weaknesses:


The faculty SCH to FTE ratio is on the lower side (2nd Quintile) but is consistent with an accredited

Health profession program meeting accreditation standards.

The program is at it maximum size unless additional clinical sites can be identified.

The program graduates around 17 students per year which ranks in the 4th Quintile. The trend is flat -

which is expected for a program operating at capacity.

Faculty are not required to engage in scholarly research, but must participate in continuing education.

Strengths:

Weaknesses:

4. QUALITY

Page 103 of 14511/13/2017




- no data on faculty outcomes

- students exceed the national exam pass rate and graduate placement rate set by the ARC/STSA

- a large portion (95%) of St. Patrick Hospital surgical techs were trained at Missoula College

- their program is currently accredited

Strengths:

Weaknesses:


•No faculty outcomes for current faculty? Only reference to additional new faculty outcomes not

available yet

•ARC/STSA results comparisons share higher levels of student outcomes, employer feedback on

surveys

Strengths:

Weaknesses:


Program may be at feasible capacity - due to lack of additional clinical sites.

95% pass rate on certification exam

89% job placement

Program is accredited

Strengths:

Weaknesses:

5. EFFICIENCY


- the loss of an FTE admin assistant has hurt their program and other health care programs

- increased the number of final internship clinical sites from 22 to 25 and have developed online classes

to help reach remotely located students

- no losses to their program's faculty

Strengths:

Weaknesses:


•Reference to the data sheet lacking real data, but no real description on the content or errors of the

content

•Efforts to improve efficiency reference loss in FTE, but no other efforts demonstrated – notation of on-

line class options

•how does the program compare with other Surgical Tech programs for efficiency

Increase in clinical sites for surgical technologyStrengths:

Weaknesses:


reduced support to department

Instructional costs have remained relatively flat (per author)

Administrative support is provided through Health profession programs and support has been cut

from 2 FTE to 1 FTE

Clinical sites have been increased from 22 to 25

Strengths:

Weaknesses:

6. OPPORTUNITY

Page 104 of 14511/13/2017




- the program lacks in contributing to interdisciplinary areas of inquiry

- the program already contributes to UM's Vision through advising, providing job opportunities, extra-

curricular activities and supporting student rotations in rural areas

- the program greatly contributes to state-wide needs

- their one opportunity for restructuring will help reach more students and can improve other health

care departments

Strengths:

Weaknesses:


•Who is providing the “well-documented information on workforce needs of Montana’s Healthcare

sector”, generalization

•Creativity in Core Curriculum Model

•Innovative ideas with certifications of surgical services model that could offer some opportunities to

enhance UM and relations with medical programs in the community

•Contributes to the UM Strategic Vision

Strengths:

Weaknesses:


Appears to have limited local growth opportunities

On line instruction offers the opportunity for growth. Creating outreach programs and course sharing

with other MUS colleges offers opportunity for significant growth

Implementing a Core Curriculum Model could improve efficiency department wide.

Improved laboratory equipment would improve student experience and outcomes at small cost.

Strengths:

Weaknesses:

Page 105 of 14511/13/2017

17Acad AP181 181 Diesel Equipment Technology-2Y 2Y



1. ALIGNMENT


Doesn't address bullet 1

N/AStrengths:

Weaknesses:


No statement on 2020 strategic plan (not the goal)

•Certification of Student in Brakes and Air Conditioning

•Diesel Equipment Technology is essential training program for state and nation because of workforce

shortages.

•MC program survives primarily on donations from industry (all engines but 1 donated in 27 years).

•Almost 100% placement of students

Strengths:

Weaknesses:


Criteria 1 - Bullet 1 - did not answer question clearly or link to the UM Strategic Plan on the

dimensions required.

Criteria 1 - Bullet 2 - good response

Criteria 1 - Bullet 3 - great response

Strengths:

Weaknesses:

2. Demand


Lowest quintile score for metric 3

Doesn't address bullet 1

if cuts are made, other programs would lose studentsStrengths:

Weaknesses:



1 4 0.8 3 0.45 2 0.4 7 1.4 5 0.5 6 0.9 4.45Reviewer:

2 5 1 7 1.05 6 1.2 6 1.2 8 0.8 6 0.9 6.15Reviewer:

3 5 1 5 0.75 5 1 6 1.2 7 0.7 7 1.05 5.7Reviewer:

Ranking Category:




Total Count: 14

Page 106 of 14511/13/2017




•None observed

•Limited enrollment doesn’t allow for other students to be in courses.

•Appears to be high demand with limited admissions (wait list; largest program on west campus).

•Diesel Technology encourages students work part-time in placements in community as apprentices.

•Students are encouraged to complement the training with business education, welding or heavy

equipment operation training.

•The courses (7) their student take outside of area would be down 25 students if cut.

•Quintile 1 on non-majors-but not their intent.

Strengths:

Weaknesses:


N/A

Criteria 2 - Bullet 1 - solid response


Strengths:

Weaknesses:

3. Productivity


doesn't answer bullets

4th quintile for metric 1

trending towards higher metrics for 5th and 8th metrics

Strengths:

Weaknesses:


•SCH to Instructional and TT FTE quintile 2 (not clear how certification or training plays a role in

SCH/faculty ratio (only 2 faculty-not sure if weakness).

•R,T, S not relevant to this specific 2 year program

•Majors are quintile 4.

•Graduates are Q3.

•Faculty productivity appears connected to training, outreach to industry (apprenticeships,

donations), and placement (~100% placement).

Strengths:

Weaknesses:


Criteria 3 - Bullet 2: This is applicable to this program and a little explanation would have helped.

Criteria 3 - Bullet 1: not applicable to this program.

Criteria 3 - Bullet 2: not applicable to this program.

Strengths:

Weaknesses:

4. QUALITY


N/A

100% job placement out of graduationStrengths:

Weaknesses:

Page 107 of 14511/13/2017




•No formal survey process of alumni.

•Time to degree quintile 5.

•Job placement local and national and almost 100%.

•Students also move into 4-year degree programs.

•Faculty are certified in numerous certifications relevant to training by manufacturers.

•Students praise program (no formal survey).

•Industry seeks to continue to hire graduates year after year.

Strengths:

Weaknesses:


n/a


Criteria 4 - Bullet 2: good response actually focused on the quality of faculty as it relates to the

program under review

Strengths:

Weaknesses:

5. EFFICIENCY


relies on money from lab fees

Many donations to assist in costsStrengths:

Weaknesses:


•As stated above SCH to instructional /TT FTE is Q2 (shouldn't be counted against twice).

•No grants or IDCs- not weakness per se, but no one is tracking their donations from industry which

appear meaningful and substantial to their functioning. (our MISTAKE apparent on quintile of 2 for

zeros).

•Risks, recruitment and advising have been impacted with loss of 1 FTE staff on West Campus.

•Making a lot of an extremely restricted and cut budget despite the impact of these costs on education

and training.

•The program is surviving on lab fees and donations primarily.

•Collaboration with other programs also appears to help with meeting training needs.

•Program uses centralized assistance where it can for needs (Business Office, Registrar’s Office, full-

time staff now part-time work study on west campus).

Strengths:

Weaknesses:


n/a




Strengths:

Weaknesses:

6. OPPORTUNITY


doesn't address um 2020 plan

Potential for students to specialize with certificatesStrengths:

Weaknesses:

Page 108 of 14511/13/2017




•Program doesn’t have adequate storage or space for equipment and taking on more students-not

clear where this would come from.

•Program would need more faculty for above ideas as well.

•Program has wait-listed students and clear opportunity for growth.

•Ideas for 3-year degree that would integrate heavy equipment and welding.

•Ideas for grant/foundation seeking more money would need relief time for faculty.

•Summer school programs in Power generation and Refrigeration might yield increased students

needed in the trucking and rail industry areas.

Strengths:

Weaknesses:


n/a


Criteria 6 - Bullet 2: superb response


Criteria 6 - Bullet 4: good response

Strengths:

Weaknesses:

Page 109 of 14511/13/2017

17Acad AP184 184 Heavy Equipment Operation-Cert Cert



1. ALIGNMENT


•No mention is made of the values or even the UM2020 Strategic Plan.

•The preparation of students for the 21st century workforce is a strength.Strengths:

Weaknesses:


I do not see any references to whether or not this program supports the mission and vision of UM

The program works with local businesses and contractors. Students come from local, national and

international areas.

Strengths:

Weaknesses:


The report did not specify how the program is related to Leadership, Engagement, Sustainability, or

Diversity.

The Heavy Equipment Operations program provides training that directly meets workforce needs

within the state. The program is well connected to many employers. Out-of-state students are also

attracted to this certificate, because of the shortage of qualified operators and grade setters/surveyors

in all areas of the country.

Strengths:

Weaknesses:

2. Demand


•There are no Gen Ed courses associated with this program.

•The response to impacts if this program were cut simply lists courses.

•There are no strengths for this program on this criteria.Strengths:

Weaknesses:


I don't necessarily see an internal demand for the program, but a certificate of this type is not like

general university programs and should not be graded as such.

We are seeing a huge demand in the industry for Heavy Equipment Operators, both locally and

nationally. The Civil Construction Industry is experiencing a shortage of qualified operators and grade

setters/surveyors in all areas of the country. The program receives calls and emails from multiple

entities asking to hire their graduates.

Strengths:

Weaknesses:



3 5 1 3 0.45 1 0.2 5 1 7 0.7 4 0.6 3.95Reviewer:

2 5 1 5 0.75 5 1 5 1 5 0.5 5 0.75 5Reviewer:

1 4 0.8 2 0.3 7 1.4 5 1 7 0.7 3 0.45 4.65Reviewer:

Ranking Category:




Total Count: 15

Page 110 of 14511/13/2017




There did not seem to be interdisciplinary initiatives in this program.

The report listed five other courses at the university that would suffer in enrollment if this program

were curtailed.

Students are encouraged to take courses in the Diesel Program, Welding Program, and other online

courses.

Strengths:

Weaknesses:

3. Productivity


•While the program does not have a scholarly or research component, it should have a service and

outreach component.

•This program produces a fairly regular number of graduates.Strengths:

Weaknesses:


There is no information provided for productivity

There is no information provided for productivityStrengths:

Weaknesses:


N/A was listed for all three bullets--it would seem that there would at least be an instructional

component to this program.

Not sure--nothing was included in the report.Strengths:

Weaknesses:

4. QUALITY


•The evidence of faculty outcomes is anecdotal.

•The high job placement rate is a strength of this program.Strengths:

Weaknesses:


I don't see any weaknesses

Students that graduate and want to work have 100% job placement. Those that want to continue their

education go to Missoula College or the main UM campus. Faculty evals come back with high marks.

Strengths:

Weaknesses:


Besides job placements, it would be helpful to have other data on student outcomes.

No faculty awards or other recognition was listed.

Every year the program has 100% job placement for its students.

Faculty evaluations have high marks, and the two instructors have 45 years of experience.

Strengths:

Weaknesses:

5. EFFICIENCY


•No substantial weaknesses on this criteria.

•The reliance on donated equipment is an efficiency.

•The generation of funds through contracted jobs is an efficiency.

Strengths:

Weaknesses:

Page 111 of 14511/13/2017




I don't see Matrix data added to the report, so I don't know about FTEs, etc...

The program has to be efficient because they rely on their own money to fund projects.This makes it

difficult to repair machinery or upgrade to newer products. They have had to be creative in fixing

existing machinery by having the diesel and welding programs help with repairs.

Strengths:

Weaknesses:


It was not clear whether the program has any administrative support.

Benchmarks with other programs were not provided.

The program asserts that it relies solely on its own accounts that it generates by doing contracted jobs

in the community.

The instructors work with the Diesel and Welding programs to make repairs on its equipment.

The program has seen a reduction in support for helping students register and receive financial aid.

Strengths:

Weaknesses:

6. OPPORTUNITY


•The argument for additional resources is weak.

•The response does not address the Strategic Vision.

•The request of more scheduling authority for the program director seems reasonable.Strengths:

Weaknesses:


I do not see weaknesses regarding this opportunity analysis

The program needs to restructure the registration process and have one registration for the full year. If

they created a three year degree, which would consist of two programs back to back, they would be at

full capacity and students would be guaranteed spots in the program.

Strengths:

Weaknesses:


The new Strategic Opportunities were not addressed.

Ways to enhance interdisciplinarity and serve statewide needs were not directly explained.

The high demand for Operators and Gradesetters/Surveyors provides opportunities to grow this

program.

A potential three-year degree was proposed.

Strengths:

Weaknesses:

Page 112 of 14511/13/2017

AP185 185 HVAC Technician-Cert Cert




1. ALIGNMENT


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:



· No report submittedStrengths:

Weaknesses:

2. Demand


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:


· Quintile 1 – SCH ratio non-majors to total

· NoneStrengths:

Weaknesses:

3. Productivity


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:



2Reviewer:

3 1 0.2 2 0.3 5 1 3 0.6 1 0.1 1 0.15 2.35Reviewer:

1Reviewer:

Page 113 of 14511/13/2017

AP185 185 HVAC Technician-Cert Cert




· Moderate five year average for certificatesStrengths:

Weaknesses:

4. QUALITY


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:




Weaknesses:

5. EFFICIENCY


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:




Weaknesses:

6. OPPORTUNITY


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:




Weaknesses:

Page 114 of 14511/13/2017

17Acad AP186 186 Precision Machine Technology-Cert Cert




1. ALIGNMENT


- aligned with some of UM's mission, vision and values (new program less than 2 years old)

- Engagement of students through hands on experiences

- Help student integrate into job market in local and state level

- Gives students base in manufacturing fabrication and communication

Strengths:

Weaknesses:


Didn't directly address alignment.

Didn't clearly connect answers to question content.

N/AStrengths:

Weaknesses:


•bullet 1 doesn’t address the UM2020 strategic plan, but does illustrate how the program offers a path

to further career development

•is the program essential to UM (bullet 2): demonstrates that the program is essential to

manufacturing process development, mechanical and structural engineering.

•good explanation of what types of skills are developed in the program and their contribution to

workforce needs.

Strengths:

Weaknesses:

2. Demand


- new program so not a whole lot to go off of, departmental data shows SCH generated mostly via

students within department

- Job market expected to grow 6% for 2014-2024, constant contact with local businesses about needStrengths:

Weaknesses:


Information provided in 2.1 was more relevant for 1.3.

N/AStrengths:

Weaknesses:



3 4 0.8 5 0.75 3 0.6 4 0.8 6 0.6 3 0.45 4Reviewer:

2 3 0.6 1 0.15 5 1 1 0.2 5 0.5 3 0.45 2.9Reviewer:

1 4 0.8 4 0.6 5 1 4 0.8 6 0.6 4 0.6 4.4Reviewer:

Page 115 of 14511/13/2017




•more specifics about how many graduates the region could support would strengthen the report

dramatically

•program is new and already seeing growth in the number of students

•good support through Bureau of Labor Stats job outlook.

•local industry asking for qualified graduates.

Strengths:

Weaknesses:

3. Productivity


- 4 withdrew, new program so tough to judge on just first year, ~50% completion

- Working with local/state employers to refine curriculum

- 10 students in first year, 4 graduated in 1 year certificate program

-100% (4/4 graduates) placement filled via local demand

Strengths:

Weaknesses:


N/A

Provided information regarding steps to advanced program credentialing/certification.

Outreach to local manufacturers for feedback about program and workforce needs.

Strengths:

Weaknesses:


•response in bullet 3 does not explain how program measures aspects of the curriculum such how

ethical and professional demeanor are conveyed.

is the program too new to be able to illustrate productivity?

•outreach with local industry to understand workforce needs to develop the curriculum.

•continually developing curriculum based on feedback from employers

•100% student employment rate from local demand.

•plans to develop program into 2-year with accreditation through NIMS.

Strengths:

Weaknesses:

4. QUALITY


- new program so again no data and not much to go off of

- 4 graduates and employed (10 students to begin with)Strengths:

Weaknesses:


Only 50% of students graduated.

100% employment for graduates.Strengths:

Weaknesses:


•program is too new for data to reveal trends

•no response for faculty outcomes (N/A)

•program explains additional required resources to meet accreditation standards through NIMSStrengths:

Weaknesses:

5. EFFICIENCY

Page 116 of 14511/13/2017




- no available data on FTE or anything for program

- worked with local employers to have materials and equipment donated to help keep program

relevant without ability to upgrade purchase equipment

- share budget with welding which has been cut, offset partially via student fees

- currently looking for partnership to generate revenue

Strengths:

Weaknesses:


No specific information about efforts toward efficiency, but it's a new program and has experienced

reductions.

Collaborations/cost sharing with local manufacturers.Strengths:

Weaknesses:


•need to support claim that the program can only sustain 12 students per year at current budget levels.

•suggests that program could earn revenue to support the program by contracting with local

manufacturers to produce machine parts.

•suggests partnerships with local industry to “underwrite” (the reader’s term, not the author’s) the

cost of the program

Strengths:

Weaknesses:

6. OPPORTUNITY


- New program and issues need to be addressed for program to be recognized in the state which will

require investment

- no indication of contributions to strategic vision of UM

- graduates employable locally and instruction prepares students to continue in a wide range of

opportunities

Strengths:

Weaknesses:


Didn't make clear connections to alignment or enhancing UM.

Didn't connect some of the information provided with the question content.

Some specific examples of potential/needed improvements to move the program forward.Strengths:

Weaknesses:


•something seems to be missing from the response for criteria 6, bullet 1. as it is, doesn’t address

strategic vision

•good explanation for what the program could potentially support for mechanical engineering thereby

implying establishing a role as leader in interdisciplinary areas. (doesn’t specifically address bullet 2,

but you can read between the lines).

Strengths:

Weaknesses:

Page 117 of 14511/13/2017

AP187 187 Recreational Power Equipment-Cert Cert



No Report Submitted

1. ALIGNMENT


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:


No Information Provided

No Information ProvidedStrengths:

Weaknesses:

2. Demand


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:


No Information Provided

No information provided – Q1 for non-majors to totalStrengths:

Weaknesses:

3. Productivity


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:



1Reviewer:

2Reviewer:

3 1 0.2 1 0.15 1 0.2 1 0.2 1 0.1 1 0.15 1Reviewer:

Page 118 of 14511/13/2017




3.8. (5YA – student/instruction FTE ratio) – Q2 3.9. (trend) – Q2 – .67 3.5. (Degrees Awarded) –

Q3 FY13: 12.0 FY14: 12.0 FY15:6.0 FY17:2.0 5YA: 8.0 3.6. (Trend) – Q1 - 0.74

3.5. (Degrees Awarded) – Q3 FY13: 12.0 FY14: 12.0 FY15:6.0 FY17:2.0 3.6. (Trend) – Q1 -

0.74

Strengths:

Weaknesses:

4. QUALITY


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:


No other information regarding the quality of the program

Q5 on time to degreeStrengths:

Weaknesses:

5. EFFICIENCY


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:


Q2 – 5YA of SCH for undergrad per instructional FTE No information provided

No information providedStrengths:

Weaknesses:

6. OPPORTUNITY


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:


No information provided


Weaknesses:

Page 119 of 14511/13/2017



Page 120 of 14511/13/2017

17Acad AP188 179 Carpentry-Cert Cert




1. ALIGNMENT


Weaknesses:

•Carpentry has data; FM-no data specific to program-NO SCT data and thus will be in group 1.

•Second year merge of Carpentry and Facilities MGT

•Appear to be addressing LESD in strategic plan, even increasing diversity of students.

•SCT came from idea on how to reinvigorate both.

•Appears to be high need niche area; students can get hired away prior to finishing, or just take

courses to increase knowledge base.

Strengths:

Weaknesses:


The program has become much more diverse, but more information could be provided on how the

cultural needs of the 21st century are being addressed.

This program showed strong connections with Leadership, Engagement, Sustainability, and Diversity.

Sustainability is an obvious strength.

The program fulfills the professional training aspect of UM's mission.

Students in the program have 100% job placement, and the report claims that number of students could

be doubled and there would still be 100% job placement.

Students develop strong soft skills in this degree.

Strengths:

Weaknesses:


B2-Not fully addressed.

B1-leadership, engagement, sustainability, and diversity clearly part of mission.

B2-Community would lose public service aspect.

B3-Meets workforce needs.

Strengths:

Weaknesses:

2. Demand


•Carpentry has student data; none for FMgt; no SCT data (GE generation not the goal of this program).

•Students work with other campus and community programs assisting in building projects

•SCT students take GE, and come from EVST, and other areas with sustainability interests

Strengths:

Weaknesses:



1 4 0.8 2 0.3 3 0.6 4 0.8 4 0.4 5 0.75 3.65Reviewer:

2 8 1.6 6 0.9 4 0.8 5 1 5 0.5 4 0.6 5.4Reviewer:

3 7 1.4 7 1.05 6 1.2 7 1.4 6 0.6 7 1.05 6.7Reviewer:

Page 121 of 14511/13/2017




The report said that the data do not represent the current reality, but what the actual numbers are were

not provided.

Collaborations are occurring with many departments, including Theatre, Business, the Glacier

Institute, Food Service, and the Energy Program.

This program has also reached out to Botany and Chemistry for possible collaborations.

Several areas were listed that would be adversely affected by cuts in Sustainable Construction.

Strengths:

Weaknesses:


Data difficult to use since SCT is new program and was result of merge of carpentry and FME. I'm not

counting this as a strength or weakness.

B1-Collaborates with other programs and community in a unique way through SCT.

B2-Elective options for other programs would be reduced.

Strengths:

Weaknesses:

3. Productivity


•Carpentry has stable student numbers; #’s in last two years for Facilities Mgt to zero- not clear if now

in SCT- no SCT data.

•Program students and faculty build 1 new home a year.

•Service to community as time allows (playhouse, concrete floor, senior home safety upgrades, etc.).

•Teaching goals identified in strategic plan are met.

Weaknesses:

•Carpentry has stable student numbers; #’s in last two years for Facilities Mgt to zero- not clear if now

in SCT- no SCT data

Strengths:

Weaknesses:


The number of majors is relatively low.

The program asserts that it has met its instructional program goals, but data/evidence are not

presented for this.

The department acknowledged that productivity isn't measured.

in the Creative domain, the program generates one new home a year and improves numerous existing

structures.

Service is provided in the many structures that are built around the community.

Strengths:

Weaknesses:


B2&3-Does not measure "productivity."

B1&2-Build one house per year. Potential revenue when they sell a home. Also, other campus and

community projects as resources allow.

Strengths:

Weaknesses:

4. QUALITY

Page 122 of 14511/13/2017




•Data not across programs.

Carpentry has stable student numbers; #’s in last two years for Facilities Mgt to zero- not clear if now

in SCT- no SCT data

•Reports 100% job placement that appears to be in carpentry.

•3-4 Faculty have numerous certifications in relevant trade areas; awards and honors evident.

•Green building and specialty expertise represented.Program students and faculty build 1 new home a

year.

•Service to community as time allows (playhouse, concrete floor, senior home safety upgrades, etc.).

•Teaching goals identified in strategic plan are met.

Strengths:

Weaknesses:


More evidence of the quality of student outcomes could be highlighted (e.g., assessment reports, exit

and alumni surveys).

Faculty credentials were provided, but more description/explanation of quality would would have

been helpful.

As noted above, job placement is 100%.

The time to degree data were good.

Faculty have won several awards related to building.

Strengths:

Weaknesses:


B3-Not applicable.

None found.

B1-100% job placement rate. Has a "Mike Rowe" scholar in program.

B2-Highly qualified and active faculty.

Strengths:

Weaknesses:

5. EFFICIENCY


•Efficiency has created class sizes that exceed OSHA recommendations.

•No other data.Data not across programs.

•

•Merge based on efficiency appears to have good basis.

•Goals are to serve more students with better combination of skills and their impression is this is so

(double the students), as well as increase recruitment and retention.

•Able to retain FTE with no increases planned.

•Program uses centralized assistance where it can for needs (Business Office, Registrar’s Office, full-

time staff now work study on west campus).

Strengths:

Weaknesses:


There were not any examples of collaborating with other units to improve efficiency.

By merging a number of areas, this program has been able to improve enrollments.

Despite losing its administrative associate, the program faculty have taken on additional

responsibilities and worked to maintain quality.

Strengths:

Weaknesses:

Page 123 of 14511/13/2017




B1- Classroom safety put at risk due to larger classes sizes.

B1-Operations budget completely eliminated.

B3-Admin position eliminated in FY17.

B1-Reacting to budget reductions by increasing section sizes.

B2-Merged carpentry and FME to create new SCT program.

B3-Faculty fulfill administrative duties since admin position was eliminated.

Strengths:

Weaknesses:

6. OPPORTUNITY


•None apparent

•

•Program has wait-listed students.

•Ideas for program match UMVision in several areas.

Strengths:

Weaknesses:


The ideas presented in this section were good, but very few details were provided about how these

might be accomplished.

Besides the "Teaching in Place Goal," the other strategic opportunities were not addressed, and state-

wide needs were not discussed.

The program is working toward increasing online learning.

Interdisciplinarity is built into the degree.

As noted earlier, the report confidently asserts that the number of students could be doubled, and they

would still have 100% job placement.

The faculty's goal is to create a regional destination campus for building science and sustainable

construction techniques.

Strengths:

Weaknesses:


B3-Not addressed.

B1-Using strengths and expertise of program. Unit built sound booth to record courses to teach online.

B2-"Creation of shelter" is a universal concept.

B4-Increase size of program with high success rate (job placement).

Strengths:

Weaknesses:

Page 124 of 14511/13/2017

17Acad AP188 180 Electrician Helper-Cert Cert




1. ALIGNMENT


N/A

Criteria1Bullet1-Excellent response

Criteria1Bullet2-reasonable response

Criteria1Bullet3-Excellent response

Strengths:

Weaknesses:


Does not even mention the unit of analysis (Electrician Helper) by its title or explain how it fits into this

larger AAS.

•Does an excellent job of addressing the alignment for the umbrella degree.Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:

2. Demand


n/a

Criteria2Bullet1-solid response

Criteria2Bullet2-okay response

Strengths:

Weaknesses:


•Not sure where electrician helper fits into all of this.

Again, good explanation of the Sustainable Construction unit and its demand and interdisciplinary

collaborations but not this particular unit of analysis or how it fits.

Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:

3. Productivity



2 3 0.6 3 0.45 2 0.4 2 0.4 1 0.1 1 0.15 2.1Reviewer:

3Reviewer:

1 6 1.2 5 0.75 4 0.8 4 0.8 5 0.5 5 0.75 4.8Reviewer:

Page 125 of 14511/13/2017




Criteria3Bullet1-no response needed

Criteria3Bullet2-need to measure

Criteria3Bullet3-does not show how goals were "met or exceeded".

n/aStrengths:

Weaknesses:


•Uploaded the wrong central data sheet. The sheet for this unit of analysis shows no enrollment and

no explanation is offered.

•Compelling outcomes of the sustainable construction side of things.Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:

4. QUALITY


Criteria 4 - Bullet 2 states that the "consider[ing] the quality of program outcomes" the program should

"provide evidence of the quality of faculty outcomes" - the report provides no connection between the

faculty listed and the "quality of program outcomes".

Criteria4-Bullet1: This could have used more detail and support.Strengths:

Weaknesses:


•Again, nothing to address this Unit of Analysis.

•Faculty are well-credentialed.Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:

5. EFFICIENCY


n/a

Criteria 5 - Bullet 1 - good answer

Criteria 5 - Bullet 2 - excellent answer

Strengths:

Weaknesses:


•Does not address electrician helper at all.

•None provided for this Unit of AnalysisStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:

6. OPPORTUNITY

Page 126 of 14511/13/2017




Criteria 6 - Bullet 2 - did not answer question

Criteria 6 - Bullet 4 - would have benefited with a stronger answer

Criteria 6 - Bullet 1 - good answer

Criteria 6 - Bullet 3 - reasonable answer

Strengths:

Weaknesses:


•No mention of the certificate being reviewed.

•Sustainable construction aligns to the strategic vision.Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:

Page 127 of 14511/13/2017

17Acad AP188 182 Facility Management-Cert Cert




1. ALIGNMENT


1) ties to leadership and diversity are underdeveloped, and none of the four 2020 values has quantified

data to support it.

2) does not extensively detail how reductions would truly impact the rest of the university, besides a

diminishment of the areas outlined.

1) strong ties to strategic values of engagement and sustainability through its curriculum, service-

learning focus, hands-on experiences, and mission statement.

2) cites the university mission, specifically the areas of professional training, basic/applied research,

and service as reasons for its essentiality.

3) demonstrates adequate ties to social and cultural needs of the 21st century (specifically with regards

to “soft-skills” such as team-building, collaboration, diversity, and cultural awareness).

4) notes its 100% job placement rate to emphasize its workforce development efforts, and notes that

one of its biggest problems is that students are being hired before they can complete the two-year

program.

Strengths:

Weaknesses:


•Loss of funding would reduce the university’s commitment to service and technology transfer.

•Labs involved team leaders overseeing work groups

•The program serves the community by building affordable housing, repairing indigent housing and

providing accessibility modifications

•The program’s mission is building sustainable housing

•Vigorous recruitment has increased diversity in the program.

•The program provides professional training.

•Students develop social cohesion and teamwork skills

•The program has reached 100% employment for students who want to enter the labor market.

Strengths:

Weaknesses:



1 6 1.2 3 0.45 2 0.4 5 1 6 0.6 3 0.45 4.1Reviewer:

3 8 1.6 6 0.9 7 1.4 9 1.8 9 0.9 7 1.05 7.65Reviewer:

2 6 1.2 6 0.9 7 1.4 6 1.2 6 0.6 7 1.05 6.35Reviewer:

Page 128 of 14511/13/2017




•The industry hires students about ½ through the program and leads to higher attrition

•The necessity of the certificates was not addressed, which would be interesting to know since

students are being hired without completion

•Labs are structured with teams of students with leaders. Faculty coach cooperation and leadership

•Students build affordable housing, reroofed housing, and remodel homes with safety concerns

•Sustainability is in the core of the program. Core competencies remain the same but new sustainable

technologies evolve and are taught to stay relevant. Graduates should know sustainability techniques

but recognize it as essential

•Students enrolling and recruited into the program have changed in the last decade and diversity

within the program has increased

•Professional training is provided in this program, students learn to provide shelter, in a sustainable

and ecological way

•If the program were cut UM would struggle to provide technology transfer and service benefitting

local, region, state, nation and the world

•Due to the community nature of study there is social cohesion and awareness of ethnic, racial, gender

and cultural awareness follows

•Workforce development is primary goal and the program has consistently had 100% job placement in

grads wanting to enter the workforce. Workforce needs could allow for a double in enrollment and

they could maintain 100% job placement

Strengths:

Weaknesses:

2. Demand


1) no data available for SCH for Gen-Ed courses, nor SCH for GE courses per FTE, as the program

recently (2015) merged several smaller programs together to form Sustainable Construction

Technology.

2) does not extensively detail how reductions would affect other programs, other than listing lower

“students in all general education courses [for which there is no data], the welding program, and

elective options for students [in other fields]”.

1) no data available for SCH for Gen-Ed courses, nor SCH for GE courses per FTE, as the program

recently (2015) merged several smaller programs together to form Sustainable Construction

Technology.

2) notes that it has shared “students, equipment, and faculty expertise” with the following other

campus units: Theater, Business, Glacier Institute, Food Service, Facility Services, and Energy

Strengths:

Weaknesses:


•New, consolidated program has little data

•Reduction of funding would affect the welding, EVST, and reduced choices for students in EVST,

NRGY and other programs.

•The program works with the Theatre Department, the Business Entrepreneur program, Food Services,

Facility Services and others.

•Faculty members have expertise in different areas

Strengths:

Weaknesses:

Page 129 of 14511/13/2017




•Each faculty is necessary for the program to continue to exist in its current state

•By merging into SCT there are more certificates and more pathways to an AAS

•Enrollment has increased because of more diverse offerings

•Changes were made with no increases to FTE

•Students, equipment and faculty expertise have been shared with Theater, Business, Glacier Institute,

Food Service, Facility Services and the Energy Program

•Reductions would reduce elective options for the entire program

•Each faculty has specific skills and expertise and reductions would impact the entire program and the

holistic approach

Strengths:

Weaknesses:

3. Productivity


1) ranks in the lowest quintile for number of majors, with an average of 48 students per year.

2) very low five-year average of degrees awarded (0.6) and a low average student FTE/instructional

FTE ratio of 7.3.

3) The program simply notes that drops in enrollment may have coincided with a decrease in

unemployment.

4) lists some of its service achievements and projects (such as building a community playhouse or

installing handicapped ramps), but fails to list how these are tracked or measured against expectations.

5) None of the information in this section is quantified.

1) The program simply notes that drops in enrollment may have coincided with a decrease in

unemployment.

2) lists some of its service achievements and projects (such as building a community playhouse or

installing handicapped ramps), but fails to list how these are tracked or measured against expectations.

3) explains its instructional mission and objectives (e.g. “provide hands-on training programs in skilled

trades), and explains that in recent years it has met all of its goals and measures in this area.

Strengths:

Weaknesses:


•Resources limit how much service the program can perform.

•Program completes at least one new home a year, as well as improving numerous other buildings.

•The program's mission is to teach students and serve the community. The report has numerous

examples of ongoing construction projects in the community.

•The program as specific, program goals for instruction.

Strengths:

Weaknesses:


N/A

•Consistent enrollment, despite a recent dip due to anecdotal comments of uncertainty of the program

and recent changes that have been implemented and a dip in unemployment.

•At least one new home per year is created and improvements are made to other buildings

•Heavily involved in service in Missoula and the UM campus. Service with Missoula Parks and Rec, a

ramp at Fort Missoula, a concrete ramp for Facilities Services, Missoula Urban Demonstration, Human

Resource Council with affordable housing and private outreach

•Instruction meets all of the program goals for student learning objectives

Strengths:

Weaknesses:

4. QUALITY

Page 130 of 14511/13/2017




1) These outcomes could be better qualified, and many suggested areas such as assessment data or

alumni surveys are ignored.

2) Limited development to suggest the quality of faculty and students is at capacity.

1) demonstrates an average time-to-degree of 1.9 years, which would place it in the highest quintile.

2) notes its 100% placement into the workforce, and lists other achievements of its graduates,

including: creation of construction firms, one Mike Rowe Scholar, and some transfer to a four-year

program.

3) program notes some of the achievements of its faculty, including awards earned, degree

qualifications, and certifications secured.

Strengths:

Weaknesses:


•No specific tools to measure outcomes

•One-hundred percent employment for those looking for jobs

•Students have started their own construction firms and become employers

•Faculty members have multiple degrees and certifications in their fields

Strengths:

Weaknesses:


N/A

•Time to degree averages right at 2 years

•100% job placement amongst graduates who want to enter the workforce

•Graduates have gone on to own their own construction firms and become MT employers

•One student who is a Mike Rowe scholar

•A few students have gone on to earn 4-year degrees, but most enter the workforce

•All faculty have received a number of professional certifications or awards in their field

•Every faculty has external recognition

Strengths:

Weaknesses:

5. EFFICIENCY


1) ranks in the lowest quintile for UG SCH per instructional FTE (at an average of 218) and in the

second lowest for SCH per T/TT faculty (at an average of 564.6).

2) notes that none of the data in this section is relevant, as the Sustainable Construction Technology

degree is only in its second year after the merger.

1) notes that none of the data in this section is relevant, as the Sustainable Construction Technology

degree is only in its second year after the merger.

2) explains that it has lost an administrative associate, has dealt with increased courses sizes (which it

notes creates an unsafe environment for students), and has no operating budget.

3) demonstrated exceptional innovation in its decision to merge Carpentry with Facilities Management

Engineering to create the Sustainable Construction Technology program

4) is “on track to improve graduation rates and retention” but cannot verify this with data due to its

status as a new program.

5) currently only has one work study position to fulfill its administrative duties.

Strengths:

Weaknesses:

Page 131 of 14511/13/2017




•Increased class sizes because of budget cuts could be a safety issue

•No operating budget means the program can’t purchase or replace tools and supplies.

•Loss of an administrative associate in Industrial Technology has affected the program

•The program is the result of a merger, which has improved enrollment without an increase in FTE.

•Faculty have absorbed the loss of the administrative FTE by taking on additional duties.

Strengths:

Weaknesses:


N/A

•The program has maintained 4.0 FTE, but has had to increase size which can create unsafe classroom

environments

•Zero operating budget means no new tools, equipment or supplies

•Administrative Assistant III was lost due to budget cuts

•With the new merge enrollment is up and the program is on track to improve graduation rates and

retention and improvements come with no increase in faculty FTE. Increased enrollment and revenue

with no increase in FTE

•One work study helps to answer the phone and direct students, but with the loss of the one Admin

Assistant there is no liaison with main campus or the Dean’s Office

Strengths:

Weaknesses:

6. OPPORTUNITY


1) does not demonstrate strong capacity to establish UM as an interdisciplinary leader

2) does not identify one opportunity for restructuring to improve its efficiency/collaborations.

3) Specific ideas for implementation are not provided.

1) program notes its tie to the new strategic value to “meet students where they are” by providing

more online courses and lectures, and says that it generally connects well with the ‘economic

development goals” of the plan.

2) states that it could double its enrollment and maintain its 100% job placement, and simply needs

resources for recruitment and potentially faculty/facilities if successful.

Strengths:

Weaknesses:


•N/A

•The program is developing online courses.

•The program serves a community need for shelter

•The program could become the hub of a regional center for building science and sustainable

construction.

•The program says with additional resources, faculty and facilities, it could double its enrollment and

still not fully meet the demand for construction workers.

Strengths:

Weaknesses:

Page 132 of 14511/13/2017




•Only one of the Strategic Vision pieces addressed

•No tangible evidence or ideas in how they plan to achieve goals were provided

•Working to increase online learning (students created a studio to record lectures)

•State wide needs are met by creating graduates who can provide shelter through sustainable means.

This is also done through interdisciplinary models within the program

•Goal is to create a regional destination campus for building science and sustainable construction

•If the program doubled in size job placement could remain at 100%, but they need additional

resources to help with recruitment and additional faculty lines to support the program

Strengths:

Weaknesses:

Page 133 of 14511/13/2017

17Acad AP188 183 Green Building-Cert Cert




1. ALIGNMENT


Lack of justification overall for need of program to meet UM's mission.

Program aligns well with sustainability efforts of UM2020. Also aligns with mission for professional

training. Program also demonstrates anecdotally the improvement in diversity recruitment.

Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:


NM

The program appears to align with UM2020. It provides a dynamic learning environment and engages

students in sustainable construction practice.

Strengths:

Weaknesses:

2. Demand


The is still overall low enrollment and use of SCH in an interdisciplinary sense.

The demand of the program seems to be trending upwards with declining enrollment.Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:


SCT is only in its 2nd year and is missing support data. Since SCT merged with FME there should be a

way to collect some data for the aspects of this program that existed previously.

Author indicates reduction in students. May be result of strong economy (low unemployment),

uncertainty in program survival due to budget cuts, or a combination of both.

Appears to be economic demand for graduates in the construction industry.Strengths:

Weaknesses:

3. Productivity



2Reviewer:

3 6 1.2 4 0.6 4 0.8 4 0.8 4 0.4 4 0.6 4.4Reviewer:

1 3 0.6 2 0.3 2 0.4 2 0.4 5 0.5 2 0.3 2.5Reviewer:

Page 134 of 14511/13/2017




There is no depth or data to prove productivity. Also, the author states ,any students don't complete

program because they entire workforce without a degree.

The job placement rate that is also anecdotal is 100%.Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:


Missing centralized data to support one way or the other.

Authors claim strength in time to graduation - no evidence provided.Strengths:

Weaknesses:

4. QUALITY


No depth to explanation of time to degree, or job placement assessment.

Some years the average was at or below 2 years.Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:


not much data or evidence provided.

Author claims 100 percent placement - seems reasonable in current construction environment.Strengths:

Weaknesses:

5. EFFICIENCY


Lack of depth in assessment,

Increased course size with fewer faculty and staff for program. Combined with other programs to form

current program. This is a good indicator if efficiency efforts.

Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:


reductions in general funding limit the programs ability to acquire needed tools for training.

combined the SCT and FME programs into one department.

Program is only in second year so data is limited.

Strengths:

Weaknesses:

6. OPPORTUNITY

Page 135 of 14511/13/2017




Did not reference strategic vision 1.1 or possible efforts to align with new vision.

Could double number of students in program and keep job placement rating.Strengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:


any expansion would appear to need financial support in a time when financial support has been

reduced.

According to author, demand for graduates is high and resources might allow program to expand - but

supporting data is weak or non-existent.

Program is only two years old, program would have been vetted in the ASCRC approval process -

more time is needed to collect information on demand, productivity, efficiency and quality.

Strengths:

Weaknesses:

Page 136 of 14511/13/2017

17Acad AP188 188 Sustainable Construction Technology-2Y 2Y




1. ALIGNMENT


•None seen.

•The Sustainable Construction Technology program aligns very well with all values of UM2020.

•The SCT program provides essential training in creating Shelter, with various aspects supporting

UM’s mission.

•The nature of team building in SCT brings together diverse students who bond in social as well as

professional groups.

•The program provides skilled, well-trained workers for the workforce needs.

Strengths:

Weaknesses:


50% attrition as students are hired before they finish the program.

Aligned well with UM2020, i.e. leadership, engagement, sustainability, diversity.

100% job placement for graduates.

Definitely meeting local workforce needs.

Strengths:

Weaknesses:


would have liked more details on actually how many women and students of color are in the program;

would have liked more robust discussion of connection to UM mission; would have liked to have seen

more discussion of full sets of skills developed in program;

good evidence of service learning; strong connection to sustainability; good connection to diversity;

solid connection to UM mission; strong placement record;

Strengths:

Weaknesses:

2. Demand


•None seen.

•The program was created last year by the combination of Carpentry and facilities management

engineering, so central data are limited.

•Collaborations exist with several departments on the Mountain campus (Theater, Business, etc.).

Additional opportunities would be possible with increased funding.

•Because of the collaborative nature of the program, a decrease in funding would have a wide-spread

inpact.

Strengths:

Weaknesses:



1 7 1.4 7 1.05 7 1.4 8 1.6 6 0.6 8 1.2 7.25Reviewer:

2 7 1.4 6 0.9 6 1.2 5 1 5 0.5 6 0.9 5.9Reviewer:

3 7 1.4 5 0.75 3 0.6 3 0.6 9 0.9 2 0.3 4.55Reviewer:

Page 137 of 14511/13/2017




N/A

Merging Carpentry and Facilities Management Education (FME) created more career

options/pathways for students.

Program collaborates with several UM departments on building projects.

Reductions would impact several other departments.

Strengths:

Weaknesses:


would have liked to have seen much more discussion of negative impacts; very thin treatment

solid connection to other programs; solid discussion of impact;Strengths:

Weaknesses:

3. Productivity


•No clear, objective measurements can be enumerated other than project completions.

•The ability of this program to provide service to UM and the community is only limited by time and

resources. Several projects are completed every year benefitting several public resources.

•The instructional objectives are being met.

Strengths:

Weaknesses:


Datasheet information is only from Carpentry.

Important service/outreach activities that have positive impact for on-and off-campus entities.Strengths:

Weaknesses:


very hard to assess productivity; how does one home a year compare to other comparable programs?;

need more discussion of actually how many projects are done on an annual basis; very thin discussion

of meeting program goals; needs evidence of how those goals have been met

good evidence of connection to the community;Strengths:

Weaknesses:

4. QUALITY


•None seen.

•100% of graduates who want to enter workforce are employed, some becoming employers

themselves. Other students have won awards.

•Faculty are recognized for their excellence in their fields.

Strengths:

Weaknesses:


N/A

Employment outcomes very positive (100%).

Graduates participating in entrepreneurship activities/small business ownership.

Well-qualified faculty.

Strengths:

Weaknesses:


need much more detail on specifics of student outcomes; lists of certification does not seem an

adequate measure of out comes

evidence in student outcomes includes some specifics; glad to see mention of one award in faculty

outcomes; great job placement rate

Strengths:

Weaknesses:

Page 138 of 14511/13/2017



5. EFFICIENCY


•Budget cuts have forced an increase in class size to where it impacts student safety.

•Lack of budget has limited the ability to purchase supplies, reducing the instructional opportunities

fro students.

•Admin cuts negatively affected the ability for the West Campus to communicate with the East

Campus.

•Budget cuts at MC created the need to combine programs, with a good outcome in the form of this

new program.

Strengths:

Weaknesses:


N/A

Merging Carpentry and FME programs (with no extra FTE) increased enrollment and created more

options for students.

Faculty have taken on administrative responsibilities because of loss of Administrative support FTE.

Strengths:

Weaknesses:


none noticeable – clearly doing very important work with very little

impacts on instruction is very disturbing; appear to be doing very much with very littleStrengths:

Weaknesses:

6. OPPORTUNITY


•None seen.

•Increased on-line learning is a goal to allow learning in place.

•Improved ability to create shelter using sustainable construction techniques addresses the new Vision

as well.

•The program is fully enrolled. Increased resources would provide training for additional students in

this 100% of graduates employed program.

Strengths:

Weaknesses:


Partially addressed contributing to the Strategic Vision document, i.e. briefly mentioned partner with

place and meeting workforce needs. More information would have provided more context.

Built a recording studio to record lectures and increase online learning.

Potential to become regional destination campus and increase enrollment.

Strengths:

Weaknesses:


need much more robust discussion, discussion of restructuring and allocation of additional resources

very thin; needs much more discussion and attention in all bullet points in this section

good to see movement toward on-line instruction;Strengths:

Weaknesses:

Page 139 of 14511/13/2017

17Acad AP189 189 Welding Technology-2Y 2Y



1. ALIGNMENT


1. Provides a lot of non-specific information

1. Works to make students more employable by emphasizing critical thinking

2. Students are awarded technical endorsements

Strengths:

Weaknesses:


Nothing on sustainability or diversity.

The report writer does not consider the program in alignment with the UM Mission.

Leadership and engagement addressed.

Although the author does not address diversity in this section, it is partially addressed under

productivity as Outreach. There are two programs that are meant to empower women and girls to

pursue this trade. Since the outreach efforts started, the number of women enrolled in this program

tripled from 2 to 6.

This program is aimed to address workforce needs.

Strengths:

Weaknesses:


discussion of leadership and engagement is very general and does not address all the elements of the

strategic plan; discussion of mission does not directly address how the program is essential to UM as a

school; section has several grammatical errors; discussion of workforce needs very thin; again includes

several grammatical errors

nice connection with Harris Thermal;Strengths:

Weaknesses:

2. Demand


1. Weak cross disciplinary demand- however that is difficult for a small, specialized program to achieve

1. Courses contribute to 3 other technical programs

2. Has dual enrollment credit for high schoolers

Strengths:

Weaknesses:



3 2 0.4 3 0.45 4 0.8 4 0.8 6 0.6 2 0.3 3.35Reviewer:

1 4 0.8 6 0.9 7 1.4 5 1 8 0.8 6 0.9 5.8Reviewer:

2 5 1 5 0.75 4 0.8 6 1.2 7 0.7 8 1.2 5.65Reviewer:

Ranking Category:




Total Count: 15

Page 140 of 14511/13/2017




-

Collaboration with local high schools to offer dual credit.

The skills offered in this program add value to other programs by providing an additional training

component.

Strengths:

Weaknesses:


very low participation rates from local high schools; discussion of impact cursory and needs much

more development.

helpful description of credentials;Strengths:

Weaknesses:

3. Productivity


1. Small, specialized programs are hard to track- the quintiles are low, but show strong improvement

in their trends for this criteria

1. Works to encourage women to join the trade by partnering with the YMCA- overall, 8 students were

enrolled as a result

2. Many students receive American Welding Society Certificates

Strengths:

Weaknesses:


Low number of majors, degree awarded, and. student FTE/instructional FTE ratio. (2, 2, 1)

5 YR trend in all areas are in the 5th quintile.

The outreach programs UTS and GRIT have stimulated an increase of women participating in this

program. The report writer states that the AWS certificates awarded has tripled in the last 5 years.

Central data does not match this with the number of students who have completed the program.

Strengths:

Weaknesses:


very low enrollment numbers overall; missing any discussion of professional or scholarly productivity

great program serving girls in the field; good growth in completion of certificatesStrengths:

Weaknesses:

4. QUALITY


1. N/A

1. Several student's capstone projects have won the Lincoln Electric Career Project Competition

2. Faculty members are certified welding inspectors by the American Welding Society

Strengths:

Weaknesses:


-

This is a 2 year degree and on average, students complete this just under 2 years.

Students regularly win in the Lincoln Electric Career Project competition.

There is a certification standard for instructors and local industry has a “high degree of input and

participation in relation to the welding program development.”

Strengths:

Weaknesses:

Page 141 of 14511/13/2017




but the competition is entirely internal to the program, thus not a clear indicator of success in the larger

welding community; but missing a sense of the larger accomplishments of the welding faculty

good discussion of competition; good discussion of certification and accreditation of instructorsStrengths:

Weaknesses:

5. EFFICIENCY


N/A

1. Partnering with Miller Electric was beneficial to students and saved a lot of money for the program

2. See criteria 5, bullet 2

Strengths:

Weaknesses:


This. Program is falling behind in maintaining necessary equipment. Money raised to support this

program has been siphoned to “cover additional expenses not related to the Missoula Welding

Program.”

Partnership has been created between Miller Electric and Missoula College Welding that has enabled

the program to become a

Miller Welding Testing Center”. This provides students access to state of the art equipment at no cost

while potential customers of Miller distributors are able to try the equipment.

Strengths:

Weaknesses:


missing any discussion of administrative FTE

strong evidence of collaboration with Miller Welding; great cost savings; impressive that the program

has found a way to move forward without the benefit of state funds for purchasing and repairing

equipment

Strengths:

Weaknesses:

6. OPPORTUNITY


1. Provides little information about how they could cut costs- however, they already have saved a vast

amount of money by partnering with Miller electric

1. Could offer an introductory class available to all students

2. Could allow students to achieve a credential in one semester

Strengths:

Weaknesses:


-

This program provides a rounded skill set so that students are not “constrained to one position in a

workplace” once they complete the program. Program provides several examples where they already

partner with Place.

There is an opportunity to restructure the program to meet Gen-Ed requirements and open this skill up

to all students at UM. This could also provide an opportunity to expose welding student to higher

education.

Strengths:

Weaknesses:

Page 142 of 14511/13/2017




does not discuss the creating change together document; section has multiple grammatical errors; not

clear how bullet labeled “restructuring the program” is actually restructuring; no discussion of

allocation of additional resources or interdisciplinary inquiry

great anecdote about making a menorah for the local Jewish communityStrengths:

Weaknesses:

Page 143 of 14511/13/2017

AP197 197 Entrepreneurship-Cert Cert



No Report Submitted

1. ALIGNMENT


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:


No information provided


Weaknesses:

2. Demand


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:


Trend for metric 3 is declining, drop from 9104 in 2013 to 5474 in 2017. • No other information on

FTE data sheet

· Quintile 3 for 5 YA of SCH for Gen-Ed courses, 2017 highest with 900, up from 681 in 2016 •

Quintile 3 for 5 YA of SCH ratio of non-majors to total –Weaknesses:

Strengths:

Weaknesses:

3. Productivity


No review

No reviewStrengths:

Weaknesses:



1Reviewer:

2Reviewer:

3 1 0.2 2 0.3 1 0.2 1 0.2 1 0.1 1 0.15 1.15Reviewer:

Page 144 of 14511/13/2017




No review

No reviewStrengths:

Weaknesses:


· No information provided

· No information providedStrengths:

Weaknesses:

4. QUALITY


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:




Weaknesses:

5. EFFICIENCY


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:




Weaknesses:

6. OPPORTUNITY


No review

No reviewStrengths:

Weaknesses:


No review

No reviewStrengths:

Weaknesses:

Page 145 of 14511/13/2017






Weaknesses:

Page 146 of 14511/13/2017

Documents

Total Count: 16 - University of Montana · Reviewer Score Weight Score Weight Score Weight Score Weight Score Weight Score Weight Total ... Technology (AP #158) Strengths: None seen