Report of Outcomes Assessment Results · Does your current outcomes assessment plan include student learning assessment ... Learning: Performance Objectives (Targets ... conciseness

1

Report of Outcomes Assessment Results

Institution: Eastern Oregon University

Academic Business Unit: College of Business

Academic Year: 2015-2016

International Assembly for Collegiate Business Education 11374 Strang Line Road Lenexa, Kansas 66215

USA In

tern

ati

on

al

Ass

em

bly

fo

r C

oll

eg

iate

Bu

sin

ess

Ed

uca

tio

n

Inte

rna

tio

na

l A

sse

mb

ly f

or

Co

lle

gia

te B

usi

ne

ss E

du

cati

on

2

Outcomes Assessment 1. Do you offer any majors, concentrations, specializations, emphases, options, or tracks as part of

your business programs?

X Yes. If yes, proceed to item 2 below.

No. If no, proceed to item 4 below. 2. Do your majors, concentrations, specializations, emphases, options, or tracks appear on students’

transcripts, diplomas, diploma supplements, or other official records of program completion?


No. If no, proceed to item 4 below. 3. Does your current outcomes assessment plan include student learning assessment information for

all majors, concentrations, specializations, emphases, options, and tracks contained within your business programs?


No. If no, please submit a revised outcomes assessment plan with your interim report that addresses student learning

assessment for all majors, concentrations, specializations, emphases, options, and tracks comprising any portion of your business programs. Information about this requirement can be found on the IACBE website at the following address: www.iacbe.org/oa-key-areas.asp.

4. Is the outcomes assessment plan that you submitted to the IACBE still current or have you made

changes?

X The outcomes assessment plan that we have previously submitted is still current.

Changes have been made and the revised plan is attached.

We have made changes and the revised plan will be sent to the IACBE by:

3

Outcomes Assessment Results For Academic Year: 2015-2016

Section I: Student Learning Assessment

Intended Student Learning Outcomes for the Bachelor of Science/Art in Business Administration (BADM):

General Program Intended Student Learning Outcomes (General Program ISLOs)

1. Students in the Business Administration degree program will demonstrate functional knowledge of the concepts, vocabulary, principles and practices that are commonly used in the business environment.

2. Students in the Business Administration degree program will demonstrate advanced communication skills using appropriate methodologies and technologies.

3. Students in the Business Administration degree program will demonstrate critical thinking and analytical reasoning skills.

4. Students in the Business Administration degree program will demonstrate an ability to incorporate diverse cultural perspectives, and ethical reasoning and action into decision making processes.

5. Students in the Business Administration degree program will demonstrate the ability to design and carry out an individual project that emphasizes practical applications of business concepts.

Intended Student Learning Outcome: Concentration in Leadership, Organization and Management (LOM)

1. Students completing the LOM concentration will be able to demonstrate knowledge of core management concepts.

Intended Student Learning Outcome: Concentration in Marketing

1. Students completing the Marketing concentration will be able to demonstrate knowledge of core marketing concepts.

Intended Student Learning Outcome: Concentration in Accounting

1. Students completing the Accounting concentration will be able to demonstrate knowledge of core accounting concepts.

Assessment Instruments for Intended Student Learning Outcomes— Direct Measures of Student Learning:

Performance Objectives (Targets/Criteria) for Direct Measures:

1. Direct Measure - Comprehensive End of Program exam (Peregrine Academic Services).

Objective (Target/Criterion) for Direct Measure 1

80% of students will score 50% or higher on the exam related to Core ISLOs assessed by this measure and, in their particular concentrations, will score at least 80% on each subset of examination questions related

General Program ISLOs Assessed by this Measure: 1,2,3,4,5

4

LOM ISLO Assessed by this Measure: 1

Marketing ISLO Assessed by this Measure: 1

Accounting ISLO Assessed by this Measure: 1

to each of the concentration ISLOs assessed by this measure.

2. Direct Measure – Civic Engagement and Ethics Exercise required of all students (BA 411)

General Program ISLOs Assessed by this Measure: 4


80% of students will achieve a score of 3 or above using the scoring rubric of this ISLO.

3. Direct Measure - Comprehensive Capstone Research Paper (BA 419 and BA 498) required of all students and Concentration Capstone Case Studies (BA 462, BA 464, BA 419)


80% of students will achieve a score of 3 or above using the scoring rubric of this ISLO.





Assessment Instruments for Intended Student Learning Outcomes— Indirect Measures of Student Learning:

Performance Objectives (Targets/Criteria) for Indirect Measures:

1. Indirect Measure - Student Exit Surveys Objective (Target/Criterion) for Indirect Measure 1

80% of students will indicate that they “agree” or “strongly agree” at the end of the program in achieving each of the core ISLOs assessed by this measure and, in their particular concentrations, “agree” or “strongly agree” in achieving each of the concentration ISLOs assessed by this measure.





2. Indirect Measure - Student Capstone course evaluations. Objective (Target/Criterion) for Indirect Measure 2

80% of students will indicate that they “agree” or “strongly agree” at the end of the program in achieving each of the core ISLOs assessed by this measure and, in their particular concentrations, “agree” or “strongly agree” in achieving each of the concentration ISLOs assessed by this measure.





5

Assessment Results: BADM

Summary of Results from Implementing Direct Measures of Student Learning:

1. A total of 145 students completed the Peregrine CPC exam from July 1, 2015 through June 30, 2016. The average score on the exam was 52.52%. 78/145 students (54%) scored 50% or higher on the exam. Data was not provided that would allow us to break out results by concentration.

2. A total of 229 students were assessed on their ability to incorporate diverse cultural perspectives and ethical reasoning into decision making processes. Overall, 91.02% of students scored 3 or above on the rubric used to assess this student learning outcome.

3. A total of 221 students were assessed using the comprehensive capstone research paper that is the signature assignment in BA 498 and BA 419. Of those, 98.0% of students scored 3 or above on the rubric used to assess all five student learning outcomes.

Summary of Results from Implementing Indirect Measures of Student Learning:

1. 83 students participated in the voluntary exit survey for the College of Business. Of those, 90.3% responded “agree” or “strongly agree” when asked to rate the program’s success in regard to the ISLOs.

2. 83 students participated in the voluntary exit survey for the College of Business. Of those, 97% responded “agree” or “strongly agree” when asked to rate the program’s capstone course evaluations.

Summary of Achievement of Intended Student Learning Outcomes:

Intended Student Learning Outcomes Learning Assessment Measures

General Program ISLOs

Peregrine CPC Exam

BA 411 Civic Engagement

Exercise

Capstone Research

Paper

Student Exit Surveys

Capstone Course Evaluation

Performance Target Was…





1. Students in the Business Administration degree program will demonstrate functional knowledge of the concepts, vocabulary, principles and practices that are commonly used in the business environment.

Not Met Met Met Met Met

2. Students in the Business Administration degree program will demonstrate advanced communication skills using

N/A N/A Met N/A Met

6

appropriate methodologies and technologies.

3. Students in the Business Administration degree program will demonstrate critical thinking and analytical reasoning skills.

N/A N/A Met Met Met

4. Students in the Business Administration degree program will demonstrate an ability to incorporate diverse cultural perspectives, and ethical reasoning and action into decision making processes.

N/A Met Met N/A Met

5. Students in the Business Administration degree program will demonstrate the ability to design and carry out an individual project that emphasizes practical applications of business concepts.

N/A N/A Met N/A Met

Intended Student Learning Outcomes: Concentrations

Peregrine CPC Exam

Conc. Capstone

Case Study

Student Exit Survey

Capstone Course Evaluation





1. LOM N/A N/A N/A Peregrine report insufficient to

determine data by concentration

2. Marketing N/A N/A N/A Peregrine report insufficient to


3. Accounting N/A N/A N/A Peregrine report insufficient to


Proposed Courses of Action for Improvement in Learning Outcomes for which Performance Targets Were Not Met:

1. Peregrine Exit Exam – our goal is that 80% will score 50% or higher. Only 54.0% scored 50% or higher. The Peregrine exam has not been “required” test (extra credit) and students report being uninformed about the exam. The test format does not allow teasing out information by concentration so use of the exam will be reviewed. It is intended that the test will be required going forward and becomes part of the syllabus assignments and Peregrine test versions specific to each concentration will be assigned in the future.

7

Intended Student Learning Outcomes for Master of Business Administration:

General Program Intended Student Learning Outcomes (General Program ISLOs)

1. Students will demonstrate quantitative literacy using appropriate concepts, methodologies, and techniques.

2. Students will demonstrate critical thinking and analytical reasoning skills through integrated problem solving in core business areas.

3. Students will effectively communicate complex business issues with conciseness and clarity, demonstrating proficiency in both written and oral communications.

4. Students will effectively recognize, analyze and develops solutions to ethical dilemmas in the professional environment.

5. Students will effectively participate in results producing teams.

Assessment Instruments for Intended Student Learning Outcomes— Direct Measures of Student Learning:

Performance Objectives (Targets/Criteria) for Direct Measures:

1. Direct Measure 1 - Project - BA 540 Objective (Target/Criterion) for Direct Measure 1

80% of students score 3 or better on all criteria using the scoring rubric of this ISLO.


2. Direct Measure 2 - Case analysis - BA 580




3. Direct Measure 3 - Oral presentation and written report - BA 515




4. Direct Measure 4 - Research report - BA 560




5. Direct Measure 5 - Group Project - BA 515 Objective (Target/Criterion) for Direct Measure 5



Assessment Instruments for Intended Student Learning Outcomes— Indirect Measures of Student Learning:

Performance Objectives (Targets/Criteria) for Indirect Measures:

1. Indirect Measure 1 - Student Course Evaluations Objective (Target/Criterion) for Indirect Measure 1

8

General Program ISLOs Assessed by this Measure: 1,2,3,4,5 80% of students completing the program courses will indicate that they are “agree” or “strongly agree” that they have achieved each of the core ISLOs assessed by this measure.

2. Indirect Measure 2 - Alumni Survey Objective (Target/Criterion) for Indirect Measure 2

80% of alumni will indicate that they are “successful” or “very successful” in achieving each of the core ISLOs assessed by this measure.


Assessment Results: MBA

Summary of Results from Implementing Direct Measures of Student Learning:

1. 33 students completed BA 540 during spring of 2016, and were assessed on their ability to demonstrate quantitative literacy . Of these, 93.09% scored 3 or above on all of the criteria in the scoring rubric.

2. 18 students completed BA 580 during summer of 2016, and were assessed on their ability to demonstrate critical thinking and analytical reasoning. Of these, 100% scored 3 or above on all of the criteria in the scoring rubric.

3. 33 students were assessed in BA 515 in the summer of 2015, and were assessed on their written and oral communication skills. Of these, 94.12% scored 3 or above on all criteria in the scoring rubric.

4. 30 students completed BA 560 during winter term 2016, and were assessed on their ability to effectively recognize, analyze and develops solutions to ethical dilemmas in the professional environment. Of these, 96.77% scored 3 or better on all criteria on the scoring rubric.

5. 33 students completed BA 515 during summer term scored 3 or better on the rubric which assessed their ability to participate in results-producing teams. Of these, 100% scored 3 or better on all criteria on the scoring rubric.

Summary of Results from Implementing Indirect Measures of Student Learning:

1. 100% of respondents indicated either “successful” or “very successful” in achieving each of the core ISLOs.

2. A very low response rate to the MBA Alumni survey has produced statistically insignificant data. No meaningful conclusions may be drawn.

Summary of Achievement of Intended Student Learning Outcomes:

Intended Student Learning Outcomes Learning Assessment Measures

General Program ISLOs

Project

BA 540

Case Analysis

BA 580

Presentation & Report

BA 515

Research Report

BA 560

Group Project

BA 515

Student Course Evaluation Alumni Survey






Performance Target Was… Performance Target Was…

1. Students will demonstrate quantitative literacy using appropriate concepts,

Met N/A N/A N/A N/A

Met No data

available

9

methodologies, and techniques.

2. Students will demonstrate critical thinking and analytical reasoning skills through integrated problem solving in core business areas.

N/A Met N/A N/A N/A

Met No data

available

3. Students will effectively communicate complex business issues with conciseness and clarity, demonstrating proficiency in both written and oral communications.

N/A N/A Met N/A N/A Met No data available

4. Students will effectively recognize, analyze and develops solutions to ethical dilemmas in the professional environment.

N/A N/A N/A Met N/A Met No data available

5. Students will effectively participate in results producing teams.

N/A N/A N/A N/A Met Met No data available

Proposed Courses of Action for Improvement in Learning Outcomes for which Performance Targets Were Not Met:

1. Alumni Survey: The response rate is very low. Likely an ineffective measure absent some change in data collection methodology. This will be discussed in the fall convocation meetings dedicated to closing the loop.

10

Section II: Operational Assessment (Note: Complete this section only if you received first-time accreditation or reaffirmation of accreditation after

January 1, 2011.)

EOU College of Business

Operational Assessment

Intended Operational Outcomes:

1. Curricula include the skills, knowledge and experiences that are responsive to student and employer needs and show parity with comparator

institutions.

2. Programs incorporate civic engagement opportunities for students through projects with faculty and/or community members.

3. The administration recruits and retains qualified, student-centered faculty and staff.

4. Student support functions (e.g. delivery modalities, class scheduling, and advising) facilitate student matriculation.

5. Operations are managed efficiently using a cost-center approach where resources follow enrollments, faculty needs, and program requirements.

Assessment Measures/Methods for Intended Operational Outcomes: Performance Objectives (Targets/Criteria) for Operational Assessment Measures/Methods:

1. Operational Assessment Measure/Method 1 Objective (Target/Criterion) for Measure/Method 1

Each year, 90% of these meetings/reviews will occur monthly during the 9-month academic year.

Curriculum review

Operational Outcome assessed by this measure: 1


80% of students will achieve a score of 3 or above using the scoring rubric.

Civic Engagement Exercise required of all students (BA 411)



80% of faculty who pursue tenure/promotion obtain it

80% satisfaction rate (4 or 5) on quality of teaching on student course evaluations

Tenure and Promotion Rates

Student Course Evaluations



80% of students will rate satisfaction at 4 or above on the scale. Student exit survey


11


Parity. Percentage of money allocated to COB versus SCHs generated by COB


Summary of Results from Implementing Operational Assessment Measures/Methods:

1. The Curriculum Committee met 17 times during the academic year and minutes from those meetings are available for review.

2. Met: 91.02% of students achieved a score of 3 or above on the scoring rubric. A civic-engagement exercise is a required component of BA 411 (Business Ethics & Society), which Is a core requirement for the Bachelor’s degree in Business Administration.

3. Met: 100% promotion rate, and 90% satisfaction rate (4 or 5) on quality of teaching on evaluations.

4. Not Met: 64 of 83 respondents reported “agree” or “strongly agree” (4 or 5) (77.11%).

5. Met: SCH and FTE are monitored by the administration team within the College of Business.

Summary of Achievement of Intended Operational Outcomes:

Intended Operational Outcomes

Operational Assessment Measures/Methods

Curriculum Review

Civic Engagement

Exercise

Tenure & Promotion

Rates

Student Course

Evaluations

Student Exit Survey

Budget & Enrollment

Data







1. Curricula include the skills, knowledge and experiences that are responsive to student and employer needs and show parity with comparator

institutions.

Met N/A N/A N/A N/A N/A

2. Programs incorporate civic engagement opportunities for students through projects with faculty and/or community members.

N/A Met N/A N/A N/A N/A

3. The administration recruits and retains qualified, student-centered faculty and staff.

N/A N/A Met Met N/A N/A

12

4. Student support functions (e.g. delivery modalities, class scheduling, and advising) facilitate student matriculation.

N/A N/A N/A N/A Not Met N/A

5. Operations are managed efficiently using a cost-center approach where resources follow enrollments, faculty needs, and program requirements.

N/A N/A N/A N/A N/A Met

Proposed Courses of Action for Improvement in Operational Outcomes for which Performance Targets Were Not Met:

1. 16 of 83 students rated 3 (neutral) (19.27%). 1 of 83 rated 2 (disagree) (1.2%). 2 of 83 students rated 1 (strongly disagree) (2.41%). This is a very small sample size collected from the Peregrine test compared to the BADM graduation numbers (nearly 200). Requring the Peregrine test rather than “extra credit” should yield a larger sample size. In the meantime, a committee will review scheduling and draft an improved course schedule optimized for the program. The business corriculum committee will begin a review of courses in order to determine whether current course offerings are still relevant and being taught efficiently.

Documents

Report of Outcomes Assessment Results · Does your current outcomes assessment plan include student learning assessment ... Learning: Performance Objectives (Targets ... conciseness