22
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016 BUAD ASSESSMENT RESULTS 2015 / 2016 ACADEMIC YEAR

BUAD ASSESSMENT RESULTS 2015 / 2016 … Assessment Report...BUAD ASSESSMENT RESULTS 2015 / 2016 ACADEMIC YEAR BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016 I ASSESSMENT CONTENT

Embed Size (px)

Citation preview

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

BUAD ASSESSMENT RESULTS

2015 / 2016 ACADEMIC YEAR

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

I ASSESSMENT CONTENT

ASSESSMENT AREA WHAT IS DONE 1 Oral Rubric BUAD348: applies the rubric to a presentation assignment during the semester

BUAD499: applies the rubric to the policy project presentation at the end of the semester

2 Capstone Project Ratings - Oral Communications BUAD 499 Business Policy Project Presentation Evaluation Form

3 Capstone Project Ratings - Critical Thinking BUAD 499 Business Policy Project Presentation Evaluation Form

4 Critical Thinking - Ratio Analysis Problem BUAD 225 Accounting II o Ratio analysis problem to test critical thinking skills. BUAD342 Corporate Finance o Cost of capital problem

5 MFT - Legal & Social Environment Administered week after break – Fall / Spring

6 Ethics Project in Marketing BUAD 233 Marketing Management - Ethics project

7 MFT - Economics & International Issues Administered week after break – Fall / Spring

8 Capstone Project Ratings - Entry Decision & Analytical Tools

BUAD 499 Business Policy Project Presentation Evaluation Form

9 Global Test Questions in POM BUAD348 Production & Operations Mgmnt - Global supply chain case analysis

10 Internships Supervisor Assessment at the end of the assignment Internship director assessment at the end of the assignment

11 Capstone Project Ratings - Accounting & Finance BUAD 499 Business Policy Project Presentation Evaluation Form

12 Capstone Project Ratings - Marketing BUAD 499 Business Policy Project Presentation Evaluation Form

13 Capstone Project Ratings - Management BUAD 499 Business Policy Project Presentation Evaluation Form

14 Capstone Project Ratings - Management Science BUAD 499 Business Policy Project Presentation Evaluation Form

15 Capstone Project Ratings - Information & Systems BUAD 499 Business Policy Project Presentation Evaluation Form

16 MFT - Accounting & Finance Administered week after break – Fall / Spring 17 MFT - Marketing Administered week after break – Fall / Spring 18 MFT - Management Administered week after break – Fall / Spring 19 MFT - Management Science Administered week after break – Fall / Spring 20 MFT - Information Systems Administered week after break – Fall / Spring 21 Embedded Exam Questions - Accounting & Finance BUAD 215 Accounting I – 20 questions on final exam

BUAD 225 Accounting II – 15 questions in individual topic exams BUAD 342 Corporate Finance Assessment Questions

22 Embedded Exam Questions - Marketing BUAD233 Marketing Management - 10 questions on final exam

23 Embedded Exam Questions - Management BUAD254 Org. Behavior - 11 questions on final exam BUAD499 - 5 questions on final exam

24 Embedded Exam Questions - Management Science BUAD348 Production Operations – 20 Assessment Questions BUAD248 Quantitative Methods – 20 Assessment Questions

25 Embedded Exam Questions - Information Systems BUAD258 Information Systems I – 10 questions on final exam

26 Written Rubric BUAD254: applies the rubric to a written assignment during the semester BUAD499: applies the rubric to the policy project presentation at the end of the semester

27 Capstone Project Ratings - Written Communications BUAD 499 Business Policy Project Presentation Evaluation Form

28 Senior Survey Senior survey is administered to all seniors when they take BUAD499 policy.

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

II PROCESS

WHAT WHEN OWNER

1 The faculty is reminded that individual assessment programs are to be executed. This is placed on department meeting agenda’s and discussed at the meeting

Prior to the end of each semester

Assessment coordinator

2 Embedded testing: Each individual faculty member conducts the testing in their classroom using the designated materials established for the particular course and it’s measurements

Final exam or mid course assignments

Faculty

3 Embedded testing: Each faculty member provides the collected test data to the assessment coordinator

Following administering

Faculty

4 MFT testing is conducted – target is the week after Fall and Spring break

Week after college break – Fall / Spring

Assessment coordinator

5 Policy presentations are made and rating sheets are completed by reviewers (internal / external) and provided to the assessment coordinator

Last week of classes

K Baker

6 Graduating student survey results are provided (taken by all graduating seniors)

End of semester report

Statistical coordinator

7 Internship data is provided End of semester Internship coordinator

8 The received data is entered to the master tracking spreadsheet

End of semester Assessment coordinator

9 The data is entered to WEAVE which is the college system for assessment data collection

Mid June (as directed)

Assessment coordinator

10 Any faculty whose data does not meet the standards are assigned to establish a plan of action to be implemented.

Mid June – as part of assessment report

Department Chair Assessment coordinator

11 A report is generated for the year end results – Prior to start of next semester

Target September of academic year

Assessment coordinator

12 The report is attached to the WEAVE system for record retention

Target September of academic year

Assessment coordinator

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

III LEARNING OUTCOMES AND MEASURES

ORAL COMMUNICATIONS

Oral rubric o BUAD348 Production & Operations Management o BUAD499 Business Policy

Site Supervisor – Internship

Capstone Project presentation rating – oral presentation

WRITTEN COMMUNICATIONS

Written rubric o BUAD254 Organizational Behavior o BUAD499 Business Policy

Site Supervisor – Internship

Capstone Project presentation rating – Written skill

EXTERNAL / GLOBAL FORCES

Test questions o BUAD348 Production & Operations Management

CRITICAL THINKING

Ratio analysis problem o BUAD225 Accounting II

Cost of Capital problem o BUAD342 Corporate Finance

Site supervisor – Internship

Capstone Project presentation rating – Critical thinking

ETHICAL REASONING

Ethics problem o BUAD233 Marketing Management

Site supervisor – Internship

MFT sections o Legal & social issues

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

ACCOUNTING & FINANCE

Embedded questions – final exam o Buad215 Accounting I o BUAD225 Accounting II o BUAD342 Corporate Finance

MFT sections o Accounting & finance

Capstone project rating – accounting & finance

MARKETING

Embedded questions – final exam o Buad233 Marketing Management

MFT sections o Marketing

Capstone project rating - marketing

MANAGEMENT

Embedded questions – final exam o BUAD254 Organizational Behavior o BUAD499 Business Policy

MFT sections o Management

Capstone project rating - Management

MANAGEMENT SCIENCE

Embedded questions – final exam o BUAD248 Quantitative Methods o BUAD348 Production & Operations Management

MFT sections o Management Science

Capstone project rating – Management Science

INFORMATION SYSTEMS

Embedded questions – final exam o BUAD258 Information Systems I

MFT sections o Information Systems

Capstone project rating – Information systems

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

IV RESULTS / STATUS / ACTION

Areas needing attention

ASSESSMENT AREA Area not meeting goals 1 Oral Rubric

2 Capstone Project Ratings - Oral Communications

3 Capstone Project Ratings - Critical Thinking Monitor – 78% vs goal of 80%

4 Critical Thinking - Ratio Analysis Problem; Cost of Capital

Need to look at the cost of capital problem in BUAD342

5 MFT - Legal & Social Environment

6 Ethics Project in Marketing

7 MFT - Economics & International Issues

8 Capstone Project Ratings - Entry Decision & Analytical Tools

9 Global Test Questions in POM

10 Internships

11 Capstone Project Ratings - Accounting & Finance Monitor – 78% vs goal of 80%

12 Capstone Project Ratings - Marketing

13 Capstone Project Ratings - Management

14 Capstone Project Ratings - Management Science Monitor – 78% vs goal of 80%

15 Capstone Project Ratings - Information & Systems

16 MFT - Accounting & Finance 17 MFT - Marketing 18 MFT - Management 19 MFT - Management Science 20 MFT - Information Systems 21 Embedded Exam Questions - Accounting & Finance All are below target – need to address in AY 2015/2016

22 Embedded Exam Questions - Marketing

23 Embedded Exam Questions - Management Below target – need to address in AY 2015/2016

24 Embedded Exam Questions - Management Science Below target in BUAD248 – need to address in AY 2015/2016

25 Embedded Exam Questions - Information Systems

26 Written Rubric Below target in BUAD254 – need to address in AY 2015/2016

27 Capstone Project Ratings - Written Communications

28 Senior Survey Senior survey is administered to all seniors when they take BUAD499 policy.

Item 1 – Oral Rubric BUAD348

2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

Oral Rubric BUAD348

BUAD258 BUAD348 BUAD348 BUAD348 BUAD348

70% of students will achieve a 3 or better on each component of the oral communications rubric in BUAD 348 (Productions

Eye contact 64% 40% 82% 95% 82%

Mannerisms 51% 51% 91% 96% 91%

Verbal Skills 44% 67% 97% 95% 95%

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

Operations Management) and 80% in BUAD 499 (Business Policy)

Tone 45% 72% 95% 94% 95%

Business attire 55% 78% 91% 94% 89%

Subject knowledge 65% 78% 92% 92% 100%

Consistency & organization 59% 85% 97% 95% 99%

Mechanics 50% 99% 100% 89% 96%

Quality of Slides 71% 90% 99% 80% 98%

Visual Aids/Handouts 62% n/a n/a n/a n/a

COMMENT: No new plans. Evaluation against the rubric is done using a current event written

/ oral presentation project which has been continuously improved upon. The results are

positive. Students present well and continually improve.

Item 1 – Oral Rubric BUAD499

2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

Oral Rubric - BUAD499

BUAD499

J Lyon data

BUAD499 J Lyon data

BUAD499 BUAD499 BUAD499

70% of students will achieve a 3 or better on each component of the oral communications rubric in BUAD 348 (Productions Operations Management) and 80% in BUAD 499 (Business Policy)

Eye contact 97% 89% 93% 94% 96%

Mannerisms 95% 90% 95% 92% 93%

Verbal Skills 99% 94% 95% 94% 93%

Tone 94% 99% 97% 96% 96%

Business attire 100% 95% 100% 100% 94%

Subject knowledge

93% 95% 100% 99% 99%

Consistency & organization

95% 98% 99% 99% 99%

Mechanics 96% 99% 100% 96% 89%

Quality of Slides 100% 98% 99% 97% 97%

Visual Aids/Handouts

82% 95% 99% 99% 98%

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

COMMENT: No new plans. Evaluation against the departmental rubric and results are all positive.

Students present well and continually improve.

Item 2 – Capstone Communications

Capstone Project Ratings - Oral

Communications

2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

BUAD499 BUAD499 BUAD499 BUAD499 BUAD499

89%

Oral Communication

At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.

95% 81% 100% 87% XIV - Handling

questions

100% 94% 100% 100% XV - Oral

Communication

COMMENT: We have made changes in the evaluation process. Student group projects are

observed by the course professor, a group of faculty, and non-faculty outside participants. We

have struggled to produce a score that took into account the variety of observers and their

knowledge base. Due to the many variables, we feel the scoring is not informative. Starting in

Spring 2016, the course professor has taken the observer inputs and produced one composite

score that will be the one used for evaluation. Results exceed the target and no changes are

planned.

Item 3 – Capstone Critical Thinking

Capstone Project Ratings - Critical Thinking

2011-2012 2012-2013 2013-2014 2014-2015 2015-2016

At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.

85% 88% 94% 87% 78%

COMMENT: We have made changes in the evaluation process. Student group projects are

observed by the course professor, a group of faculty, and non-faculty outside participants. We

have struggled to produce a score that took into account the variety of observers and their

knowledge base. Due to the many variables, we feel the scoring is not informative. Starting in

Spring 2016, the course professor has taken the observer inputs and produced one composite

score that will be the one used for evaluation. Results are slightly below the target and we will

monitor the situation going forward.

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

Item 4 – Critical Thinking (Ratio Analysis / Cost of Capital)

Critical Thinking 2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

At least 70% of our students will be competent as defined by a score of 70 or better on embedded questions 71% 86% 78% 76% 81%

Ratio Analysis - Accounti

ng II

85% 86% 60%

BUAD342 Corporate Finance –

Cost of capital / capital

budgeting problems

COMMENT: Results for Ratio analysis in BUAD225 are on track and will not be changed. In

BUAD342 a new faculty member has joined the department and some corrective measures will

be addressed in AY 2016/2017

Item 5 – MFT Legal & Social Environment

MFT - LEGAL & SOCIAL 2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

MFT MFT MFT MFT MFT

70% of students will be within 1 standard deviation of national level

Legal & social

69% 67% 64% 82% 88%

COMMENT: Results in 2011 – 2014 were close to goal. Subsequent results showed the

benefits of our overall effort to improve the MFT process. No changes to the process are

planned.

Item 6 – Ethics in Marketing

Ethics in Marketing 2011-2012 2012-2013 2013-2014 2014-2015 2015-2016

At least 70% of our students will be competent as defined by a score of 70 or better on embedded questions

71% 86% 96% 84% 97%

COMMENT: Goals are continuously met. In 2015/2016 the case has been upgraded and

refreshed to maintain relevance to today’s marketing environment. No changes to the process

are planned.

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

Item 7 – MFT Economics & International

MFT - Economics & International 2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

MFT MFT MFT MFT MFT

70% of students will be within 1 standard deviation of national level

Economics 54% 62% 49% 72% 82%

International 69% 57% 41% 55% 79%

COMMENT: Results in 2011 – 2014 were close to goal. Subsequent results showed the

benefits of our overall effort to improve the MFT process. No changes to the process are

planned.

Item 8 – Capstone – Entry Decision

Capstone Project Ratings - Oral Communications

2011-2012 2012-2013 2013-2014 2014 - 2015

2015 - 2016

BUAD499 BUAD499 BUAD499 BUAD499 BUAD499

At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.

75% 88% 94% 93% 89%

COMMENT: We have made changes in the evaluation process. Student group projects are

observed by the course professor, a group of faculty, and non-faculty outside participants. We

have struggled to produce a score that took into account the variety of observers and their

knowledge base. Due to the many variables, we feel the scoring is not informative. Starting in

Spring 2016, the course professor has taken the observer inputs and produced one composite

score that will be the one used for evaluation. Results exceed the target and no changes are

planned.

Item 9 – Global Productions & Operations

Global questions in POM 2011-2012 2012-2013 2013-2014 2014-2015 2015-2016

At least 70% of our students will be competent as defined by a score of 70 or better on embedded questions

95% 85% 72% 93% 72%

COMMENT: Results are meeting the goals. No changes planned

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

Item 10 – Internship

2011-2012 2012-2013 2013-2014 2014-2015 2014-2015 Internship Internship Internship Internship Internship Internship

Goal: 80% of students above average; 80% of sites above average. Average = 75%

97% 92% 87% 96% 86%

95% 92% 91% 93% 87%

Percent of students graduating with an internship

47% 44% 56% 42% 44%

COMMENT: Data was not collected in 2015/2016 due to the director being on sabbatical

Item 11 – Capstone – Accounting & Finance

2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

Capstone Project Ratings - Accounting & Finance

78%

Accounting & Finance

At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.

48% 69% 69% 87% V -

Accounting

58% 75% 56% 87% VII - Finance

COMMENT: We have made changes in the evaluation process. Student group projects are

observed by the course professor, a group of faculty, and non-faculty outside participants. We

have struggled to produce a score that took into account the variety of observers and their

knowledge base. Due to the many variables, we feel the scoring is not informative. Starting in

Spring 2016, the course professor has taken the observer inputs and produced one composite

score that will be the one used for evaluation. Results are slightly below the target and this

measurement will be monitored in the future.

Item 12 – Capstone – Marketing

2011-2012 2012-2013 2013-2014 2014-2015 2015-2016

Capstone Project Ratings - Marketing

At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.

80% 81% 75% 80% 83%

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

COMMENT: We have made changes in the evaluation process. Student group projects are

observed by the course professor, a group of faculty, and non-faculty outside participants. We

have struggled to produce a score that took into account the variety of observers and their

knowledge base. Due to the many variables, we feel the scoring is not informative. Starting in

Spring 2016, the course professor has taken the observer inputs and produced one composite

score that will be the one used for evaluation. Results exceed the target and no changes are

planned.

Item 13 – Capstone – Management

2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

Capstone Project Ratings - Management

89%

Management

At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.

74% 88% 94% 67%

IX - Human Resource

80% 94% 94% 93% II - Mission Statement

80% 94% 88% 73% IV - Core Competencies

COMMENT: We have made changes in the evaluation process. Student group projects are

observed by the course professor, a group of faculty, and non-faculty outside participants. We

have struggled to produce a score that took into account the variety of observers and their

knowledge base. Due to the many variables, we feel the scoring is not informative. Starting in

Spring 2016, the course professor has taken the observer inputs and produced one composite

score that will be the one used for evaluation. Results exceed the target and no changes are

planned.

Item 14 – Capstone – Management Science

2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

Capstone Project Ratings - Management Science

78%

At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.

85% 81% 94% 73%

COMMENT: We have made changes in the evaluation process. Student group projects are

observed by the course professor, a group of faculty, and non-faculty outside participants. We

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

have struggled to produce a score that took into account the variety of observers and their

knowledge base. Due to the many variables, we feel the scoring is not informative. Starting in

Spring 2016, the course professor has taken the observer inputs and produced one composite

score that will be the one used for evaluation. Results are slightly below the target and will be

monitored in the future

Item 15 – Capstone – Information Systems

2011-2012 2012-2013 2013-2014 2014-2015 2015-2016

Capstone Project Ratings - Information Systems

At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.

64% 75% 88% 93% 89%

COMMENT: We have made changes in the evaluation process. Student group projects are

observed by the course professor, a group of faculty, and non-faculty outside participants. We

have struggled to produce a score that took into account the variety of observers and their

knowledge base. Due to the many variables, we feel the scoring is not informative. Starting in

Spring 2016, the course professor has taken the observer inputs and produced one composite

score that will be the one used for evaluation. Results exceed the target and no changes are

planned.

Item 16 – MFT – Accounting & Finance

MFT - Accounting & Finance 2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

MFT MFT MFT MFT MFT

70% of students will be within 1 standard deviation of national level

Accounting 61% 64% 65% 79% 85%

Finance 60% 70% 83% 85% 90%

COMMENT: Results in 2011 – 2014 were close to or met the goal. Subsequent results show

the benefits of our overall effort to improve the MFT process. This will continue.

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

Item 17 – MFT – Marketing

MFT – Marketing

2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

MFT MFT MFT MFT MFT

70% of students will be within 1 standard deviation of national level

Marketing 77% 69% 69% 79% 86%

COMMENT: Results in 2011 – 2014 were close to or met the goal. Subsequent results show

the benefits of our overall effort to improve the MFT process. This will continue.

Item 18 – MFT – Management

MFT - MANAGEMENT 2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

MFT MFT MFT MFT MFT

70% of students will be within 1 standard deviation of national level

Management 83% 76% 77% 87% 97%

COMMENT: Results consistently meet goals. No changes are planned

Item 19 – MFT – Management Science

MFT - MANAGEMENT SCIENCE 2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

MFT MFT MFT MFT MFT

70% of students will be within 1 standard deviation of national level

Management 46% 49% 56% 87% 91%

COMMENT: Results in 2011 – 2014 were close to or met the goal. Subsequent results show

the benefits of our overall effort to improve the MFT process. This will continue.

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

Item 20 – MFT – Information Systems

MFT - INFORMATION SYSTEMS 2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

MFT MFT MFT MFT MFT

70% of students will be within 1 standard deviation of national level

Information Systems 52% 57% 72% 65% 73%

COMMENT: Results in 2011 – 2014 were close to or met the goal. Subsequent results show

the benefits of our overall effort to improve the MFT process. This will continue.

Item 21 – Embedded Questions in Accounting & Finance

EMBEDDED QUESTIONS 2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

ACCOUNTING & FINANCE

At least 70% of our students will be competent as defined by a score of 70 or better on embedded questions

58% 65% 72.0% 72.0% 58.6% Embedded Questions - Accounting I

58% 65% 65.8% 100.0% 58.9% Embedded Questions -

Accounting II

40% 76% 54% 67.2% 66.0% Embedded Questions -

Corporate Finance

COMMENT: Accounting & finance faculty are working to address the questions used and

making efforts to improve results by looking at teaching practices and measurements. One

significant item was that a faculty member was suddenly on medical leave and teaching was

distributed to other faculty members causing some level of ineffectiveness

Item 22 – Embedded Questions in Marketing

Embedded questions - Marketing 2011-2012 2012-2013 2013-2014 2014-2015 2015-2016

At least 70% of our students will be competent as defined by a score of 70 or better on embedded questions 37% 59% 83% 76% 90%

COMMENT: Marketing faculty have addressed shortcomings and results are now meeting

goals

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

Item 23 – Embedded Questions in Management

Embedded Questions – Management – BUAD254

2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

At least 70% of our students will be competent as defined by a score of 70 or better on embedded questions

60% 64% 57% 66% 67%

COMMENT: Organizational Behavior faculty are addressing shortcomings. A new Tenure

track faculty member has been hired and is facing this issue with strong efforts to make

changes in the methods and teaching practices.

Embedded Questions – Management – BUAD499

2011-2012 2012-2013 2013-2014 2014-2015 2015-2016

At least 80% of our students will be competent as defined by a score of 70 or better on embedded questions 81% 86% 92% 81% 92%

COMMENT: No action needed

Item 24 – Embedded Questions in Management Science

2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

Embedded Questions – Management Science

At least 70% of our students will be competent as defined by a score of 70 or better on embedded questions

BUAD248 61% 69% 79% 91% 55%

BUAD348 87% 94% 87% 80% 82%

COMMENT: BUAD248 has been redeveloped and is still in it’s initial stages of development.

Faculty teaching this course will be working to address the shortcomings.

Item 25 – Embedded Questions in Information Systems

2011-2012 2012-2013 2013-2014 2014-2015 2015-2016

Embedded Questions - Information Systems

At least 70% of our students will be competent as defined by a score of 70 or better on embedded questions

92% 89% 90.0% 90.7% 84.3%

COMMENT: Goals are met. No action needed

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

Item 26 – Written Rubric – Organizational Behavior

2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

Written Rubric BUAD254 BUAD254 BUAD254 BUAD254 BUAD254

70% of students will achieve a 3 or better on each component of the oral communications rubric in BUAD 254 (Organizational Behavior) and 80% in BUAD 499 (Business Policy)

73% 71% 76% 78% 73% Material

71% 63% 79% 75% 64% Reasoning

66% 77% 68% 69% 61% Evidence

57% 60% 69% 80% 81% Organization

56% 63% 80% 69% 68% Style

COMMENT: Organizational Behavior faculty are addressing shortcomings. A new Tenure

track faculty member has been hired and is facing this issue with strong efforts to make

changes in the methods and teaching practices.

2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

Written Rubric BUAD499 BUAD499 BUAD499 BUAD499 BUAD499

70% of students will achieve a 3 or better on each component of the oral communications rubric in BUAD 254 (Organizational Behavior) and 80% in BUAD 499 (Business Policy)

96% 87% 100% 100% 89% Material

96% 93% 94% 100% 89% Reasoning

100% 87% 88% 100% 89% Evidence

100% 93% 81% 100% 89% Organization

100% 87% 75% 100% 89% Style

COMMENT: No action needed

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

Item 27 – Capstone – Written communications

COMMENT: No action needed

Item 28 – Senior Survey

Senior survey 2009 - 2010

2010 - 2011

2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

The majority of students should be satisfied with our program and its offerings. (Somewhat satisfied, satisfied, very satisfied)

99% 98% 99% 94% 96% 97% 99%

COMMENT: No action needed

2011-2012

2012-2013

2013-2014

2014-2015

2015-2016

Capstone Project Ratings - Written Communications

BUAD499 BUAD499 BUAD499 BUAD499 BUAD499

89% Written Communication

At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.

95% 88% 88% 80% XVI - Written

communication

95% 94% 100% 93% XIII -

Presentation

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

V MAJOR FIELD TEST - The ETS® Major Field Tests are comprehensive undergraduate

and MBA outcomes assessments designed to measure the critical knowledge and

understanding obtained by students in a major field of study. The Major Field Tests go beyond

the measurement of factual knowledge by helping you evaluate your students' ability to analyze

and solve problems, understand relationships and interpret material from their major field of

study.

The following charts show the status and progress over several years. In Spring 2014 we felt

that the program needed attention and steps were taken to

1- Create study guides to be used for material refreshing

2 – Raise the level of reward (grade) for test score

3 – Change student culture regarding the test and the importance of doing well even

though they were graduating seniors

The results in 2016 show sustained improvement

The score of 161.49 in Fall 2015 puts our program in the top 25% of 442 comparison

schools

150.33 150.20

147.69

156.76

148.22

153.71 153.60

150.97

155.18157.03

161.49

159.41

153.39

140.00

145.00

150.00

155.00

160.00

165.00

RC data - MFT mean score variation

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

9

24

35

60

8695

81

42 45

22

116

2 1

<130 135 140 145 150 155 160 165 170 175 180 185 190 195

BUAD499 Student CountMFT Total

Fall 2010 thru Spring 2016

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

VI ACBSP

Feb 15, 2015 Issued the required QA report to ACBSP

June 19, 2015 Received ACBSP feedback report

Feedback:

Remove Condition on 3.2. Remove Note on Criterion 5.7.2. from 2013

Maintain Note on Criterion 5.3: Information for two faculty members was either incomplete or unclear. These portfolios (see Appendix B of the Standards and Criteria) should be submitted to ACBSP to establish that the faculty members are qualified to teach the courses to which they are assigned.

Opportunity for Improvement on O9: Although up-to-date data are presented in the evidence file of the Campus Labs Report, Roanoke's web site presents a link which leads to 2010-2012 data. Please update the web site with current information.

Place a Condition on Standard 4: The business unit must have a learning outcomes assessment program with learning objectives for each program, a minimum of three successive sets of periodic assessment results to identify trends, comparisons with similar programs, and evidence that it is analyzing and using the results to improve educational processes and student learning. This means

All concentrations must be assessed as a program - Need measures of outcomes for each concentration

- Report – 2/15/2017

- Clear – 4/20/ 2019

VII SACS

Reported through academic year 2015/2016

Reflecting on assessment this year, what does the data reveal about student

learning in the program?

The data shows

o Student performance is stable in most areas of evaluation o Some areas of deficiency still require attention to meet goals o The results of effort to improve the MFT score has been sustained through

Increased student effort to score well Development and availability to students of material refresher guides for

prior coursework Application of stronger weighting and penalty for lack of participation /

performance in the MFT testing process

BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016

Areas still requiring attention

o Capstone project – critical thinking o Capstone project – Accounting & Finance o Capstone project – Management Science o Embedded questions – Accounting & Finance o Embedded questions – Management o Embedded questions – Management science o Written rubric – BUAD254 o BUAD342 – Critical thinking

Reflecting on assessment this year, what does the data reveal about student

learning in the program?

o Critical thinking skills remain a challenge. Student do better when they can memorize what to do rather than think through a problem and decide what to do

o Quantitative areas have bimodal populations which carries over into assessment o The importance of a solid math skills base to do well in quantitative courses o Students present well orally o Student effort is tied to the level of reward – grade points, credit. If there are not

enough points tied to assessment, then students do not prepare to the extent possible.

Summarize the program improvements for next year based on assessment results

The major plans for 2016/2017 are to address

o Transition assessment coordination duties to a new coordinator. o Continue to work on specific areas of embedded question testing where scores

are below target. This will be a topic at the Fall start of semester retreat. o Continue to look for ways to incorporate more global / international content into

individual courses o Continue assessment training of new and existing faculty o Continue development of a process to assess at the concentration level using E-

portfolio as required by ACBSP

Considering changes implemented as a result of prior assessment, how was student

learning affected? Please provide evidence of changes to student learning

o The BUAD program MFT mean score in Fall semester was 161.49 and in Spring semester it

was 159.41 placing us in the top 1/4 of 442 comparison schools. 161.49 is the highest score

since beginning using MFT in Fall 2010.

o In areas where more points are tied to assessment activity, students work harder to do well.

In BUAD348 global assessment – For one faculty the assessment quiz provided was 3% of

the final grade and 17 out of 18 scored above the target for 94%. For another faculty

teaching the same material but counting the assessment quiz for very little of the overall

course grade, the result was 49%.