Student Outcomes Manual

1

Student Outcomes Manual

2020-2021

This document provides up-to-date assessment information to the stakeholders of Bryan College regarding

the extent to which the college’s educational goals and student learning outcomes have been met.

2

Office of Institutional Effectiveness

TABLE OF CONTENTS

Bryan College Educational Goals ................................................................................................................... 3

Bryan College General Education ................................................................................................................... 5

Bryan Freshman Mean ACT Scores .............................................................................................................. 7

ETS Proficiency Profile: General Education Learning Outcomes, National Percentiles (New Students

and Seniors) ....................................................................................................................................................... 8

ETS Proficiency Profile: Proficiency Classification (Seniors) ...................................................................... 9

ETS Major Field Test: Biology ..................................................................................................................... 10

Discipline Content ACAT Exam: Biology .................................................................................................... 11

ETS Major Field Test: Business ................................................................................................................... 12

Discipline Content ACAT Exam: History .................................................................................................... 13

ETS Major Field Test: Literature in English ............................................................................................... 14

ETS Major Field Test: Mathematics ............................................................................................................. 15

ETS Major Field Test: Music ........................................................................................................................ 16

Portfolio Evaluation: Music ........................................................................................................................... 17

ETS Major Field Test: Psychology ................................................................................................................ 18

PRAXIS II & edTPA Scores: Education Licensure Majors ............................................................... 19/20/21

SSI: How Satisfied Are Bryan Students Compared to Students in Private Colleges? ............................. 22

SSI: Student Evaluations of Majors and Advisors ...................................................................................... 23

Institutional Mission Expressed as Educational Goals: Class of 2019 as New Students and Seniors ...... 24

Alumni Survey of Employment & Graduate School ............................................................................... 25/26

3

Academic Year: 2020-2021

College Mission:

The mission of Bryan College is to educate students to become servants of Christ to make a difference in today's

world. The College seeks to assist in the personal growth and development of qualified students by providing an

education based upon an integrated understanding of the Bible and the liberal arts.

Educational Goals Assessment Procedures & Instruments

1. Students will develop a knowledge of the Bible

and the liberal arts and an ability to harmonize

that knowledge through an understanding of their

relationships.

Student Achievement Criteria

Student Satisfaction Inventory

ETS Proficiency Profile

Senior Oral Examinations, Presentations, and/or Recitals

Alumni Surveys

Other Assessments

Student/Peer Course Evaluations

General Education Learning Outcomes Survey

Student Satisfaction Survey

Major Surveys

2. Students will develop competency in one or more

subjects as a foundation for graduate study or

vocations related to the disciplines of Christian

Studies, Humanities, Natural Science, and Social

Science.


Alumni Surveys


Praxis II, ETS Major Field Tests, ACAT History Exam

Senior Oral Examinations & Performance Platforms

Field Experience & Internship Evaluations

Other Assessments


Educational Goals Survey



3. Students will demonstrate academic excellence by

thinking critically, working independently and

cooperatively, communicating clearly, and

expressing themselves creatively.


Alumni Surveys


Praxis II, ETS Major Field Tests, ACAT History Exam

Senior Oral Examinations & Performance Platforms


Other Assessments


Student Surveys


Educational Goals

Student Learning Outcomes

4

Educational Goals Assessment Procedures & Instruments



4. Students will develop wholesome attitudes,

healthful habits, responsible citizenship,

constructive interests and skills, and the

recognition that education is a continuing process.

Student Assessment Criteria

Alumni Surveys



Other Assessments

Spiritual Formation Survey



Evaluations of Chapels

Conference Evaluations

Leadership Training Evaluations

5. Students, faculty, and staff will serve the local

community and the Bryan constituency with

academic and creative experiences and

consultative services in ways consistent with the

educational philosophy, purpose, and resources of

the College.


Alumni Surveys


Other Assessments




PCI Evaluations


6. Students will mature spiritually by engaging in

opportunities for Christian leadership, ministry,

service, worship, and discipleship.


Alumni Surveys


Field Experience and Internship Evaluations

Other Assessments

MLK Service Evaluations

Student Surveys



Evaluations of Chapels

PCI Evaluations

CLF Evaluations

Spiritual Life Conference Evaluations

7. Students will enhance their undergraduate and

graduate education by participation in research

projects and colloquia conducted by Bryan’s

faculty, academic departments, and affiliate and

ancillary organizations.


Research Projects, Written/Oral Reports, Presentations,

Recitals

Other Assessments




5

Academic Year: 2020-2021

College Mission:

The mission of Bryan College is to educate students to become servants of Christ to make a difference in today's

world. The College seeks to assist in the personal growth and development of qualified students by providing an

education based upon an integrated understanding of the Bible and the liberal arts.

Learning Outcomes Assessment Procedures & Instruments

1. Students will make a difference in today’s

world by strengthening their educational

foundation.


ETS Major Field Tests, ACAT History Exam

Alumni Surveys


Other Assessments

Developmental Coursework Evaluation

Freshman English Course Evaluation

General Education Math Course Evaluation





world by developing a Christian Worldview.


Alumni Surveys


Other Assessments

Christian Worldview Course Evaluation

Biblical Foundations Course Evaluation

Pentateuch Course Evaluation

New Testament Literature Course Evaluation

Christian Life Formation Course Evaluation




Curriculum Mapping

Practical Christian Involvement (PCI) Survey

PCI Evaluation

GENERAL EDUCATION

LEARNING OUTCOMES

6

Learning Outcomes Assessment Procedures & Instruments


world by engaging the culture.


Alumni Surveys


Other Assessments

General Education Psychology Course Evaluation

Introduction to Communications Course Evaluation

Foreign Language Course Evaluation





world by exploring the arts.


Alumni Surveys


Other Assessments

Introduction to Literature Course Evaluation

Introduction to Fine Arts Course Evaluation





world by understanding the natural world.


Alumni Surveys

ETS Proficiency Profile Lab Sciences Course Evaluation

Other Assessments

Non-lab Sciences Course Evaluation

Concepts of Physical Fitness Course Evaluation

Exercise and Health Activities Course Evaluation




7

2020 National Average: 20.7 (59th percentile)

2019 Tennessee Average: 19.4 (47th percentile)

Four-Year National Average: 20.9

Four-Year Bryan Average: 22.9

Six-Year Bryan Average: 22.9

* Averages include a limited number of students that did not take the ACT; CLT or SAT scores were

converted to an ACT score for these students.

** Beginning in the Fall of 2020 Bryan College stopped requiring ACT or equivalent tests for admissions, a

limited number of incoming freshmen had no score to report.

6469

6569

75

64

0

10

20

30

40

50

60

70

80

90

100

2015 (22.5) 2016 (22.9) 2017 (22.6) 2018 (23.3) 2019 (24.0) * 2020 (21.8) * **

BRYAN FRESHMAN

MEAN ACT SCORES

2005 - 2010

Nat

ion

al P

erce

nti

le

8


The charts below indicate how Bryan College students performed nationally on the Proficiency Profile.

These percentiles represent the percentage of students in colleges/universities with a master’s program

that scored at or below the raw scores received by students at Bryan College.

GENERAL EDUCATION LEARNING OUTCOMES

NATIONAL PERCENTILES (Senior & Freshman)

75 78

7063

7280 78 80

0

10

20

30

40

50

60

70

80

90

100

Na

tio

na

l P

erce

nti

le

Senior (SP-21) Percentiles

38

70

52 52

6761

41

67

0

10

20

30

40

50

60

70

80

90

100

Na

tio

na

l P

erce

nti

le

Freshman (FA-20) Percentiles

9


The charts below indicate how Bryan College students performed nationally on the Proficiency Profile.

These scores represent the performance of Bryan freshmen and senior students in colleges/universities

with a master’s program: categories possible range from 100-130.

GENERAL EDUCATION LEARNING OUTCOMES

NATIONAL PERCENTILES (New Students & Seniors)

Mean score for Seniors = 451.1 (57%ile nationally)

Mean score for New Students = 437 (50%ile nationally)

Bryan College administers the ETS Proficiency Profile to both freshmen and senior students to measure

student achievement in relation to the effectiveness of the College’s general education curriculum.

Bryan College’s minimal threshold for this senior percentile on this student achievement measure is 50%.

EXDEEDED

Bryan College’s goal is to increase student achievement by raising the mean senior score, versus freshmen

from the same incoming class, by 5 points (11.94 mean achieved). EXCEEDED

109.71

116.12

114.57

111.37

113.76

110.86

113.49

113.84

120.02

115.5

114.7

116.66

115.58

117.2

90 100 110 120 130

Critical Thinking

Reading

Writing

Mathematics

Humanities

Social Sciences

Natural Sciences

2021 Seniors 2017 Freshmen

Value Added to 2021

Seniors compared to

Freshmen 2017

scores

Total Score 11.94

Critical

Thinking

4.13

Reading 3.9

Writing 0.93

Mathematics 3.33

Humanities 2.9

Social Sciences 4.72

Natural

Sciences

3.71

10

ETS MAJOR FIELD TEST

BIOLOGY

2013 – 2019 ~

TOTAL STUDENTS, 42 seniors

Mean scores are shown in parentheses; the range of scores is 120-200.

~ Due to COVID-19 testing did not occur in the spring of 2020, the ACAT was adopted in 2021, see the next

page for results

*2015 is combined with 2016: 3 students took the exam in 2015

**2017 is combined with 2016: 4 students took the exam in 2017

***2018 is combined with 2017: 4 students took the exam in 2018

Seven-Year Bryan Average: 160.4

Bryan College’s goal/target is 75th percentile or above for tested majors. NOT MET

Bryan College’s minimal threshold is 50th percentile for tested majors. Programs with recent data below this

threshold undergo review and modification to improve student achievement outcomes. NOT MET

94 95

84

72 72

88

31

0

10

20

30

40

50

60

70

80

90

100

2013 (165)

6 students

2014 (165)

8 students

2015-2016

(160)

8 students*

2016 (158)

5 students

2016-2017

(165)

9 students*

2017-2018

(161)

8 students**

2019 (149)

12 students

Na

tio

na

l P

erce

nti

le

11

ACAT TEST BIOLOGY

2021

TOTAL STUDENTS, 4 seniors



threshold undergo review and modification to improve student achievement outcomes. EXCEEDED

56

0

10

20

30

40

50

60

70

80

90

100

2021 (491) 4 students

Na

tio

na

l P

erce

nti

le

12


BUSINESS

2014 – 2021 ~

TOTAL STUDENTS: 139 seniors

Mean scores are shown in parentheses; the possible range of scores is 120-200.

~ Due to COVID-19 testing did not occur in the spring of 2020


Bryan College’s goal/target is 75th percentile or above for tested majors. EXCEEDED



89

97

76

94

70

93

86

0

20

40

60

80

100

120

2014 (160)

15 students

2015 (163)

16 students

2016 (156)

14 students

2017 (160)

22 students

2018 (154)

24 students

2019 (160)

26 students

2021 (157)

22 students

Na

tio

na

l P

erce

nti

le

13

DISCIPLINE CONTENT ACAT EXAM

HISTORY

2015 – 2021

TOTAL STUDENTS: 23 tested seniors

* Starting in 2020 Bryan College will not report Education majors in subject tests.

The range of scores is 200-800 for ACAT exams.

Seven-Year Bryan Average: 555




84

76

57

25

65

77

82

0

10

20

30

40

50

60

70

80

90

2015 (600) 5

students

2016 (572) 3

students

2017 (518) 4

students

2018 (449) 2

students

2019 (547) 2

students

2020* (575)

4 students

2021 (625) 3

students

Na

tio

na

l P

erce

nti

le

14


LITERATURE IN ENGLISH

2014- 2021 ~


Mean scores are shown in parentheses; the range of scores is 120-200.


*2018 (3 students) is combined with 2017 (1 student) and 2016 (5 students)

**2017 (1 student) is combined with 2016 (5 students)





99

87

60

69

84

99 97

0

10

20

30

40

50

60

70

80

90

100

2014 (181)

8 students

2015 (165)

16 students

2016 (156)

5 students

2016-2017

(158)

6 students

2016- 2018

(163) 9

students **

2019 (181)

2 students

2021 (173)

4 students

Nat

ion

al P

erc

en

tile

15

ETS MAJOR FIELD EXAM

MATHEMATICS

2014 - 2021

TOTAL STUDENTS: 12

Mean scores are shown in parentheses; the range of possible scores is 120-200.

2014-2021 Bryan Average: 152.5

** Starting in 2020 Bryan College did not report Education majors in subject tests.

National percentiles calculated for years 2017-2020 based on Comparative Data provided by ETS.




66

38

6 7

88

34

0

10

20

30

40

50

60

70

80

90

100

2014 (159)

2 students

2015

(152.5) 2

students

2016 No

students

2017 (142)

1 student

2018 No

students

2019 (145)

4 students

2020**

(166.5) 2

students

2021 (150)

1 student

16


MUSIC

2013 – 2019*

TOTAL STUDENTS: 37 students


* Starting in the fall of 2019 the music department transitioned from the ETS MFT to

student portfolio evaluation, which is found in the next section.

**2018 (2 students) combined with 2017 (6 students)


Note: Scores included in this data represent students participating in the following music major options:

Music Performance, Piano Pedagogy, Music Education, and Church Music/Music Ministry.




90

7874

48

78

48

38

0

10

20

30

40

50

60

70

80

90

100

2013

(158.75)

4 students

2014 (159)

3 students

2015 (155)

8 students

2016 (151)

6 students

2017 (157)

6 students

2018 (149)

8 students**

2019 (147)

8 students

Nat

ion

al P

erc

en

tile

17

PORTFOLIO EVALUATION

MUSIC

2020*

TOTAL STUDENTS: 13 students

* Starting in the fall of 2019 the music department transitioned from the

ETS MFT to student portfolio evaluation. The music department no longer

requires the ETS MFT exam for the various majors connected to music

because the results were skewed since only half of the degree programs

require all the courses represented in ETS MFT. Bryan transitioned to a

portfolio that students submit which includes check points that begin with

their freshman year including these elements:

1. Letter of successful completion of the Freshman Advisory

2. Programs of all Repertoire performances (8 minimum required)

3. Programs of participations in all ensembles (16 minimum required)

4. Letter of successful completion of Sophomore Platform

5. Recital programs and program notes

6. Recital or Pedagogy paper of Applied area

7. Christian Worldview of the Arts/Pedagogy paper in Applied area

100% 100%

0%

2020 2021

# o

f st

ud

en

ts p

asse

d

18


PSYCHOLOGY

2014 – 2021* ~



*Note: In the 2014 version, dates were updated to reflect the academic year during which the test was

administered.






9194

76

91

83

92

39

0

10

20

30

40

50

60

70

80

90

100

2014 (167)

19 Students

2015 (172)

15 students

2016 (168)

8 students

2017 (168)

7 students

2018 (164)

15 students

2019 (168)

10 students

2021 (155)

16 students

Nat

ion

al P

erc

en

tile

19

PRAXIS II SCORES

EDUCATION LICENSURE MAJORS

PRAXIS II TOTAL STUDENTS: 29 students

100 100100 100

0

10

20

30

40

50

60

70

80

90

100

Elementary Content Knowledge Teaching Reading

Perc

ent

PRAXIS II

Pass Rate 2018-2019 Pass Rate 2019-2020

174 174175

173

157159

145

150

155

160

165

170

175

180

Elementary Content Knowledge Teaching Reading

Pra

xis

Test

Sco

re R

ange

PRAXIS II

BC Mean 2018-2019 (Raw Score) BC Mean 2019-2020 (Raw Score) TN Passing Score

20

edTPA * SCORES


edTPA TOTAL STUDENTS: 21 students

* Starting in 2019 the education department began transition from the PRAXIS II exam to edTPA. Due to the transition there is

insufficient data in subject areas/grade levels to break out additional areas for 2018-2019.

100 100

0

20

40

60

80

100

6 - 12 Prinicples of Learning and Teaching K - 5 Prinicples of Learning and Teaching

Perc

ent

edTPA

Pass Rate 2019-2020

44.17

35.635 35

0

5

10

15

20

25

30

35

40

45

50

K-5 Principles of Learning and Teaching 7-6 Principles of Learning and Teaching

edTP

A T

est

Sco

re R

ange

2019-2020 edTPA

BC Mean 2019-2020 (Raw Score) TN Passing Score

21


Subject Specific Assessment Results 2019/2020

Praxis II Content Area Assessment

NES *

* TN currently allows Praxis II or NES for math subject assessment

edTPA

** Through December 2019 the passing score was 35 but increased to 40 beginning January 2020.

6-12 Licensure

n-size Pass Rate Average Score TN Passing

Score

Biology 1 100% 179 148

English 1 100% 172 167

History 0 N/A N/A 157

K-12 Licensure


Score

Exercise Health

Science

2 50% 164 169

Music 0 N/A N/A 162

6-12 Licensure


Score

Math 1 100% 266 220

6-12 Licensure


Score **

Biology 1 0% 39 35/40

Math 1 100% 39 35/40

English 1 100% 39 35/40

History 0 N/A N/A 35/40

K-12 Licensure


Score **

Exercise Health

Science

2 50% 33.7 35/40

Music 2 0% 35 35/40

22

STUDENT SATISFACTION SURVEY (SSI)

How Satisfied Are Bryan Students Compared to

Students in Private Colleges

December 2020

(151 of 264 Students Surveyed – 57% of Sample Group)

5.64

5.67

4.86

5.56

5.64

5.58

5.78

5.97

5.86

5.34

5.62

6.09

5.49

5.41

5

5.39

5.33

5.31

5.65

5.5

5.7

5.15

5.44

5.73

1 2 3 4 5 6 7

Student Centeredness

Service Excellence

Safety and Security

Responsiveness to Diverse Populations

Registration Effectiveness

Recruitment and Financial Aid

Instructional Effectiveness

Concern for the Individual

Campus Support Services

Campus Life

Campus Climate

Academic Advising

Other Private College Students Bryan Students

Not satisfied at all Very satisfied

23

STUDENT EVALUATIONS OF MAJORS

AND ADVISORS, 2014-2020

(from Student Satisfaction Inventory)

635 Students Responding Over 7 Years

CONTENT OF COURSES WITHIN THE MAJORS

ACADEMIC ADVISING

5.90 5.935.66 5.64

5.87 5.915.75

1

2

3

4

5

6

7

2014

(62 students)

2015

(80 students)

2016

(77 students)

2017

(65 students)

2018

(77 students)

2019

(123 students)

2020

(151 students)

6.12 6.12 6.105.80

5.99 6.10 6.09

1

2

3

4

5

6

7

2014

(62 students)

2015

(80 students)

2016

(77 students)

2017

(65 students)

2018

(77 students)

2019

(123 students)

2020

(151 students)

Very Satisfied

Somewhat Satisfied

Somewhat Dissatisfied

Not Satisfied at All

Very Satisfied

Somewhat Satisfied

Somewhat Dissatisfied

Not Satisfied at All

24

INSTITUTIONAL MISSION EXPRESSED AS

EDUCATIONAL GOALS:

SSI Survey 2021

December 2020 (151 of 264 Students Surveyed – 57% of Sample Group)

Degree to Which the Upperclassmen Students Stated They

Achieved Bryan’s Mission and Educational Goals

Educational Goal #1 – “Students will develop a knowledge of the Bible and the liberal arts and an ability to harmonize that

knowledge through an understanding of their relationships”

Educational Goal #2 - “Students will develop competency in one or more subjects as a foundation for graduate study or

vocations related to the disciplines of Christian Studies, Humanities, Natural Science, and Social Science”

Educational Goal #3 – “Students will demonstrate academic excellence by thinking critically, working independently and

cooperatively, communicating clearly, and expressing themselves creatively”

Educational Goal #4 – “Students will develop wholesome attitudes, healthful habits, responsible citizenship, constructive

interests and skills, and the recognition that education is a continuing process”

Educational Goal #5 - “Students, faculty, and staff will serve the local community and the Bryan constituency with academic

and creative experiences and consultative services in ways consistent with the educational philosophy, purposes, and resources of

the College”

Educational Goal #6 - “Students will mature spiritually by engaging in opportunities for Christian leadership, ministry, service,

worship, and discipleship”

Educational Goal #7 - “Students will enhance their undergraduate and graduate education by participation in research projects

and colloquia conducted by Bryan’s faculty, academic departments, and affiliate and ancillary organizations”

Mission Statement - “Educating students to become servants of Christ to make a difference in today’s world”

6.276.06 5.93

6.29 6.20 6.33 6.44 6.375.96

5.67 5.685.90

5.67 5.78 5.84 5.78

0.00

1.00

2.00

3.00

4.00

5.00

6.00

7.00

Goal #1 Goal #2 Goal #3 Goal #4 Goal #5 Goal #6 Goal #7 Misson

Importance Ranking Satisfaction Ranking

Extensively

Moderately

Minimally

Not at all

25

CAREER & GRADUATE SCHOOL ALUMNI SURVEY

2014-2020

Number of Alumni Employed, both Employed and in Graduate

School, or Attending Graduate School

45 46

28 27 30

15 14

8 8

139

1135

14

4 5

1

1

2

1

3

0

10

20

30

40

50

60

70

2014 (61) 2015 (68) 2016 (48) 2017 (38) 2018 (44) 2019 (51) 2020 (33)

Res

po

nce

bre

akd

ow

n

Year of Graduation

Employed Graduate School and Employed Graduate School

26

ALUMNI STATISTICS

Percentage of Bryan Alumni employed or pursuing additional

education within six months of graduation compared to National

Association of Colleges and Employers

2014-2020

Bryan College’s most recent alumni survey indicates that 97.0% of recent graduates are employed, not

employed by choice, or pursuing graduate studies. This rate is compared to the NACE national average

Career Outcomes Rate. The 2019 rate published by NACE is 86%.

~ Please note that the one student that indicated a status of unemployed from 2020 graduates indicated this

was due to Covid; 2020 NACE data was not available at the time this document was produced.

Bryan College’s minimal threshold on this student achievement measure is 90%.

Bryan College’s goal/target for this measure is to sustain 95%-plus.

93.5

86.8 87.5

97.4 97.7 10097

80.3 78.9 81 81.285.7 86

0

20

40

60

80

100

120

2014 2015 2016 2017 2018 2019 2020~

Per

cen

tage

s

Graduation Year

Bryan Alumni NACE

Documents

Student Outcomes Manual