20
De Anza Research, May 19, 2003 1 LinC Research Site visit with Marybeth Mason and Sally Murphy Feedback on Retention and Success Assessment Discussion of other approaches

De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy Feedback on Retention and Success Assessment Discussion

Embed Size (px)

Citation preview

Page 1: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

1

LinC Research

Site visit with Marybeth Mason and Sally Murphy

Feedback on Retention and Success Assessment

Discussion of other approaches

Page 2: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

2

•Review research approach

•Discuss methodology

•Highlight findings

•List ideas for future analyses

Agenda

Page 3: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

3

•Initial data collection

•Data thru fall 2002

•Plan to replicate each summer for previous year

Data Collection

Page 4: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

4

•Established a baseline of information

•Did not attempt to account for •differences in classroom teaching •grading •student motivation

Initial Research

Page 5: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

5

•Assess an important goal of the program:

•To improve student learning by

highlighting the connections between

disciplines and interesting topics,

thereby strengthening students’

intellectual curiosity and experiences.

Research Question

Page 6: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

6

•Use grades as a proxy measure of student learning

•Should expect higher course success rates for Learning Communities students, on average, than those in comparable non-Learning Community courses, ceteris paribus

Research Approach

Page 7: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

7

Methodology•Student grades in learning community sections were compared with non-learning community sections of the same or related courses for that term

•Course to course comparison not always available

•Did not control for different class sizes

Page 8: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

8

Methodology Continued•Grades grouped as:

•Success - A, B, C, or P•Withdrawal - W •Non-Success - D, F, NP, I

•The grade percents were based on all the grades for the section, including W’s

Page 9: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

9

Course Comparisons

Page 10: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

10

Whose Country Is This Anyway? 2002F LinC ESL 005.01D HIST017A01D Non-LinC ESL 005.REL HIST017AREL

LinC 236 84% 23 8% 23 8% 282 100%Non-LinC 3,288 66% 819 16% 869 17% 4,976 100%

# % # % # % # %Success Non-Success Withdrew Total

Level of Analysis

Page 11: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

11

•In a typical quarter•more than 200 students •10 to 15 LinC sections•five or six “Learning Communities”

•1,401 students have participated in LinC courses over the last four years

Summary of Findings

Page 12: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

12

•Overall, the course success rates were higher for LinC than similar courses 

•Course success rates for the program have generally increased since the program started in 1998 

•LinC course success rates appear to vary by curriculum content

Findings Continued

Page 13: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

13

Success Rates for LinC and Similar Courses De Anza College, 1998-2002

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Success Non-Success Withdrew

LinC Non-LinC

Page 14: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

14

Success Rates of LinC and Similar Non-LinC Courses by Term, De Anza College, 1998-2002

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

98w 98s 99w 99s 99f 00s 00m 00f 01w 01s 01m 01f 02w 02s 02m 02f

LinC Non-LinC

Page 15: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

15

Page 16: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

16

Page 17: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

17

•Combine information on course success with classroom assessment data and other survey information

•Additional variables such as previous language skills, success in math and English gateway courses, and economic need will also be considered

Future Analyses

Page 18: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

18

•Future analysis will also look at college persistence rates (an examination for one following term showed slightly higher rates for LinC students)

•Other areas of research will focus on taking into account student and faculty self-selection bias

Future Analyses Continued

Page 19: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

19

•Inferential statistical tests can also be used

•Chi Square•T Test

Statistical Tests

Page 20: De Anza Research, May 19, 20031 LinC Research Site visit with Marybeth Mason and Sally Murphy  Feedback on Retention and Success Assessment  Discussion

De Anza Research, May 19, 2003

20

Discussion

•Approaches used elsewhere?

•Other ways to measure success?