6
1 Significant Increases in Associate Degree Graduation Rates: CUNY Accelerated Study in Associate Programs (ASAP) (July 13, 2015) Founded in 2007 with support from the New York City Center for Economic Opportunity (CEO), ASAP is a comprehensive program for associate-degree students at nine CUNY colleges: Borough of Manhattan, Bronx, Hostos, Kingsborough, LaGuardia, and Queensborough Community Colleges; Medgar Evers College; and College of Staten Island and New York City College of Technology, as of fall 2015. Key program components include full-time enrollment, block scheduled first-year courses, cohort course taking, financial support, intrusive and mandatory advisement, a student- success seminar, career services, and tutoring. The program is committed to graduating at least 50% of students within three years through provision of comprehensive support services and financial resources that remove barriers to full-time study, build student resiliency, and support timely degree completion. Currently less than 25% of CUNY community college students and only 16% of urban community college students nationally graduate within three years. 1 There have been eight ASAP cohorts totaling 8,670 students admitted across all participating colleges, with the first cohort entering in fall 2007 and the eighth in fall 2014. Total projected enrollment as of fall 2015 is 7,500 students. ASAP has proven to be one of CUNY’s most successful community college initiatives with students in the program graduating at a rate more than double that of similar students. The program has garnered national attention and been rigorously evaluated. ASAP evaluation includes ongoing internal analysis by CUNY utilizing a quasi-experimental constructed comparison group design, a five-year experimental design random assignment study led by MDRC, and cost- benefit analysis led by Professor Henry Levin and the Center for Benefit-Cost Studies in Education (CBCSE) at Teachers College Columbia University. Key findings from CUNY’s evaluation of ASAP 2 reveal: o ASAP students graduate at more than double the rates of non-ASAP students. To date, across five cohorts, ASAP has an average graduation rate of 52% vs. 22% of comparison group students. o Students who start ASAP with developmental needs graduate at high rates just like students who enter fully skills proficient: After three years, 48% of ASAP students with developmental needs and 59% of fully skills proficient ASAP students have graduated vs. 20% of non-ASAP students with developmental needs and 27% of fully skills proficient non-ASAP students. o There are large and significant differences between ASAP and comparison group students in terms of retention rates, movement through developmental course work, credit accumulation, and graduation rates. These differences are seen as early as the first semester and continue to be found at all junctures over three years. o Students from underrepresented groups appear to benefit more from ASAP than other students. o When longer term outcomes across CUNY are considered, ASAP students are more likely to earn a degree. Seven years after beginning, 64% of ASAP students had earned either an associate or baccalaureate degree (or both) vs. 42% of comparison group students. 1 Source: CUNY Office of Institutional Research and Assessment (OIRA) and CUNY OIRA analysis of data from the Institutional Postsecondary Educational Data System (IPEDS). 2 Complete ASAP evaluation findings can be found at: http://www.cuny.edu/academics/programs/notable/asap/about/evaluation.html.

Significant Increases in Associate Degree … study found an average savings of $6,500 per graduate. Part two of Dr. Levin’s analysis looked at the benefits of timely graduation,

Embed Size (px)

Citation preview

1

Significant Increases in Associate Degree Graduation Rates:

CUNY Accelerated Study in Associate Programs (ASAP) (July 13, 2015)

Founded in 2007 with support from the New York City Center for Economic Opportunity (CEO), ASAP is a comprehensive program for associate-degree students at nine CUNY colleges: Borough of Manhattan, Bronx, Hostos, Kingsborough, LaGuardia, and Queensborough Community Colleges; Medgar Evers College; and College of Staten Island and New York City College of Technology, as of fall 2015. Key program components include full-time enrollment, block scheduled first-year courses, cohort course taking, financial support, intrusive and mandatory advisement, a student-success seminar, career services, and tutoring. The program is committed to graduating at least 50% of students within three years through provision of comprehensive support services and financial resources that remove barriers to full-time study, build student resiliency, and support timely degree completion. Currently less than 25% of CUNY community college students and only 16% of urban community college students nationally graduate within three years.1 There have been eight ASAP cohorts totaling 8,670 students admitted across all participating colleges, with the first cohort entering in fall 2007 and the eighth in fall 2014. Total projected enrollment as of fall 2015 is 7,500 students. ASAP has proven to be one of CUNY’s most successful community college initiatives with students in the program graduating at a rate more than double that of similar students. The program has garnered national attention and been rigorously evaluated. ASAP evaluation includes ongoing internal analysis by CUNY utilizing a quasi-experimental constructed comparison group design, a five-year experimental design random assignment study led by MDRC, and cost-benefit analysis led by Professor Henry Levin and the Center for Benefit-Cost Studies in Education (CBCSE) at Teachers College Columbia University. Key findings from CUNY’s evaluation of ASAP2 reveal:

o ASAP students graduate at more than double the rates of non-ASAP students. To date, across five cohorts, ASAP has an average graduation rate of 52% vs. 22% of comparison group students.

o Students who start ASAP with developmental needs graduate at high rates just like students who enter fully skills proficient: After three years, 48% of ASAP students with developmental needs and 59% of fully skills proficient ASAP students have graduated vs. 20% of non-ASAP students with developmental needs and 27% of fully skills proficient non-ASAP students.

o There are large and significant differences between ASAP and comparison group students in terms of retention rates, movement through developmental course work, credit accumulation, and graduation rates. These differences are seen as early as the first semester and continue to be found at all junctures over three years.

o Students from underrepresented groups appear to benefit more from ASAP than other students.

o When longer term outcomes across CUNY are considered, ASAP students are more likely to earn a degree. Seven years after beginning, 64% of ASAP students had earned either an associate or baccalaureate degree (or both) vs. 42% of comparison group students.

1 Source: CUNY Office of Institutional Research and Assessment (OIRA) and CUNY OIRA analysis of data from the Institutional Postsecondary Educational Data System (IPEDS). 2 Complete ASAP evaluation findings can be found at: http://www.cuny.edu/academics/programs/notable/asap/about/evaluation.html.

2

External Evaluation of ASAP

MDRC has released a three-year report from its random assignment study of ASAP, which includes a sample of 900 students.3 Participants include ASAP students from cohorts three and four from three community colleges who entered with developmental education needs. Students were randomly assigned to either the program group or control group, ensuring that the two groups were similar in terms of background and motivation and differences in outcomes are a direct result of participating in ASAP. MDRC’s three-year report found that ASAP students outperformed the control group students with respect to persistence, credit accumulation, full-time enrollment, three-year graduation, and transfer to four-year colleges. The three-year graduation rate for ASAP students was nearly double the graduation rate of control group students. MDRC stated that “ASAP’s effects are the largest MDRC has found in any of its evaluations of community college reforms. The model offers a highly promising strategy to markedly accelerate credit accumulation and increase graduation rates among educationally and economically disadvantaged populations” (Scrivener et al. 2015). ASAP was also the subject of a comprehensive cost-benefit study led by Dr. Henry Levin of the Center for Benefit-Cost Studies in Education (CBCSE) at Teachers College Columbia University.4 Part one of Dr. Levin’s study, a cost-effectiveness analysis of ASAP, reveals that despite higher up-front costs, the average cost per three-year ASAP graduate is lower than for comparison group graduates. The study found an average savings of $6,500 per graduate. Part two of Dr. Levin’s analysis looked at the benefits of timely graduation, both for the individual and for the public sector, by examining increased earnings and tax revenues as well as reduced costs for social services such as public health, public assistance, and criminal justice. The study found that an investment in ASAP has large financial returns for both the taxpayer and the student. For every dollar invested in ASAP by the taxpayer, $3.50 are returned per associate degree conferred in the form of increased tax revenues and social service savings, and for each dollar invested by the ASAP student, $12.20 are returned through increased earnings. Dr. Levin and his team conclude that the total net benefits for 1,000 enrolled ASAP students is $46.5 million higher than for 1,000 comparison group students who do not enroll in the program. ASAP Expansion and Replication

Thanks to generous support from the City of New York ASAP will expand to 25,000 students by academic year 2018-2019. Part of the ASAP expansion will include serving more (STEM) majors. In addition to serving more CUNY students seeking their associate degree, ASAP is also beginning to serve students who are pursuing their bachelor’s degree. CUNY received funding from the Robin Hood Foundation to adapt the ASAP model to a four-year college setting, in this case the John Jay College of Criminal Justice, which is launching their program in the fall of 2015 with a pilot cohort of 250 students. To expand the reach of ASAP beyond New York City, CUNY is working with MDRC, the Ohio Board of Regents (OBR), and three Ohio community colleges to replicate ASAP in Ohio. With support from the Great Lakes Higher Education Corporation, CUNY is providing technical assistance to OBR and the three partner colleges, which are launching programs in fall 2015 that will serve 1,500 low-income students. Furthermore, CUNY and MDRC, with support from the Gates Foundation, will engage in outreach to other states and college systems to assess opportunities for replicating ASAP across the country. For more information about ASAP, please visit www.cuny.edu/sites/asap.

3 MDRC ASAP reports can be found online at: http://www.mdrc.org/publication/doubling-graduation-rates 4 Dr. Levin’s reports can be found online at: http://cbcse.org/wordpress/wp-content/uploads/2013/06/Levin-ASAP-Cost-Effectiveness-Report_092412_FINAL-5.pdf and http://cbcse.org/wordpress/wp-content/uploads/2013/05/Levin_ASAP_Benefit_Cost_Report_FINAL_05222013.pdf.

Combined

ASAP Students

Combined Comparison

Group Students

Total Enrollment N 8,672 22,545

College

BMCC % 19.2 27.8

Bronx % 10.9 8.4

Hostos % 10.1 4.4

KBCC % 19.7 25.6

LaGuardia % 18.4 17.7

Medgar Evers % 2.5 ~~

QCC % 19.2 16.2

Gender

Male % 41.9 44.7

Female % 58.1 55.3

Ethnicity

American Indian/Native Alaskan % 0.4 0.4

Asian/Pacific Islander % 11.5 14.7

Black % 32.0 28.6

Hispanic % 42.6 39.8

White % 13.6 16.6

Age Group

18 or younger % 47.4 36.4

19 % 15.2 19.5

20 to 22 % 17.1 25.2

23 to 29 % 12.2 13.5

30 or older % 8.1 5.4

Mean Age mean 21.4 21.2

Admission Type

First-time Freshmen % 66.6 50.3

Transfer Students % 7.1 19.1

Continuing Students % 26.3 30.7

Developmental Students2

%

At Time of Application to ASAP % 80.1 77.0

At Time of Entry into ASAP % 69.7 69.2

College Admissions Average3

mean 76.0 74.3

GED Recipients3

% 11.6 11.3

Pell Receipt4

% 74.3 84.4

October 20, 2014

4 Data is not yet available for Cohort 7 students.

Summary Profile of Combined ASAP and Comparison Group Cohorts1

Preliminary Data

1 Combined cohorts include ASAP students admitted in fall 2007, fall 2009, spring 2010, fall 2010, fall 2011, fall 2012, fall 2013 and fall 2014, and

comparison group students admitted in fall 2006, fall 2008, spring 2009, fall 2009, fall 2010, fall 2012 and fall 2013. Profile data not yet available for

the fall 2014 cohort.

2 Students who required developmental coursework. ASAP data is reported by college ASAP directors. Comparison group data come from the

CUNY Institutional Research Database.

3 Data is not available for all students; Data is missing for most transfer students and students who applied as direct admits to the college.

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

ASAP CompGroup

ASAP CompGroup

ASAP CompGroup

ASAP CompGroup

ASAP CompGroup

2nd Semester 3rd Semester(1 Year)

4th Semester 5th Semester(2 Year)

6th Semester

92.7%

83.9% 80.9%

65.7%

71.3%

54.8%

39.3% 38.7%

19.9%

27.7%

26.1%

9.0%

40.8%

14.8%

Average Retention Rates of ASAP and Comparison Group Students1: Fall 2007-Fall 2013 Cohorts2 92.7%

83.9% 80.9%

65.7%

71.3%

54.8%

65.4%

47.6%

42.5%

60.7%

ASAP (Graduated)

ASAP (Re-enrolled)

Comparison Group (Re-enrolled)

Comparison Group (Graduated)

1

Comparison groups are constructed for each cohort and consist of students enrolled at each college who met ASAP eligibility criteria but did not participate in ASAP. 2

Semester to semester retention at college of entry. Second and third semester retention rates for cohorts entering in fall 2007, fall 2009, spring 2010, fall 2010, fall 2011, fall 2012 and fall 2013 (ASAP N=6,394; Comp group N=22,824). Fourth and fifth semester retention rates for same cohorts except fall 2013 (ASAP N=4,547; Comp group N=19,090). Sixth semester retention rate for same cohorts except fall 2012 and fall 2013 (ASAP N=2,985; Comp group N=15,042). Overall rates are calculated by averaging individual cohort rates. Source: CUNY Office of Institutional Research and Assessment. November 13, 2014

0%

10%

20%

30%

40%

50%

60%

All Dev EduNeed

FullyProficient

All Dev EduNeed

FullyProficient

All Dev EduNeed

FullyProficient

2-Year Graduates(ASAP N=4,547; Comp N=19,087)

2.5-Year Graduates(ASAP N=2,985; Comp N=15,042)

3-Year Graduates(ASAP N=2,985; Comp N=15,042)

26.1%

19.0%

37.9%

40.8%

35.7%

50.6% 51.9%

48.0%

58.7%

9.0%

6.5%

13.2% 14.8%

12.6%

19.8%

22.2%

20.0%

27.4%

Average Graduation Rates of ASAP and Comparison Group Students1: Fall 2007-Fall 2012 Cohorts2

ASAP Comparison Group

1Comparison groups are constructed for each cohort and consist of students enrolled at each college who met ASAP eligibility criteria but did not participate in ASAP.

2Students who have officially graduated through summer 2014. The 2.5 -year and 3-year rates include fall 2007, fall 2009, spring 2010, fall 2010, and fall 2011 ASAP cohorts and their comparison groups. The 2-year rates also include the fall 2012 ASAP cohort and comparison group. Overall graduation rates are calculated by averaging the individual cohort graduation rates. Developmental education need or skills proficiency is based on status at time of entry. Source: CUNY Office of Institutional Research and Assessment, CUNY ASAP participating colleges, and National Student Clearinghouse.

October 31, 2014

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

Dev Ed Needat Application

Dev Ed Needat Entry

Dev Ed Remaining 3rd Sem

83.0%

71.3%

15.6%

79.8%

73.1%

37.0%

Movement Through Developmental Education for Combined ASAP and Comparison Group Cohorts 1

ASAP Comparison Group

1Includes fall 2009, spring 2010, fall 2010, fall 2011, and fall 2012 ASAP cohorts (N=3,407) and their comparison groups (N=17,406). Source: CUNY Office of Institutional Research and Assessment and CUNY ASAP participating colleges.

October 14, 2014