41
PROMOTING OR PERTURBING A CCESS Jacob P K Gross An Event History Analysis of the PERTURBING A CCESS Jacob P .K. Gross Indiana University Project on Academic Success Effects of Financial Aid on Latinos’ Educational Attainment Association for Institutional Research, Annual Forum 2008

PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

PROMOTING ORPERTURBING ACCESS

Jacob P K GrossAn Event History Analysis of the

PERTURBING ACCESS

Jacob P.K. GrossIndiana UniversityProject on Academic Success

Effects of Financial Aid on Latinos’ Educational Attainment

Association for Institutional Research, Annual Forum 2008

Page 2: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Themes for This SessionThemes for This Session

P li i d h t ti it i

2

Policies and approaches to promoting equity in education and beyond

What can be done to improve postsecondary completion among Latinos?

Can financial aid policy be used to promote attainment? If so, to what extent?,

Page 3: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Cause for Concern About EquityCause for Concern About Equity3

“Demographics and affordability —they seem to be on a collision course ”they seem to be on a collision course.

Male admissions official at a religious institution, quoted in The Chronicle of Higher Education, May 2, 2008 p B42008, p. B4

Page 4: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Illustration of Demographic ChangesIllustration of Demographic Changes4

Source: Pew Hispanic Center calculations of ACS 2005Source: Pew Hispanic Center calculations of ACS, 2005

Page 5: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Total Charges in Constant (2007) DollarsTotal Charges in Constant (2007) Dollars5

Source: College Board Trends in Student Aid, 2007

Page 6: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Total State Need and Non-Need-Based Grants to Students Grants to Students

6

Source: College Board Trends in Student Aid, 2007

Page 7: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

7

Page 8: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

EHA Methods in Educational Research EHA Methods in Educational Research

EHA i l d i t f th d l i l

8

EHAs include a variety of methodological approaches to studying occurrence and timing of eventsg

Singer and Willett (1991, 1993, 2003), DesJardins (1994 1999 2002 2003) Chen DesJardins (1994, 1999, 2002, 2003), Chen (2007), Calcagno et al. (2007), and others have begun to pave the way for more g p ywidespread use of EHA in IR and educational research

Page 9: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Research Questions & ContextResearch Questions & Context

To what extent do different forms of aid affect 9

To what extent do different forms of aid affect educational attainment among Latinos? How do the effects of aid on attainment change over time?

LoansGrantsWork-study

IndianaNewcomer stateNewcomer stateIndianapolis has 5th highest growth rate of any metro areaPredominantly Mexican, Mexican-Americans

Page 10: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Sample Selection CriteriaSample Selection Criteria

All first time baccalaureate degree program

10

All first-time baccalaureate-degree-program-enrolled Latinos in Indiana public institutions

E d l d d f d Earned at least six credits during first academic year

Page 11: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Study DesignStudy Design

Observation Period: 1999-2006

11

Observation Period: 1999 2006Combined years 6 and 7 because of small numbers

O R k d b f f llOrigin: Risk period begins first year of enrollment

Exit: Risk period ends at point of first departure

Event of Interest: First departureFirst year in which student did not earn any creditFirst year in which student did not earn any credit

Page 12: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Study Design (continued)Study Design (continued)

Analysis Time (or clock)

12

Analysis Time (or clock)

Years enrolled, starting with first period of ll tenrollment

Students who began in 2005-2006 were not i l d d b it t ibl t b included because it was not possible to observe the event of interest

Page 13: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Data SourcesData Sources

Enrollment data (student level) from IN statewide

13

Enrollment data (student level) from IN statewide SUR system representing the universe of public enrollments

FAFSA data (student level) from state financial aid coordinating body

IPEDS postsecondary institutional data (institution level)level)

Page 14: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Discrete Time ModelDiscrete-Time Model

Dependent variable is the rate of occurrence of first

14

Dependent variable is the rate of occurrence of first departure at a given moment in time

D h d ( l d ) h fDiscrete hazard (similar to incidence rate) is the focusAlways between 1 and 0

Th hi h th h d th t th i kThe higher the hazard, the greater the risk

logit h(tj ) =  ][]...[

5544332211

772211

xxxxxDDD

βββββααα

++++++++

 

Page 15: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Model SpecificationModel Specification15

Time Financial Aid Background Preparation College Enrollment

• Dummyvariable

• Total cost*• Loans*

• Gender• Income*

• HS rank• HS diploma

• Institution type• Residency

for each year

• Grants*• Work-study*• Received aid?*

• Age* • SAT combined • Major• Credits taken• Year one 20 credits?• Dev. education creditsDev. education credits• Housing• 21st Century Scholar• Cumulative GPA

*Time-varying explanatory variables

Page 16: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Limitations & ConsiderationsLimitations & Considerations

Aid is a necessary but sufficient condition to

16

Aid is a necessary but sufficient condition to promote academic success

Factors like familial encouragement mentoring Factors like familial encouragement, mentoring, and campus climate can have a profound effect on Latino students’ success

Aid may play a larger role in promoting college enrollment than persistenceenrollment than persistence

Self-selection biases may be at play

Page 17: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

17

D i ti Fi diDescriptive Findings

Page 18: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

    Count Col %

Institution type Community college 40 0.8State universities 530 10.0Regional campuses 2616 49.3

Descriptive

18

g pUrban university 403 7.6Research universities 1714 32.3

Received Financial Aid 3739 70.5Received Grants 2385 45.0R i d L 2283 43 1Descriptive

Snapshot at Origin

Received Loans 2283 43.1Work‐study 327 6.2

Ajusted Gross Income Below $19,000 925 17.4$19,000 to $41,999 1393 26.3$42,000 to $78,999 1509 28.5Origin , ,$79,000 and more 1475 27.8

Gender Female 2380 44.9Male 2923 55.1

Combined SAT Score Low SAT (<=910) 2342 44.2Mid SAT (920 1020) 1298 24 5Mid SAT (920‐1020) 1298 24.5High SAT (>=1030) 1656 31.3

College GPA A 673 13.5B 2083 41.6C or Less 2247 44.9

Student housing On‐campus housing 1884 35.5Off‐campus housing 3183 60.0Lived with parents 194 3.7Housing unknown or live 42 0.8

Major Declared No 1079 20 3Major Declared No 1079 20.3Yes 4224 79.7

Yes 686 12.9No 4617 87.1

Total 5303 100.0

Twenty‐first Century Scholar

Page 19: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Prevalence of First DeparturePrevalence of First Departure19

Page 20: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Incidence of First DepartureIncidence of First Departure

A i id t 29 8 t

20

Average incidence rate=29.8 percent

Time % Experiencing% p gDeparture

1 25

3 50

4 75

Page 21: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Incidence of First DepartureIncidence of First Departure21

Page 22: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Incidence of First Departure by Aid ReceiptIncidence of First Departure by Aid Receipt22

Page 23: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Incidence of First Departure by Loan ReceiptIncidence of First Departure by Loan Receipt23

Page 24: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Distribution of Aid by Type in First YearDistribution of Aid by Type in First Year24

2317 2237

2012

ts

995

er of Stude

nt

323

Num

be

Grants Loans Need‐based Aid Recipient

Institutional Aid

Work‐studyRecipient Aid

Page 25: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Temporal Distribution of Aid By TypeTemporal Distribution of Aid By Type25

3000

2500

3000

nts

1500

2000

er of Stude

n

Grants

Loans

Need‐based Aid

500

1000

Num

be

Need based Aid

Institutional Aid

Work‐study

0

1 2 3 4 5 6 7

Y f E ll

No Aid

Years of Enrollment

Page 26: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Proportional Distribution of Aid Over Time by TypeOver Time by Type

26

0 60

0 40

0.50

0.60

ng Aid

G

0.30

0.40

tion

 Receivin Grant

Loans

Need‐basid Aid

0.10

0.20

Prop

ort

Institutional Aid

Work‐study

No Aid0.00

1 2 3 4 5

Years of Enrollment

No Aid

Page 27: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Average Aid Amounts Over TimeAverage Aid Amounts Over Time27

$8 000

$6,000 

$7,000 

$8,000 

ount

$3,000 

$4,000 

$5,000 

age Aid Amo

Grants

Loans

$

$1,000 

$2,000 Aver Loans

Work‐study

$‐

1 2 3 4 5 6

Years of Enrollment

Page 28: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Average Grant Amounts Over Time by Institution Typeby Institution Type

28

$4 000

$3,000 

$3,500 

$4,000 

unt

$1 500

$2,000 

$2,500 

ge Aid Amou

State universities

$500 

$1,000 

$1,500 

Averag Regional campuses

Research universities

$‐

1 2 3 4 5

Yearsof EnrollmentYears of Enrollment

Page 29: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

29

Inferential ResultsInferential Results

Page 30: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Discrete Time Model Results Discrete-Time Model Results 30

  B S.E. Sig. Exp(B)

Year Two ‐0.21 0.06 0.00 0.81Year Three 0.40 0.07 0.00 1.50Year Four 0.39 0.09 0.00 1.47Year Five 0.55 0.13 0.00 1.74Years 6 & 7 0.00 0.34 ns 1.00Total Cost 0.03 0.01 0.00 1.03G t 0 00 0 00 1 00Grants 0.00 0.00 ns 1.00Loans ‐0.01 0.00 0.00 0.99Work‐study ‐0.01 0.01 ns 0.99Received Aid ‐0 10 0 05 0 06 0 91Received Aid ‐0.10 0.05 0.06 0.91

Correct Predicted 66%‐2 Log likelihood 12797.49Cox & Snell R Square 0 11Cox & Snell R Square 0.11Nagelkerke R Square 0.15 ns=not statistically significant

Page 31: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Discrete-Time Model Results (continued)Discrete-Time Model Results (continued)31 B S.E. Sig. Exp(B)

Age 0.02 0.01 0.00 1.02Men compared toMen compared to women ‐0.07 0.05 ns 0.93Income 0.00 0.00 ns 1.00High school rank 0.00 0.00 0.07 1.00Compared to RegularCompared to Regular High School DiplomaHonors ‐0.02 0.11 ns 0.98Core 40 0.19 0.08 0.02 1.20Missing 0 50 0 07 0 00 1 65Missing 0.50 0.07 0.00 1.65Other (e.g., GED) 0.68 0.24 0.01 1.96

SAT Composite 0.00 0.00 ns 1.00

College Cumulative GPA ‐0.63 0.03 0.00 0.53Compared to Research UniversityRegional ‐0.16 0.07 0.03 0.85Branch 0.41 0.09 0.00 1.50Urban ‐0.11 0.11 ns 0.90Community College ‐0.52 0.32 0.10 0.59

Page 32: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Discrete Time Model Results (continued)Discrete-Time Model Results (continued)32

B S.E. Sig. Exp(B)

Compared to On‐Campus

Not Reported 0.50 0.16 0.00 1.65pOff Campus 0.62 0.09 0.00 1.86With Parents 0.72 0.15 0.00 2.06

Declared Major ‐0.25 0.06 0.00 0.78Development Ed Credits 0.03 0.02 0.06 1.0321st Century Scholar ‐0.03 0.07 ns 0.9721st Century Scholar 0.03 0.07 ns 0.97Resident ‐0.17 0.10 ns 0.85Total Credits ‐0.02 0.01 0.00 0.98Earned 20 Credits in YR1 ‐0.29 0.11 0.01 0.75Earned 20 Credits in YR1 0.29 0.11 0.01 0.75

Page 33: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Baseline First Departure Hazard (Main Effects of Time)(Main Effects of Time)

33

0.40

0.30

0.35

0 15

0.20

0.25

Fitted

 Hazard

0.05

0.10

0.15F

0.00

1 2 3 4 5 6&7*

Years of Enrollment

*not statistically significant

Page 34: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Full & Main Effects of Time ModelsFull & Main Effects of Time Models34

0 50

0 35

0.40

0.45

0.50

zard

0 20

0.25

0.30

0.35

parture Haz

Full Model

0 05

0.10

0.15

0.20

First D

e

ME Time Model

0.00

0.05

1 2 3 4 5 6&7

Years of Enrollment

Page 35: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

First Departure by Aid ReceiptFirst Departure by Aid Receipt35

0.60

0.50

0.30

0.40

Aid

0 10

0.20No Aid

0.00

0.10

1 2 3 4 5 6&7

Page 36: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Differential Effects of Cost on First DepartureFirst Departure

36

0.60

0 40

0.50

azard

O Y

0.30

0.40

eparture Ha One Year

Two Years

Three Years

0.10

0.20

First D

e

Four Years

Five Years

Si & S Y0.00

‐3000 ‐2000 ‐1000 0 1000 2000 3000

Diff f A C t i D ll

Six & Seven Years

Difference from Average Cost in Dollars

Page 37: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Hazard Profiles for Simulated CostsHazard Profiles for Simulated Costs37

0.60

0 30

0.450.44

0.48

0 40

0.50

azard

0.350.30

0.35

0.31 0.27

0.400.40 0.44

0.310.30

0.40

eparture Ha

$10,298 0.31 0.27

0.10

0.20

First D $4,298 

0.00

1 2 3 4 5 6 & 7

Yearsof EnrollmentYears of Enrollment

Page 38: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Conclusions & ImplicationsConclusions & Implications

Sufficiency of aid?

38

Sufficiency of aid?Proportionally the use of grants decreased over time while loans increasedAn increase in loans was associated with decreased incidence of departure, ceteris paribusG t t t ti ti ll l t d t d tGrants were not statistically related to departureHowever, total costs were associated with increased incidence of departure, ceteris paribusp , p

Receipt of aid was associated with decreased incidence of departure

Page 39: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Conclusions & Implications (continued)Conclusions & Implications (continued)

Most dramatic increase in first departure incidence

39

Most dramatic increase in first departure incidence occurred at the end of the first year, ceteris paribus

A higher GPA having a declared major earning A higher GPA, having a declared major, earning more credits, attending a regional campus, and earning 20 credits in the first year were all

fassociated with decreased likelihood of departing

An increase in developmental education credits and living off-campus were associated with increased likelihood of departing

Continuous enrollment may be less common

Page 40: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Future ResearchFuture Research

What costs are not included in this picture yet may

40

What costs are not included in this picture, yet may affect departure?

Familial obligations

Debt load (school and otherwise)

First departure may or may not be a competing s depa u e ay o ay o be a co pe g event with graduation

Time-varying effects versus time-constant effects of Time varying effects versus time constant effects of aid and other variables

Page 41: PROMOTING OR PERTURBING CCESSpas.indiana.edu/pdf/AIR2008_Promoting_or_Perturbing_Access.pdf · bO Rk f d l f lOrigin: Risk period begins first year of ... starting with first period

Suggestions or Additional InformationSuggestions or Additional Information41

Jacob P.K. Gross

Indiana UniversityProject on Academic Success

[email protected]

Slides will be available at http://pas.indiana.edu