Summer Nudging PWP

Summer Nudging 2015Minnesota Office of Higher Education

Outline● Summer Melt ● Causes of Summer Melt● Harvard Study: Summer Nudging● Summer Nudging at OHE● The Nudges● Plans for the Future● Mass Media ● Organizational Chart● Evaluation● Stakeholders● Data Collection Methods and Procedures

“Summer Melt”Approximately 1 in 5 college bound students fail to matriculate in the fall.

Causes of Summer MeltExtra responsibilities at home--summer jobs, taking care of family members, etc.

No sustained support from guidance counselor

First generation college student; no parents, guardians, siblings have attended college

Complexity of forms (i.e. FAFSA and medical insurance policies)

Harvard Study: Summer NudgingA Harvard study by Benjamin L. Castleman and Lindsay C. Page found that “an automated and personalized text messaging campaign to remind students of required college tasks substantially increased college enrollment....”

In other words, a gentle reminder, or ‘nudge’ helped students succeed in going to college!

Summer Nudging at OHEYear 1: 2013, launched the pilot program in two high schools and nudged 100 students.

• Idea formulated from the Communications Department (Jen Fox) from an email from the Harvard Study

• Contacted Get Ready Program Counselors (partners) to work with caseloads over the summer months holding office hours, making calls, printing transcripts

• Met with students in English classes during the school year

• Sent out 15 text messages over summer

Summer Nudging at OHEYear 2: 2014, OHE began to work with seven high schools and college access programs throughout Minnesota.

• Media outreach used• Expanded to 600 students• Same 15 nudges as year 1• Conducted pre/post survey- received 20 of 300 resposes; although not

statistcally signigicant, responses were exclusively positive

Summer Nudging at OHEYear 3: This summer (2015), OHE is working with seven high schools that specifically serve low-income and students of color, nudging approximately 375 students.

• Addition of 2 Interns : Program Assistant (“nudger”, grants, presentations, future models) and Program Evaluator (survey, twitter, Facebook)

• 10 schools involved• Students targeted at sites; needs basis• Pre/Post surveys

Summer Nudging at OHECurrently, provide students:

●Email and text message reminders, or “nudges”●Office hours for additional assistance●Availability to speak over the phone with Program Assistant, Kat Klima ●Resources on social media—Facebook & Twitter

Summer Nudging at OHE• Cost Effective

• Money from Women of Wise Grand and Century College as well as other agency monies

• “The marginal cost of each message is about $0.01”• $7 per student with the option of adding partners

Topics Covered by the NudgesFAFSATranscripts Placement ExamsOrientation & Class RegistrationStudent Account CreationHealth InsuranceHousingPaying for collegeTransportation Financial Aid & Counseling Resources

Have u tried (and succeeded in) logging into ur student account online? U should try! When is ur college's orientation? How are u getting there?

Yes I have already signed in. My orientation is in July and my grandma is taking me.

Plans for the FutureNudging begins Junior year of high schoolParents and guardians can also sign up to be nudgedAbility for students to sign up on a website to be nudgedCollaboration with colleges and universities

Mass Media Presence• https://twitter.com/MNSummerNudging

• Minnesota Public Radio: Summer Nudging Interview with Jen Fox• Alex Friedrich, Reporter, Higher Education

Organizational ChartSummer Nudging

Manger

Program Evaluator(Intern)

Students

Partners(Counselors)

Program Associate (Intern)

EvaluationInputs: Leading to an activity which effect the end goal.

• What is invested?• Unprepared students, school counselors, program staff, phones, computer,

internet, school visits, summer melt book, office hours, bilingual communication

Evaluation• Question: Is the rate that college-intending high school graduates

matriculate into college in the fall after high school graduation increasing as a result of receiving summer text messages that include the tasks required for college and connect them to professionals who offer college-going assistance?

EvaluationOutputs: Activities and Participation

• What is done?• Text, respond/converse, email, phone calls, office hours, outreach & sign up, parent

outreach

• Who is reached?• Students who are prepared for college, college ready parents, more developed network

of schools

EvaluationOutcomes-Impact: Short Term, Medium Term, Long Term “Benchmarks”

• This Year (2015): 1, 000 students, signed up and signed consent form- want to know FAFSA completion, self-autonomy

• In 5 Years: Individual level opt-in• Ultimate Impact: No need for nudging!

Stakeholders• Who are they?

• Primary: students

• Secondary: MDE, governor, OHE, commissioner, taxpayers (remedial education), counselors, parents, colleges, college access and community programs

Stakeholders

Influence

Inte

rest

low

low

high

high

Family

Community & College Access Programs

Students

Interns (Staff)

Counselors

Colleges

MOHEMDE

Governor

CommissionerTaxpayers

Data CollectionMethods and Procedures• Data Collection:

• Consent Form• Pre/Post Survey• No other proposed data collection currently

Data CollectionMethods and Procedures

Data CollectionMethods and ProceduresWhat to evaluate? (Short Term)• What students had full or partial completion of the program?• Conduct a pre/post knowledge survey with participants

What to evaluate? (Long Term)• Program identification and branding• Scalable programming• Continued program development = New logic model

Data CollectionMethods and ProceduresLimitations of External Factors:• Texting on a Phone• Staff Capacity• Technology Access and Validity• Funding• Changes in Financial Aid Policy• OHE Focus Change• Students can opt out of program

So What?• For the Program:

• Summer bridge programs, like Summer Nudging, are needed to help ALL students stay on track for college.

• Critical for underrepresented and first generation college students to receive added assistance

So What?• Evaluation Purposes:

• Very new program which leaves lots of room to continually search for ways to better measure outcomes.

• More capacity in staff number allows for more opportunities to collect data,• Stakeholders vary in the involvement/concern for the program, but a piece of

workforce planning for the future of the state and nation.