Summer Nudging 2015Minnesota Office of Higher Education
Outline● Summer Melt ● Causes of Summer Melt● Harvard Study: Summer Nudging● Summer Nudging at OHE● The Nudges● Plans for the Future● Mass Media ● Organizational Chart● Evaluation● Stakeholders● Data Collection Methods and Procedures
“Summer Melt”Approximately 1 in 5 college bound students fail to matriculate in the fall.
Causes of Summer MeltExtra responsibilities at home--summer jobs, taking care of family members, etc.
No sustained support from guidance counselor
First generation college student; no parents, guardians, siblings have attended college
Complexity of forms (i.e. FAFSA and medical insurance policies)
Harvard Study: Summer NudgingA Harvard study by Benjamin L. Castleman and Lindsay C. Page found that “an automated and personalized text messaging campaign to remind students of required college tasks substantially increased college enrollment....”
In other words, a gentle reminder, or ‘nudge’ helped students succeed in going to college!
Summer Nudging at OHEYear 1: 2013, launched the pilot program in two high schools and nudged 100 students.
• Idea formulated from the Communications Department (Jen Fox) from an email from the Harvard Study
• Contacted Get Ready Program Counselors (partners) to work with caseloads over the summer months holding office hours, making calls, printing transcripts
• Met with students in English classes during the school year
• Sent out 15 text messages over summer
Summer Nudging at OHEYear 2: 2014, OHE began to work with seven high schools and college access programs throughout Minnesota.
• Media outreach used• Expanded to 600 students• Same 15 nudges as year 1• Conducted pre/post survey- received 20 of 300 resposes; although not
statistcally signigicant, responses were exclusively positive
Summer Nudging at OHEYear 3: This summer (2015), OHE is working with seven high schools that specifically serve low-income and students of color, nudging approximately 375 students.
• Addition of 2 Interns : Program Assistant (“nudger”, grants, presentations, future models) and Program Evaluator (survey, twitter, Facebook)
• 10 schools involved• Students targeted at sites; needs basis• Pre/Post surveys
Summer Nudging at OHECurrently, provide students:
●Email and text message reminders, or “nudges”●Office hours for additional assistance●Availability to speak over the phone with Program Assistant, Kat Klima ●Resources on social media—Facebook & Twitter
Summer Nudging at OHE• Cost Effective
• Money from Women of Wise Grand and Century College as well as other agency monies
• “The marginal cost of each message is about $0.01”• $7 per student with the option of adding partners
Topics Covered by the NudgesFAFSATranscripts Placement ExamsOrientation & Class RegistrationStudent Account CreationHealth InsuranceHousingPaying for collegeTransportation Financial Aid & Counseling Resources
Have u tried (and succeeded in) logging into ur student account online? U should try! When is ur college's orientation? How are u getting there?
Yes I have already signed in. My orientation is in July and my grandma is taking me.
Plans for the FutureNudging begins Junior year of high schoolParents and guardians can also sign up to be nudgedAbility for students to sign up on a website to be nudgedCollaboration with colleges and universities
Mass Media Presence• https://twitter.com/MNSummerNudging
• Minnesota Public Radio: Summer Nudging Interview with Jen Fox• Alex Friedrich, Reporter, Higher Education
Organizational ChartSummer Nudging
Manger
Program Evaluator(Intern)
Students
Partners(Counselors)
Program Associate (Intern)
EvaluationInputs: Leading to an activity which effect the end goal.
• What is invested?• Unprepared students, school counselors, program staff, phones, computer,
internet, school visits, summer melt book, office hours, bilingual communication
Evaluation• Question: Is the rate that college-intending high school graduates
matriculate into college in the fall after high school graduation increasing as a result of receiving summer text messages that include the tasks required for college and connect them to professionals who offer college-going assistance?
EvaluationOutputs: Activities and Participation
• What is done?• Text, respond/converse, email, phone calls, office hours, outreach & sign up, parent
outreach
• Who is reached?• Students who are prepared for college, college ready parents, more developed network
of schools
EvaluationOutcomes-Impact: Short Term, Medium Term, Long Term “Benchmarks”
• This Year (2015): 1, 000 students, signed up and signed consent form- want to know FAFSA completion, self-autonomy
• In 5 Years: Individual level opt-in• Ultimate Impact: No need for nudging!
Stakeholders• Who are they?
• Primary: students
• Secondary: MDE, governor, OHE, commissioner, taxpayers (remedial education), counselors, parents, colleges, college access and community programs
Stakeholders
Influence
Inte
rest
low
low
high
high
Family
Community & College Access Programs
Students
Interns (Staff)
Counselors
Colleges
MOHEMDE
Governor
CommissionerTaxpayers
Data CollectionMethods and Procedures• Data Collection:
• Consent Form• Pre/Post Survey• No other proposed data collection currently
Data CollectionMethods and Procedures
Data CollectionMethods and ProceduresWhat to evaluate? (Short Term)• What students had full or partial completion of the program?• Conduct a pre/post knowledge survey with participants
What to evaluate? (Long Term)• Program identification and branding• Scalable programming• Continued program development = New logic model
Data CollectionMethods and ProceduresLimitations of External Factors:• Texting on a Phone• Staff Capacity• Technology Access and Validity• Funding• Changes in Financial Aid Policy• OHE Focus Change• Students can opt out of program
So What?• For the Program:
• Summer bridge programs, like Summer Nudging, are needed to help ALL students stay on track for college.
• Critical for underrepresented and first generation college students to receive added assistance
So What?• Evaluation Purposes:
• Very new program which leaves lots of room to continually search for ways to better measure outcomes.
• More capacity in staff number allows for more opportunities to collect data,• Stakeholders vary in the involvement/concern for the program, but a piece of
workforce planning for the future of the state and nation.
Recommended