Upload
others
View
9
Download
0
Embed Size (px)
Citation preview
LEARNING TOGETHER AND THE STUDENT EXPERIENCE:
Institutions Embracing Data to Help More Students Start, Stay & Finish Strong
Mark David Milliron CIVITAS LEARNING® COPYRIGHT © 2018 [email protected]
ISSUES DRIVING CHANGE
• Success Indicators
✓ Completion, on-time completion, transfer,
equity gaps, STEM, career success, thriving
• Enrollment
• Affordability
• Initiative Fatigue
• Resource Optimization
• Personalization
DATA IMPACT MATRIX A THEORY OF WORK
INSI
GH
T
INTELLECTUALLY CURIOUS
Late Signal
STATUS QUO
No/Wrong Signal
BEST PRACTICISM
Weak Signal
STUDENT
SUCCESS
SCIENTISTS
Strong Signal
ACTION
THE OPPORTUNITY FOR GREATER IMPACT
ONBOARDING GET ON PATH STAY ON PATH Successful Transition from Developing an Educational Ongoing Ed Plan and Admission to Enrollment Plan for Success Retention Management
STUDENT JOURNEY
of students fail to enroll
Up to 40% 42% of students are leaving
16% of students leave with enough
within their first 3 terms credits, but no credential
27
$16K CIVITAS LEARNING® COPYRIGHT © 2018
Average excess credits earned without clear path progression
Average additional debt for every year at a two-year college
Tuition revenue lost $$$ due to attrition
CCA, Time is the Enemy | Harvard University, SDP Summer Melt | CCRC, Early Momentum Metrics
CIVITAS LEARNING – DATA TO POWER OUTCOMES
40% OF ACTIVE U.S. STUDENTS
7M ENROLLED STUDENTS
20M STUDENT RECORDS
200M COURSE
ENROLLMENTS
~2K PREDICTIVE
MODELS
CIVITAS LEARNING® COPYRIGHT © 2018
STRATEGIES TO ACHIEVE OUTCOMES
CareerStudent Inquiry Persistence & Graduation
MILESTONE DECISIONS
MAJORS
SECTIONS
OPPORTUNITIES
TO ENGAGE & SUCCESS SUPPORT
COACHING
MINDSET NUDGING
CAREERS
COURSES
SCHEDULE
PRECISION OUTCOMES • ENROLLMENT • EQUITY • PERSISTENCE • COMPLETION • WORKFORCE • PLACEMENT COURSE
ENCOURAGEMENT
RESOURCES & PROGRAMS
POLICY EVALUATION
Civitas Learning® Copyright ©2018
BRINGING THE WORK TOGETHER
Personalized Precision Engagement Pathways
Student Success Intelligence Platform
CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2017 | CONFIDENTIAL
TIMELY, RELEVANT INSIGHTS – EMERGING TRENDS, STUDENT-LEVEL SCORES
SIGNAL INTELLIGENCE
O U T C O M E S PERSONALIZED PATHWAYS PRECISION ENGAGEMENT
PE R S O N A L IZ E D IN S I G H TS D R I VE A C T IO N A C R O S S T H E S T U D E N T L I F E C Y C L E
PREDICTIVE
INSTITUTION-SPECIFIC APPROACH – 2000+ PREDICTIVE MODELS IN PRODUCTION
MODELS
DEPTH OF DATA – 95% OF PREDICTIVE POWER COMES FROM DERIVATIVES
ENGAGEMENT ACADEMIC LIFE & LOGISTICS ● LMS activity streak ● Modality features ● Degree program alignment scores ● LMS relative-to-section average ● GPA consistency ● Credits withdrawal patterns
● Terms attempted/completed ratio ● Financial aid change variables DERIVATIVES
BREADTH OF DATA – CROSS-SYSTEM & CROSS-INITIATIVE
DATA SIS LMS FINANCIAL AID CRM ADMISSIONS TUTORING
Civitas Learning® Copyright ©2018
BRINGING THE WORK TOGETHER
Personalized Precision Engagement Pathways
Student Success Intelligence Platform
CIVITAS LEARNING® COPYRIGHT © 2018
Civitas Learning® Copyright ©2018CIVITAS LEARNING® COPYRIGHT © 2018
Civitas Learning® Copyright ©201817
Exemplar Signals across the Civitas:
OVERVIEW: ILLUME COURSES
YELLOW FLAG SIGNAL Course where even students with a C who persist may be at risk of not graduating.
CHALLENGE SIGNAL (GATEKEEPER/GATEWAY) A significantly above average percentage of students earn Ds, Fs or withdraw and have a lower likelihood of graduating compared to students who earn As, Bs or Cs.
QUALIFIER SIGNAL Only an A improves a student’s likelihood of graduating, where typically an A, B or C all improve graduation likelihood. In addition, students who earn a B are at least 15% less likely to graduate than those who earn an A.
LATE HURDLE SIGNAL Students most commonly take this course three or more years into their career, and student performance is significantly more predictive than other courses taken in the same year.
CIVITAS LEARNING® COPYRIGHT © 2018
Civitas Learning® Copyright ©2018
GRADE SIGNALSOVERVIEW: GRADE SIGNALS
YELLOW FLAG SIGNAL Students who earn “C” in an early term courses tend to persist but not graduate when compared to other courses taken in the same year.
In this English Composition and Rhetoric Course, students that receive a C are 94.4% likely to persist, but are only 52% likely to graduate, compared to an average graduation rate of 70%.
The graduation rate of students with a grade better than a C is 80%.
CIVITAS LEARNING® COPYRIGHT © 2018
Civitas Learning® Copyright ©2018
Civitas Learning® Copyright ©2018
Civitas Learning® Copyright ©2018
7.62
IMPACT ON STUDENT OUTCOMES
11.1 percentage points
P E
R S
I S
T E
N C
E
19.0 percentage points
on average and up to
with most challenged
CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
-
-
-
-
Civitas Learning® Copyright ©2018
COLLEGE SCHEDULER IMPACT ON PERSISTENCE
+2.4pp AVERAGE FOR
FALL 15 16 TERMS
+4.1pp AVERAGE FOR
SPRING 15 16 TERMS
+120 ADDITIONAL STUDENTS
+4.8pp AVERAGE FOR
FALL 15 16 TERMS
+512 ADDITIONAL STUDENTS
+745 ADDITIONAL STUDENTS
+1.7pp AVERAGE FOR
SPRING 15 16 TERMS
3X GREATER FOR STEM STUDENTS
CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2017
20% increase
in retention
53% more degrees
& credentials awarded
35% more graduates
CIVITAS LEARNING® COPYRIGHT © 2018
BRINGING THE WORK TOGETHER
Personalized Precision Engagement Pathways
Student Success Intelligence Platform
CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
COMMUNITY INSIGHT 2
GAINING DEEPER UNDERSTANDING OF HIGH GPA DEPARTURES
98% of institutions in this study are losing more students above 2.0 GPA than below it.
This benchmark is based on a data set of 4 million students from 62 institutions.
CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
CAMPAIGN: HIGH GPA, LOW-MODERATE PERSISTENCE
Outreach Goal • Come to advising, persistence
Students Targeted • Undergraduate, GPA 3.0-4.0 w/
low persistence likelihood
Outreach Owner
• Illume Working Group pulls student list, creates case for advisors
Strategy • Sent before spring midterms
Sample Email: We’re Proud of You!
Hi <student first name>,
I wanted to send you a note to see how your semester is going. College can be challenging this time of year and even the most successful students can struggle. Common challenges for students include job commitments, family responsibilities, financial pressures, transportation issues, or a combination of these and other issues. Do any of these sound familiar to you?
If you are experiencing any of these issues, or other things, I am here to help!
I am proud of your progress and excited to support your continued success.
Sincerely,
<Advisor Name>
CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
CAMPAIGN: NEAR-COMPLETERS & THE FINISH LINE
Outreach Goal
• Catalyze completion among students more than 75% of way
Students Targeted
• Students who had accumulated 75% of credits on ANY degree path, segmented by persistence likelihood
Outreach Owner
• Student success team
Strategy
• Identify optimal student group, segment outreach by persistence quartile – top/email, middle/calls, lowest/face to face
CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2017 | CONFIDENTIAL
31% increase in graduates in one year
38% increase in credentials awarded
CIVITAS LEARNING® COPYRIGHT © 2018
COMMUNITY INSIGHTS REPORT ISSUE 4
FOCUSING ON THE FINISH LINE
COMING SOON
CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
COMMUNITY INSIGHT 1
ONE-MORE COURSE INSIGHT
Differences in persistence rates between number of sections
(courses) attempted, according to institution type.
This benchmark is based on data across 57 institutions (34 community colleges and 23 4-year institutions).
Persistence may be increased with increased course load for some students.
• One more course
Largest increase (14.91 pp) for community
college students taking one course per
term versus two
• Continued, but declining, value
with each increase
Adding even one more course will not
be a reality for all students
• Education is not one-size-fits-all
Need to make realistic recommendations
to help all students
CIVITAS LEARNING® COPYRIGHT © 2018
C H I C A G O R E G I O N A L W O R K S H O P
THE PROGRAM
CIVITAS LEARNING, INC. -- CONFIDENTIAL INFORMATION
UNIFIED DATA LAYER
Target Audience: Students in good standing, enrolled in fewer than six hours for Spring 2018
Goal: Students enroll in just one more class, which may put them over the 5.14 credit hour tipping point indicated as a “top perseverance indicator” by Illume
Messaging: Taking one more class will help you achieve your goal faster
C H I C A G O R E G I O N A L W O R K S H O P
OUTCOME
UNIFIED DATA LAYER
2,036 emails
1,053 opens (52% open rate)
199 students added courses
289
Overall 1 percentage point lift in the percent of students taking 7 or more credit hours Spring ‘18 compared to Spring ’17.
CIVITAS LEARNING, INC. -- CONFIDENTIAL INFORMATION
CIVITAS LEARNING® COPYRIGHT © 2018
COMMUNITY INSIGHT 1
PARTNER INSIGHT
CIVITAS LEARNING® COPYRIGHT © 2018
Civitas Learning® Copyright ©2018CIVITAS LEARNING® COPYRIGHT © 2018
Civitas Learning® Copyright ©2018
Measure the impact of programs, policy changes & interventions
• Identify comparable control groups
• Leverage prediction-based propensity score matching
• Measure true intervention efficacy
• Meets What Works Clearinghouse guidelines
CIVITAS LEARNING® COPYRIGHT © 2018
Hi Sam,
Welcome to the university. Congratulations again on your
scholarship! We’re so happy to have you as a student. It was great
meeting you at our advising session last week.
Did you know our most successful students the real rock stars
visit the Writing Center an average of 6 times the first semester
their junior year. Let’s make sure you’re a rock star too! I can arrange
for you to meet up with another student to show you around the
center. Let’s talk.
The Writing Center
here
Civitas Learning® Copyright ©2018
Sam Jones
Hi Sam…wanted to let you
know that the Writing
Center is a big part of doing
well in your major. The
majority of students using
the writing center are
achieving A’s in their courses. Come see what’s available and how we can
support you! The Writing
Center is located in Goodall
Hall Room 223.
There is a meet-up at the
Writing Center for new
students at 7pm on Thursday.
Can you commit to going?
Maybe
Would you like a reminder on
Wednesday?
Yes
Hi Sam – Here is your
reminder that there is a
meet-up tomorrow at 7pm
for new students at the
Writing Center. 10 new
students are planning to
attend. Are you in?
– –
Matt Champion, Advisor
Civitas Learning® Copyright ©2018
BRINGING THE WORK TOGETHER
Personalized Precision Engagement Pathways
Student Success Intelligence Platform
CIVITAS LEARNING® COPYRIGHT © 2018
-
Civitas Learning® Copyright ©2018
A CLEAR PATH – FROM START TO FINISH
Start Strong
● Easily manage critical onboarding tasks
● Develop a deeper sense of belonging through personalized engagement
Stay on the Path to Success
● Follow course a roadmap, track progress, understand requirements, and evaluate potential plan changes
● Align degree and career, gain insight to job demand
● Quickly find the best fit schedule and enroll for classes
SCHEDULING
PLANNING
ONBOARDING & STUDENT
ENGAGEMENT
CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
THE CIVITAS: A COMMUNITY LEARNING TOGETHER
RESOURCES & RESEARCH
Tools & guidance to start stronger
& learn faster together
● Webinars on tactics & learnings
● Nudge hub
● Playbooks
● User guides
● Civitas Learning Space
● Community Insights Reports
● Podcasts on trends & tactics
● Additional support services
COMMUNITY OF PRACTICE
Networking & opportunities to learn from
other Civitas Partners & industry experts
● National Advisory Board (NAB): Dr. Vince Tinto, Dr. Linda Baer, Dr. Davis Jenkins
● Mission-aligned Investors: Lumina Foundation, ReThink, Valhalla
● Annual Summit: 250+ Partner attendees
● Regional Workshops: Throughout US each year
● Research Partnerships
The Civitas
Representing 300+ Partners
CIVITAS LEARNING® COPYRIGHT © 2018
April 2nd – 4th civitaslearning.com/summit
UNITE AT
CIVITAS LEARNING® COPYRIGHT © 2018