34
EDUCAUSE Conference - November 2, 2017 Using Analytics to Precisely Target Students to Raise Retention & Graduation Rates and Unlock Performance-Based Funding Dr. Paul Dosal Vice President - Student Affairs & Student Success Dr. Travis Thompson Designer, Researcher, Instructor - Information Technology

10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

EDUCAUSE Conference - November 2, 2017

Using Analytics toPrecisely Target Students to

Raise Retention & Graduation Rates and Unlock Performance-Based Funding

Dr. Paul DosalVice President - Student Affairs & Student Success

Dr. Travis ThompsonDesigner, Researcher, Instructor - Information Technology

Page 2: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

The Student Success MOVEMENT at USF

Page 3: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

• SMART Lab• Living Learning Communities• Extended Library Hours• Career Services • Peer Financial Consulting

• Tutoring & Writing Services• Course Re-design• Degree Tracking Software• Academic Advocates• Informational Campaigns

Implemented policies, programs and practices, including:

Page 4: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

FTIC Retention Rate

*Source IPEDS: Data reported follows IPEDS methodology but are based on internal preliminary data.

Page 5: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

6-Year Graduation Rate

*Source IPEDS: Data reported follows IPEDS methodology but are based on internal preliminary data.

Page 6: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

4-Year Graduation Rate

*Source IPEDS: Data reported follows IPEDS methodology but are based on internal preliminary data.

Page 7: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Source IPEDS: Data reported follows IPEDS methodology but are based on internal preliminary data.

6-YearGraduation Rate: ETHNICITY& RACE

87%71.3%

73.9%67.7%

Page 8: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

6-Year Graduation Rate: PELL & NON-PELL

Source IPEDS: Data reported follows IPEDS methodology but are based on internal preliminary data.

Page 9: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

6-Year Graduation Rate: GENDER

Source IPEDS: Data reported follows IPEDS methodology but are based on internal preliminary data.

Page 10: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

We believe all students can and will succeed if giventhe opportunity to do so.

Dr. Paul DosalUSF Vice President – Student Affairs & Student Success

Page 11: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

The top performer, University of South Florida, receives very high marks for improving its graduation

rate and good—but not great—scores across the other dimensions. That’s good work, but they won’t

be satisfied with the results yet.

2016 Eduventures Student Success Ratings

Page 12: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

89% in 2012Moving off the PLATEAU

Page 13: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

From Plateau to PREEMINENCE

Page 14: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Turned to DATA for a Kick Start

Adoption of Miller/Herreid Persistence Model (2012) Pre-matriculation model identifies top 10% of new FTIC most

at risk of not persisting Student interventions coordinated through first-year course,

RAs, and advisors

Introduction of ‘Big Data’ (2014) Civitas Predictive Analytics Platform purchased Live data feed from SIS and LMS systems Data ingestion completed spring 2016

Page 15: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Civitas Predictive Analytics Platform

Page 16: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Empowering Frontlines to Reach the Right Students

Page 17: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Created Persistence Committee (2016)Cross functional team who identifies and supports all at-risk

students through timely and appropriate interventions Academic Advocates (case managers) Financial Aid Housing & Residential Education Academic Advisors Academic Foundations Instructors Cashier’s Office Orientation Team Leaders Library Career Counselors

Initial focus on 2015 cohortReceives list of at-risk students weekly and segments into

groups based on risk level

Page 18: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Pushing Higher with a CASE MANAGEMENT Model

Page 19: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Objective:Right SUPPORT, Right STUDENT, Right TIME Identify at-risk students before problems occurRefer students to the appropriate expert Transform passive support services into active outreachCreate a dynamic network of service providersShare data and reports to create 360 view of studentsUse communications tool more effectively to expand capacity

Page 20: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Case Management Model

•Responsible for assigned student population success

•Accountable to student outcomes•Use technology for proactive

management

Risk Identification & Segmentation

Individualized Support Strategies

Efficient Scalable Care

Which students are at risk? How do we use our resources strategically and efficiently to support the individual needs of these students?

High RiskStudents

Increasing RiskStudents

Low RiskStudents

Coordinate High-Touch CareWork closely with students and manage

Interactions with support offices/services.

Monitor and InterveneUse analytics to uncover problems before

they escalate.

Enable Self-DirectionUse electronic tools to nudge and advise,

freeing staff to focus on higher risk students.

Ownership & Accountability

Who owns student success?

Student Success Leadership•Oversee efforts•Organize resources & incentives•Track & report metrics

Advisors

Page 21: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Powering with TECHNOLOGY

Page 22: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Pillars for Archivum Insights

Assembles data from multiple sources to create a clear view of the current and future state of USF and our studentsLifeblood of our student support ecosystemPersonalized connection with each student we serveShines a bright light on policies, practices and

initiatives so we can precisely allocate our time and resources to do the most good

Page 23: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Process: Design Thinking + Agile/Scrum

Design team

sprint 4…

Delivery sprints

teambacklog

pre-production Releases

production release

sprint 1 sprint 2 sprint 3

Needfinding in Sprint 0

Personas

Collaborative Charter and business value measures

Story Map

2 week sprint to explore, refine, and plan product delivery 2 week sprints to iteratively and incrementally develop and

deliver releases comprised of the most valuable features

Architectural Prototypes

Release Plan

Mockups &Functional Prototypes

Page 24: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Student Profile SnapshotIncludes Academic Success Factors & Self-Service Hub

Page 25: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Student Success FactorsAcademic Profile expanded; click on items for more info

Page 26: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Personal Profile Provides context on students prior to advising meetings

Page 27: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Student Success DashboardShowing “My Corral” of each advisor’s assigned students and access to other functions

Page 28: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

My Cases and ReferralsAbility to filter and search cases and referrals

Page 29: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Care Team view of Academic ProfileStudent Success Factors integrated from multiple systems

Page 30: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

ReferralsEasily create referrals to departments or services

Page 31: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Finish In FourCare Team coordination toward on-time student graduation

Page 32: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Dr. Mark David MillironCo-founder & Chief Learning Officer - Civitas Learning

Like healthcare, we are poised tosignificantly change things in higher education.

It’s likely we will look back in 10 years and makethe argument that we never want to go back

to our dark ages.

Page 33: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production

Next StepsEnhance and expand the case management approachExpand the use of predictive analyticsClose the gender gap Transform student support from passive to activeDesign “reports” with strong information-action pairings

Page 34: 10-2017 Using Analytics to Precisely Target[1]€¦ · Process: Design Thinking + Agile/Scrum Design team sprint 4… Delivery sprints team backlog pre-production Releases production