1Making Data Work - LACCD ATD Retreat 012011

8/3/2019 1Making Data Work - LACCD ATD Retreat 012011

1/30

Rob Johnstone & Priyadarshini Chaplot

LACCD Achieving the Dream Retreat

January 20, 2012

Making Your Data Work


2/30

What we will cover

1. Framing the issue

2. What we learned from the BRIC Initiative, theAspen Prize, and Completion by Design

3. Making the connection

Building Stronger Systems for SLOs and Program Review September 2011 2


3/30

WHO IS THE RP GROUP?

Putting our work in context



4/30

The RP Group

Strengthens the abilities of California communitycolleges to gather, analyze and act on informationin order to strengthen student success

Provides research, evaluation, professionaldevelopment, and technical assistance servicesthat support evidence-based decision-makingand inquiry

Work is defined and conducted by communitycollege practitioners



5/30

A RESOURCE FOR INSTITUTIONAL CHANGE

A Culture of Inquiry

An Applied Inquiry Framework for Student Completion September 2011 5


6/30

What is a Culture of Inquiry?

Institutional capacity for

supporting open, honest andcollaborative dialog focused on

strengthening the institution

and the outcomes of itsstudents.



7/30

Culture of Inquiry: Why All the Fuss?

Because this ongoing work is challenging

but necessary!

Work needs to marry insight & evidence

Problems are large and recurring

No silver bullet / evident answers

Multiple solutions likely needed

Progress is not linear

Requires cross constituency interaction



8/30

Culture of Inquiry: Features

Widespread sharing and easy access

to user-friendly information on student

outcomes

Encouraging more people to ask awider collection of questions and use

their evidence and conclusions to

enhance decision making Shared, reflective and dynamic

discussions



9/30

Culture of Inquiry: More Features

Multiple opportunities to discuss

information within and across

constituency groups

Continuous feedback so adjustmentscan be made along the way and

processes can be adapted

Culture that values curiosity,questions and robust conversations



10/30

THE IMPETUS FOR OUR WORK

Why does prioritizing a

culture of inquiry makesense?



11/30

Youre wasting

time and money

when your outcomesdont focus on

the right data.

11


12/30

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008

Retention Rate

Success Rate

1999 2008

20 year trend for

institutional outcomes

What does that tell us

about the usefulness ofthese metrics in setting

institutional strategies?



13/30

Much of what isneeded to support

good decision making is

beyond thetraditional

accountabilitymeasures.

13


14/30

What is Our Colleges Transfer Rate?


15/30

Data

do notspeak

for themselves.

15


16/30

The vital role of conversation

In order to make data useful, ample time and

space are needed to discuss and analyze the

information and connect it back to the original

research question.

Answers are not always immediately apparent,

so skilled facilitation may be needed

to dig out the deeper meaning.

Multiple perspectives and

types of information are often

needed to make sense of

individual data points.!


P3


17/30

Slide 16

P3 A visual would be fantastic. I would boil it down into:

- Adequate opportunities (time and space)- Guided inquiry and the importance of good facilitation

- Multiple perspectives tell a story betterPriya, 8/22/2011


18/30

WHAT CAN WE DO?

What the RP Group has

learned



19/30

BRICs on-campus support helps colleges

improve internal practices.

Technical experts who are community

college practitioners

Focus on discrete practices such as

program review

Opportunities for dialog



20/30

Strategy 1:Reform processes

to make them

simpler andprovide

more usefulinformation.

19


21/30

age 2:While what colleges developedvaried, each system was:

Meaningful Sustainable

Consistent


For example


22/30

Comprehensive Assessment Report Examples

http://www.rpgroup.org/resources/comprehensive-

assessment-reports-best-practice-examples-around-country

Resource Compendium on Assessment

http://www.rpgroup.org/resources/assessment-strategies-and-models-help-tell-story



23/30

Strategy 2: Create

space and

time to talk

so good ideas can

be put into action

22


24/30

Get conversations going using inquiry guides.

Assessing Student Learning Outcomes

Using an Equity Lens to Assess Student Learning

Assessing Student Services Outcomes

Maximizing the Program Review Process

Assessing Non-credit Student Learning Outcomes



25/30

Strategy 3:Make better use of

existing processes;dont

reinvent thewheel.

24


26/30

Strategy 4:Pick your

organizationalimprovement priorities

and stickto them.

25


27/30

Strategy 5:To build lasting

changes, ensureyou involve a

broad rangeof leadership.

26


28/30

WHAT THIS MEANS FOR YOU

How can you improve your

accountability and successefforts?



29/30

Brainstorm & DiscussPick one of the following questions to answer and pair up withsomeone to share your ideas.

What process could we simplify at our college?

How could we create more opportunities for conversationsabout our student outcomes?

What is a process we could redesign to make it moreuseful?

What should be my colleges top improvement priority?

How could we build stronger and deeper support forimprovement efforts?

Making Your Data Work November 2011 28


30/30

Find Out MoreThe RP Group Website

www.rpgroup.org

Rob Johnstone, Senior Research Fellow

[email protected]

Bob Gabriner, Leadership Chair

[email protected]

29

Documents

1Making Data Work - LACCD ATD Retreat 012011