132
Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Embed Size (px)

Citation preview

Page 1: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Leadership for Effective Implementation and Sustainability of PBIS

Kent McIntosh

University of Oregon

Page 2: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

1. Describe the concepts of implementation science and sustainability

2. Share the factors related to promoting sustainability of PBIS in schools

3. Provide activities to use in your schools for sustaining effective practices…as soon as tomorrow

4. Provide time to build an action plan

Goals for this Evening

Handouts:http://www.pbis.org

Page 3: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Support for these projects:

IES: NCSER (R324A120278)

OSEP: TA Center on PBIS (H326S03002)

Social Sciences and Humanities Council of Canada (SRG F09-05052)

Hampton Endowment Fund (J07-0038)

Page 4: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Investigating your Systems of SupportCSI Maps

Page 5: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

RESPONSE TO INTERVENTION

AND THE THREE TIER MODEL 1-5% Tier 3 - Supports for a Few

5-15% Tier 2 - Supports for Some

80-90% Tier 1 - Supports for All

Page 6: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

in order to increase student success

=

These students get these tiersof support

+

Three Tiered Model of Student Supports(from Susan Barrett)

The goal of the tiers is student success, not labeling

Page 7: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

C = Core (Universal) S = Strategic (Targeted) I = Intensive (Intensive) Write down the support provided at each

tier (strategies, programs, interventions) Write down how your school identifies

what level of support students need

CSI Maps

handout

Page 8: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

RESPONSE TO INTERVENTION

AND THE THREE TIER MODEL

Page 9: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

C = Core (Universal) S = Strategic (Targeted) I = Intensive (Intensive) Write down the support provided at each

tier (strategies, programs, interventions) Write down how your school identifies

what level of support students need

CSI Maps

Page 10: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

1. Identify GAPS in: 1. Support

2. Assessment

2. Consider priorities for filling gaps

CSI Maps: Interpretation

Page 11: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

What did you learn? What surprised you?

Discussion

Page 12: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Next, put a check mark next to the practices/interventions/strategies for which: You collect student outcomes dataStudent outcomes data show improvement

Going Deeper:Outcomes

Page 13: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

What did you learn? What surprised you?

Discussion

Page 14: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

The extent to which the critical features of the practice (e.g., PBS) are implemented as intended

Helps us improve outcomes for students Helps team target next steps and areas for

improvement

What is… fidelity of implementation?

Why assess it?

Page 15: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

“Fidelity of implementation of academic and behaviour interventions is documented before measuring effects and assigning worth to them or blaming children (and teachers) for continuing failure.”

(Algozzine, Putnam, and Horner, 2012)

Use of Fidelity Data

Page 16: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

1. Identify the critical features of effective practices

2. Show the degree to which our agreements and values are visible in our daily practice

3. Should be used to celebrate successes and continual growth as opposed to magnifying shortcomings

Good fidelity of implementation tools…

(adapted from Miller, 2010)

Page 17: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

How do you track that you have implemented well?

Now, circle practices/interventions for which you collect fidelity data

Fidelity of Implementation Considerations

Page 18: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

What did you learn? What surprised you?

Discussion

Page 19: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

What happens next? Name 2 action plan steps

Report Out

Page 20: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Action Plan

handout

Page 21: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

We just took inventory of the WHAT and organized it by tiers

WHAT = the practices, programs or strategies themselves

Now let’s talk about the HOW

HOW = putting them in place

The WHAT and the HOW

Page 22: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

An Introduction toImplementationScience

Page 23: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

What do we mean by implementation?

“A specified set of purposeful activities at the practice, program, and system level designed to put into place a program or intervention of known dimensions with fidelity.”

What is implementation science?“The study of how to promote implementation.”

Definitions

Page 24: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Common perception

TRAINING

IMPLEMENTATION

=

Page 25: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Implementation Equation

Effective InterventionsThe “WHAT”

Effective Implementation

The “HOW”

Positive Outcomes for

Students (and adults)

Page 26: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Dean Fixsen

“Students cannot benefit from

interventions they do not experience.”

Page 27: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

The State of the ArtSynthesis of

implementation research from 1970-2004

Program development and replication data

Qualitative study of programs

The National Implementation Research Network Monograph

ctndisseminationlibrary.org/PDF/nirnmonograph.pdf

Page 28: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Evidence-based Interventions

Actual SupportsYears 1-3

Outcomes Years 4-5

Every Teacher Trained

Fewer than 50% of the teachers received some training

Fewer than 10% of the schools used the CSR as intended

Every Teacher Continually Supported

Fewer than 25% of those teachers received support

Vast majority of students did not benefit

Aladjem & Borman, 2006; Vernez, Karam, Mariano, & DeMartini, 2006

Longitudinal Studies of a Variety of Comprehensive School Reforms

Lessons from Failed Efforts (Fixsen, 2013)

Page 29: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

LETTING IT HAPPENTeachers are accountable

vs.

MAKING IT HAPPEN Implementation teams are accountable

Quality Implementation

Based on Greenhalgh, Robert, MacFarlane, Bate, & Kyriakidou, 2004

Page 30: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

1. We pick what’s most likely to workEvidence-based practices

2. We organize our resources for successMulti-tiered systems of supportFollow stages of implementation

How do we MAKE IT HAPPEN?

Exploration Installation

Initial ImplementationFull Implementation

Sustainability

Page 31: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Stages of Implementation(Fixsen et al., 2005)

Exploration

Installation

Initial Implementation

Full Implementation

Sustainability

Page 32: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Stage Primary Goal Key Implementation ActivitiesExploration To determine whether the

practice is a good match for the community, based on the needs and resources of the community and the demands and benefits of the practice

-Investigating the practice-Assessing needs and resources of the community and the demands and benefits of the practice -Developing an implementation plan for the chosen practice, including action items and a clear timeline

Stages of Implementation

Page 33: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Stages of Implementation

Stage Primary Goal Key Implementation ActivitiesInstallation To prepare and structure the

resources and supports to build a solid framework for implementation

-Ensuring adequate funding and staffing-Developing mechanisms related to initial implementation and the day to day routines of the practice (e.g., referral forms, data management systems)-Training the school personnel to implement the practice

Page 34: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Stages of Implementation

Stage Primary Goal Key Implementation ActivitiesInitial Implementation

To maintain the fidelity and principles of the practice throughout the initial resistance to change

-Implementing the practice with students-Structuring a support system for troubleshooting and professional development to maintain the fidelity of the practice and keep morale high

Page 35: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Stages of Implementation

Stage Primary Goal Key Implementation ActivitiesFull Implementation

To continue to carry out the practice with high fidelity and monitor effectiveness as the practice shifts from a new initiative to the routine practice (i.e., the status quo)

-Monitoring fidelity with formal measures and comparing to fidelity criterion goals-Assessing practice effectiveness once fidelity criterion goals are met

Page 36: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Stages of Implementation

Stage Primary Goal Key Implementation ActivitiesSustainability To respond to shifts in the

community and in original support for the practice (e.g., staff turnover, loss of funding) and maintain the practice, with high fidelity, through these changes

-Continuing to monitor fidelity and effectiveness-Maintaining an awareness of the needs of the community as they change-Ensuring proper support and training in the practice as new staff enter the community

Page 37: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

What do we usually do well?What do we usually not do well?

Exploration

Installation

Initial Implementation

Full Implementation

Sustainability

Page 38: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

What are the odds that a given school initiative will sustain?

Page 39: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

(Latham, 1988)

Page 40: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

What specific experiences have you had with initiative abandonment?

Implementation Autopsies

Page 41: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

1. React to Problem Behavior

2. Select and Add Practice

3. Hire Expert to

Train Practice

4. Expect (Hope) for Implemen-

tation

5. Wait for new

problem

Get off the Train & Hope Train

Page 42: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

1. If you continued on the same or similar path, what will be the likely result?

2. What would it look like in your “dream work world”?

Back to your CSI Maps

Page 43: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

1. We pick what’s most likely to workEvidence-based practices

2. We organize our resources for successMulti-tiered systems of supportFollow stages of implementation

3. We provide support to the adults who are supporting the studentsOngoing coachingDistrict systems

How do we MAKE IT HAPPEN?

Exploration Installation

Initial ImplementationFull Implementation

Sustainability

Page 44: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

SustainabilityDurable implementation of a practice at a

level of fidelity that continues to produce valued outcomes (McIntosh et al., 2009)

Definition

Page 45: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

OngoingChallenge

StudentOutcomes

Select Practices& Implement with Fidelity

Antecedent Behavior Consequence

Barriers to Sustainability: The Three Cs

Changes in Context

- Lack of contextual fit

- New challenges exist

- Competing initiatives

Changes in Capacity

- Loss of funding

- Attrition of key opersonnel

Changes in Consequences

- Diminished effectiveness odue to poor fidelity

- Outcomes no longer operceived as important

Page 46: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Identifying barriers (and plans to address them) is a critical step in systems-level change (Curtis, Castillo, & Cohen, 2008)

Sometimes you need to avoid those obstacles!

Why “admire the problem?”

Page 47: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Sustainability ActivityBarriers to Sustainability Worksheet

Page 48: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Barriers to Sustainability Worksheet

Risk Factors/Barriers

Plan to Address Barriers

Changes in Context

Changes in Capacity

Changes in Consequences

Page 49: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

OngoingChallenge

StudentOutcomes

Select Practices& Implement with Fidelity

Antecedent Behavior Consequence

Barriers to Sustainability: The Three Cs

Changes in Context

- Lack of contextual fit

- New challenges exist

- Competing initiatives

Changes in Capacity

- Loss of funding

- Attrition of key opersonnel

Changes in Consequences

- Diminished effectiveness odue to poor fidelity

- Outcomes no longer operceived as important

Page 50: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Please share:A barrier to sustainability (past or present)Your plan for addressing it (if you have one)

A Sustainable Community of Practice

Page 51: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Perceived Importance of Contextual Features for Sustainability of PBISMcIntosh, K., Predy, L., Upreti, G., Hume, A. E. & Mathews, S. (2014). Perceptions of contextual features related to implementation and sustainability of School-wide Positive Behavior Support. Journal of Positive behavior Interventions, 16, 29-41.

Page 52: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Admini

strato

r Sup

port

Staff B

uy-in

Fidelity

Data

Teaming

Resou

rces

Stakeh

older

Invo

lvemen

t

Trainin

g

SWPBS P

hilos

ophy

Moti

vatio

n

Distric

t Sup

port

0

10

20

30

40

50

60

70

Nu

mb

er o

f R

esp

onse

s

Enablers of Sustainability

How would you answer?

Page 53: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

School Administrator Support

Ok…what do we do when…1. A committed administrator moves on?

2. An administrator is opposed to PBIS?

Most important single perceived factor in sustainability?

Page 54: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

School TeamMaintain the PBIS handbookDocument support among staff and stakeholdersCollect and share outcomes dataMeet with the new administrator

District TeamBuild PBIS into written policyBuild PBIS competencies into hiring criteriaDevelop district coaching capacity

Sustaining PBIS through Administrator Turnover(Strickland-Cohen, McIntosh, & Horner, 2014)

Page 55: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Interviews with 10 principals initially opposed or lukewarm to PBIS but are now champions

Interview questions:1. What helped your active support for PBIS?

2. What hindered your active support for PBIS?

3. What would have made you support PBIS from the onset?

Research on Enhancing Principal Support(McIntosh, Kelm, & Canizal Delabra, in press)

Page 56: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

District Actions Provide “Principal Academies” for new administrators

Basics of PBIS Role of administrators

Provide coaching to schools Networking

Arrange informal conversations with other principals supportive of PBIS

Arrange site visits at nearby PBIS schools At the school

Help school staff demonstrate support

Helpful Strategies for Enhancing Principal Support(McIntosh, Kelm, & Canizal Delabra, in press)

Page 57: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

For schools already implementing PBIS, barriers are perceived as less important than facilitators (McIntosh et al., 2014)

…and the presence of common barriers is only weakly related to

sustained fidelity of implementation (Turri et al., under review)

Feeling depressed about barriers?

Page 58: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

U.S. Schools using PBISAugust, 2015 21,278

00 01 02 03 04 05 06 07 08 09 10' 11' 12' 13' 14' 15' 16' 17' 18'0

2500

5000

7500

10000

12500

15000

17500

20000

22500

25000

Page 59: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Of 915 schools, what proportion of schools were still sustaining PBIS after 5 years?

93%

Predicting Abandonment of PBIS (Nese et al., under review)

Page 60: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

In what year did schools abandon PBIS?

1 2 3 4 5 6 7

-5%

0%

5%

10%

15%

20%

25%

30%

Implementation Year

% o

f A

band

onin

g Sc

hool

s

Page 61: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Promote PRIORITY Ensure EFFECTIVENESS Increase EFFICIENCY Use data for CONTINUOUS

REGENERATION

Four Principles for Sustaining PBIS

Page 62: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Importance in comparison to other practices

Incorporation into core system components

Connection to other initiatives

What is PRIORITY?

Page 63: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Maximize visibilityPresent data to people with resourcesDescribe effects of abandoning support for the

practice Get into written policy Braid project with other initiatives

Show how practice can lead to outcomes of new initiatives

Promoting PRIORITY

Page 64: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

What is braiding?

(Bohanon, Goodman, & McIntosh, 2009)

Page 65: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Setting Events TriggeringAntecedents

MaintainingConsequence

Behavior

Presence ofPBIS Coach

Prevalenceof

ProblemBehavior

ImplementPBIS Reductions

InProblemBehavior

DesiredAlternative

TypicalConsequenceSummary Statement

AcceptableAlternative

Page 66: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

RestorativePractices

Social &EmotionalLearning

Anti-Bullying Initiatives

Family Engagement

Academic Achievement

Reducing Racial

Inequities

School-basedMental Health

Page 67: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

1. Identify shared, valued outcomes What are our overall goals?

2. Defend against activities that don’t help us meet those goals

No free lunches

3. Find common structures (and language) that can be integrated

Teams, data, professional development

Steps in Braiding Initiatives

Page 68: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Sustainability ActivityBraiding worksheet

Page 69: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

handout

Page 70: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

1. Identify a new initiative you want to implement (e.g., PBS, MTSS) and write it at the top

2. Write all existing initiatives in the first column

3. Complete the rows to find the value added by adopting the new initiative

MTSS Initiative Alignment Worksheet

Page 71: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon
Page 72: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Newsletters To parents

Monthly/quarterly reports To school staff

Formal presentations To school board To district administrators To PTA To community agencies and businesses

Local news

Make PBIS Efforts Public!

Page 73: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Newsletters

Page 74: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Extent to which the practice results in desired outcomes

Effects must be attributed to the practice

What is EFFECTIVENESS?

Page 75: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

2006-07 2007-08 2008-09 2009-100

5000

10000

15000

20000

25000

30000

35000

0

50

100

150

200

250

300

350

400

ODR's

Positives

Po

siti

ve R

efer

ral

Sli

ps

Off

ice

Dis

cip

lin

e R

efer

rals

Positive Referrals vs. ODRs:FG Leary Fine Arts School, Chilliwack, BC

Page 76: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Focus on FIDELITY OF IMPLEMENTATION Assess it regularly Use it to enhance what you

already do Share data showing how

fidelity is related to effects

Ensuring EFFECTIVENESS

Page 77: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Team Implementation Checklist (TIC) PBIS Self-Assessment Survey (SAS) School-wide Evaluation Tool (SET) School-wide Benchmarks of Quality (BoQ) Benchmark of Advanced Tiers (BAT) Monitoring Advanced Tiers Tool (MATT) PBIS Tiered Fidelity Inventory (TFI)

Available at: http://pbisapps.org

Measures to assess FIDELITY

Page 78: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Relationship between continued effort and continued effectiveness

Weighed against other potential practices

What is EFFICIENCY?

Page 79: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Get it down on paperLesson plansSchedulesAgendas

Focus on efficient team meetings

Increasing EFFICIENCY

Page 80: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Initiative, Committee

Purpose Outcome Target Group

Staff Involved

SIP/SID/etc

Attendance Committee

Character Education

Safety Committee

School Spirit Committee

Discipline Committee

DARE Committee

PBIS Team

Working Smarter Team Matrix

1. Eliminate all initiatives that do NOT have a defined purpose and outcome measure

2. Combine initiatives that have the same outcome measure and same target group

3. Combine initiatives that have 75% of the same staff

4. Eliminate initiatives that are not tied to School Improvement Goals

handout

Page 81: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Initiative, Committee

Purpose Outcome Target Group

Staff Involved

SIP/SID

Attendance Committee

Increase attendance

Increase % of students attending daily

All students

Eric, Ellen, Marlee

Goal #2

Character Education

Improve character

Improve character All students

Marlee, J.S., Ellen

Goal #3

Safety Committee

Improve safety Predictable response to threat/crisis

All students

Has not met Goal #3

School Spirit Committee

Enhance school spirit

Improve morale All students

Has not met

Discipline Committee

Improve behavior

Decrease office referrals All students

Ellen, Eric, Marlee, Otis

Goal #3

DARE Committee

Prevent drug use

All students

Don

PBIS Team Implement 3-tier model

Decrease ODRs, increase attendance, enhance academic engagement, improve grades

All students

Eric, Ellen, Marlee, Otis, Emma

Goal #2Goal #3

Sample Team Matrix

Page 82: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Collection of data to monitor fidelity, outcomes and context

Adaptation over time while keeping critical features intact

Ongoing investment in building local capacity

What is CONTINUOUS REGENERATION?

Page 83: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Adjust practices for a changing environmentPriorityEffectivenessEfficiency

Connect with a community of practice

Using data for CONTINUOUS REGENERATION

Page 84: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Share fairs, networking sessions, district mini-conferences, web-based sharing

Opportunities for school teams to:Celebrate successesLearn from peersSteal ideasContinue momentum Invite important stakeholders

Create Communities of Practice

Page 85: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

http://www.pbismissouri.org http://www.pbisillinois.org http://bcpbs.wordpress.com http://pbismaryland.org http://www.cenmi.org/miblsi http://www.modelprogram.com/ http://www.PBISmn.org/ http://www.PBISvideos.org/

Legal Downloads

Page 86: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

0

10

20

30

40

50

60

October November

To

tal

OD

Rs

Playground

Classroom

Using Data for Decision MakingSifton Elementary, Vancouver, WA

Page 87: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Sifton Playground Challenge

Page 88: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

0

10

20

30

40

50

60

October November

To

tal

OD

Rs

Playground

Classroom

Using Data for Decision MakingSifton Elementary, Vancouver, WA

Page 89: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

0

10

20

30

40

50

60

October November

To

tal

OD

Rs

Playground

Classroom

Using Data for Decision MakingSifton Elementary, Vancouver, WA

Page 90: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

When you keep it fresh……avoid lethal mutations

Consider the critical features of what makes PBIS effectiveReward systems – recognition of their success

Not a scrap of paper without recognition Not insincere praise Not the same for everyone!

Cautions for Continuous Regeneration

Page 91: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Sustainability ActivityPBIS Systems Checkup

Page 92: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

handout

Page 93: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Research on PBIS Sustainability

Page 94: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

What is the strongest predictor of PBIS sustainability?

McIntosh, K., Mercer, S. H., Hume, A. E., Frank, J. L., Turri, M. G., & Mathews, S. (2013). Factors related to sustained implementation of School-wide Positive Behavior Support. Exceptional Children, 79, 293-311.

Page 95: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Having a supportive administrator?

Having a strong PBIS team?

What is more important to sustainability?

Page 96: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Model fit indices acceptable (except χ2) χ2 (731) = 881.55, p < .001, CFI = .96, TLI = .96,

RMSEA = .03 R 2 = .45 Factors

Priority (B = .14, SE = .39, p > .05)Team Use of Data (B = .61, SE = .24, p < .05)District Priority (B = -1.14, SE = .66, p > .05)Capacity Building (B = .98, SE = .43, p < .05)

Results: Predictive Model

Page 97: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Sustained PBIS

Fidelity

5.38**

.07

Team Use of Data

School Priority

.47

8888888888888888888888888888888

District Priority

Capacity Building

Sustained PBIS

Fidelity

-.34

.41

88888

888

Page 98: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Having a supportive administrator

Having a strong PBIS team

What is more important to sustainability?

Page 99: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

PBIS is most sustainable with a supportive administrator and a strong team

If administrators take too much of a lead, sustainability can suffer

School teams can benefit from training in running meetings and using data

District systems (coaching, training, CoPs) enable both admins and teams

Takeaways

Page 100: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Your Turn! Find someone next to you:

1. Do you have a champion in your school?

2. How would your systems fare if that person moved on?

3. What steps do you need to take to ensure that you’ll continue the work?

Page 101: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

What critical features predict sustained PBIS implementation?Mathews, S., McIntosh, K., Frank, J. L., & May, S. (2014). Critical features predicting sustained implementation of school-wide positive behavior support. Journal of Positive Behavior Interventions, 16, 168-178.

Page 102: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Research Questions

1. To what extent do school personnel ratings of implementation of PBIS systems significantly predict sustained implementation and levels of problem behavior?

2. Within any statistically significantly predictive PBIS systems, which critical features of these systems significantly predict sustained implementation?

Page 103: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Four SystemsSchool-wideNon-classroomClassroom Individual

PBIS Self-Assessment Survey (Sugai, Horner, & Todd, 2000)

Page 104: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

School-wideNon-classroomClassroom Individual

Which system best predicts sustained implementation (BoQ) 3 years later?

Page 105: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

School-wideNon-classroomClassroom Individual

Which system best predicts student outcomes (ODRs) 3 years later?

Page 106: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Expected behaviors defined clearly Problem behaviors defined clearly Expected behaviors taught Expected behaviors acknowledged regularly Consistent consequences CW procedures consistent with SW systems Options exist for instruction Instruction/materials match student ability High rates of academic success Access to assistance and coaching Transitions are efficient

Which features best predict sustained implementation?

Page 107: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Focus on bringing PBIS into the classroomConsistency with SW systemsHigh rates of acknowledgment for prosocial

behavior Focus on quality differentiated instruction

across academic domainsStudent instruction at their level

Lessons learned for sustaining School-wide PBIS

Page 108: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon
Page 109: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Matrix

SETTING

All Settings

Hallways Playground CafeteriaLibrary/

Computer Lab

Assembly Classroom

Respect Ourselves

Be on task.

Give your best effort.

Be prepared.

Walk. Have a plan.

Eat all your food.

Select healthy foods.

Study, read, compute.

Sit in one spot.

Respect Others

Be kind.Hands/feet

to self.Help/share

with others.

Use normal voice

volume.Walk to right.

Play safe.Include others.Share

equipment.

Practice good table manners

Whisper.Return books.

Listen/watch.Use

appropriate applause.

Respect Property

Recycle.Clean up after self.

Pick up litter.

Maintain physical space.

Use equipment properly.

Put litter in garbage can.

Replace trays &

utensils.Clean up

eating area.

Push in chairs.

Treat books carefully.

Pick up.Treat chairs appropriately

.

Expe

ctati

ons

Page 110: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

EXPECTATIONS

Classroom Procedures/Routines

Class-Wide ArrivalCooperative

LearningGroups

IndependentSeat Work

Whole Group

Identify Attention Signal…….Teach, Practice, Reinforce

Be Respectful

Be Responsible

Be Safe

Page 111: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

EXPECTATIONS

Classroom Procedures/Routines

Class-Wide ArrivalCooperative

LearningGroups

IndependentSeat Work

Whole Group

Identify Attention Signal…….Teach, Practice, Reinforce

Be Respectful

• Listen to others• Use inside

voice • Use kind words• Ask permission

• Enter/exit classroom prepared

• Use inside voice

• Listen to others• Acceptdifferences• Use kind words• Encourageothers

• Use quiet voice

• Follow directions

• Eyes/ears on speaker

• Raise hand to speak

• Contribute to learning

Be Responsible

• Be prepared• Follow

directions• Be a problem

solver• Make choices

that support your goals

• Place materials in correct area

• Begin warm-up promptly

• Use Time Wisely

• Contribute• Complete your

part

• Be a TASK master

• Use your neighbour

• Follow directions

• Take notes• Meet your

goals

Be Safe

• Keep hands, feet, and objects to self

• Organize your self

• Walk

• Walk • Use Materials Carefully

• Keep hands, feet, and objects to self

• Stay at seat• Keep hands,

feet, and objects to self

Page 112: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

What do long-term sustainers tell us about sustainability?

Andreou, T. E., McIntosh, K., Ross, S. W., & Kahn, J. D. (2015). Critical incidents in sustaining school-wide positive behavioral interventions and supports. Journal of Special Education, 49, 157-167.

Page 113: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Three schools and their school district in rural British Columbia

Sustained PBIS systems for over a decade with minimal provincial support

17 educators 4 District administrators (current or former)4 Principals (current or former)6 General education teachers3 Special education teachers

Settings and Participants

Page 114: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Qualitative interview questions:1. What helps sustainability of PBIS?

2. What hinders sustainability of PBIS?

Method

Page 115: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Findings: 13 Categories Continuous Teaching Positive

Reinforcement SWPBIS Team

Effectiveness Staff Ownership Adaptation Community of

Practice Involving New

Personnel

Use of Data Access to External

Expertise Maintaining Priority School Administrator

Involvement Staff Turnover Conflict of Personal

Beliefs/Mistaken Beliefs

Page 116: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

“They believe that what we’re doing is actually making a difference because we see change in behavior.”

“If people find a very positive environment with children…they’re very respectful and so on…then you want to...It reinforces that what we’re doing is right and we don’t want to lose that, we want to keep going.”

Positive Reinforcement

Page 117: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

“If it is given to you from the principal, then there is an automatic reaction, the question is whether I have to do it or I don't have to do it...Coming from a teacher…there is a reason for why you’re doing it, because it makes my job easier, because I can tell you as a colleague, hey I'm doing this and it's…staff driven. Not being told to do it.”

Staff Ownership

Page 118: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

“First year teachers, they’re overwhelmed, but we kept saying, you know, we’d love to see you at a meeting, you know, it would really help out. And so when they go there it just automatically includes, “you need to start understanding how it really works.”

Involving New Personnel

Page 119: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

PBIS Leadership Team Self-AssessmentA self-assessment and action planning tool for

district, regional, or state leadership teamsAn integrated action plan for sustainabilityAvailable for free at: http://pbis.org

A District Planning Tool for Sustainability

Page 120: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

The SUBSIST ChecklistA research validated self-assessment and

action planning tool for school teams and coaches

An integrated action plan for sustainabilityAvailable for free at:

http://kentmcintosh.wordpress.com

A School Team Planning Tool for Sustainability

Page 121: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Sustainability ActivitySUBSIST Checklist

Page 122: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

1. Complete Self-AssessmentWhat do we have in place?What would be the one addition that would

make the biggest difference?

2. Create an Action Plan to enhance sustainability

Identify WHO will do WHAT by WHEN

SUBSIST Checklist:Self-Assessment for Sustainability

handout

Page 123: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Please share:One of your school’s sustainability strengths

What’s working, strategies, ongoing activities, etc. How you overcame an obstacle

Your top action plan task

A Sustainable Community of Practice

Page 124: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Something for Tomorrow

Page 125: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Teachers are given a stamped, pre-addressed postcard for each student in their classrooms at the start of the year

GOAL: send a quick, positive note home for each student in the school

“Positive Parent Postcards”

Page 126: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Provide students with a school-wide matrix (with blank expectation by setting cells)

Have students write (or draw) expectations for each area

Use results to:Revise matrix to include more

“student-friendly” examples Identify areas or expectations that need

reteaching

“The Blank Matrix Activity”

Page 127: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

In one word, what have you found to be the single greatest FACILITATOR of sustainability?

Your Turn Again (time permitting)

Page 128: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

In one word, what have you found to be the single greatest BARRIER to sustainability?

Your Turn Again (time permitting)

Page 129: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Complete the following steps with your team or on your own:

1. What are the three things that you think would make the most impact on your school’s systems?

2. Create an action plan:

Consider WHO will do WHAT by WHEN

Your Turn Again (time permitting)

Page 130: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Contact Information

Kent McIntoshSpecial Education Program

University of Oregon

[email protected]

@_kentmc

Handouts: http://kentmcintosh.wordpress.com

Cannon Beach, Oregon © GoPictures, 2010

Page 131: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

Coffey, J., & Horner, R. H. (2012). The sustainability of school-wide positive behavioural interventions and supports. Exceptional Children, 78, 407-422.

Curtis, M. J., Castillo, J. M., & Cohen, R. (2008). Best practices in system-level change. In A. Thomas & J. P. Grimes (Eds.), Best practices in school psychology V (pp. 887-901). Bethesda, MD: National Association of School Psychologists.

Gietz, C. & McIntosh, K. (2014). Relations between student perceptions of their school environment and academic achievement. Canadian Journal of School Psychology, 29, 161-176.

Hume, A. E., & McIntosh, K. (2013). Construct validation of a measure to assess sustainability of school-wide behavior interventions. Psychology in the Schools, 50, 1003-1014.

Mathews, S., McIntosh, K., Frank, J. L., & May, S. (2014). Critical features predicting sustained implementation of school-wide positive behaviour support. Journal of Positive Behavior Interventions, 16, 168-178.

Selected References

Page 132: Leadership for Effective Implementation and Sustainability of PBIS Kent McIntosh University of Oregon

McIntosh, K., Horner, R. H., & Sugai, G. (2009). Sustainability of systems-level evidence-based practices in schools: Current knowledge and future directions. In W. Sailor, G. Sugai, R. H. Horner, G. Dunlap (Eds), Handbook of positive behavior support (pp. 327-352). New York: Springer.

McIntosh, K., MacKay, L. D., Hume, A. E., Doolittle, J., Vincent, C. G., Horner, R. H., & Ervin, R. A. (2011). Development and initial validation of a measure to assess factors related to sustainability of school-wide positive behaviour support. Journal of Positive Behavior Interventions, 13, 208-218. doi: 10.1177/1098300710385348

McIntosh, K., Mercer, S. H., Hume, A. E., Frank, J. L., Turri, M. G., & Mathews, S. (2013). Factors related to sustained implementation of school-wide positive behaviour support. Exceptional Children, 79, 293-311.

McIntosh, K., Predy, L. K., Upreti, G., Hume, A. E., Turri, M. G., & Mathews, S. (2014). Perceptions of contextual features related to implementation and sustainability of school-wide positive behaviour support. Journal of Positive Behavior Interventions, 16, 29-41.

Vaughn, S., Klingner, J., & Hughes, M. (2000). Sustainability of research-based practices. Exceptional Children, 66, 163-171.

Selected References