9
Adopt, adapt or abandon? Instructors’ Decisions to use Research-Based Materials Stephanie Chasteen Rachel Pepper, Steven Pollock, Katherine Perkins Science Education Initiative University of Colorado - Boulder

Adopt Adapt or Abandon? Instructors' Decisions to Use Research-Based Materials

Embed Size (px)

DESCRIPTION

This is from my talk at AAPT 2011 Physics education researchers often develop materials for classroom use. Instructors then choose which of those materials they would like to implement. We present a case study of University of Colorado’s transformed junior E&M course. After the transformation work in Sp/Fa 2008, 4 subsequent instructors of this course decided which materials – such as tutorials, clicker questions, or use of documented student difficulties – to use. Based on detailed interviews of those instructors, we examine what was and was not sustained, and discuss aspects of the course materials that enabled sustainability across instructors. We also present examples of less successful implementation that provide useful feedback on the use of PER-based resources – both for educational researchers and for the instructors making use of these instructional techniques.

Citation preview

Page 1: Adopt Adapt or Abandon?  Instructors' Decisions to Use Research-Based Materials

Adopt, adapt or abandon?Instructors’ Decisions to use

Research-Based Materials

Stephanie Chasteen Rachel Pepper, Steven Pollock, Katherine Perkins

Science Education InitiativeUniversity of Colorado - Boulder

Page 2: Adopt Adapt or Abandon?  Instructors' Decisions to Use Research-Based Materials

PER at ColoradoFaculty:

Melissa DancyMichael DubsonNoah FinkelsteinValerie OteroKathy PerkinsSteven PollockCarl Wieman (on leave)

Postdocs/ Scientists: Charles BailyDanny CaballeroStephanie ChasteenJulia ChamberlainKelly LancasterLaurel MayhewEmily MooreAriel PaulRachel PepperNoah PodolefskyBenjamin Zwickl

Grad Students:Stephanie Barr Kara GrayLauren Kost-Smith (PhD May 11)May LeeMike RossBen SpikeBen Van DusenBethany Wilcox

Teachers / Partners / Staff:Shelly BelleauJackie Elser, Trish Loeblein Susan M. Nicholson-DykstraSara SeverenceEmily QuintyMindy Gratny, Kate KidderJohn Blanco, Sam ReidChris Malley, Jon OlsonOliver Nix, Nina Zabolotnaya

Page 3: Adopt Adapt or Abandon?  Instructors' Decisions to Use Research-Based Materials

Background

• Transformed first-semester of junior E&M‣ Learning Goals

‣ Concept Tests / Clicker Questions

‣ Student Difficulties

‣ Tutorials

‣ Modified Homework

• Created digital course archives (www.colorado.edu/sei)

• Developed conceptual diagnostic, the CUE

Image copyright Vadim Plessky

Page 4: Adopt Adapt or Abandon?  Instructors' Decisions to Use Research-Based Materials

Rigorous Documentation

• Tracked use of materials

• Tracked student demographics

• Observed classrooms

• Analyzed student attitude/feedback surveys

• Interviewed instructors

Image copyright Vadim Plessky

We will provide the main outcomes of a variety of systematic analyses:

Page 5: Adopt Adapt or Abandon?  Instructors' Decisions to Use Research-Based Materials

!"!#

$!"!#

%!"!#

&!"!#

'!"!#

(!"!#

)!"!#

*!"!#

+!"!#

,!"!#

-.#/01$#

-.#/01%#

-.#/01&#

-.#/01'#

-.#/01(#

2345-.#/01$#

2345-.#/01%#

2345-.#/01&#

-.#1627$#

-.#1627%#

2345-.#1627$#

2345-.#1627%#

2345-.#1627&#

2345-.#1627'#

2345-.#1627(#

2345-.#1627)#

!"#$%&'()*'$

839:56;9:# <=>4#

8?@9>A9#0BCA=D34#/;9;=EA?5F=9;B#-3CE9;9#G/01H# 1:=4B=EB#I;A:CE;5J=9;B#-3CE9;9#G1627H#

KL;E=M;#(58.2 +/- 1.4%)

N = 488

(44.6 +/- 1.6%)

The materials work

Page 6: Adopt Adapt or Abandon?  Instructors' Decisions to Use Research-Based Materials

Instructors use the materials

3 out of 5 instructors choose

to use

Factors aiding transfer

• Departmental culture & support• Faculty buy-in• Staff support• A-la-carte course archive• Co-seminar tutorials• Instructor positive experience• None refer to CUE data...

Page 7: Adopt Adapt or Abandon?  Instructors' Decisions to Use Research-Based Materials

But not everyone uses them

2 out of 5 chose not to

use the materials

Factors influencing choice not to use materials

• Less interested in interactive techniques• Had previously-developed course

materials = time and ego investment!

Page 8: Adopt Adapt or Abandon?  Instructors' Decisions to Use Research-Based Materials

Learning sustained across institution & instructor

!"!#

$!"!#

%!"!#

&!"!#

'!"!#

(!"!#

)!"!#

*!"!#

+!"!#

,!"!#

-.#/01$#

-.#/01%#

-.#/01&#

-.#/01'#

-.#/01(#

2345-.#/01$#

2345-.#/01%#

2345-.#/01&#

-.#1627$#

-.#1627%#

2345-.#1627$#

2345-.#1627%#

2345-.#1627&#

2345-.#1627'#

2345-.#1627(#

2345-.#1627)#

!"#$%&'()*'$

839:56;9:# <=>4#

8?@9>A9#0BCA=D34#/;9;=EA?5F=9;B#-3CE9;9#G/01H# 1:=4B=EB#I;A:CE;5J=9;B#-3CE9;9#G1627H#

KL;E=M;#

CU

!"!#

$!"!#

%!"!#

&!"!#

'!"!#

(!"!#

)!"!#

*!"!#

+!"!#

,!"!#

-.#/01$#

-.#/01%#

-.#/01&#

-.#/01'#

-.#/01(#

2345-.#/01$#

2345-.#/01%#

2345-.#/01&#

-.#1627$#

-.#1627%#

2345-.#1627$#

2345-.#1627%#

2345-.#1627&#

2345-.#1627'#

2345-.#1627(#

2345-.#1627)#

!"#$%&'()*'$

839:56;9:# <=>4#

8?@9>A9#0BCA=D34#/;9;=EA?5F=9;B#-3CE9;9#G/01H# 1:=4B=EB#I;A:CE;5J=9;B#-3CE9;9#G1627H#

KL;E=M;#

Non-CU What issues are important in

implementation?

• Instructor attention to course and upper-division student difficulties

• Student buy-in• Implementation fidelity

Page 9: Adopt Adapt or Abandon?  Instructors' Decisions to Use Research-Based Materials

So what?Course materials were used, and used successfully,

by many instructors at various institutions.Yay! but...

How it is implemented

matters

External support structures influence instructor decisions

Instructor beliefs and experience influence their

decisionsOur inclination to “put the materials out there” for instructor use is, at least

somewhat, naive. Targeting of friendly or new faculty, and continued support, is important.

Details in PERC 2011 paper -- raise your hand if you want a copy [email protected]