1
D S r D Lb? E S w S R Dr P Lb pr N.G. Holmes and D.A. Bonn Dept. of Physics & Astronomy Carl Wieman Science Education Initiative University of British Columbia, Vancouver, BC [email protected] The Lab: Context The Lab: Index of Refraction Why they didn’t reflect What students did A possible explanation is that students did not have enough time to complete the lab and reflect on their results. This was not the case for this lab, though. In fact, 75% of students had left the lab with 45 minutes remaining and no students stayed working for the full 3 hours. Previous labs were often short on time, however, and interviews suggested that students may have gotten used to rushing their work. Other explanations for why students did not reflect elicited from student interviews and in-class observations include: Habits of not reflecting due to previous time crunches “Sp wr wFollowing algorithms for assessing agreement between values 3 Prr vv r w fr qv v r Inflated uncertainties hide inaccuracies S Ur >> TA Ur Ur fr Ir Mr >> Ar Mr Value agreement over quality measurement “D r b r, r b fStudent error “Srpr b w v wr p w p f rLack of value for reflection A r r , rr f w rr . Orientation of the plexiglass prism (semicircle) and the fixed protractor angles can be seen on the left. The incident beam (fixed) entered along the 0° line and the prism was rotatable to orient the position of the normal and, hence, the angle of incidence. Snell’s Law (SL) Using an incident angle of 60°, measure the refracted angle and determine n from Snell’s Law: Total Internal Reflection (TIR) Measure the critical angle of incidence beyond which the incident beam is totally reflected with no refracted beam and determine n from: Brewster’s Angle (BA) Use a polarizer to determine n using Brewster’s angle (BA), the angle of incidence at which the reflected beam is completely polarized: n = sin " incident ( ) sin " refracted ( ) n = tan " Brewster' s ( ) References 1 J. Day, and D.A. Bonn, Physical Review Special Topics - Physics Education Research 7, 010114 (2011). 2 T.S.Volkwyn, S.Allie, A.Buffler, and F.Lubben, Physical Review Special Topics - Physics Education Research 4, 010108 (2008). 3 B.M. Zwickl, N. Finkelstein, and H.J. Lewandowski, in AIP Conference Proceedings, 1513, 442-445 (2012) We extracted students’ values from their lab books for analysis, including original and final values if changes were made to measurements during the lab. 49% of students made the SL systematic error 58% of the students who made the SL error corrected it 20% of students reported the systematic error as their final value 60% of students made the TIR systematic error Only 2 students corrected the TIR systematic error The difference between reflecting in TIR and SL may simply be due to the relative sizes of the disagreements! This study involved 136 students in a two-semester first-year physics lab course at the University of British Columbia. The learning goals in the course focus exclusively on developing “skills at acquiring data, understanding the nature of uncertainty in measurements, and developing statistical and graphical methods for evaluating the data” (p. 2). 1 A series of studies had previously been conducted in the lab to target how students learn particular data handling skills. There had been little explicit instruction, however, on evaluation of higher level scientific reasoning skills. This study was conducted to assess whether students were engaging in authentic scientific sensemaking when confronted with disagreements between different measurements of the same quantity. !"#$%& '()&$*+,- !%%/% "#$%&'#(#)* +$,-&,$*#. ) "#$%&'#(#)* +$,-&,$*#. ) 0)#,,1% 2$3 4 '#5'$-*#. 6 78!9:;<!8: ) 6 =!>?;<!<@ 4 %A%*#($B- C @>: ) C @!=7 DEF 4 -'GB-$, 6 >@!8:;<!8: ) 6 =!>?;<!<= 4 %A%*#($B- C >8: ) C =!>= H'#3%*#'1% I)J,# 4 K'#3%*#'1% 6 8L:;=: ) 6 =!>?;<!<L n = 1 sin " critical ( ) How they reflected In many cases, students changed their values of n during the lab, often to correct systematic errors. Rather than explaining how or why they changed their measured values, students crossed out the initial value and replaced it with the new one. No students provided clear and distinct descriptions of how they managed to correct their errors. Comparing all three measurements and checking agreement Talking to other groups and comparing values Calculating the expected angle using n from a previous measurement But many students thought that this was cheating! sin trr¡¡"dú Making the lab more scientific Experiments use high-quality equipment capable of accurate and precise measurements Ample time and support to reflect in each lab Experience where reflection improves measurement quality Placing assessment emphasis on lab process over final product and increased emphasis on quality of measurements and explanations Explicit support to develop different sensemaking strategies 1.0 1.5 2.0 2.5 0 10 20 30 40 50 Index of Refraction (n) Number of Students SL Original SL Final 1.0 1.5 2.0 2.5 0 10 20 30 40 50 Index of Refraction (n) Number of Students SL TIR BA In fact, students greatly inflated their uncertainties (at least twice as large as the precision obtained by TAs), especially if their values were inaccurate (about twice as high as accurate or corrected measurements). This inflation often meant that the TIR measurement agreed with the other two within uncertainty ranges. Expert Accurate Corrected Inaccurate Measured n Reported Uncertainty 0.00 0.05 0.10 0.15 0.20 SL TIR

Doug Bonn and James Day - CWSEI · N.G. Holmes and D.A. Bonn Dept. of Physics & Astronomy ... Physics Education Research 4, 010108 ... were engaging in authentic scientific sensemaking

Embed Size (px)

Citation preview

D!"#$ S%"&#%& !r D!"#$ ' L'b? E#$'$"#$ S()*&#(+ w"(, S%"&#("-% R&'+!#"#$ D)r"#$ P,.+"%+ L'b /p&r"0&#(+

N.G. Holmes and D.A. Bonn Dept. of Physics & Astronomy

Carl Wieman Science Education Initiative University of British Columbia, Vancouver, BC

[email protected]

The Lab: Context

The Lab: Index of Refraction

Why they didn’t reflect What students did A possible explanation is that students did not have enough time to complete the lab and reflect on their results. This was not the case for this lab, though. In fact, 75% of students had left the lab with 45 minutes remaining and no students stayed working for the full 3 hours. Previous labs were often short on time, however, and interviews suggested that students may have gotten used to rushing their work. Other explanations for why students did not reflect elicited from student interviews and in-class observations include:  Habits of not reflecting due to previous time crunches

“S!"p !#$%&$%' (%) wr$!* +",*!#$%' )"w%”  Following algorithms for assessing agreement between values3

Pr"-*).r* )$) %"! $%v"/v* r*0*-!$%' "% w#(! $! ,*(%+ f"r %",$%(//1 *q.$v(/*%! v(/.*+ !" )$+('r**

 Inflated uncertainties hide inaccuracies

S()*&#( U#%&r('"#("&+ >> TA+ U#%&r('"#("&+ U#%&r('"#("&+ f!r I#'%%)r'(& M&'+)r&0&#( >> A%%)r'(& M&'+)r&0&#(+

 Value agreement over quality measurement

“D$)%’! !r1 !" b* (--.r(!*, !r$*) !" b* +(f*”

 Student error

“S.rpr$+*) b1 #"w -/2* !#* v(/.*+ w*r*” 3* p/4$'/(++ w(+ 5.+! “( /.,p "f (-r1/$-”

 Lack of value for reflection

A// +!.)*%!+ !r$*) !" #$)* !#* "r$'$%(/ ,$+!(&*+, r(!#*r !#(% f"-.+$%' "% #"w !#*1 ,(%('*) !" -"rr*-! !#*,.

Orientation of the plexiglass prism (semicircle) and the fixed protractor angles can be seen on the left. The incident beam (fixed) entered along the 0° line and the prism was rotatable to orient the position of the normal and, hence, the angle of incidence.

Snell’s Law (SL) Using an incident angle of 60°, measure the refracted angle and determine n from Snell’s Law:

Total Internal Reflection (TIR) Measure the critical angle of incidence beyond which the incident beam is totally reflected with no refracted beam and determine n from:

Brewster’s Angle (BA) Use a polarizer to determine n using Brewster’s angle (BA), the angle of incidence at which the reflected beam is completely polarized:

!

n =sin " incident( )sin " refracted( )

!

n = tan "Brewster's( )

References 1J. Day, and D.A. Bonn, Physical Review Special Topics - Physics Education Research 7, 010114 (2011). 2T.S.Volkwyn, S.Allie, A.Buffler, and F.Lubben, Physical Review Special Topics - Physics Education Research 4, 010108 (2008). 3B.M. Zwickl, N. Finkelstein, and H.J. Lewandowski, in AIP Conference Proceedings, 1513, 442-445 (2012)

We extracted students’ values from their lab books for analysis, including original and final values if changes were made to measurements during the lab. • 49% of students made the SL systematic error • 58% of the students who made the SL error corrected it • 20% of students reported the systematic error as their final value • 60% of students made the TIR systematic error • Only 2 students corrected the TIR systematic error The difference between reflecting in TIR and SL may simply be due to the relative sizes of the disagreements!

This study involved 136 students in a two-semester first-year physics lab course at the University of British Columbia. The learning goals in the course focus exclusively on developing “skills at acquiring data, understanding the nature of uncertainty in measurements, and developing statistical and graphical methods for evaluating the data” (p. 2).1

A series of studies had previously been conducted in the lab to target how students learn particular data handling skills. There had been little explicit instruction, however, on evaluation of higher level scientific reasoning skills. This study was conducted to assess whether students were engaging in authentic scientific sensemaking when confronted with disagreements between different measurements of the same quantity.

!"#$%& '()&$*+,-.!%%/%

"#$%&'#(#)* +$,-&,$*#./) "#$%&'#(#)* +$,-&,$*#./)

0)#,,1%/2$3 4'#5'$-*#./6/78!9:;<!8: )/6/=!>?;<!<@ 4%A%*#($B-/C/@>: )/C/@!=7

DEF 4-'GB-$,/6/>@!8:;<!8: )/6/=!>?;<!<= 4%A%*#($B-/C/>8: )/C/=!>=

H'#3%*#'1%/I)J,# 4K'#3%*#'1%/6/8L:;=: )/6/=!>?;<!<L

!

n = 1sin " critical( )

How they reflected In many cases, students changed their values of n during the lab, often to correct systematic errors. Rather than explaining how or why they changed their measured values, students crossed out the initial value and replaced it with the new one. No students provided clear and distinct descriptions of how they managed to correct their errors.

 Comparing all three measurements and checking agreement  Talking to other groups and comparing values  Calculating the expected angle using n from a previous measurement

But many students thought that this was cheating!

Wo*,jI *tø^n ll^qt_

?touh"w"

Tnlea r/ Wn*ehon/-

;*tU ( tuln*,,hon ìn 4 ,u r7n/V

v . z Z /-;'ø;AW i¿l .rl,w¿ wi i

I x,'

^(,(,/^,)/ò'0 J ¿r

< k s¿','-<",\,,r,îf ÍlrnK#:Tr:tp,(, eot"*',\ praa incicbr,/ atyi ¿r ¿)"'2-,,,,,

'Art, nX I

sin trr¡¡"dú

JJZ ,úLi./

'/rl 5/J¡ / 3

lab '-þ^tfur,ø't,1trrr;fn-y,

5hra,iv ".^I n".v €o!-ú/-".à'er

II

_)

srng I'rMttr,tJ- 7 ;Oc = tlSJ 0.ço.

: o. OZ..w

nr(*r4- þ'rtøø't'

!\.ln\\.S" \ 1 'c.o

?

Making the lab more scientific  Experiments use high-quality equipment capable of accurate and

precise measurements  Ample time and support to reflect in each lab  Experience where reflection improves measurement quality  Placing assessment emphasis on lab process over final product and

increased emphasis on quality of measurements and explanations  Explicit support to develop different sensemaking strategies

Using Invention Tasks toHelp Students Become

Better Scientists

Carl Wieman Science Education Initiative

Department of Physics and Astronomy

University of British Columbia

Natasha Holmes, Ido Roll,Doug Bonn and James Day

1.0 1.5 2.0 2.5

010

2030

4050

Index of Refraction (n)

Num

ber o

f Stu

dent

s

SL OriginalSL Final

1.0 1.5 2.0 2.5

010

2030

4050

Index of Refraction (n)

Num

ber o

f Stu

dent

s

SLTIRBA

In fact, students greatly inflated their uncertainties (at least twice as large as the precision obtained by TAs), especially if their values were inaccurate (about twice as high as accurate or corrected measurements). This inflation often meant that the TIR measurement agreed with the other two within uncertainty ranges.

Expert Accurate Corrected Inaccurate

Measured n

Rep

orte

d U

ncer

tain

ty

0.00

0.05

0.10

0.15

0.20

SLTIR