24
NWEA 2011 - RIT Scale Norms Some Things You Should Know About the 2011 RIT Scale Norms Prepared by: Dan Henderson, NWEA Partner Relations Region Manager John Woodin, NWEA Partner Relations State Representative

NWEA 2011 - RIT Scale Norms

Embed Size (px)

DESCRIPTION

NWEA 2011 - RIT Scale Norms. Some Things You Should Know About the 2011 RIT Scale Norms Prepared by: Dan Henderson, NWEA Partner Relations Region Manager John Woodin, NWEA Partner Relations State Representative. Introduction. “No, your students’ performance didn’t change from last spring.” - PowerPoint PPT Presentation

Citation preview

Page 1: NWEA 2011  -  RIT Scale Norms

NWEA 2011 - RIT Scale Norms

Some Things You Should Know About the 2011 RIT Scale Norms

Prepared by:Dan Henderson, NWEA Partner Relations Region ManagerJohn Woodin, NWEA Partner Relations State Representative

Page 2: NWEA 2011  -  RIT Scale Norms

Introduction“No, your students’ performance

didn’t change from last spring.”The norm group and

methodology did changeSimply creates a different

comparisonA 215 RIT is still a 215 RIT –

means the same thing related to performance

Page 3: NWEA 2011  -  RIT Scale Norms

Key Differences from 2008Methodology: set of norms more

representative of school age population

Everyone will see some changes: status and growth norms

Norms have been applied to both past and current scores (for consistency and growth projections)

Page 4: NWEA 2011  -  RIT Scale Norms

What will be “fixed” in the 2011 Norms…Asterisks * will be replaced with 1 or

99 (percentiles)Kindergarten growth norms will be

reinstated for fall to springKindergarten status norms will be

reinstated for fall and winter11th grade norms will be reinstated as

soon as possible

Page 5: NWEA 2011  -  RIT Scale Norms

Sampling student test records “Students” were randomly sampled from a pool of test event records. (all test records of the student from the study period in the subject of

interest)

• Pool represented about 5.1 million students,• from 13,000 schools • located in more than 2,700 school

districts• from over 50 states and • contained about 35 million test

events.

Smallest grade level sample was about 20,000 students.

Page 6: NWEA 2011  -  RIT Scale Norms

Post-stratification procedures •Based on school-level variables commonly associated with challenges and opportunities

•School–level variables: Mix of student ethnicity, percent free/reduced lunch eligibility, Title 1 eligibility, ALL Title 1, grade range served, charter status, magnet status, enrollment at each grade, total enrollment, school level, school type, school locale, pupil-teacher ratio.

•Combined to form a School Challenge Index (SCI) for each state – using ALL schools in the state, not only NWEA schools

•SCI was used as a post-stratification weight for all analyses

Page 7: NWEA 2011  -  RIT Scale Norms

Differences in Status NormsMinor changes in status normsPercentiles changed very littleLarger changes for grades 1 & 2 for

high and low achieving students◦ Difference in partner base (more schools

and students than 2008)◦ Different methodology for selection which

results in more representative norms

Page 8: NWEA 2011  -  RIT Scale Norms

130 140 150 160 170 180 1900

102030405060708090

100

Reading - Grade 1 - Fall

20082011

RIT Score

Perc

enti

le R

ank

140 150 160 170 180 190 200 2100

102030405060708090

100

Reading - Grade 1 - Spring

20082011

RIT Score

Perc

enti

le R

ank

Page 9: NWEA 2011  -  RIT Scale Norms

155 165 175 185 195 205 215 2250

102030405060708090

100

Reading - Grade 3 - Fall

20082011

RIT Score

Perc

enti

le R

ank

165 175 185 195 205 215 225 2350

102030405060708090

100

Reading - Grade 3 - Spring

20082011

RIT Score

Perc

enti

le R

ank

Page 10: NWEA 2011  -  RIT Scale Norms

170 180 190 200 210 220 230 2400

102030405060708090

100

Reading - Grade 5 - Fall

20082011

RIT Score

Perc

enti

le R

ank

175 185 195 205 215 225 235 2450

102030405060708090

100

Reading - Grade 5 - Spring

20082011

RIT Score

Perc

enti

le R

ank

Page 11: NWEA 2011  -  RIT Scale Norms

175 185 195 205 215 225 235 2450

102030405060708090

100

Reading - Grade 7 - Fall

20082011

RIT Score

Perc

enti

le R

ank

180 190 200 210 220 230 240 2500

102030405060708090

100

Reading - Grade 7 - Spring

20082011

RIT Score

Perc

enti

le R

ank

Page 12: NWEA 2011  -  RIT Scale Norms

140 150 160 170 180 190 200 2100

20

40

60

80

100

Mathematics - Grade 1 - Spring

20082011

RIT Score

Perc

enti

le R

ank

130 140 150 160 170 180 190 200 2100

102030405060708090

100

Mathematics - Grade 1 - Fall

20082011

RIT Score

Perc

enti

le R

ank

Page 13: NWEA 2011  -  RIT Scale Norms

160 170 180 190 200 210 2200

102030405060708090

100

Mathematics - Grade 3 - Fall

20082011

RIT Score

Perc

enti

le R

ank

170 180 190 200 210 220 2300

20

40

60

80

100

Mathematics - Grade 3 - Spring

20082011

RIT Score

Perc

enti

le R

ank

Page 14: NWEA 2011  -  RIT Scale Norms

180 190 200 210 220 230 2400

102030405060708090

100

Mathematics - Grade 5 - Fall

20082011

RIT Score

Perc

enti

le R

ank

180 190 200 210 220 230 240 2500

20

40

60

80

100

Mathematics - Grade 5 - Spring

20082011

RIT Score

Perc

enti

le R

ank

Page 15: NWEA 2011  -  RIT Scale Norms

Difference in Growth NormsLess difference in the middle of

achievement continuumLarger differences at the two ends of

achievement (especially extremes)High or low achievers may see larger

differences in growth projectionsLow Achievers: lower grow

projections than in the pastHigh Achievers: higher growth

projections

Page 16: NWEA 2011  -  RIT Scale Norms

Growth in 2008 Norm study

Pt. AFALL

Pt. BSpring

Growth within the grade only

Page 17: NWEA 2011  -  RIT Scale Norms

How growth is conceptualized Previous

grade Grade of Interest Next grade

S F W S F

1 36 54 8272

Instructional weeks

*

1

2

3

4

5

6

students

.

.

.

All scores included

All scores included

Page 18: NWEA 2011  -  RIT Scale Norms

Flat Growth RatesGrowth projections tend to be

flatter in 2011 than the 2008 norms◦Grades 5, 6, 8 show flat growth in Math◦In a large national sample, students in

these grades tended to show similar growth regardless of where they were on the RIT scale

Due to sampling methods – overly large impact of extreme scores in 2008

Page 19: NWEA 2011  -  RIT Scale Norms

155 165 175 185 195 205 215 225 2350

5

10

15

Reading - Grade 3 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

160 170 180 190 200 210 220 230 2400

5

10

15

Reading - Grade 5 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

Page 20: NWEA 2011  -  RIT Scale Norms

160 170 180 190 200 210 220 230 2400

5

10

15

Reading - Grade 7 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

165 175 185 195 205 215 225 235 24502468

1012141618

Reading - Grade 8 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

Page 21: NWEA 2011  -  RIT Scale Norms

155 165 175 185 195 205 215 225 235 24502468

10121416

Mathematics - Grade 3 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

160 170 180 190 200 210 220 230 240 25002468

10121416

Mathematics - Grade 4 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

Page 22: NWEA 2011  -  RIT Scale Norms

165 175 185 195 205 215 225 235 245 25502468

10121416

Mathematics - Grade 5 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

170 180 190 200 210 220 230 240 250 2600

2

4

6

8

10

12

14

Mathematics - Grade 6 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

Page 23: NWEA 2011  -  RIT Scale Norms

170 180 190 200 210 220 230 240 250 26002468

101214

Mathematics - Grade 7 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

170 180 190 200 210 220 230 240 250 2600

2

4

6

8

10

12

14

Mathematics - Grade 8 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

Page 24: NWEA 2011  -  RIT Scale Norms

Applying Growth to Past Terms

Since NWEA uses growth norms that overlap from year to year – had to apply the norms backward

Cannot compare 2008 growth norms to 2011 growth norms – not comparable