November 2009

2

The first two processes occurred during Review

Week.

After the Review Week, top scoring programs were

reviewed by a small group for conceptual development

quality. They created a narrative evaluation.

Content (Standards and Coherence)

Key Program Elements

Conceptual Development

3

Standards50%

Program Coherence20%

Student Learning10%

Facilitating Instruction10%

Assessment5%

Equity & Accessibility5%

Key Program

Elements

Content

69 reviewers reviewed 85 individual products (program-grade range) from 20 publishing houses

402 individual readings Over 29,000 data elements collected Each product received 4-5 independent

readings Each reading completed in an average of 6

hours

4

0.30

0.40

0.50

0.60

0.70

0.80

0.90

1.00

Science Companion STC FOSS (K-5) Science - Diamond Edition

Science: A Closer Look

Experience Science

Elementary School Composite Scores with 95% Confidence Intervals

5

Science Companion Science & Technology for Children (STC) Full Option Science System (FOSS)

6

Elementary Content Results

7

0.80 - 1.00

0.60 - 0.79

0.40 - 0.59

0.20 - 0.39

0.00 - 0.19

Legend

SY IN AP PS ES LS All

Experience Science

FOSS (K-5)

Science - Diamond Edition

Science Companion

Science: A Closer Look

STC

Grand Total

Elementary Content Measure

Program Name

P1 P2 P3 P4 P5 P6 All

Experience Science

FOSS (K-5)

Science - Diamond Edition

Science Companion

Science: A Closer Look

STC

Grand Total

Program Name

Elementary Program Coherence

8

ItemExp

erie

nce

Sci

ence

FO

SS (K

-5)

Sci

ence

- D

iam

ond E

ditio

n

Sci

ence

Com

pan

ion

Sci

ence

: A C

lose

r Look

ST

C

Gra

nd T

ota

l

4-5 SYSA

4-5 SYSB

4-5 SYSC

4-5 SYSD

4-5 INQA

4-5 INQB

4-5 INQC

4-5 INQD

4-5 INQE

4-5 INQF

4-5 INQG

4-5 INQH

4-5 INQI

4-5 APPA

4-5 APPB

4-5 APPC

4-5 APPD

4-5 APPE

4-5 APPF

4-5 APPG

4-5 APPH

4-5 PS1A

4-5 PS1B

4-5 PS2A

4-5 PS2B

4-5 PS2C

4-5 PS3A

4-5 PS3B

4-5 PS3C

4-5 PS3D

4-5 PS3E

Elementary (4-5) Detailed Content Results

Item

Exp

erie

nce

Sci

ence

FO

SS (K

-5)

Sci

ence

- D

iam

ond E

ditio

n

Sci

ence

Com

pan

ion

Sci

ence

: A C

lose

r Look

ST

C

Gra

nd T

ota

l

4-5 ES1A

4-5 ES1B

4-5 ES1C

4-5 ES1D

4-5 ES2A

4-5 ES2B

4-5 ES2C

4-5 ES2D

4-5 ES2E

4-5 ES2F

4-5 ES3A

4-5 ES3B

4-5 LS1A

4-5 LS1B

4-5 LS1C

4-5 LS1D

4-5 LS1E

4-5 LS2A

4-5 LS2B

4-5 LS2C

4-5 LS2D

4-5 LS2E

4-5 LS2F

4-5 LS3A

4-5 LS3B

4-5 LS3C

4-5 LS3D

Total

continued

9

Scale Item

Exp

erie

nce

Sci

ence

FO

SS (K

-5)

Sci

ence

- D

iam

ond E

ditio

n

Sci

ence

Com

pan

ion

Sci

ence

: A C

lose

r Look

ST

C

Gra

nd T

ota

l

Student Learning S1

S2

S3

S4

S5

S6

Student Learning Total

Facilitating Instruction F1

F2

F3

F4

F5

F6

Facilitating Instruction Total

Equity and Accessibility E1

E2

E3

E4

E5

E6

Equity and Accessibility Total

Assessment A1

A2

A3

A4

A5

A6

Assessment Total

All Elementary School Results for Key Program Elements

Key Program Elements

10

0.00 0.25 0.50 0.75 1.00

STC

Science: A Closer Look

Science Companion

Science -Diamond Edition

FOSS (K-5)

Experience Science

Student Learning

0.00 0.25 0.50 0.75 1.00

STC

Science: A Closer Look

Science Companion

Science -Diamond Edition

FOSS (K-5)

Experience Science

Facilitating Instruction

Key Program Elements, Continued

11

0.00 0.25 0.50 0.75 1.00

STC

Science: A Closer Look

Science Companion

Science -Diamond Edition

FOSS (K-5)

Experience Science

Equity and Accessibility

0.00 0.25 0.50 0.75 1.00

STC

Science: A Closer Look

Science Companion

Science -Diamond Edition

FOSS (K-5)

Experience Science

Assessment

Scale Results for Recommended Elementary Programs

12

0.00 0.25 0.50 0.75 1.00

Assessment

Equity and Accessibility

Student Learning

Facilitating Instruction

Program Coherence

Content

FOSS (K-5)

0.00 0.25 0.50 0.75 1.00

Assessment

Equity and Accessibility

Student Learning

Facilitating Instruction

Program Coherence

Content

Science Companion

0.00 0.25 0.50 0.75 1.00

Assessment

Equity and Accessibility

Student Learning

Facilitating Instruction

Program Coherence

Content

STC

How did you handle statistical ties when making the recommendations?

There are some standards that none of the texts addressed well. Is that an issue with the standard, or with the materials?

How were modular materials scored, in comparison to more traditional textbooks?

13

14

http://www.k12.wa.us/CurriculumInstruct/InstructionalMaterialsReviewScience.aspx

Contact:Gilda Wheeler, OSPI Interim Science Supervisor(360) 725-4976Gilda.Wheeler@k12.wa.us