Section 4

Achievement Section Overview. Test scores provide a major source of information about district-wide student achievement. Nationally normed standardized tests permit comparison of Shaker student achievement against that of a nationally representative sample of students. In 2005-06, all students in grades three, five, seven and nine took the new Terra Nova published and normed by California Testing Bureau/McGraw Hill in 2000. Ohio state achievement scores permit examination of student achievement compared to state standards. Using these test results, Shaker students can be compared to Ohio students, but not to a national sample of students. College entrance examinations permit comparison of Shaker students who may be college-bound against similar students in Ohio and in the nation. In addition to test data, retention/promotion data and graduation rates are reported.

Because of the size and scope of this section, analysis of and comments about the data appear in parts. Part I focuses on the Terra Nova. Part II focuses on the Ohio achievement and proficiency tests. Part III includes college entrance examinations and graduation data.

I. Terra Nova Achievement Tests

Note: Terra Nova stanine scores reported here are based on comparison with nationally representative norm samples. A student can earn one of nine possible stanine scores. A stanine score of 1, 2, or 3 means that the student performed at or below the 22nd percentile; this is considered below average. A stanine score of 4, 5, or 6 means the student scored between the 23rd and 77th percentiles, which is considered to be in the average range. A stanine score of 7, 8 or 9 is above the 77th percentile and is above average.

A. Reading (Tables 1-4, p. 35-36)

Third Graders: Terra Nova Reading

• 86% of all third graders in the Shaker Heights City School District performed in the average or above-average range on the Terra Nova reading test in 2005-06.

• There are differences in the performance of European-American and African-American third graders. European-American third graders most often (68%) performed above average on the reading test, while African-American third graders most often (62%) performed at the average range.

• Based on analysis of variance, third-grade girls tested in September 2005 outperformed third-grade boys to a statistically significant degree. This gender difference was similar for African-American and European-American third graders.

Fifth Graders: Terra Nova Reading

• 89% of fifth graders performed in the average or above-average range on the Terra Nova reading test in 2005-06.

• There was a strong difference in performance by race/ethnicity. 79% of the European-American students performed in the above-average range on the total reading test; 64% of the African-American students performed in the average range on this test.

29

Section 4

• Based on an analysis of variance, there were no statistically significant differences for boys and girls.

Seventh Graders: Terra Nova Reading

• 88% of seventh graders performed in the average or above-average range on the Terra Nova reading test.

• While 71% of European-American students typically performed in the above-average range, 67% of African-American students performed in the average range.

• Differences in performance in reading were statistically significant by gender; girls outperformed boys.

Ninth Graders: Terra Nova Reading

• 87% of ninth graders performed in the average or above-average range on the Terra Nova reading test.

• 72% of European-American students typically performed in the above-average range; 66% of African-American students performed in the average range.

• Differences in performance in reading by gender were statistically significant, with girls outperforming boys.

B. Language (Tables 5-8, p. 37-38)

Third Graders: Terra Nova Language

• 87% of the third graders performed in the average or above-average range on the Terra Nova language test.

• European-American and African-American third graders most often scored in the average range, 49% and 70% respectively.

• There were statistically significant differences in performance on the spring Terra Nova by gender; girls outperformed boys in language, a difference that was evident regardless of race/ethnicity.

Fifth Graders: Terra Nova Language

• 87% of the fifth graders performed in the average or above-average range on the Terra Nova language test.

• While 73 % of European-American fifth graders performed in the above-average range on the language test, African-American students (65%) most often performed in the average range.

• There were statistically significant differences in performance by gender, with fifth-grade girls outperforming fifth-grade boys on average.

Seventh Graders: Terra Nova Language

• 89% of the seventh graders performed in the average or above-average range on the Terra Nova language test.

30

Section 4

• When assessed by race/ethnicity, the average range typifies the performance of African-American students (55%), and the above-average range typifies that of the European-American students (85%).

• Girls outperformed boys on the seventh grade language test to a statistically significant degree.

Ninth Graders: Terra Nova Language

• 86% of the ninth graders performed in the average or above-average range on the Terra Nova language test.

• When assessed by race/ethnicity, the average range typifies the performance of African-American students (60%) and the above-average range typifies that of the European-American students (71%).

• As in the other tested grade levels, girls outperformed boys on the ninth grade language test to a statistically significant degree.

C. Mathematics (See Tables 9-12, pages 39-40)

Third Graders: Terra Nova Mathematics

• Third grade performance on this test was strong, with 92 % of the students earning an average or above-average score.

• A difference by racial/ethnic group was evident. Slightly more than three-fourths (76%) of European-American students received an above-average score; close to two-thirds of African-American students (64%) received an average score.

• There were no gender differences in performance on the third-grade math test.

Fifth Graders: Terra Nova Mathematics

• 84% of fifth-grade students scored in the average range or above on the Terra Nova Multiple Assessment in mathematics.

• The most common score range for European-American was the above-average range (85%) and for African-American fifth graders, the most common score was in the average range (54%).

• There were no statistically significant differences associated with gender.

Seventh Graders: Terra Nova Mathematics

• 87% of the seventh graders performed in the above-average or average range on the Terra Nova test in mathematics.

• European-American seventh graders most typically scored in the above-average range (78%), and the majority (60%) of African-American seventh graders scored in the average range.

• Analysis of math performance by gender revealed no statistically significant differences.

31

Section 4

Ninth Graders: Terra Nova Mathematics

• 86% of the ninth graders performed in the above-average or average range on the Terra Nova test in math.

• 85% of European-American ninth graders scored in the above-average range and the majority (64%) of African-American ninth graders scored in the average range

• Analysis of math performance by gender revealed no statistically significant differences on the ninth grade Terra Nova.

D. Science (Tables 13-16, p. 41-42)

Third Graders: Terra Nova Science

• 91% of third graders performed in the above-average or average range on the third-grade science test.

• The most common stanine for European-American third graders (64%) was in the above-average range on the science test, and that for African-American third graders (75%) was in the average range.

• There were no gender differences in performance on the third-grade science test.

Fifth Graders: Terra Nova Science

• 84% of fifth-grade students scored in the average or above-average range on the fifth-grade Terra Nova science test.

• The most common range for European-American fifth graders was above average (79%); the most common range for African-American fifth graders was average (56%).

• There were no statistically significant differences by gender.

Seventh Graders: Terra Nova Science

• 89% of the seventh graders performed in the average or above-average range on the Terra Nova in science.

• The majority of the European-American seventh graders (71%) scored in the above-average range, and most African-American seventh graders (69%) scored in the average range.

• Analysis of science performance by gender revealed no statistically significant differences.

Ninth Graders: Terra Nova Science

• 83% of the ninth graders performed in the average or above-average range on the Terra Nova in science.

• Two-thirds of the European-American ninth graders (66%) scored in the above-average range, and a majority (60%) of African-American ninth graders scored in the average range.

• Analysis of science performance by gender revealed no statistically significant differences.

32

Section 4

E. Social Studies (Tables 17-20, p. 43-44)

Third Graders: Terra Nova Social Studies

• 86% of third graders performed in the average or above-average range.

• African-American third graders most often earned average scores (60%), and European-American third graders most often earned above-average scores (76%) in social studies.

• There were no gender differences in performance on the third-grade social studies test.

Fifth Graders: Terra Nova Social Studies

• 86% of fifth-grade students scored in the average or above-average range on the fifth-grade social studies test.

• The most common score range for European Americans was above average (78%), and for African-American fifth graders the most common score range was average (61%).

• There were no statistically significant differences associated with gender on the social studies test.

Seventh Graders: Terra Nova Social Studies

• 89% of the seventh graders performed in the average or above-average range on the Terra Nova in social studies.

• While the majority of the European-American seventh graders (83%) scored in the above-average range, slightly more than half (61%) of African-American seventh graders scored in the average range.

• Analysis of social studies performance by gender revealed no statistically significant differences.

Ninth Graders: Terra Nova Social Studies

• 82% of the ninth graders performed in the average or above-average range on the Terra Nova in social studies.

• Close to three-fourths (72%) of European-American ninth graders scored in the above-average range; slightly more than half (57%) of African-American ninth graders scored in the average range.

• Like analyses of social studies at other grade levels, analysis of social studies performance by gender revealed no statistically significant differences.

II. K-4 Elementary School Comparisons (Tables 21-25, p. 45-47)

This set of tables reports distributions of stanine scores on reading, mathematics, language, science and social studies third-grade Terra Nova tests by each K-4 school. An analysis of variance was conducted for each test. Statistically significant differences were found for all content areas. The following differences were found:

33

Section 4

• Third-grade reading: Performance in reading was highest for Onaway. Fernway, Boulevard, and Mercer were similar and in the middle. Lomond student performance was lowest.

• Third-grade language: Mercer and Onaway had high scores. Lomond, Boulevard and Fernway had lower scores.

• Third grade math: Onaway students scored highest, followed by Fernway. Boulevard and Mercer students had similar scores. Lomond scored lowest on average.

• Third-grade social studies: Onaway and Fernway scored high; Lomond scored lowest.

• Third-grade science: Onaway and Fernway scored high; Lomond scored lowest on average.

III. Growth in Reading and Math over Time (Tables 26-27, p. 48-49)

Using the standard score scale1 of the Terra Nova it is possible to trace growth over time for students who take tests in the same subject from one grade level to the next.

Tables 31 and 32 report the median scores for all elementary school students who took the reading and math tests both times while they were students in the Shaker Heights City School District. The following findings are evident:

• For all cohorts, the combined group of all students exhibited growth over time.

• The achievement gap between African-American and European-American students increased slightly in reading and narrowed in math from first grade to third grade. In reading, the gap widened slightly from 37 to 43 scale score points. In math, it declined from 58 to 49 scale score points. The tests were administered in spring of first grade and fall of third grade.

• The achievement gap in reading and math increased from third to fifth grade. In reading this increase was slight--from a gap of 40 scale points in third grade to one of 46 scale score points in fifth grade. In math, it was more substantial, widening from a difference of 45 points to a difference of 65 points. The tests were administered in spring of third grade and spring of fifth grade.

• The achievement gap widened in reading and narrowed in math from fifth to seventh grade. In reading the increase grew from a gap of 42 scale points in fifth grade to one of 50 scale score points in seventh grade. In math, the change was less substantial, decreasing from a difference of 52 points to a difference of 51 points. The tests were administered in spring of fifth grade and fall of seventh grade.

• The achievement gap between African-American and European-American students widened in reading and in math from seventh grade to ninth grade. In reading, the gap was 48 scale score points in seventh grade and 49 scale score points in ninth grade. In math, it widened from 59 to 68 scale score points. The tests were administered at the beginning of the school year for both grade levels.

1 The lowest scale scores are for kindergarten children: 290 for the Terra Nova math test and 355 for the Terra Nova reading test. The highest scale scores are for high school twelfth-grade students: 866 (Total Reading) to 915 (Total Mathematics).

34

Section 4

TABLES

Tables 1-4. Terra Nova Reading Test Scores for Grades 3, 5, 7 and 9 Grouped by Stanine for the Shaker Heights City School District, Combined and by Race/Ethnicity 2005-062

Table 1. Percent at Each Stanine Level: Third Grade Terra Nova Reading

14%25%

4%

44%

62%

28%

42%

13%

68%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

Table 2.

Percent at Each Stanine Level: Fifth Grade Terra Nova Reading

11%19%

1%

44%

64%

20%

45%

17%

79%

0%10%20%30%40%50%60%70%80%90%

Combined African American European American

BelowAverageAbove

2 National Distribution in Reading, Based on National Stanines

22%

56%

22%

0%20%40%60%

U.S. Students

BelowAverageAbove

35

Section 4

Table 3. Percent at Each Stanine Level: Seventh Grade Terra Nova Reading

13%23%

1%

52%

67%

29%35%

10%

71%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

Table 4. Percent at Each Stanine Level: Ninth Grade Terra Nova Reading

13%21%

1%

51%

66%

27%36%

14%

72%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

36

Section 4

Tables 5-8. Terra Nova Language Test Scores for Grades 3, 5, 7 and 9 Grouped by Stanine for the Shaker Heights City School District, Combined and by Race/Ethnicity 2005-063

Table 5.

Percent at Each Stanine Level: Third Grade Terra Nova Language

13%22%

3%

57%70%

49%

30%

8%

48%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

Table 6. Percent at Each Stanine Level: Fifth Grade Terra Nova Language

13%22%

1%

47%

65%

26%40%

13%

73%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

3 National Distribution in Language, Based on National Stanines

37

22%

56%

22%

0%20%40%60%

U.S. Students

BelowAverageAbove

Section 4

Table 7.

Percent at Each Stanine Level: Seventh Grade Terra Nova Language

11%20%

1%

38%

55%

14%

51%

26%

85%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

Table 8. Percent at Each Stanine Level: Ninth Grade Terra Nova Language

15%24%

1%

49%60%

28%37%

15%

71%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

38

Section 4

Tables 9-12. Terra Nova Math Test Scores for Grades 3, 5, 7, and 9 Grouped by Stanine for the Shaker Heights City School District, Combined and by Race/Ethnicity 2005-064

Table 9. Percent at Each Stanine Level: Third Grade Terra Nova Math

8%15%

1%

43%

64%

24%

49%

21%

76%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

Table 10. Percent at Each Stanine Level: Fifth Grade Terra Nova Math

17%29%

1%

37%

54%

14%

47%

17%

85%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

4 National Distribution in Math, Based on National Stanines

22%56%

22%

0%50%

100%

U.S. Students

BelowAverageAbove

39

Section 4

Table 11. Percent at Each Stanine Level: Seventh Grade Terra Nova Math

13%21%

1%

44%

60%

21%

43%

19%

78%

0%10%20%30%40%50%60%70%80%90%

Combined African American European American

BelowAverageAbove

Table 12. Percent at Each Stanine Level: Ninth Grade Terra Nova Math

14%23%

1%

46%

64%

15%

40%

14%

85%

0%10%20%30%40%50%60%70%80%90%

Combined African American European American

BelowAverageAbove

40

Section 4

Tables 13-16. Terra Nova Science Test Scores for Grades 3, 5, 7 and 9 Grouped by Stanine for the Shaker Heights City School District, Combined and by Race/Ethnicity 2005-065

Table 13.

Percent at Each Stanine Level: Third Grade Terra Nova Science

9%17%

2%

55%

75%

34%36%

8%

64%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

Table 14. Percent at Each Stanine Level: Fifth Grade Terra Nova Science

16%27%

1%

40%

56%

20%

44%

17%

79%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

5 National Distribution in Science, Based on National Stanines

22%

56%

22%

0%20%40%60%

U.S. Students

BelowAverageAbove

41

Section 4

Table 15. Percent at Each Stanine Level: Seventh Grade Terra Nova Science

11%19%

1%

53%

69%

28%36%

11%

71%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

Table 16. Percent at Each Stanine Level: Ninth Grade Terra Nova Science

18%29%

1%

51%60%

33%32%

11%

66%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

42

Section 4

Tables 17-20. Terra Nova Social Studies Scores for Grades 3, 5, 7 and 9 Grouped by Stanine for the Shaker Heights City School District, Combined and by Race/Ethnicity 2005-066

Table 17.

Percent at Each Stanine Level: Third Grade Terra Nova Social Studies

12%20%

4%

60%

21%

76%

39%21%

49%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

Table 18. Percent at Each Stanine Level: Fifth Grade Terra Nova Social Studies

14%24%

1%

43%

61%

22%

43%

15%

78%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

6 National Distribution in Social Studies, Based on National Stanines

22%56%

22%

0%50%

100%

U.S. Students

BelowAverageAbove

43

Section 4

Table 19. Percent at Each Stanine Level: Seventh Grade Terra Nova Social Studies

12%19%

1%

43%

61%

16%

46%

20%

83%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

Table 20.

Percent at Each Stanine Level: Ninth Grade Terra Nova Social Studies

18%30%

1%

46%57%

27%36%

13%

72%

0%

20%

40%

60%

80%

100%

Combined African American European American

BelowAverageAbove

44

Section 4

Table 21-25. Terra Nova Test Scores for Grade 3 Grouped by Stanine for the Shaker Heights City K-4 Elementary Schools, by School 2005-06

Table 21. Percent of Third Graders at Each Stanine Level by School - Reading

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Boulevard

Fernway

Lomond

Mercer

Onaway

BelowAverageAbove

Above 38% 42% 31% 38% 66%

Average 45% 46% 49% 49% 29%

Below 17% 12% 21% 13% 4%

Boulevard Fernway Lomond Mercer Onaway

Table 22. Percent of Third Graders at Each Stanine Level by School - Language

0% 20% 40% 60% 80% 100%

Boulevard

Fernway

Lomond

Mercer

Onaway

BelowAverageAbove

Above 30% 25% 20% 41% 40%

Average 51% 64% 65% 48% 57%

Below 19% 12% 14% 12% 3%

Boulevard Fernway Lomond Mercer Onaway

45

Section 4

Table 23. Percent of Third Graders at Each Stanine Level by School - Mathematics

0% 20% 40% 60% 80% 100%

Bouelvard

Fernway

Lomond

Mercer

Onaway

BelowAverageAbove

Above 46% 58% 34% 52% 66%

Average 44% 40% 56% 39% 29%

Below 11% 2% 11% 9% 4%

Bouelvard Fernway Lomond Mercer Onaway

Table 24. Percent of Third Graders at Each Stanine Level by School - Social Studies

0% 20% 40% 60% 80% 100%

Boulevard

Fernway

Lomond

Mercer

Onaway

BelowAverageAbove

Above 50% 56% 34% 49% 68%

Average 36% 42% 46% 38% 28%

Below 14% 2% 20% 13% 4%

Boulevard Fernway Lomond Mercer Onaway

46

Section 4

Table 25.

Percent of Third Graders at Each Stanine Level by School - Science

0% 20% 40% 60% 80% 100%

Boulevard

Fernway

Lomond

Mercer

Onaway

BelowAverageAbove

Above 37% 42% 23% 36% 52%

Average 52% 54% 62% 55% 47%

Below 11% 4% 15% 9% 2%

Boulevard Fernway Lomond Mercer Onaway

47

Section 4

Tables 26-27. Growth in Math and Reading Over Time

Table 26. Growth in Reading, Based on Terra Nova Scaled Scores

Based on students who were 3rd graders in 2005-06 Based on students who were 5th graders in 2005-06

631

591

570

607

607

650

550

570

590

610

630

650

670

1 3

Grade

Scal

e Sc

ore

Total

AfricanAmerican

EuropeanAmerican

681

658

704

649

628

668

600

620

640

660

680

700

720

3 5

GradeSc

ale

Scor

e

Total

AfricanAmerican

EuropeanAmerican

Based on students who were 7th graders in 2005-06 Based on students who were 9th graders in 2005-06

681677

657 660

699

710

640

660

680

700

720

740

5 7

Grade

Scal

e Sc

ore

Total

AfricanAmerican

EuropeanAmerican

697

679676

658

725

706

640

660

680

700

720

740

7 9

Grade

Scal

e Sc

ore

Total

AfricanAmerican

EuropeanAmerican

48

Section 4

Table 27. Growth in Math, Based on Terra Nova Scaled Scores

Based on students who were 3rd graders in 2005-06 Based on students who were 5th graders in 2005-06

609

554580

520

578

629

500

550

600

650

700

1 3

Grade

Scal

e Sc

ore

Total

AfricanAmerican

EuropeanAmerican

674

707

632

642

610

655

500

550

600

650

700

3 5

Grade

Scal

e Sc

ore

Total

AfricanAmericanEuropeanAmerican

Based on students who were 7th graders in 2005-06 Based on students who were 9th graders in 2005-06

686672

650

663

714702

640

660

680

700

720

740

760

5 7

Grade

Scal

e Sc

ore

Total

AfricanAmerican

EuropeanAmerican

718

689

757

686

660

719

640

660

680

700

720

740

760

7 9

Grade

Scal

e Sc

ore

Total

AfricanAmericanEuropeanAmerican

49