Using the 2009 NECAP Reports February 2010

Using the 2009 NECAP ReportsFebruary 2010

New England Common Assessment Program

2

Dr. Kevon Tucker-SeeleyAssessment Specialist

Office of Instruction, Assessment & AccountabilityRI Department of Education

1-401-222-8494

Welcome and Introductions

Ana KarantonisAssessment Specialist

Office of Instruction, Assessment & AccountabilityRI Department of Education

1-401-222-8940

3

Welcome and Introductions

NECAP Service Center1-877-632-7774

Harold StephensNECAP Program Director1-603-749-9102 ext. 2235Stephens.Harold@measuredprogress.org

Amanda Smith NECAP Program Manager1-603-749-9102 ext. 2259Smith.Amanda@measuredprogress.org

Carole SouleNECAP Program Manager1-603-749-9102 ext. 2450Soule.Carole@measuredprogress.org

Sarah Halaby-WestonNECAP Program Manager1-603-749-9102 ext. 2485Halaby-Weston.Sarah@measuredprogress.org

Elliot DunnNECAP Program Manager 1-603-749-9102 ext. 2126Dunn.Elliot@measuredprogress.org

4

NECAP Service Center: 1-877-632-7774

Welcome and Introductions

Tina Haley: NECAP Program AssistantPhone - 1-603-749-9102 ext. 2427

E-mail – haley.cristina@measuredprogress.org

Mellicent Friddell: NECAP Program AssistantPhone - 1-603-749-9102 ext. 2355

E-mail – friddell.mellicent@measuredprogress.org

Kellie Beaulieu: NECAP Program AssistantPhone - 1-603-749-9102 ext. 2156

E-mail – beaulieu.kellie@measuredprogress.org

5

Purpose of the Workshop

• Review the different types of NECAP reports

• Demonstrate the new NECAP Analysis & Reporting System

• Review the four interactive reports available from the new system

6

Involvement of Local Educators in NECAP

• Development of Grade Level Expectations• Participation in annual test item review

committees & bias and sensitivity review committees

• Use of classroom teacher judgment data• Participation in standard setting panels• Technical Advisory Committee work

7

FERPA

• The Family Educational Rights and Privacy Act (FERPA)

• Access to individual student results is restricted to: the student the student’s parents/guardians authorized school personnel

• Superintendents and principals are responsible for maintaining the privacy and security of all student records.

• Authorized school personnel shall have access to the records of students to whom they are providing services when such access is required in the performance of their official duties.

• FERPA website: http://www.ed.gov/policy/gen/guid/fpco/ferpa/index.html

8

Workshop Materials

9

Types of NECAP Reports

Student Report (Confidential)Information for ParentsItem Analysis Report (Confidential)School level by studentResults Report (Public) School and District levelSummary Report (Public) School/District/State levelStudent Level Data Files (Confidential)Excel/csv files by grade on district and school confidential site

10

Student Report

1111

This part of the report provides the individual

student’s achievement

level and scaled score

Looking at the Student Report

1212

Looking at the Student Report

1313

This part of the report provides a comparison between the

performance of this student and

her or his school, district,

and state

Looking at the Student Report

1414

Looking at the Student Report

1515

This part of the report gives

specific information about the student’s

performance in content area

subcategories

Looking at the Student Report

1616

Looking at the Student Report

17

Item Analysis Report

1818

Item Analysis Report - Legend

1919

Looking at the Item Analysis Report

2020

This part of the report gives specific information about the released items

and student performance on individual items

Looking at the Item Analysis Report

2121

Looking at the Item Analysis Report

2222

This part of the report represents all of the items used to

compute student scores - points are

displayed by subcategory.

Each student’s Scaled Score and

Achievement Level are shown.

Looking at the Item Analysis Report

2323

Looking at the Item Analysis Report

2424

Looking at the Item Analysis Report

This part of the report is where group, school, district and state summary results are located

for the Released Items only.

2525

District and School Results Report

2626

Looking at a School-Level Results Report

2727

Schools can view reports for Testing

Year (2009-10)

Looking at School Results Report – Testing Year

2828

or for Teaching Year (2008-09)

Looking at School Results Report – Teaching Year

2929

School-Level Results Report – Grade Level Summary

3030

School-Level Results Report – Grade Level Summary

3131

School-Level Results Report – Grade Level Summary

3232

School-Level Results Report – Grade Level Summary

3333

School-Level Results Report – Content Area Results

3434

Looking at the Results Report – Content Area Results

Cumulative Totals…provide information on multiple cohorts of students exposed to the program of instruction at a specific grade. Caution should be used if the program of

instruction has changed significantly.

3535

Looking at the Results Report – Content Area Results

3636

Total Possible Points includes both common and matrix items (not field-test).

Total Possible Points also

represents the test’s balance of representation.

Mathematics

Looking at the Results Report – Content Area Results

3737

Please note: The Total Possible Points column is organized differently on the Reading Results Report

106 possible points are represented here – they are sorted by “Type of

Text”

The same 106 possible points are represented

here – they are sorted by “Level of Comprehension”

Looking at the Results Report – Content Area Results

38

Total Possible Points includes both common

and matrix items (not field-test).

Reading

Looking at the Results Report – Content Area Results

39

Writing

Looking at the Results Report – Content Area Results

Total Possible Points includes both common

and matrix prompts (not field-test).

4040

Looking at the Results Report – Disaggregated Results

4141

Important Note: Disaggregated results are

not reported for sub-groups of less than 10

Looking at the Results Report – Disaggregated Results

4242

Because this is a small school, and so many of the sub-groups are smaller than 10, this part of

the report is not as useful.

But we can still look at district and state

disaggregated results.

Does this data match what we

know about the district’s

program?

Looking at the Results Report – Disaggregated Results

4343

School Summary Report

4444

Contain:• All demographic information for each student that

was provided by RIDE.• The scaled score, achievement level, and

subcategory scores earned by each student in all content areas tested

NECAP files also contain:• Performance on released items• Student questionnaire responses• Optional reports data

NECAP District and School Student-Level Data Files

4545

Released Item Documents

4646

http://iservices.measuredprogress.org

Accessing Your Confidential Reports

47

Select “Interactive”

to view Interactive

Reports

Select “Reports” to view Static Reports

47

Accessing Your Confidential Reports

4848

• Guides to Using the 2009 NECAP Reports • NECAP Analysis and Reporting System User and Training

Manual• Companion PowerPoint presentation• Grade Level Expectations • NECAP Accommodations Guide• Released Items documents• Preparing Students for NECAP: Tips for Teachers to Share

with Students

Supporting Materials and Resources