Using the 2009 NECAP Reports February 2010

Using the 2009 NECAP ReportsFebruary 2010

New England Common Assessment Program

2

Dr. Kevon Tucker-SeeleyAssessment Specialist

Office of Instruction, Assessment & AccountabilityRI Department of Education

1-401-222-8494

Welcome and Introductions

Ana KarantonisAssessment Specialist

Office of Instruction, Assessment & AccountabilityRI Department of Education

1-401-222-8940

3


NECAP Service Center1-877-632-7774

Harold StephensNECAP Program Director1-603-749-9102 ext. [email protected]

Amanda Smith NECAP Program Manager1-603-749-9102 ext. [email protected]

Carole SouleNECAP Program Manager1-603-749-9102 ext. [email protected]

Sarah Halaby-WestonNECAP Program Manager1-603-749-9102 ext. [email protected]

Elliot DunnNECAP Program Manager 1-603-749-9102 ext. [email protected]

4

NECAP Service Center: 1-877-632-7774


Tina Haley: NECAP Program AssistantPhone - 1-603-749-9102 ext. 2427

E-mail – [email protected]

Mellicent Friddell: NECAP Program AssistantPhone - 1-603-749-9102 ext. 2355


Kellie Beaulieu: NECAP Program AssistantPhone - 1-603-749-9102 ext. 2156


5

Purpose of the Workshop

• Review the different types of NECAP reports

• Demonstrate the new NECAP Analysis & Reporting System

• Review the four interactive reports available from the new system

6

Involvement of Local Educators in NECAP

• Development of Grade Level Expectations• Participation in annual test item review

committees & bias and sensitivity review committees

• Use of classroom teacher judgment data• Participation in standard setting panels• Technical Advisory Committee work

7

FERPA

• The Family Educational Rights and Privacy Act (FERPA)

• Access to individual student results is restricted to: the student the student’s parents/guardians authorized school personnel

• Superintendents and principals are responsible for maintaining the privacy and security of all student records.

• Authorized school personnel shall have access to the records of students to whom they are providing services when such access is required in the performance of their official duties.

• FERPA website: http://www.ed.gov/policy/gen/guid/fpco/ferpa/index.html

8

Workshop Materials

9

Types of NECAP Reports

Student Report (Confidential)Information for ParentsItem Analysis Report (Confidential)School level by studentResults Report (Public) School and District levelSummary Report (Public) School/District/State levelStudent Level Data Files (Confidential)Excel/csv files by grade on district and school confidential site

10

Student Report

1111

This part of the report provides the individual

student’s achievement

level and scaled score

Looking at the Student Report

1212


1313

This part of the report provides a comparison between the

performance of this student and

her or his school, district,

and state


1414


1515

This part of the report gives

specific information about the student’s

performance in content area

subcategories


1616


17

Item Analysis Report

1818

Item Analysis Report - Legend

1919

Looking at the Item Analysis Report

2020

This part of the report gives specific information about the released items

and student performance on individual items


2121


2222

This part of the report represents all of the items used to

compute student scores - points are

displayed by subcategory.

Each student’s Scaled Score and

Achievement Level are shown.


2323


2424


This part of the report is where group, school, district and state summary results are located

for the Released Items only.

2525

District and School Results Report

2626

Looking at a School-Level Results Report

2727

Schools can view reports for Testing

Year (2009-10)

Looking at School Results Report – Testing Year

2828

or for Teaching Year (2008-09)

Looking at School Results Report – Teaching Year

2929

School-Level Results Report – Grade Level Summary

3030


3131


3232


3333

School-Level Results Report – Content Area Results

3434

Looking at the Results Report – Content Area Results

Cumulative Totals…provide information on multiple cohorts of students exposed to the program of instruction at a specific grade. Caution should be used if the program of

instruction has changed significantly.

3535


3636

Total Possible Points includes both common and matrix items (not field-test).

Total Possible Points also

represents the test’s balance of representation.

Mathematics


3737

Please note: The Total Possible Points column is organized differently on the Reading Results Report

106 possible points are represented here – they are sorted by “Type of

Text”

The same 106 possible points are represented

here – they are sorted by “Level of Comprehension”


38

Total Possible Points includes both common

and matrix items (not field-test).

Reading


39

Writing


Total Possible Points includes both common

and matrix prompts (not field-test).

4040

Looking at the Results Report – Disaggregated Results

4141

Important Note: Disaggregated results are

not reported for sub-groups of less than 10


4242

Because this is a small school, and so many of the sub-groups are smaller than 10, this part of

the report is not as useful.

But we can still look at district and state

disaggregated results.

Does this data match what we

know about the district’s

program?


4343

School Summary Report

4444

Contain:• All demographic information for each student that

was provided by RIDE.• The scaled score, achievement level, and

subcategory scores earned by each student in all content areas tested

NECAP files also contain:• Performance on released items• Student questionnaire responses• Optional reports data

NECAP District and School Student-Level Data Files

4545

Released Item Documents

4646

http://iservices.measuredprogress.org

Accessing Your Confidential Reports

47

Select “Interactive”

to view Interactive

Reports

Select “Reports” to view Static Reports

47

Accessing Your Confidential Reports

4848

• Guides to Using the 2009 NECAP Reports • NECAP Analysis and Reporting System User and Training

Manual• Companion PowerPoint presentation• Grade Level Expectations • NECAP Accommodations Guide• Released Items documents• Preparing Students for NECAP: Tips for Teachers to Share

with Students

Supporting Materials and Resources