5.NLTS2 Data Sources: School Surveys, Student Assessments, and Transcripts

5. NLTS2 Data Sources: School Surveys,Student Assessments, and Transcripts

5. Sources: School Surveys, Student Assessments, and Transcripts

2

Prerequisites

• Recommended modules to complete before viewing this module 1. Introduction to the NLTS2 Training Modules 2. NLTS2 Study Overview 3. NLTS2 Study Design and Sampling

5. Sources: School Surveys, Student Assessments, and Transcripts

3

Overview

Data collection sources Teacher survey Student’s school program survey School characteristics survey Student assessments

• Direct and alternate assessment Secondary school transcripts Closing Important information

5. Sources: School Surveys, Student Assessments, and Transcripts

4

Data collection sources

• Data collection instruments were designed to collect data from Parents or guardians Youth Schools Teachers

• Reminder Although there are data about families, communities,

teachers, classrooms, and schools, the youth is the unit of analysis.

5. Sources: School Surveys, Student Assessments, and Transcripts

5

Teacher survey

• Addresses experiences in general education academic classroom

• Sent to teacher for student’s first academic class of the day

• Includes $5 incentive

5. Sources: School Surveys, Student Assessments, and Transcripts

6

Teacher survey

• General education setting Subject, grade, instructional

personnel, ELL students, overall ability level

• Instruction Time, materials used, goals,

activities, techniques, groupings, technology use

• Assessment Formative, summative,

approach, use

• Behavior & discipline• Accommodations/

modifications• Support provision• Performance

Overall reading level, grades, English proficiency

• Teacher background Primary role, experience,

credentials, education, professional development

5. Sources: School Surveys, Student Assessments, and Transcripts

7

Student’s school program survey

• Looks at student’s program as a whole• Sent to teacher who knows student’s overall program• Includes $5 incentive

5. Sources: School Surveys, Student Assessments, and Transcripts

8

Student’s school program survey

• School program Grade level, setting by

curriculum domain• Transition

Goals, supports provided, student involvement, planning

• Special education services IEP, 504 plans, goals,

accommodations, services

• State and district tests• Accommodations/

modifications• Support provision• Performance/support

Overall reading level, absenteeism, disciplinary actions

• Parent involvement

5. Sources: School Surveys, Student Assessments, and Transcripts

9

School characteristics survey

• Looks at the student’s school• Gathers some information about the school’s

community • Sent to school principals or administrators

5. Sources: School Surveys, Student Assessments, and Transcripts

10

School characteristics survey

• School and community Type, grades, size, urban-

suburban-rural• Students

Number, ethnicity, special education

• Staff Teachers, aides, related service

providers• Programs

Academics, enrichment, health, community, language

• Special education policies/practices Prerefferal, supports to

general education, assessment

• Parent involvement• Background

Pressure to perform, suspensions

5. Sources: School Surveys, Student Assessments, and Transcripts

11

Student assessments

• 60 minutes• Academics• Self-concept• Self-determination• Produce meaningful data for the range of special

education students• National comparisons

5. Sources: School Surveys, Student Assessments, and Transcripts

12

Student assessments

• Direct assessment Mathematics, Reading, Science, and Social Studies (WJIII)

• Direct assessment versions Braille, Large-Print, ASL

• Alternate assessment Scale of Independent Behavior-Revised (SIB-R)

5. Sources: School Surveys, Student Assessments, and Transcripts

13

Student Assessments

• Screening Process Teacher judgment

• Student must…– Have consistent response mode– Be able to work with a stranger– Be able to complete first item on the passage comprehension

subtest If yes to above, eligible for direct assessment. If no, eligible for alternate assessment

5. Sources: School Surveys, Student Assessments, and Transcripts

14

Direct assessment: Subtests• Woodcock-Johnson Research

Edition Synonyms/antonyms Passage comprehension Calculation Applied problems Social studies Science

• Student Self-Concept Scale (Gresham & Elliott) Social Academic

• Self-determination scale Items from ARC’s Self

Determination Scale (Wehmeyer 2000)

• Friendships–Social Satisfaction–Dissatisfaction Scale (Asher 1984)

• Open ended: What is your favorite thing about school?

5. Sources: School Surveys, Student Assessments, and Transcripts

15

Direct assessment

• Notes on Visual Stimuli Students with visual impairments were

administered versions of the assessment that did not contain visual stimuli.

The scales were recalibrated to account for the smaller number of items.

5. Sources: School Surveys, Student Assessments, and Transcripts

16

Alternate Assessment

• Eligibility established by screening questionnaire• Teacher completed indirect assessment

Scales of Independent Behavior-Revised (SIB-R) Adaptive Behavior Scale (ABS)

5. Sources: School Surveys, Student Assessments, and Transcripts

17

Alternate assessment: Topics

• Language comprehension• Language expression• Personal living skills• Community living skills• Broad independence• Gross-motor coordination• Fine-motor coordination• Social interaction• Orientation to home/community

• Time and punctuality• Money and value• Eating/meal preparation• Toileting• Dressing• Self-care• Domestic skills• Work/school skills

5. Sources: School Surveys, Student Assessments, and Transcripts

18

Alternate assessment

• Some things to remember No IEP review Functioning measured through parent or teacher report,

not reviews of tests No direct measurement of IQ, executive function, or

memory

5. Sources: School Surveys, Student Assessments, and Transcripts

19

Secondary school transcripts

• Secondary school transcripts were collected for students who attended secondary school and had a transcript compiled. Not all students had a transcript.

• Transcripts vary in amount and type of information. For example, students can attend a grade level for more than one

year or may have left secondary school before completing school. No uniformity in transcript formats from school to school.

5. Sources: School Surveys, Student Assessments, and Transcripts

20

Secondary school transcripts

• Course-level data Course type Course placement (general

or special education) Grade level when attending

course Grade earned if evaluated Units earned Course hours

• School-level data School leaving status Diploma type

• Summarized data Types of courses taken Grade point average Percentage of time in

general or special education

5. Sources: School Surveys, Student Assessments, and Transcripts

21

Closing• Topics discussed in this module

Data collection sources Teacher survey Student’s school program survey School characteristics survey Student assessments

• Direct and alternate assessment Secondary school transcripts

• Next module: 6. Implications for Analysis: Data Content

5. Sources: School Surveys, Student Assessments, and Transcripts

22

Important information

NLTS2 website contains reports, data tables, and other project-related information http://nlts2.org/

Information about obtaining the NLTS2 databaseand documentation can be found on the NCES website http://nces.ed.gov/statprog/rudman/

General information about restricted data licenses can be found on the NCES website http://nces.ed.gov/statprog/instruct.asp

E-mail address: nlts2@sri.com