Embed Size (px)
Citation preview
Southern
Regional
Education
Board
HSTW
Administering the 2012 HSTW Assessment for TCTW
Sites
Southern
Regional
Education
Board
HSTW
About the HSTW Assessment
HSTW and TCTW are research-based school improvement models
HSTW Assessment is used to set baselines, acknowledge progress, identify areas for improvement, and set priorities
Only initiatives combining student achievement data with students’ perceptions of school and classroom practices
Required of HSTW and TCTW sites in even-numbered years
Administered to seniors to collect data on entire high school experience
Southern
Regional
Education
Board
HSTW
New in 2012
There will be no constructed response items in the assessment
The overall assessment time will be shortened by 20 minutes
Sites that have not paid by April 30, 2012 will not receive their school report until they do so
Southern
Regional
Education
Board
HSTWExamples of How Schools
and Centers Use the Results
Lobby for state actions to support school improvement
Identify a need for improvement Gain support for school improvement Engage the entire faculty in school
improvement Set priorities for school improvement Improve classroom practices
Southern
Regional
Education
Board
HSTWExamples of How Schools
and Centers Use the Results
In 2008, one TCTW center said “the teacher survey was a real eye-opener. Through the data, we very quickly realized that we had teachers on our campus with very different views regarding the purpose of career/technical education, particularly in the area of academic reinforcement. The survey data will allow us to identify the highest priority staff development needs and to begin creating a common understanding of our center’s role in a students’ technical and academic success.”
Southern
Regional
Education
Board
HSTW
Five Components
Reading testMathematics test Science testStudent survey
Course-taking patternsSchool/center and classroom
experiences
Teacher survey
Southern
Regional
Education
Board
HSTW
Reading Test
75 minutes80% informational texts; 20%
literary non-fiction textsIncludes meaning vocabularyIncludes paired texts (to assess
critical analysis)Does not include literary fiction or
poetry
Southern
Regional
Education
Board
HSTW
Mathematics Test
80 minutesContent
11% Number Properties and Operations
29% Measurement/Geometry24% Data Analysis, Statistics and
Probability36% Algebra
Southern
Regional
Education
Board
HSTW
Science Test
55 minutesContent
43% Life Sciences42% Physical Sciences15% Earth and Space Science
Southern
Regional
Education
Board
HSTW
Student Survey
Section 1Course-taking patterns
Sections 2 and 3School and classroom experiencesBased on HSTW Key Practices
Southern
Regional
Education
Board
HSTW
TCTW Teacher Survey
Center and classroom experiencesCenter missionHigh expectations and extra helpGuiding and supporting studentsCurriculum content and engaging
students in learningTransitionsLeadership and professional growth
Southern
Regional
Education
Board
HSTW
Results
HSTW Award of Educational Achievement
Student reportsSchool report
Southern
Regional
Education
Board
HSTWHSTW Award of Educational
AchievementMailed to centers in late April,
2012Awarded to students who:
Meet all three readiness goalsComplete at least two parts of the
HSTW-Recommended Curriculum• English/language arts, mathematics,
science
Complete a concentration• Career/technical, mathematics/science,
humanities
Southern
Regional
Education
Board
HSTW
Student reports
Mailed to centers in late April, 2012
Performance on reading, mathematics and science testPerformance level
Completion of recommended curriculum and concentration
Award status
Southern
Regional
Education
Board
HSTW
HSTW Assessment Report
Mailed to centers in late June, 2012 Executive Summary
One page summary of performance and implementation
OverviewSlightly longer summary
Full reportTables breaking out achievement by experiences **No teacher survey results
• Teacher survey results will be provided in a separate report.
Southern
Regional
Education
Board
HSTW
Administering the Assessment
1. Place orderOrder window
• September 1 – October 31, 2011
Orders must be placed online on SREB website
All communication and materials will be sent to contact person listed on order form
Southern
Regional
Education
Board
HSTW
Information needed to place order
If your center has previously participated in an assessment
Name, email address and phone number of contact person (will receive all materials and communication via mail and email through summer 2012)
Complete shipping address (no P.O. boxes)Director name, email address and phone numberSampling method and number of students to be
assessedPayment information and billing addressDates the center plans to assess within windowNumber of teachers you plan to survey (estimate)
Southern
Regional
Education
Board
HSTW
Payment Information
The cost is $34 per student.If your center or district is paying for the
assessment, a purchase order is due to SREB by November 18, 2011 to confirm your order
Final payment is due to SREB by April 30, 2012
SREB will accept payments beginning immediately (call Fran Mathis at 404-879-5611 to request an early invoice)
Southern
Regional
Education
Board
HSTW
Optional/Additional Costs
Cancellation Fee
The cancellation fee of $13 per student for the HSTW Assessment applies if orders are
cancelled after materials have been printed and/or shipped.
ITEM COST
Composite Report $465
Color Copy $210
Black and White Copy $80
Southern
Regional
Education
Board
HSTW
Administering the Assessment
2. Review administration materialsAvailable on SREB website
beginning September, 2011A link also will be included in the
order confirmation email sent upon placing an order
Review materials immediatelySet timeline for preparation and
administration
Southern
Regional
Education
Board
HSTW
Administration Materials
Test Administration GuideSampling InstructionsStudent Roster FormCourse Description GuideCourse Matching ChartChecklistHSTW Student Bulletin (with Sample
Questions Booklet)Information for SitesTasks and Timelines
Southern
Regional
Education
Board
HSTWSample Timeline
Task Schedule Estimated Time
Identify students Sept. – Nov. 2011 3 hours
Identify assistants Sept. – Nov. 2011 1 hour
Schedule time and place Sept. – Nov. 2011 2 hours
Notify students and teachers Sept. – Nov. 2011 2 hours
Prepare student roster Oct. – Dec. 2011 1 hour
Complete course matching chart Oct. – Dec. 2011 5 days
Prepare student transcripts Jan. 2012 5 days
Receive and check materials Jan. 23, 2012 1 hour
Assign answer documents to students
Jan. 24-26, 2012 3 hours
Complete section 1 of student survey for students
Prior to Scheduled Testing
3 days
Administer assessment and teacher survey
Jan. 27 – Feb. 17, 2012
2-4 days
Return materialsNo later than Feb.
17, 20121 hour
Southern
Regional
Education
Board
HSTW
Administering the Assessment
3. Identify studentsUse sampling plan selected on order
• All seniors• Random sample of 60+ seniors• All CT seniors• Random sample of 60+ CT seniors
Include all currently enrolled students in sampling
• Only exclude students if IEP exempts them from state assessments
Use sampling instructions provided to select sample
Southern
Regional
Education
Board
HSTW
Identifying Students to Participate
Only include seniorsIf selecting a sample, select a true random
sample using the instructions providedOnly exclude students if their IEP exempts
them from state assessmentsAccommodations provided for state
assessments should be provided for this assessment
• Contact ETS by October 31, 2011 to request large-print or CD materials
Accommodations exist for English language learners
Southern
Regional
Education
Board
HSTW
Identifying Students When Home Schools Are Also Participating
Center should select sample.Home school should select sample.Center and home school should compare lists to
see if any students were double-selected. If no students were double-selected, proceed as
usual. If students were double-selected, students should
assess at home school.Call ETS (Lisa Rion – 609-734-5646) to obtain a
special code.Enter that special code on all double-selected
students’ answer documents. Their results will go into both reports while they only participate once.
Southern
Regional
Education
Board
HSTW
Administering the Assessment
4. SchedulingIdentify assistants
• One assistant per 15 students is ideal
Schedule dates, times and locations• Include make-up sessions• SREB recommends administering
assessment over 2-3 days
Schedule date, time and location for teacher survey
Southern
Regional
Education
Board
HSTW
Administering the Assessment
5. NotificationNotify students, parents and
teachersProvide informational materials
and/or schedule an informational meeting
Southern
Regional
Education
Board
HSTW
Administering the Assessment
6. Prepare student roster form Include names of all participating studentsWill need to include each student’s Assessment ID
number from the answer document he or she is assigned
Keep fully completed roster on file with testing records for five years
Include students’ email addresses to assist with Follow-Up Survey of 2012 Graduates (very important!)
Southern
Regional
Education
Board
HSTW
Administering the Assessment
7. Course-taking preparationWork with home schools to complete
course-matching chart, using course description guide
• Used to link local course titles to generic SREB course titles
Include all courses current seniors could have taken during high school
Collect transcripts and course schedules for participating students, including spring courses
Southern
Regional
Education
Board
HSTW
Administering the Assessment
8. Receive assessment materialsMaterials schedule to arrive by January 23, 2012
• TCTW Teacher Survey materials will not be sent. Information will come via e-mail.
Verify contents according to instructions immediately
• This gives ETS time to send new materials should an error have occurred
Keep secure (locked) until testing beginsThese are secure testing materials and all materials
(used and unused) will need to be returnedKeep the boxes – you will need them to return
materialsKeep ALL materials
Southern
Regional
Education
Board
HSTW
Administering the Assessment
9. Prepare assessment materialsAssign each student an answer document
• Record each student’s Assessment ID number from the answer document on the student roster form
Complete section 1 (transcript analysis) for students
• Strongly recommended, but not required• Reduces testing time• Increases accuracy
Southern
Regional
Education
Board
HSTW
Administering the Assessment
10. Review testing arrangementsConfirm dates, times and locationsRemind participantsReview administration plan with
assistants
Southern
Regional
Education
Board
HSTW
Administering the Assessment
11. Administer assessmentStudent and Teacher Window: January 27 –
February 17, 2012Administration guide includes scripts and complete
instructions for administering the student assessment
Students must complete all four componentsAll materials must be postmarked for return using
the enclosed instructions and labels no later than February 17, 2012
• TCTW Teacher Survey materials will NOT be returned since the survey takes place online.
Southern
Regional
Education
Board
HSTW
Administering the Assessment
12. Return materialsPack student materials using enclosed instructions
• Completed answer documents will be packed in a different envelope and use a different return label than the test books and other materials
• If the necessary envelopes and labels are not included, you must call ETS (Lisa Rion at 609-734-5646) for replacement materials
• Teacher survey materials will be returned separately from student materials to a different location
All materials must be postmarked for return no later than February 17, 2012
Keep the receipt and tracking number!!!
Southern
Regional
Education
Board
HSTW
Administering the Assessment
VERY IMPORTANT:
Only return answer documents that you want scored. Your school will be responsible for paying for all
answer documents sent to ETS for scoring, even if the number is
over what you ordered.
Southern
Regional
Education
Board
HSTW
Important Dates to Remember Order window
September 1 – October 31, 2011
Administration materials available online September, 2011
Test materials arrive at sites January 23, 2012
Student and teacher administration window January 27 – February 17, 2012
Final return deadline February 17, 2012
Awards and student reports mailed to sites By April 30, 2012
Payment due to SREB April 30, 2012
School reports mailed to sites Late June, 2012
Southern
Regional
Education
Board
HSTWMaking the 2012 Assessment
a Success
CommunicationLetters/informational sessions for
students and parentsAnnouncements to faculty and staffStress importance, intended use,
and value of assessment
Southern
Regional
Education
Board
HSTWMaking the 2012 Assessment
a Success
CooperationImportance of the assessment to the
center’s improvement goalsImportance of students,
administration and faculty taking it seriously
Handling make-up workCooperation from teachers whose
classes might be interrupted by the assessment
Southern
Regional
Education
Board
HSTWMaking the 2012 Assessment
a Success
Encourage all students to do their bestPromote the HSTW Award of Educational
AchievementRecognize those who receive the HSTW Award of
Educational AchievementExplain the new student readiness reports and how
it can help with their resumesBuild enthusiasmBe honest – explain how this helps the center and
future studentsMake students feel special for participating in the
assessment and thank them for their participationSee “PUBLICATIONS” column athttp://www.sreb.org/page/1329/hstw_assessment.html
Southern
Regional
Education
Board
HSTWFor More Information…
Go to SREB’s Web pages on assessment for more ideas and information!
http://www.sreb.org/page/1144/assessments__surveys.html
Fran Cowart, Coordinator of [email protected]
(404) 879-5611
Ann Benson, Director of Technology Centers That [email protected]
