SMART Goal Target Setting: Using Individual Student Data
Josephine Virgilio
Purpose
• Build capacity within school communities to develop SMART Goal targets through evidence informed dialogue
• Targets that inform practice and improve student learning and achievement
Agenda
1. Context
2. Review process for setting SMART Goal Targets
3. DIP: Data Export Module
4. Visualizing the SMART Goal Targets
5. Table Activities
Toronto Catholic District School Board System Priorities
• Nurturing our Catholic Community
• Improving student learning and achievement
• Building capacity to lead and learn
Persisting Questions: Evidence Informed Dialogue
1. How are school teams unpacking EQAO data, classroom assessments, surveys, and information from the Data Integration Platform (DIP), to develop SMART goals and to guide planning and practice?
Evidence Informed Dialogue continued…
2. What evidence is there of dialogue and collaboration between divisions / departments in your school and in your family of schools, focused on using data to inform planning and improve learning?
TCDSB Data Integration Platform
Evidence Informed Dialogue• to improve student learning and achievement• to build capacity to lead and learn
Principles of Data Analysis
1. Use multiple sources of data.
2. Analyze the data in context.
3. Data are meaningless without informed interpretation.
SMART Goals
Specific Which specific area have you targeted for improvement?
Measurable How are you measuring success in the specific area?
Attainable What strategies/actions will help to attain your goal?
Results-Oriented What resources can aid in achieving desired results?
Timeline How will progress be monitored and by whom?
SMART Goals continued…
• Focuses and frames our work
• Requires us to look at gaps
• Focuses us to be specific and realistic
• Demands examination of data and actions
• Requires us to revisit and be accountable
Focus for Today
Specific • Area of student need• Precision and personalization• ‘One student at a time’
Measurable • Objective • Reliable and allows for valid
observations
Setting SMART Goal Targets
1. Review and reflect on past results.
a. To what extent did we achieve our
2011 SMART goal targets?
Review and reflect on past results continued…
Elementary School Example:
Setting a SMART Goal in Literacy: Grade 6 Reading
• Unpack the EQAO reports:• Detailed School Results (DSR)
• Profile of Strengths and Areas of Improvement (PSAI)
• Item Information Report (IIR)
• Student Questionnaire
• Tracking a Cohort Report
Review and reflect on past results continued…
Secondary School Example:
Setting a SMART Goal in Numeracy: Grade 9 Applied Math
• Unpack the EQAO reports:• Detailed School Results (DSR)
• Profile of Strengths and Areas of Improvement (PSAI)
• Item Information Report (IIR)
• Student Questionnaire
• Tracking a Cohort Report
Review and reflect on past results continued…
b. Review the individual student raw-level EQAO scores.
Elementary• How many students scored in the 2.7 –
2.9 range on the past year’s Grade 6 EQAO Reading assessment?
Secondary• How many students scored in the 2.7 –
2.9 range on the past year’s Grade 9 EQAO Applied Math assessment?
Review and reflect on past results continued…
Review and reflect on past results continued…
Precision
2. Review all assessment data relevant to this year’s SMART Goal target.• Time of school year (e.g., September
vs. January vs. May)
• Knowledge of students
• Grade
Review all relevant assessment data continued…
Elementary School ExampleLiteracy SMART Goal: Grade 6 Reading• Beginning of the school year:
• Grade 5 Report Card, Reading 3rd term• Grade 5 CAT-3 Reading National
Stanine• Grade 5 QCA 2nd Diagnostic • Grade 3 EQAO, Reading• Classroom assessments• TLCP assessment data• Teacher observations
Review all relevant assessment data continued…
Secondary School Example Numeracy SMART Goal: Gr. 9 Applied Math
• Beginning of the school year:
• Grade 8 Report Card, 3rd term • Grade 7 CAT 3 Math National Stanine• Grade 6 Math EQAO
• Exchange of information notes (e.g., Grade 8 teacher observations)
Collaboration
3. Dialogue• SMART Goal targets are based on
collaboratively reviewing individual student data
• ‘One student at a time’
• Identify student learning needs
Collaboration continued…
Elementary School ExampleLiteracy SMART Goal: Gr. 6 Reading
• Meet with Grade 5 and 6 teachers to review the assessment data available for each Grade 6 student
• Share additional information
• Predict each student’s performance on the Grade 6 EQAO in Reading.
• (E.g., ‘high Level 2’)
Collaboration continued…
Secondary School ExampleNumeracy SMART Goal: Gr. 9 Applied Math
• Dialogue e.g., Grade 9 teachers; exchange of information; Grade 8 teacher(s); Guidance Counsellor
• Share additional information
• Predict each student’s performance on the Grade 9 EQAO Applied Math assessment
• (E.g., ‘high Level 3’)
Personalization
4. Identify strategies and differentiate instruction to address the needs of each student.
• Strategies will differ among those students who will likely:
• meet or exceed the Provincial Standard
• meet the Provincial Standard with targeted and precise support
• require significant intervention to improve achievement
Midpoint Correction Opportunities
5. Identify midpoint correction opportunities to evaluate the effectiveness of the strategies implemented to achieve the SMART Goal.
• What strategies are working? • What can be improved?
• Revise and improve strategies to continue to work towards the SMART Goal.
Building Capacity
• Professional Development 2009-10Elementary:• School Improvement Teams • Schools in the Middle
Secondary:• Student Success Teams
• DIP Documents
• DIP Help Line: Danika Lockett x. 5335
DIP: Data Export Module
Data Export
Data Export continued…
2009-2010
Data Export continued…
Grade 6
Data Export continued…
All Students
Data Export continued…
Grade 5 Report Card, 3rd term
Grade 5 CAT3
Grade 3 EQAO
Data Export continued…
Visualizing the SMART Goal Target
Target Setting Module (Elementary Panel)
Target Setting
Target Setting Module continued…
Enter number of students
predicted to achieve Level 3
or 4
Target Setting Module continued…
67
Venn Diagram
Venn Diagram continued…
Student AStudent B
Student CStudent DStudent E
Student FStudent GStudent HStudent I
Student JStudent KStudent LStudent MStudent NStudent OStudent P
Student PStudent QStudent R
Student SStudent T
St. School Reading 3 Ms. Teacher
Table Activity 1: Setting SMART Goal Targets
Purpose: Review the process for setting SMART Goal targets for either:• Literacy for Grade 6 Reading• Numeracy for Grade 9 Applied Math
1.Review data on Excel sheet. 2.What other evidence may inform the SMART Goal?3.Predict each student’s performance on:
• 2009-10 Grade 6 EQAO Reading assessment• 2009-10 Grade 9 EQAO Applied Math assessment.
4.Determine the strategies and supports needed by each student to achieve the predicted performance.
5.Plan for midpoint correction opportunities to evaluate and improve strategies and supports.
Table Activity 2: Venn Diagram
Purpose: Visually represent the SMART Goal target
Using the results of Table Activity 1, transfer the predicted performance of the 20 students for either the: • Literacy SMART Goal: Gr. 6 Reading• Numeracy SMART Goal: Gr. 9 Applied Math
Table Activity 3:SMART Goal Feedback
Purpose: to continue to build capacity to set meaningful SMART Goal targets
1. Review the elementary and secondary fictional SMART Goal targets.
2. Engage in dialogue and feedback on each of the sample SMART Goal targets.
Summary
1. Review Guidelines for Setting SMART Goal Targets
a. Review past performance.
b. Review relevant assessment data.
c. Dialogue and collaborate.
‘One student at a time.’
d. Personalize strategies and supports.
e. Identify the midpoint correction opportunities to revise and improve strategies.
Summary continued…
2. DIP: Data Export Module• Excel sheet of student names, academic
and demographic data.
3. Visual Representations of SMART Goal
• Target Setting Module (Elementary Gr. 3 and 6 EQAO)
• Venn Diagram
Summary continued…
4. Table Activity 1: Set SMART Goal Targets
• Literacy: 2009-10 Grade 6 Reading• Numeracy: 2009-10 Grade 9 Applied Math
5. Table Activity 2: Venn Diagram
6. Table Activity 3: SMART Goal Feedback
Thank you!
Questions?