HIDOE/ACS WASC Focus on Learning Self-Study Training Phase III

2019–2020 Schools

HIDOE/ACS WASC Focus on Learning Self-Study Training Phase III

Focus on Learning

2 2014 ©ACS WASC

HIDOE/ACS WASC FOL Accreditation Cycle

Focus on Learning

3 2014 ©ACS WASC

HIDOE/ACS WASC FOL Accreditation Cycle

2014 ©ACS WASC 4

Outcomes of Self-Study Process

2014 ©ACS WASC 5

Agenda

Chapter V: Action Plan

Chapters I-IV

Visit and Status

HIDOE Strategic Plan 2017-2020 Three-Year Academic Plan

ACSWASC © 2013 6

Task 5: Revise the Academic Plan. Establish an ongoing follow-up process to monitor implementation and accomplishment.

Product: Chapter V: Revised Academic Plan

HIDOE/ACS WASC Tasks

8

Review Findings with Stakeholders

Which of these ideas should become part of our three-

year Academic Plan?

ACS WASC ©2018-19

Alignment: Findings, Strengths, Growth Areas, Action Plan

ACSWASC © 2013 9

Action Plan

Criteria Strengths

Criteria Growth Areas Student

Learner Needs

Data

General Learner

Outcomes

Road to the Action Plan

ACSWASC © 2013 10

Academic Plan Questions

2014 ©ACS WASC 11

What is the format of the Three -Year Academic Plan?

How does it address the goals and objectives of the Hawaii Department of

Education and Board of Education Strategic Plan 2017-2020 ?

How is the Academic Plan linked to the data about students?

Academic Plan Format

12

Where are we now? Prioritize school’s needs as identified in one or

more of the following needs assessments: -Comprehensive Needs Assessment (Title I

Schools) -ACS WASC Self-Study: Identified Growth Areas

2014 ©ACS WASC

Academic Plan Format (cont.)

13

Addressing Equity: Sub-Group Identification In order to address equity, list the targeted sub-

group(s) and their identified needs. **Specific enabling activities listed in the academic plan should address identified sub-group(s) and their needs.

2014 ©ACS WASC


14

Organize: Identify your Academic Review Team Accountable Leads

• Name • Title • Responsibility (for implementation of the

school’s strategies and initiatives)

2014 ©ACS WASC


15

Goal 1 Student Success: • Objective 1: Empowered • Objective 2: Whole Child • Objective 3: Well Rounded • Objective 4: Prepared and Resilient

Goal 2 Staff Success: • Objective 1: Focused Professional Development • Objective 2: Timely Recruitment and Placement • Objective 3: Expanded Professional Pipeline

Goal 3 Successful Systems of Support • Objective 1: Innovation • Objective 2: Adequate and Expanded Resources • Objective 3: Efficient and Transparent Supports

2014 ©ACS WASC


16

For each goal (objectives): • Outcome: By the end of three years… • Rationale

2014 ©ACS WASC


17

For each goal (objectives): Planning Components • Desired Outcome • Enabling Activities • School Year(s) of Activity • ART accountable Lead(s) • Source of Funds • Evidence of Progress (relevant data used to

regularly assess and monitor progress)

2014 ©ACS WASC

Sample of Planning Components

18

• Desired Outcome: By 2019-2020, 54% of students will score proficient in ELA.

• Enabling Activity: Implement professional development and coaching to ensure teacher clarity within their standards-based instruction areas

• Lead: Curriculum Coordinator • Target Population: All Students • Funding: WSF

2014 ©ACS WASC

Sample of Planning Components

19

• Evidence of Progress: Monitored Quarterly: 100% of teachers will

participate in classroom observation protocols focusing on:

• visible learning targets • co-constructed rubrics/criteria • checklists • student goal setting • student reflections

2014 ©ACS WASC

Academic Plan Questions

2014 ©ACS WASC 20

How does the Leadership Team determine the desired outcomes for each strategy and other components?

How does the Leadership Team ensure the Academic Plan is aligned

with the prioritized growth areas identified by the Schoolwide Focus

Groups?

Action Plan

Criteria Strengths

Criteria Growth Areas Student

Learner Needs

Data

General Learner

Outcomes

Road to the Action Plan

ACSWASC © 2013 21

22 2014 ©ACS WASC

Let’s Practice

Examine the growth areas from all the focus groups. Group these growth areas into several strands or themes. Chart these.

Let’s Check

To what extent will the strategies of your updated Academic Plan show direct alignment with the student learner needs? the General Learner Outcomes? identified growth areas? what is already identified in the Academic Plan?

Realistically will the enabling activities within each strategy of the Academic Plan impact student achievement?

2014 ©ACS WASC 23

Once Action Plan areas are identified • How do staff members update the current Academic

Plan with meaningful and realistic steps? • How are teachers and other staff involved to gain

consensus and support of the action plan? • How do staff integrate other school projects, grants, and

plans? • How do staff ensure the plan will strengthen student

achievement?

2014 ©ACS WASC 24

Visualize what will be different for students…. One year from now? Two years

from now? Three years from now?

25 2014 ©ACS WASC

How do school staff monitor implementation and accomplishment of the Academic Plan?

Why?

How?

VC Schoolwide Critical Areas for Follow-Up

2014 ©ACS WASC 26

Support those areas already identified by the school in the Academic Plan

Strengthen those identified areas in the Academic Plan

Address additional areas identified by the Visiting Committee

Why

Chapter V: Self-Check Questions

2014 ©ACS WASC 27

2014 ©ACS WASC 28

Agenda


Chapters I-IV

Visit and Status

The Self-Study

So What? What currently exists?

How effective is it?

What? What is the ideal based upon…?

• Vision, Mission, General Learner Outcomes

• HIDOE/ACS WASC Criteria and Indicators

• Academic Standards

Now What? What and how will we modify?

What should be in the Academic Three Year Plan ?

Summary: Self-Study Process

ACS WASC/HIDOE Self Study, 2019-20

ACS WASC ©2018-19 31

Chapter I Progress Report

Chapter II Student-

Community Profile

Chapter III

Self-Study Findings

Chapter IV Summary list

of Major Student Learner Needs

Chapter V Plan

Preface

Electronic Appendices

Will the self-study be ready to be sent 6 weeks prior to visit?

Has the maximum time been allotted for home and focus group work—maximizing regular meeting time?

Timeline

ACSWASC © 2013 32

Doing the work

ACSWASC © 2013 33

Organization

34

Data Teams Grade-level clusters Groups (i.e. students, classified staff, parents)

2013©ACS-WASC

Gather information based on indicators and prompts

Share:

How have you organized your Focus Groups?

Scheduling Focus Group Work in terms of needed Home Group or departmental/data team gathering/discussions

Staggering the work ACSWASC © 2013 35

Task 1: Analyze and reflect upon the school’s progress and the impact on student learning since the previous full self-study.

Product: Chapter I: Summary of Progress


Directions

37 2013©ACS-WASC

HIDOE/WASC FOL, pp. 33-34

Chapter I: Self-Check Questions

38 2013©ACS-WASC

Task 2 Chapter II

• Develop or Refine

Student/ Community Profile

• Clarify General Learner Outcomes

ACS WASC ©2016-17 39

Directions

40

HIDOE/WASC FOL, pp. 35-37

2013©ACS-WASC

Chapter II: Student/Community Profile

41

School Information/Programs Data and Findings

General Learner Outcomes Appendices

2013©ACS-WASC 2013©ACS-WASC

Chapter II: Data within Profile (pp. 39-41)

42

•Introduction (Na Hopena A’o)

•Demographic •Performance

•General Learner Outcomes •Professional Development

•Perception Data •Resources and Management

2013©ACS-WASC

43

What data should we include in our profile? Where do we obtain

the data? HIDOE/WASC FOL, pp. 39-41

2013©ACS-WASC

44

Findings from our data: What does the data tell us? (Using SSIR, ARCH, LDS,

Strive HI, etc.) 2013©ACS-WASC

45 ACS WASC ©2016-17

Sample Achievement Data Determine 2-3 findings. Any questions raised?

General Learner Outcomes

46

Global Interdisciplinary

All students Assessable

2013©ACS-WASC

HIDOE students will be…

Self-Directed Learners

Community Contributors

Complex Thinkers Quality Producers Effective Communicators Effective and Ethical Users of Technology

HIDOE/ACS WASC FOL, 2018, p. 4

General Learner Outcomes (GLOs)

Sample GLO Finding

During our self-study process we looked closely at student data on GLOs, student perceptions, and teacher expectations… After examination of our our data, we noticed that GLO #3 on Complex Thinker had the lowest number of students being rated usually or consistently and the highest rating of sometimes…we decided this would be one of our main areas of focus.

2014 ©ACS WASC 48

ACS WASC ©2015 49

Critiquing Chapter IV Activity: •Compare the profile to the Student/Community Profile Guide (FOL, pp. 39-41) •Are the appropriate data pieces included? Has the school commented upon all data?

Chapter I: Product Student/Community Profile (Task 2)

Data and Findings: trends, irregular patterns, and/or anomalies

• Demographic data, including refined GLOs and implementation of Na Hopena A’o

• Disaggregated and interpreted Student Outcome Data

• Perception data including survey summaries, if any • Draft Summary of Implications, 2-3 Student Learner

Needs and Questions for use in Focus Groups

Appendices 50 2013©ACS-WASC

Chapter II: Product Student/Community Profile (Task 2)

Procedure 3 (Page 36):

• What are the implications of the data with respect to student performance?

• Select 2-3 major preliminary student learner needs

• List important questions that have been raised by the analysis of student performance, demographic, and perception data.

51 2013©ACS-WASC

Sample Implications

52

• The ELL, SPED, Title I and Asian/Pacific Islander subgroups did not meet proficiency in reading and math.

• Even with the focus on the statewide benchmarks for standards, , there is a need to address problem-solving and critical thinking skills in reading and math.

2013©ACS-WASC

Sample Student Learning Needs

53

• Reading Comprehension Skills (academic texts, critical reading skills, and memory and retention skills)

• Math (problem-solving and operational skills) • Problem-solving and critical thinking

2013©ACS-WASC

Sample Questions for All Stakeholders

54

• How do all staff members address the issues of improving the reading, math and problem-solving and critical thinking skills within all courses and programs?

• How do all staff members address the greater use of multiple sources of data effectively to address the modification of the learning and teaching to improve students’ performance within different subgroups and grade levels?

2013©ACS-WASC

Chapter II: Product Student/Community Profile (Task 2)

Procedure 4 (Page 36):

• Discuss draft progress and profile reports with all stakeholders

• Determine if there is agreement at this time on the identified major preliminary student learning needs and important questions raised (Procedure 3). Are there any additions? How do these align to the Hawaii State Strategic Plan?

• Finalize Profile (procedure #1)/Summary (procedure #3)

55 2013©ACS-WASC

Who are the students? How are the students doing?

What does the data tell us? Not tell us?

• What questions does the data raise?

56 2013©ACS-WASC

Chapter II: Self-Check Questions

57 2013©ACS-WASC

Task 3: Evaluate the quality of the school program in relation to the HIDOE/ACS WASC criteria with emphasis on the identified student learning needs; synthesize the information; determine strengths and growth needs.

Product: Chapter III: Summary of findings for criteria in each category and supporting evidence. Identified strengths and prioritized growth areas.


ACS WASC/HIDOE Criteria

ACSWASC © 2013 59

Chapter III: Self-Study Findings

Criteria/Indicator Findings Supporting Evidence

ACSWASC © 2013 60

ACSWASC © 2013 61

Task 3: Program Analysis ─ Chapter III

ACSWASC © 2013 62

Focus Groups • Review and discuss all 5 categories of criteria • Concentrate on assigned criteria and indicators • Use prompts

What data, information, and evidence are needed to determine what currently exists and its

effectiveness?

Task 3: Initial Procedures

63 2013©ACS-WASC

Task 3: Focus Groups

64

What currently exists?

How effective is this? The So What Question?

What data, information, and evidence do we need?

2013©ACS-WASC

Focus Group Dialogue: Sample Questions

What do we know already, including the supporting evidence? What is already in the profile? What evidence is needed from the home groups?

What particular evidence is needed from the home groups related to the identified student learner needs, e.g., how can we all support the English learners? Writing?

ACSWASC © 2013 65

Category C: Standards-based Student Learning: Instruction

C1. Instruction Criterion – Student Centered Instruction

Students actively participate and are highly engaged in their learning through challenging activities that support clearly articulated learning targets so all students achieve the academic standards and the General Learner Outcomes.

2018©ACS WASC

C1: Instruction: Student Access to Learning Sample Indicator and Prompt

67

Students’ Voice and Feedback C1.3 Indicator: The school’s instructional staff members use students’ voice and feedback in order to adjust instruction and learning experiences.

C1.3 Prompt: Evaluate the effectiveness of the use of students’ voice and feedback to adjust instruction and learning experiences. Provide examples.

Findings Supporting Evidence

2018©ACS WASC

C1. Instruction Criterion – Student Access to Learning Possible Areas to Examine and Analyze

•Classroom observations to determine the extent to which differentiation of instruction is occurring and its impact on student learning

•How instructional practices and other activities facilitate access and successful educational outcomes for students who are ELL, economically disadvantaged, underachieving, gifted and talented, at-risk, and in special education

HIDOE/ACS WASC FOL, 2018, p. 73

ACSWASC © 2013 68

ACS WASC/HIDOE Template (example) www.acswasc.org

C2. Instruction Criterion – Rigorous and Relevant Instruction All teachers provide students with a rigorous and relevant instructional program that includes differentiated instruction and engaging activities and assignments so students demonstrate creative and critical thinking, problem solving, and application

Current Knowledge C2.1. Indicator: Teachers are current in the instructional content

taught and research-based instructional methodology, including the integrated use of multimedia and technology.

C2.1. Prompt: Evaluate the extent to which teachers are current in the instructional content and effectively use multimedia and other technology in the delivery of the curriculum.

Findings Supporting Evidence

ACSWASC © 2013 69

ACS WASC/HIDOE Template (example) cont. Summary, Strengths, and Growth Areas

Review all the findings and supporting evidence and summarize the degree to which the criteria in Category C are being met.

Include comments about the degree to which these criteria impact the school’s ability to address one or more of the identified student learning needs from Task 2.

Summary (including comments about the preliminary student learner needs):

Prioritize the strengths and areas of growth for Category C.

Category C: Instruction: Areas of Strength Category C: Instruction: Areas of Growth Copy and paste the Areas of Strength and prioritized Areas of

Growth/Challenges into the matrix in Chapter IV.

ACSWASC © 2013 70

Task 3: Home/Focus Groups―ACS WASC/HIDOE Criteria

What are the criteria concepts?

Indicators/Prompts

What evidence is needed for analysis?

Gathering and Analyzing Data/Information by Home and Focus Groups

ACSWASC © 2013 71

72 ACS WASC ©2016-17

Activity: Category D: Instruction-Reviewing Sample Indicators in D1 or D2

• What does the indicator mean?

• Brainstorm types of evidence that might be used for this indicator?

Jigsaw Learning: Expert Group

73 ACS WASC ©2016-17

Jigsaw: Cooperative Group

Share what your indicator means and what evidence your group considered Others might add on ideas and/or clarify meaning

74 ACS WASC ©2016-17

Thank Group and Return to Table

Share new learnings or

insights

75 ACS WASC ©2016-17

Sample Conversation Prompts…

• What patterns and trends do we find in our learnings from our practice of unpacking an indicator?

• What are the key findings that impact student learning?

• What are our reflections?

• What might we consider designing for the future?

• What do we do now?

Includes analyzing:

What the students are doing and producing

Student interviews

Other interviews, observations, etc.

Observable Evidence

ACSWASC © 2013 76

Student Work “The process of looking at

student work in a collaborative manner helps teachers take a closer look

at how they teach.” Blythe, Allen, and Powell, Looking Together at Student Work: A Companion Guide to Assessing Student Learning. New York, Teachers College Press, 2007.

Nature Quality

Frequency Growth over time

ACSWASC © 2013 77

Student Work: Probing Questions

What did you notice as you examined this work?

What evidence do you see of students' research skills here? Of the application of math skills? Of critical thinking?

How can we support students to become reflective problem solvers?

What are the learning benefits of writing in math?

How was…different from…?

ACSWASC © 2013 78

Student Work: Resources

Essential Schools: Looking Collaboratively at Student Work

www.essentialschools.org/ resources/60

Looking at Student Work

www.lasw.org/

ACSWASC © 2013 79

Evidence: Examining Student Work

Examples of types of work (especially related to student learner needs):

• Typical work, such as writing or solving math problems • Projects, such as senior project • Research Paper • Same performance tasks

or assignments • Portfolios • Case studies

ACSWASC © 2013 80

Individually… • review student work samples.

• sort work into high, middle, low levels of performance.

As a group discuss… • the characteristics of the three categories

• how to ensure student work is representative of the school’s various subgroups

• the extent to which the results of this learning opportunity demonstrate the desired performance quality of the selected standards and General Learner Outcomes.

Sample : Examining Student Work Individually…

• review student work samples.


As a group discuss…

• the characteristics of the three categories



ACSWASC © 2013 81

ACSWASC © 2013 82

What’s our purpose in looking at this student work.

What was the task designed to assess? How effective is it?

What are patterns or trends across the samples?

What are the misunderstandings and understandings?

What are implications for instruction and curriculum?

ACSWASC © 2013 83

Learning from student work

How often do students do this kind of work?

How does this work inform us about students’ abilities to be successful in reaching our General Learner Outcomes?

How will this work be evaluated?

What preceded this work? What will come next?

ACSWASC © 2013 84

How well the student understands the topic of the assignment?

The student’s mastery of a learning standard?

The student’s competence in our critical learner need? Our own grading standards?

Our next steps: press on, reteach, circle back later….?

Observations

Strategies Data-in-a-Day Roving teacher substitutes Teacher journals Shadowing students

Ground rules Capturing data

ACSWASC © 2013 85

Learning Snapshot

What are the students doing ? ___ listening ____ calculating ___ working in a group ___ watching ____ taking notes ___ working alone ___ writing ____ completing worksheet ___ reading ____ using technology Which student learner needs were observed? ___ reading ____critical thinking ___ writing ____computing What General Learner Outcomes were observed?

___ Citizen ___ Life/Career ___ Leadership

ACSWASC © 2013 86

How can your school implement staff observations as a regular practice?

What ground rules will ensure a “safe” environment and obtain staff buy-in?

What kind of “cue sheet” will the school develop?

How will the observation results be used in the FOL process?

Questions to answer about observing…

Interviews and Surveys Interviews

• Student to student • Family to family • Teacher to teacher

Surveys • Short

• Focused

• Understandable

ACSWASC © 2013 88

1) Individually, generate a few sample student questions.

2) Find a partner and share these questions. 3) Debrief, for example

• Open-ended questions • Non-biased • Concrete • Simple language

Evidence:

Interviewing

Share: One important point about evidence is…. Another important point to remember is ... Something that is still not clear to me is ...

90 ACS WASC ©2016-17

Task 3: Program Analysis ― Chapter III

Schoolwide Focus Groups

Home Groups ACSWASC © 2013 91

WRITING ANALYTICAL FINDINGS ACS WASC/HIDOE Focus on Learning

92 ACS WASC ©2016-17

• Assessment and Accountability

Sample Finding: Basis for Determination of Performance Levels Teachers at each grade level have worked hard to establish reasonable guidelines for all assessments to ensure that all students are graded on the same criteria. These, however, are not correlated among the grades. We have, however, not seen any substantial differences in students’ performance as they move to the next higher grade level. Little attention has been given to congruence among subject areas – thus we have observed that some students receive high grades in English/Language Arts and low grades in Social Studies. Fewer discrepancies are seen between Mathematics and Science grades. Fifth and sixth grade teachers have begun initial work in calibrating their grading systems. The overall plan is to continue this work throughout the other grades. Our self-study work revealed this weakness of which we were unaware.






Activity 1A Individually…

• Read the Focus Group narrative in response to the prompt.


• What did the school find in response to the prompt?

• “To what degree” did the school address the prompt?

• How “effective” was the school’s practices/strategies/programs for this prompt?

As a whole group debrief…

ACSWASC © 2013 94






Activity 1B Individually…

• Now read the second Focus Group narrative in response to the same prompt.


• What did the school find in response to the prompt?

• “To what degree” did the school address the prompt?

• How “effective” was the schools practices/strategies/programs for this prompt?

• How was this narrative sample different from the previous sample?

As a whole group debrief…

ACSWASC © 2013 95

ACSWASC © 2013 96

What’s our purpose in looking at the two samples of a Focus Group narrative?

What are implications for how Focus Groups respond to the indicators/ prompts?

Discuss the other sample narratives provided.

Ask when drafting responses to the indicators and prompts:

•Do the findings respond to what is being asked by the indicators/prompts? •Do the findings identify the degree and/or effectiveness of the school’s practices/ strategies/programs described for desired outcomes?

Key Questions

• Is what we found effective?

• Is it making a difference for students?

• Are our findings supported by evidence?

EVALUATE! EVALUATE! EVALUATE!

ACSWASC © 2013 97

Critiquing Chapter III

Criteria Findings

Supporting Evidence

How effective?

Chapter III: Self-Study Findings

ACS WASC ©2018-19

How do we know?

Was the analysis of the school program done in relation to the accomplishment of the student learner needs, the General Learner Outcomes, academic standards, and the criteria concepts?

Was the accuracy of the findings discussed and supported by evidence?

ACSWASC © 2013 99

Critiquing Chapter III

Did discussion occur about how the findings relate to supporting the learning needs of all students?

Were evaluative responses provided for all the criteria/indicators/prompts with supporting evidence? (How effective? What has been the impact on student learning?)

Are strengths and prioritized areas for growth reasonable based on the aligned findings and evidence?

ACSWASC © 2013 100

Plan and re-plan the work of Home and Focus Groups

ACSWASC © 2013 101

Schoolwide Focus Groups

What are their characteristics? What are their responsibilities?

ACSWASC © 2013 102

Self-Check Questions

ACSWASC © 2013 103

Task 4: Summarize the identified student learning needs based on profile and Focus Group analysis and findings.

Product: Chapter IV: Summary of identified student learner needs Table of identified schoolwide strengths and growth areas/challenges


105

Review strengths and growth areas from the five criteria categories

Use these to identify major themes or strands

that can help in confirming the major student learner needs

Confirm identified/revised

major student learner needs

ACS WASC ©2018-19

2014 ©ACS WASC 106

Agenda


Chapters I-IV

Visit and Status

Chairperson/Coach

2014 ©ACS WASC 107

VC Committee Members

2014 ©ACS WASC 108

Preparing for the Visit

Remembering

Planning

Students

Staff

Technology Evidence

Schedule

2014 ©ACS WASC 109

Staff

Hosting

Visit: Preparation and Follow-up

• School must send the self-study report 6 weeks prior to

visit to all. • School sends self-study report electronically to Visiting

Committee (VC) chair/members • School sends to ACS WASC using the Document Upload

link on the top of the navigation bar of the ACS WASC website: www.acswasc.org/document-upload/

2014 ©ACS WASC 110

http://www.acswasc.org/document-upload/

Visit: Preparation and Follow-up

• School shares drafts and collaboratively develops schedule with VC chair

• VC chair works with principal and self-study coordinator(s) on details such as work room needs, meeting room, technical support, logistics, etc. (Separate communication to principal on lodging arrangements, if applicable)

• After visit, school sends updated Academic Plan to ACS WASC through document upload on website

2014 ©ACS WASC 111

Schedule/Activities (3 ½ days for middle and high schools, 3 ½ days for elementary schools)

2014 ©ACS WASC 112

Daily feedback meetings between Visiting Committee members and school leaders

Classroom/campus observations

Informal interviews

Meetings with Focus Groups and others

Daily meeting of VC Chair and principal

VC report editing/reviewing

VC Report

Analysis Conclusions-Action Plan Schoolwide strengths Schoolwide critical areas for follow-up Support identified areas Strengthen identified areas Address additional areas

2014 ©ACS WASC 113

What are the critical elements that will enable your school to focus on the analysis of student

achievement?

ACSWASC © 2013 114

W A S C

We

Are

Student

Centered

ACSWASC © 2013 115

Documents

HIDOE/ACS WASC Focus on Learning Self-Study Training Phase III