24
Deliverable: Hamilton Southeastern Schools Student Achievement Analytics Solution Report Student Achievement Analytics Solution Assessment: Current State and Gap Analysis, Future State and Implementation Roadmap March 8, 2018

Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

Deliverable:

Hamilton Southeastern Schools Student Achievement Analytics

Solution Report

Student Achievement Analytics Solution Assessment: Current State and

Gap Analysis, Future State and Implementation Roadmap

March 8, 2018

Page 2: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

2 DELIVERABLE Student Achievement Analytics Solution

TABLE OF CONTENTS

Executive Summary ................................................................................................................ 3

Student Achievement Analytics Assessment ....................................................................... 4

Current State Discovery ......................................................................................................................... 4

Discovery Sessions: ........................................................................................................................... 4

Existing Flow of Information and Data: ............................................................................................... 6

Current Reporting, Developers, and End-Users: ................................................................................ 7

Data Source Portfolio ............................................................................................................................. 7

Data Sources: .................................................................................................................................... 7

School/Teacher-specific learning and evaluation tools: ...................................................................... 8

Available Data: ................................................................................................................................... 8

Available Demographic data: ............................................................................................................ 10

Potential Use Cases ............................................................................................................................ 11

Value-Feasibility Matrix ........................................................................................................................ 13

Sample Dashboard: Student Profile Dashboard ............................................................................... 15

Gap Analysis ....................................................................................................................................... 16

Data Availability and Accessibility ..................................................................................................... 16

Data Acumen and Advocacy ............................................................................................................ 16

IMPLEMENTATION ROADMAP ............................................................................................. 18

Future State ......................................................................................................................................... 18

Ideal Flow of Information and Data: .................................................................................................. 18

Student Achievement Analytics Solution .............................................................................................. 20

Data Blending and Transformation ................................................................................................... 20

Report and Dashboard Development ............................................................................................... 21

Data Service Hub Development ....................................................................................................... 21

Data Process Transformation and Implementation ........................................................................... 22

Talent Development ............................................................................................................................. 22

Develop Chief Analytics Officer role ................................................................................................. 22

Assist HSE in hiring a BI Developer to own and maintain Student Achievement Analytics Solution .. 22

Develop Data Analyst role ................................................................................................................ 22

Strategy & Planning ............................................................................................................................. 22

Data Strategy Committee Formation & Planning .............................................................................. 22

Design Thinking Facilitated Session ................................................................................................. 23

Training and Transition ........................................................................................................................ 24

Train School-Centric Data Managers................................................................................................ 24

Train faculty and staff how to use reports, dashboards and Data Service Hub ................................. 24

Transition ownership of Student Achievement Analytics Solution ..................................................... 24

Page 3: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

3 DELIVERABLE Student Achievement Analytics Solution

EXECUTIVE SUMMARY

Hamilton Southeastern Schools (HSE) has engaged KSM Consulting (KSMC) because they see a need

across all levels of the organization to better gauge and analyze student achievement. To accomplish

this, they would like KSMC to develop a Student Achievement Analytics Solution to empower teachers,

principals, staff, and the School Board to make data-driven decisions that will improve student

outcomes.

KSMC completed a series of discovery sessions to better understand the current state of reporting,

end-users, developers, and data sources. Central Office staff, teachers, principals, and School Board

members were all consulted as a part of discovery. Skyward was identified as the main source of data

for Hamilton Southeastern schools with other notable data sources being Central Office-maintained

spreadsheets and standardized test scores, provided by the State of Indiana via Pearson Education. In

general, most discovery participants found any reporting and analysis to be a cumbersome experience

of manually combining multiple data sources together or exporting data from Skyward in order to do

their own trending, if they were able to fulfill their own reporting and analysis requirements at all.

Our team identified two overarching gaps in business intelligence and data analytics at Hamilton

Southeastern Schools: data availability and accessibility, and data acumen and advocacy. Data is hard

to access, and often the desired data points are unavailable. In addition, there are no resources who

are dedicated to making data available for analysis, completing data analysis, or advocating for a data-

driven culture.

As a part of the assessment, KSMC has developed the following deliverables (all contained in this

document): Student Achievement Analytics Solution report (this document), Use-Case Definitions,

Value-Feasibility Matrix, and an Implementation Roadmap.

KSMC is proposing a solution with four components: the Student Achievement Analytics Solution,

which consists of new data sources, reports and dashboards based on prioritized User Needs, and a

Data Service Hub to surface dashboards and reports; Talent Development, to create a Analytics teams

consisting of a Chief Analytics Officer, a Data Analyst, a BI Developer, and School-Centric Data

Managers; Strategy and Planning; and Training and Transition.

Page 4: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

4 DELIVERABLE Student Achievement Analytics Solution

STUDENT ACHIEVEMENT ANALYTICS ASSESSMENT

Current State Discovery

Discovery Sessions:

As a part of Current State Discovery, KSMC met with the following individuals associated with Hamilton

Southeastern School District:

• Dr. Allen Bourff: Superintendent

• Dr. Jan Combs: Assistant Superintendent of Teaching and Learning

• Tom Bell: Director of Exceptional Learning

• Phil Lederach: Director of Secondary Education

• Mike Reuter: CFO

• Stephanie Loane: Director of Elementary Education

• Jeff Harrison: Director of Educational Technology and team

• Mike Beresford: Assistant Superintendent, Human Resources, Student Services, and School

Safety

• Kaaren Southerland: Data Systems Manager, Skyward

• Zach McKinney: Incoming Director of Transportation

• Jim White: Outgoing Director of Transportation

• Mike Bottorff: School Board Member

• Amanda Shera: School Board Member

• High School Principals:

o Matt Kegley: Principal, Hamilton Southeastern High School

o Jason Urban: Principal, Fishers High School

o Janie Ulmer: Director, Hamilton Southeastern Fishers Academy

• Junior High School Principals:

o Rob Huesing: Principal, Riverside Jr. High School

o Crystal Thorpe: Principal, Fishers Jr. High School

o Kimberly Lippe: Principal, Fall Creek Jr. High School

o Tim Mankin: Principal, Hamilton Southeastern Intermediate/Jr. High School

• Intermediate School Principals:

o Brent Farrell: Principal, Sand Creek Intermediate School

o Randy Schoeff: Principal, Fall Creek Intermediate School

o Danielle Chastain: Principal, Riverside Intermediate School

• Elementary School Principals:

o Lori Mankin: Principal, New Britton Elementary

o Sara Curran: Principal, Thorpe Creek Elementary

o Sean Henseleit: Assistant Principal, Lantern Road Elementary

o Brian Sloan: Principal, Fisher Elementary

Page 5: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

5 DELIVERABLE Student Achievement Analytics Solution

For additional context, the KSMC team held a discovery session with the Teacher Development

Specialist (TDS) group and attended a Professional Learning Community (PLC) meeting to understand

the specific data needs of those groups.

The following questions were used as a basis for discovery discussions:

• Can you provide some current ways that you are using data to make decisions?

• How would you like to utilize data in the future?

• How long does it take to receive data from individual schools/Central Office staff?

• Are there situations where there can be too much data utilization?

• How “data-ready” is the District?

• Would you like the data to be operationally, or research focused?

• How much time per day do you currently spend with data? o Compiling/cleaning/formatting/presenting vs. analyzing

• Is some type of public data access portal important to you, and if so what kinds of information would be housed there?

• How often do you talk about data with parents?

• Will the data needs vary across levels of education?

• Will data needs vary across schools?

• What data sources do you currently utilize?

• How are surrounding districts utilizing data?

Page 6: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

6 DELIVERABLE Student Achievement Analytics Solution

Existing Flow of Information and Data:

Figure A: Current State Data Flow

Presently, the Schools serve as sources of data, the bulk of which is in Skyward. Schools serve as

an input to Skyward, but individual school staff have a low level of access to data, as well as a small

amount of time to spend acquiring data in order to customize and tailor instruction. For this reason,

except for school-assigned TDS’s, most of the school staff are not empowered to use data to make

decisions and/or solve problems that impact student success.

The State of Indiana provides standardized test scores (ISTEP) to Hamilton Southeastern. These

scores are stored as files in Skyward. Hamilton Southeastern also provides standard weekly and

monthly reports back to the State of Indiana for attendance and discipline. Additionally, the State of

Indiana provides standardized testing reports to the general Public, accessible from the Indiana

Department of Education webpage.

Page 7: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

7 DELIVERABLE Student Achievement Analytics Solution

Current Reporting, Developers, and End-Users:

Current reporting is almost completely ad hoc and completed via spreadsheets or Skyward report writer

and/or Skyward Data Mine (if Skyward data is needed). Most ad hoc report requests are handled by

Jeff Harrison.

Throughout discovery, KSMC identified the following types of end users:

• School Board members

• Central Office staff and administrators

• Principals and School staff

• Teachers

• Teacher Development Specialists (TDS’s)

Data Source Portfolio

Data Sources:

Student/School Information:

• Skyward

Transportation:

• VersaTrans

• Skylert

Substitute Teacher Management:

• AESOP

Accounting:

The Central Office serves as a limited source of data – they have shared spreadsheets used to

track mental health, behavior, and police activity tied to a particular student, but they have generally

low access to data, as well. When supporting data is needed in the event of behavioral issues or

police activity (i.e. attendance, grades, test scores), Central Office staff must ask Jeff Harrison for

assistance. He uses the Skyward report writer functionality to pull the requested data and returns it

to the requestor. Every Central Office data need presently reports in an ad hoc report request to Jeff

Harrison.

The School Board is provided data by the Central Office. However, there is some concern by the

School Board that the data provided to them may not tell the whole story. In the past, the School

Board has noted discrepancies between reports provided by Central Office and reports provided by

the State of Indiana. They have a concern that some data may have been manipulated by the

Central Office, and they would like a higher level of transparency and accountability in their

relationship with the Central Office.

Page 8: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

8 DELIVERABLE Student Achievement Analytics Solution

• AS400

• Alio (deployment Fall 2018)

Library circulation/checkouts:

• Destiny

Educational tools:

• Canvas

Standardized Testing (from State of Indiana via Pearson):

• ISTEP

• IREAD

• ISTAR

• WIDA

Other Standardized Testing

• NWEA

• SAT

• PSAT

Spreadsheets:

• Mental Health

School/Teacher-specific learning and evaluation tools:

Front Row

ConnectEd

Compass

Achieve 3000

AimsWeb

F&P

Lexia

Scholastic

ReadNaturally live

ISTAR

Available Data (as specified by Jeff Harrison):

Data Source In Skyward? How Often? External

Source?

NWEA X 3x per year X

ISTEP (ILEARN) X 1x per year X

ACT X Monthly X

Page 9: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

9 DELIVERABLE Student Achievement Analytics Solution

SAT X Monthly X

GPA X 2x per year

Credit Attainment X 2x per year

Attendance X Daily

AP Scores X 1x per year X

Dual Credits X

Graduation Data X 1x per year

Interventions

Positive Behavioral Intervention and

Supports (PBIS)

Mental Health

Response to Intervention (RTI)

Behavior X

Discipline X

Retention

ECA Participation

Internships

Classroom Grades X

Guided Reading Level

WIDA X 1x per year X

IREAD 3 X 2x per year X

ISTAR X 1x per year X

Jr High Students in High School Courses X

International Baccalaureate X

Page 10: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

10 DELIVERABLE Student Achievement Analytics Solution

Available Demographic data:

Demographic Source

School Skyward

Cohort History Skyward

Teacher Skyward

District Skyward

State Skyward

Grade Level Skyward

Individual Student Skyward

Nationality Skyward

Teacher Education Level HR System

Teacher Effectiveness Standard for Success (SFS)

Teacher Retainment HR System

Administrator Effectiveness Standard for Success (SFS)

Subgroup Skyward

Gender Skyward

Socioeconomic Status (SES) Skyward

Ethnicity Skyward

Special Education Skyward

Exceptionality Skyward

High Ability Skyward

English Language Learner (ELL) Skyward

ELL Level Skyward

Page 11: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

11 DELIVERABLE Student Achievement Analytics Solution

Homeless Skyward

Title I Skyward

Teacher attendance AESOP

Teacher Seniority HR System

Teacher Education Level HR System

Dollars per Student per Building Alio (Accounting System)

Salaries Alio (Accounting System)

Supplies Alio (Accounting System)

Insurance Alio (Accounting System)

Utilities Alio (Accounting System)

Connectedness

Athletics Skyward

Student Assistance Team

Discipline Skyward

Transient Skyward

Enrollment Skyward

Class Size Skyward

Potential Use Cases

KSMC has identified use cases for both operational reporting needs and potential research studies

throughout discovery sessions.

Use Case Value Feasibility Total

Page 12: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

12 DELIVERABLE Student Achievement Analytics Solution

Teacher dashboard: Classroom-level metrics: attendance, discipline, NWEA scores, ISTEP scores, grade distribution, reading levels (metrics will vary by grade-level) 10 9 19

Principal dashboard: *Same content as Teacher Dashboard, aggregated to the School-level 10 9 19

Central Office dashboard: *Same content as Principal Dashboard, aggregated to the District-level 10 9 19

School Board dashboard: *Same content as Central Office Dashboard, aggregated to the District-level, with different security requirements, per FERPA 9 9 18

High Ability Student Dashboard: Will include Skyward data blended with National Clearing House data; Available parameters: Graduation year, race, program (ex. Advanced Math, 5th year language) 10 7 17

Dollars per student analysis. This information should be presented and filterable by building for allocation purposes 8 8 16

Guided reading level report: Available parameters: grade-level, year (multi-select), economically-disadvantaged, race. 7 8 15

Cohort analysis report: Available parameters: grade-level, year (multi-select), economically-disadvantaged, race, score type 9 6 15

Standard reporting for "receiving" principal from "sending" principal when transitioning students building-to-building 8 6 14

Summer melt on transition years 8 6 14

HSE 21-specific metric-based measurement strategy 10 4 14

Track library activity/usage impact on student success 4 9 13

Systematically organize students in classes by sub-groups based on subject areas and comprehension areas (i.e. Math-number sense, Reading-Inference, etc.) 7 6 13

"Similar case" analysis based on demographics, RTI plans, behavior/triggers, living situations, etc. inform RTI activity. 9 4 13

Impact analysis of teacher ethnicity on student success 5 7 12

Exit interview analysis from Applatrack (metricize specific areas of interview topics) 7 5 12

New hire surveys throughout the year to understand factors feeding into retention 5 6 11

Report for common curricular formative assessments - Available parameters: Assessment, student 7 4 11

RTI/PBIS snapshot - methods attempted, and results/outcomes-- Tier 1, Tier 2, Tier 3 interventions, extracurricular involvement of these students 7 4 11

Historical information report on track of student through school system (what teachers/classes/schools they've had in the past) 5 5 10

Track student health and impact of sleep and home factors 9 1 10

Model student outcomes in high school and beyond based on student demographic factors 7 2 9

Page 13: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

13 DELIVERABLE Student Achievement Analytics Solution

Measure impact of TDS on teacher performance and student success 6 3 9

Student involvement dashboard - extracurriculars, clubs, class participation, etc. 7 2 9

RFID tracking and ridership program to understand bus riding patterns 6 2 8

Teacher effectiveness based on impact of Title I, II, III funding usage for professional development 3 5 8

Indiana Gateway: usage of funds to trend bond usage 2 6 8

Effect of red-shirting kindergartners based on indicators 3 5 8

Standardized testing results based on funding amount spent, number of students per school 6 1 7

Identify students that would benefit from a late bus or afterschool program and use ridership data to track usage 4 2 6

Counselor time management report how do counselors spend their time? How much with students? 4 2 6

Value-Feasibility Matrix

Figure C: Value-Feasibility Matrix, Upper Right Quadrant

Page 14: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

14 DELIVERABLE Student Achievement Analytics Solution

Figure D: Value-Feasibility Matrix, Upper Left Quadrant

Figure E: Value-Feasibility Matrix, Bottom Right Quadrant

Page 15: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

15 DELIVERABLE Student Achievement Analytics Solution

Figure F: Value-Feasibility Matrix, Bottom Left Quadrant

Sample Dashboard: Student Profile Dashboard

The Student Profile Dashboard will be used by teachers to get a holistic student view that is currently

both cumbersome and time consuming to pull together when needed.

This dashboard contains the following data points for a selected student:

• Date Entered District

• Grade Level

• Attendance (Trend)

• Discipline (Trend)

• Gender

• Race

• Economically Disadvantaged (yes/no)

• Special Education (yes/no)

• Free/Reduced Lunch (yes/no)

• Grades (Current, Trend by date completed)

• ISTEP Math (Trend by date administered)

• ISTEP Reading (Trend by date administered)

Page 16: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

16 DELIVERABLE Student Achievement Analytics Solution

• NWEA Math (Trend by date administered)

• NWEA Reading (Trend by date administered)

Gap Analysis

KSMC has identified gaps in the current state of business intelligence and data analysis at Hamilton

Southeastern schools in two main areas:

Data Availability and Accessibility

Presently, there are no standard analytical reports that are run at any level – the data isn’t currently

aggregated to support analysis by teachers, administration, Central Office staff, or the School Board.

Hamilton Southeastern schools could be missing out on important trends – positive and negative – to

support decision-making and problem-solving, because little is known about what data is available or

how to access it.

• Lack of standard reports and dashboards

o Teachers and principals must cobble together many individual data points in order to get

a holistic view of an individual student, classroom or school.

o Central Office staff has extremely limited access to aggregated data for analysis or

state-mandated reporting. Any data need results in an ad hoc report request – the

majority of which are completed by Jeff Harrison, who has limited time available for

these types of requests.

• Disparate data sources

o Though both internal to HSE, Skyward data and Central Office-generated data (mental

health, behavior) are maintained separately and must be combined manually, on an ad

hoc basis, for reporting.

o Standardized testing scores are currently the only external data source used by the

school district. Though stored in Skyward, standardized testing data is stored outside of

the Skyward table structure and is not joined with the rest of the Skyward data.

• No centralized location to run reports or access data

o Other than pulling individual data points from Skyward and manually combining them,

there is no method for teachers, principals and Central Office staff to access data for the

purposes of analysis.

Data Acumen and Advocacy

At this point, all report requests are ad hoc and require time from the Director of Educational

Technology, whose time is already both limited and valuable. Hamilton Southeastern has very few

other experts available for reporting and analysis or advocacy for data usage.

• Lack of staff dedicated to creation, availability, and analytics

o There are limited staff that can create reports in Skyward, and these report requests

often fall to Jeff Harrison

Page 17: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

17 DELIVERABLE Student Achievement Analytics Solution

o There are no staff members dedicated to making data more available to users at all

levels of the organization.

• Lack of awareness/data-driven culture

o Because Hamilton Southeastern doesn’t have any standard reports that are regularly

used and shared across the organization, there is a general lack of awareness about the

available data and how it can be used for decision-making and problem-solving.

o In some parts of the organization, there is an existing stigma that the time it takes to

gather and analyze data is so great that it detracts accomplishing the goal of the

analysis.

Page 18: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

18 DELIVERABLE Student Achievement Analytics Solution

IMPLEMENTATION ROADMAP

Future State

Ideal Flow of Information and Data:

Figure G: Future State Data Flow

The Schools serve as sources of data, but in exchange they should also be the recipients of data.

KSMC proposes the development of reports and dashboards that will provide both operational and

research value to teachers and school staff. Each school’s School-Centric Data Manager will be a

Data Service Hub power-user and will be able to assist with and advocate for data-usage within the

school.

Page 19: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

19 DELIVERABLE Student Achievement Analytics Solution

Standardized testing scores from the State of Indiana (as well as other agencies) will be stored in

database tables that can be joined with other student data and used for analysis. Around the same

date that standardized test scores are published by the State of Indiana, Hamilton Southeastern will

also generate and publish reports to the Public on the school district’s standardized testing

performance.

The Central Office will continue to serve as a source of mental health, behavior and police activity

data, but they will also have much greater access to data and reports, including a Central Office

dashboard, which will be an aggregated version of dashboards used in the Schools. Other standard

reports will be created to support job functions within Central Office, and they will have access to a

data analyst to assist in ad hoc reporting needs to assess positive effects of programs, such as High

Ability and Student Assistance.

The School Board will be provided data by the Data Service Hub team for ad hoc report requests,

but they will also have access to a School Board dashboard, which will be an aggregated version of

dashboards used in the Schools and Central Office, compliant with FERPA requirements. This will

provide increased transparency between the School Board and Central Office while providing the

School Board with greater access to data.

Page 20: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

20 DELIVERABLE Student Achievement Analytics Solution

Student Achievement Analytics Solution

KSMC will develop a Student Achievement Analytics Solution to serve as the overarching answer for

the data challenges at Hamilton Southeastern Schools.

Development of the Student Achievement Analytics Solution will consist of the following elements:

Data Blending and Transformation

Using Skyward data as the base, KSMC will utilize additional public sources of data (such as census

data, standardized testing data, etc.) to provide HSE faculty and staff a more holistic view of student

achievement - both in aggregate and at the individual student level, with access levels enforced per

FERPA guidelines.

The data sources (both internal and external) that will be incorporated into Data Service Hub are:

• Skyward

Finally, the Data Service Hub will serve as the link between people, process, and tools. The Data

Service Hub Team will consist of the Chief Analytics Officer, a Business Intelligence developer, Data

Analyst, and the School-Centric Data Managers from each school. These individuals will serve as

Data Service Hub advocates and power-users within their respective parts of the school district,

helping their departments to use standard dashboards and reports, while also gathering

requirements for new dashboards and reports that could increase operational efficiency and student

outcomes. The Data Service Hub will also be the user interface for dashboard and reports, with

access levels enforced per FERPA guidelines.

The first set of Dashboards created for the Data Service Hub will be operational in nature –

designed to save the teachers, principals, staff, and administrators time by aggregating their

most used information into a single dashboard. Not only will these dashboards save time by

putting all relevant information in a single window, they will help to drive adoption of the Data

Service Hub across the organization and create demand for additional reports.

After the operational dashboards are in place, KSMC will develop two additional dashboards

more focused on research – the High Ability Student Dashboard and the Cohort Analysis

Report. The High Ability Student dashboard will include National Clearing House data to

connect student experience and student performance while in HSE schools to outcomes

after high school and college. This will inform curriculum decisions and investments

throughout the student lifecycle at HSE schools.

The Cohort Analysis report will help teachers and principals to be able to better gauge

student performance by benchmarking student scores against other students in the same

cohort – based on grade-level, economically-disadvantaged, and race. The Cohort Analysis

Report will also allow the teacher to select what years provide relevant data.

Page 21: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

21 DELIVERABLE Student Achievement Analytics Solution

• Central Office spreadsheets

o Mental Health

o Behavior

o Police Activity

• National Clearing House

• Census

• IPEDS

• Standardized Testing

o NWEA

o ISTEP

o PSAT/SAT

Report and Dashboard Development

Based on the Use-Case Definitions and Value-Feasibility Matrix, KSMC will design and develop the

following standard reports and dashboards for various audiences, dependent on job function and

FERPA guidelines:

Report/Dashboard Description

Student Profile Dashboard *As defined by Sample Dashboard, above

Teacher Dashboard

Classroom-level metrics: attendance, discipline, NWEA

scores, ISTEP scores, grade distribution, reading levels

(metrics will vary by grade-level)

Principal Dashboard *Same content as Teacher Dashboard, aggregated to the

School-level, with different security requirements, per FERPA

Central Office Dashboard *Same content as Principal Dashboard, aggregated to the

District-level, with different security requirements, per FERPA

School Board Dashboard *Same content as Central Office Dashboard, aggregated to the

District-level, with different security requirements, per FERPA

High Ability Student Dashboard Will include Skyward data blended with National Clearing

House data; Available parameters: Graduation year, race

Cohort Analysis Report Available parameters: grade-level, year (multi-select),

economically-disadvantaged, race, score type

Dollar Per Student Report Per building to show cost allocation

Data Service Hub Development

In order to enable a data-driven culture, KSMC will design and develop a Data Service Hub to link

people, process, and tools. The Data Service Hub will utilize PowerBI as a user interface for accessing

dashboards and reports, with access levels enforced per FERPA guidelines. In addition, KSMC will

develop the above list of standard dashboards and reports prior to introduction of the Data Service Hub.

Page 22: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

22 DELIVERABLE Student Achievement Analytics Solution

Data Process Transformation and Implementation

Currently, HSE has inconsistent processes for creating, requesting, and sharing data. KSMC will

assess and transform data-centric processes, such as how data is requested, how access is granted

(including FERPA regulations), how data is shared with the School Board and public, and how data is

added or augmented by Central Office, TDS and teachers.

Talent Development

KSMC will assist Hamilton Southeastern in hiring, training and building leaders within the

organization to support teachers and staff in the use of data to drive decision-making and improve

performance. These individuals will be responsible for advocating for a sustainable approach to future

data analytics efforts and solution maintenance.

Develop Chief Analytics Officer role

An internal resource to promote, advocate, and lead analytics implementation is crucial in any

organization. Due to the gap within this skill-set currently at HSE, KSMC will assist in defining a Chief

Analytics Officer role, while identifying and supporting the Chief Analytics Officer in transition into this

new role.

Assist HSE in hiring a BI Developer to own and maintain Student Achievement Analytics

Solution

KSMC will assist in defining and developing a BI Developer role, identifying and interviewing individuals

to fill the role, and conclude with hiring an internal BI Developer. KSMC will thoroughly train the new BI

developer on all technical, data, and analysis components of the Student Achievement Analytics

Solution and ultimately transition management of all components to the BI Developer.

Develop Data Analyst role

KSMC will assist in defining a Data Analyst role and identifying a Data Analyst early in the

implementation process. It is the goal of the KSMC team that the Data Analyst attend any business

analysis meetings and training sessions with the KSMC team. The Data Analyst will be thoroughly

trained on the Data Service Hub and all data inputs to provide ongoing analysis, assistance, and

power-user training to HSE faculty and stuff.

Strategy & Planning

Building and deploying a data solution is only helpful if the organization is aligned and ready to support

and maintain the solution in the long-run. KSMC will work to prepare HSE to support and maintain the

Data Service Hub's strategic value to the organization now and in the future.

Data Strategy Committee Formation & Planning

KSMC will assist HSE in forming and guiding a Data Strategy Committee. It will be the goal of this

committee to ensure that the Data Service Hub continues to meet the needs of HSE staff, teachers,

Central Office and School Board. Long-term, this committee will meet monthly ensure that data

governance guidelines are followed and that the Data Service Hub serves as an accurate, useful and

Page 23: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

23 DELIVERABLE Student Achievement Analytics Solution

independent source of data for all users. KSMC will kick-off this committee with a Design Thinking

Facilitated Session.

Design Thinking Facilitated Session

KSMC will host a Design Thinking Facilitated session for Data Strategy Committee members to

determine how best to roll-out the Data Service Hub for maximum adoption among teachers and

principals. Currently, these groups of users struggle to use data to make operational and strategic

decisions because acquiring and combining the appropriate data is so cumbersome and time

consuming.

User adoption is a key part of the success of the overall Student Achievement Analytics Solution, and

we need to ensure that reports and dashboards become a part of daily life for teachers and principals.

The goal of this Design Thinking Session is to build a plan for creating and maintaining a data-driven

culture at Hamilton Southeastern School District over the next 3 years.

The Facilitated Session will utilize Design Thinking principles and methodologies to help address

creation and maintenance of a data-driven culture. Participants will work through a facilitated and

iterative session of user need identification, problem definition, brainstorming, solution development,

and prototyping. The Expert facilitator will guide the process, using custom-selected techniques and

activities to make the solution development as effective as possible. Following the process, KSMC will

provide documentation of the process and results.

Figure C: Design Thinking Methodology

Mark Caswell, KSM Consulting Director of Professional Services leads this series of workshops,

developed from Stanford University d.school Design Thinking courses. Layering activity-based learning

Page 24: Hamilton Southeastern Schools Student Achievement ...€¦ · DELIVERABLE Student Achievement Analytics Solution 5 For additional context, the KSMC team held a discovery session with

24 DELIVERABLE Student Achievement Analytics Solution

with simple, executable concepts, Mark draws from the coursework and experience to guide each

workshop, ultimately building creativity and encouraging action. Participants learn not only through

presentation of concepts, but also through hands-on activity and iteration, culminating in guided group

discussion about concepts and application in the participants' workplace.

Training and Transition

KSMC will work to train, inform, and coach leaders at all levels of Hamilton Southeastern School District

on the use of the Data Service Hub to drive decision-making, improve performance, and gain

efficiencies. By January 1, 2019, KSMC will have completely transitioned ownership of the Student

Achievement Analytics Solution to the newly formed Analytics team, consisting of a Chief Analytics

Officer, a BI Developer, and a Data Analyst.

Train School-Centric Data Managers

Hamilton Southeastern schools will identify an individual in each school to serve as a School-Centric

Data Manager. The School-Centric Data Manager will be leveraged as Data Service Hub power-users

and resources for the faculty and staff at their respective school(s). They will encourage the use of Data

Service Hub to make informed instructional decisions in each classroom. KSMC will deliver and record

Data Service Hub training for these resources and provide the recording as a deliverable.

Train faculty and staff how to use reports, dashboards and Data Service Hub

In addition to training the School-Centric Data Manager for each school, KSMC will deliver and record

basic training for all faculty and staff to ensure that they know how to use reports and dashboards with

in the Data Service Hub. This recording will be provided as a deliverable.

Transition ownership of Student Achievement Analytics Solution

KSMC will work with the Analytics team to ensure a smooth transition of ownership to Hamilton

Southeastern schools. KSMC and HSE will share responsibilities throughout the engagement with

KSMC taking decreasing responsibility the new Analytics team members are ramped-up on solution

components and ready to take on maintenance and development. By January 1, 2019, KSMC will

transition the Student Achievement Analytics Solution completely to HSE staff.