No Slide Title

DASHBOARDS for district-level problem solvingJulie Q. Morrison, External Evaluator Michigans Integrated Behavior and Learning Support Initiative

Presentation at the SPDG National Meeting Washington, DCOctober 9-10, 20141Presentation OverviewThe Context: MiBLSi and the Need for a Comprehensive, Interactive Database

The MiBLSi Database: Four Unique Features

The MiBLSi District Dashboard

The Process and Logistics of Developing a Dashboard

2The ContextMichigans Integrated Behavior and Learning Support Initiative (MiBLSi) is funded by the Michigan Department of Education, Office of Special Education and Michigans State Personnel Development Grant from the U.S. Department of Education, Office of Special Education Programs.3MiBLSis Mission StatementTo develop capacity to scale-up an integrated behavior and academic MTSS model that can be implemented with fidelity, endures over time and utilizes data-based decision making at all levels of implementation support

The MiBLSi DatabaseThe MiBLSi Database includes district dashboards that aggregate school-level information for use during problem-solving sessions.

6What are District Dashboards?District dashboards were built to align with a specific set of data analysis questions and action planning steps to help districts continuously improve implementation of MTSS to maximize positive student outcomes.

7What are District Dashboards?District dashboards were designed to streamline data collection and analysis so that teams can spend more time developing meaningful plans to identify celebrations and address areas of need.

Four Unique Features of MiDataFeature #1Dashboards and reports are designed for alignment with MiBLSis data review process at the school, district, and ISD levels.MiData provides a common format for school, district, and ISD teams to analyze their data as they participate in MiBLSi Data Review professional learning sessions. Having a standard format will make it easier for teams to learn the process without having to devote as much cognitive energy to cross-walking the look of their data with what is being presented.9Four Unique Features of MiDataFeature #2MiData offers a place to enter and analyze capacity and fidelity data not hosted in any other system. MiData provides a common format for school, district, and ISD teams to analyze their data as they participate in MiBLSi Data Review professional learning sessions. Having a standard format will make it easier for teams to learn the process without having to devote as much cognitive energy to cross-walking the look of their data with what is being presented.10Implementation Fidelity and Systems Capacity Data Incorporated in MiDataImplementation Fidelity Measures:Planning and Evaluation Tool for Effective School-wide Reading Programs (PET-R)School-wide Evaluation Tool for Secondary Literacy (SWEPT)School-Wide Evaluation Tool for Reading-Self-Assessment (SWETR-S)

System Capacity Measures:District Capacity Assessment (DCA)Intermediate Unit Capacity Assessment (IUCA)The ability to enter these data and all other data used within an integrated model of MTSS means that teams can use MiData as an excellent starting point for their problem solving, without having to go to multiple data systems to answer important data analysis questions.11Four Unique Features of MiDataFeature #3MiData creates a single point of entry (school-level) that aggregates data up to the district, ISD, and state levels. One of the largest challenges to an effective data review process at the ISD and District levels is the amount of time and energy required to regularly access the right data, organize, and summarize data. With MiData, coaches enter school-level implementation fidelity and student outcome data and that information is then immediately accessible to districts and ISDs through their dashboards. It is organized and summarized for effective problem-solving, making it much easier for a district or ISD team to spend their valuable time on the important work of planning.12Four Unique Features of MiDataFeature #4The MiData dashboards are based on principles for effective display of data and information processing, combined with repeated cycles of usability testing. MiData dashboards have been designed using principles of effective data visualization to make the graphics consistent, easy to interpret, and clutter-free. All aspects of MiData, from registration to data entry to dashboard and report functionality have been tested through multiple cycles of usability testing with MiBLSi staff and school, district, and ISD partners. Each cycle resulted in enhancements to the system, ensuring optimal functionality and ease of use. 13The MiBLSi District Dashboard TabsReachReading/EngagementBehavior OutcomeReading FidelityBehavior FidelityCapacityContextDomain 1. Reach

Domain 1. Reach

Domain 2. Reading/Engagement

Domain 3. Behavior Outcome

Domain 3. Behavior Outcome

Domain 3. Behavior Outcome

Domain 4. Reading Fidelity

Domain 4. Reading Fidelity

Domain 5. Behavior Fidelity

Domain 6. Capacity

24Domain 7. Context

The Process and Logistics of Developing a Dashboard Usability TestingThe Process1. Content Developers sketched out what indicators should be included and what they should look like. Participated in PD on Data Visualization at AEA with Veronica Smith and consulted with Stephanie Evergreen.2. Partnered with Ron, the technical design expert in developing dashboards3. Provided explicit instructions in using the data dashboards in the context of the fall, winter, and spring data reviews for trainers (anticipate questions) and district users (data entry). Considerations included: User Agreements signed, who has access.

The Logistics26Contact InformationJulie Morrison, Ph.D.University of CincinnatiCollege of Education, Criminal Justice, and Human ServicesSchool of Human Services, School Psychology ProgramE-mail: Julie.Morrison@uc.edu27