Introducing Edwin

An integrated suite of teaching and learning tools

Massachusetts Department of Elementary and Secondary Education

2

Our core strategies

Prepare all students for success after high school by:

Strengthening curriculum, instruction, and assessment

Improving educator effectiveness

Turning around the lowest performing districts and schools

Using data and technology to support student performance

• Student profiles• An early warning

indicator system• Dashboards &

reports

• Model curriculum units

• Curriculum mapping and Lesson planning tools

• Aligned to Standards

• Tools to assess student understanding of multiple standards

• Competency Tracking System

• Aligned to standards

• High-quality digital resources to support instruction

• Aligned to standards3

Massachusetts Department of Elementary and Secondary Education

4

Edwin Teaching & Learning

Online access Massachusetts Curriculum Frameworks Online access to curriculum tools including Model

Curriculum being developed by the State, to customize and share electronically

Easy to use paper, online and clicker test administration options for teachers to determine what progress students have made and what help they need

Data analysis and reporting capabilities A portfolio of every students’ work

Edwin Teaching & Learning will enable teachers to accelerate and personalize the education experience by providing:

Massachusetts Department of Elementary and Secondary Education

5

Edwin Teaching & LearningUpcoming joint webinar series with Thinkgate to demonstrate the functionality of Edwin Teaching & Learning. Webinars will be conducted live on the following schedule and sessions will be recorded for offline viewing.

Edwin Teaching & Learning Executive Overview  – Wednesday, January 23 Noon – 1PM

Demonstrate the benefits and functionality of the Edwin Teaching & Learning

Register to attend at: http://bit.ly/W425q9 OR www.thinkgate.net/OHMA

Assessment Creation and Administration – Wednesday, January 30 Noon – 1PM

Demonstrate creating and administering assessments and reporting http://bit.ly/Uo8Hkw

Curriculum, Instruction and Resources – Wednesday, Feb 6 Noon – 1PM

Demonstrate curriculum, instruction tools and integration with learning resources http://bit.ly/VYdquY

What is Edwin Analytics? Data Warehouse Merged into Edwin

• Login roles for Edwin Analytics remain the same as the EDW: DW – (210) District User DW – (211) School User DW – Evaluator

• URL for Edwin Analytics remains the same as EDW No need to update Trusted Sites

• Security Portal Edwin Analytics link added

• New Security Portal Link• Data Warehouse v3.0 link

will be gone. • Edwin Analytics (EDW) will

have Data Warehouse content.

What is Edwin Analytics?

• Data Warehouse Announcement will explain the move.

• New Content in Edwin Analytics• EWIS reports on the Student tab• College Readiness reports on the Student tab

Accessing Edwin

8

What is in Edwin Analytics?What is the SAME: EDW reports are still availableWhat is NEW and available by the end of January:

Identify current students in grades 1-12 who may be at risk of missing key educational targets (Early Warning Indicator System (EWIS) reports)Identify how your former students did after they graduated from your school/district (Postsecondary Readiness and Success)

9

Early Warning Indicator System

10

11

What are Early Warning Indicators? Methodological way of looking at students and

their likelihood of meeting specific academic goals

Traditionally implemented at the high school level to help predict which students are most likely to drop out

Tool for educators to better design and target student interventions in a timely way

MA EWIS Background Department previously provided Early Warning

Indicator Index (EWII) to predict the likelihood grade 9 students would graduate

Department worked with American Institutes for Research (AIR) to develop the new risk models

District feedback, e.g., focus groups and webinars

Rollout of EWIS in September via Security Portal12

13

Key Concepts Massachusetts EWIS is for grade levels 1-12

Based on four grade-level groupings that are connected to key academic goals along the academic trajectory that are designed to be relevant to and actionable for educators As a state, currently at different levels of achieving these

four academic goals

Three EWIS risk levels: low, moderate, high A student that is “low risk” is predicted to be likely to

meet the academic goal

14

Grade Groupings & Goals

Age Groups

Grade Levels

Academic Goals (expected student outcomes for each

age group)

Current Statewide

Results for Goal

Early Elementary

Grades 1-3

Proficient or advanced on 3rd grade ELA MCAS

61%

Late Elementary

Grades 4-6

Proficient or advanced on 6th grade ELA and Mathematics MCAS

54%

Middle Grades

Grades 7-9

Passing grades on all 9th grade courses 75%

High School

Grades 10-12

High school graduation (four-year) 83.4%

Key Concepts, continued Provides risk level information for all students based

on prior year data

The risk levels are not based on a student’s relative likelihood for reaching an academic goal when compared with other students

Individual indicators in the risk model are not reflective of the level of risk - taken together, the indicators (data points) collectively form a risk level

Only includes data from existing statewide collections (SIMS and SCS) and state assessments (MCAS and MEPA)

15

16

EWIS is / is not…The Massachusetts EWIS is… The Massachusetts EWIS is not…

A tool to better target interventions and supports at the individual, small group, and whole school levels.

A “life sentence” or a reason to label students.

A systematic way to flag students that need to be further examined to determine what additional support are necessary.

A diagnostic tool that provides details on the exact reason(s) why a student is at risk for not meeting an expected academic goal.

Related to measures that are included in the state’s school and district accountability system (PPI), but is not itself an accountability measure.

An accountability measure.

Based on data and risk models that the Department will reexamine each year to continually improve the system.

A stagnant system that will remain exactly the same in future years.

17

Statewide EWIS FindingsEarly Elementary:

P/A of Gr 3 ELA MCAS

Late Elementary:P/A of Gr 6 ELA &

math MCAS

Middle Grades:Passing all Gr 9

courses

High School:High school graduation

Grade 1

Grade 2

Grade 3

Grade 4

Grade 5

Grade 6

Grade 7

Grade 8

Grade 9

Grade 10

Grade 11

Grade 12

High 28.3% 29.0% 29.2% 34.5% 34.6% 37.2% 18.3% 16.0% 18.5% 9.9% 7.4% 4.1%

Mod. 23.4% 20.9% 18.7% 18.1% 19.6% 14.5% 22.3% 23.4% 18.4% 13.3% 5.9% 4.5%

Low 42.9% 47.4% 49.6% 45.1% 43.5% 45.7% 56.0% 57.6% 56.7% 72.4% 82.1% 84.8%

N/A 5.4% 2.7% 2.5% 2.3% 2.3% 2.6% 3.4% 2.9% 6.4% 4.4% 4.6% 6.7%

Edwin Analytics: EWIS Reports There are three EWIS reports in Edwin:

EWIS Student List (EW601) EWIS District View (EW301) EWIS Graphical View (EW302)

All can be filtered numerous way (e.g., selecting specific schools, grade levels, student subgroups)

18

EWIS Student List (EW601)

19

What are the current risk levels of my students?

What are the prior risk levels of my current students?

What data points (indicators) went into the calculation to determine the risk level?

20

EWIS District View (EW301)

21

Which grade levels or schools have the most students that need targeted support in order to be on track to meet the next academic goal?

What is the breakdown of high, moderate, and low risk levels in a particular student subgroup (e.g. among students with disabilities)?

Where does the district need to focus additional resources to get students back on track for meeting the next academic goal?

22

EWIS Graphical View (EW302)

23

How does a selected group of students compare to the district and state?

What are the previous risk levels of the currently enrolled students over the past 5 years? E.g., what are the previous risk levels of my current 4th

grade male ELL students?

What are the risk levels of a specific student group over the past 5 years? E.g., what are the risk levels of 4th grade male ELL

students each year over the last 5 years?

24

Postsecondary Enrollment and Outcomes

25

How did our students do after graduating?

Three new reports:Postsecondary Outcomes of Public HS Graduates:

All Institutions (CR301)

Postsecondary Outcomes of Public HS Graduates: MA Public Institutions Only (CR302)

Postsecondary Outcomes of Public HS Graduates:Academic Preparation (CR303) … but each is really several reports in one!

26

How many public high school graduates enroll postsecondary?

… at MA public institutions?

On top: data from CR301; on bottom: data from CR302

27

Where did students enroll? (Anywhere in the USA)

This data from CR301See CR302 for MA Public Institutions Only

28

What does persistence look like across subgroups?

How many return for a 2nd year?

Data from CR301; See CR302 for MA Public Institutions Only

29

How many of your graduatesobtain a degree?

How does that vary by subgroup? How does that vary by the type of institution

where students enroll? (4-year, 2-year, public, or private)

Data from CR301; See CR302 for MA Public Institutions Only

30

What are enrollment rates of students who complete AP or Mass Core coursework?

Data from CR301; See CR302 for MA Public Institutions Only

31

Which type of institutions do they attend?

Data from CR303

32

Of those in MA public postsecondary, what % enroll in remedial courses?

In which subjects?

Data from CR302

33

What are the MCAS scores of students who take remedial courses?

Data from CR302

34

How many credits do graduates earn in their first year of college?

What about developmental credits?

Data from CR302

35

… and this is just the beginning of what we can do!

We could also explore… What is the relationship between

MCAS scores and the type of institution where students enroll? (4-year, 2-year, public, or private)

What is the postsecondary experience of students from a specific subgroup (CVTE, ELL, students with disabilities, high needs, etc)?

36

How did our students do after graduating?

Three new reports:Postsecondary Outcomes of Public HS Graduates:

All Institutions (CR301)

Postsecondary Outcomes of Public HS Graduates: MA Public Institutions Only (CR302)

Postsecondary Outcomes of Public HS Graduates:Academic Preparation (CR303) … but each is really several reports in one!

37

Comparing the Three ReportsPotential Questions CR301 CR302 CR303How many graduates go on to postsecondary? X X XWhat type of institutions (4-year/2-year, private/public) do graduates attend?

X X X

Which specific institutions did students attended? How many went to each?

X X

What are the enrollment rates of students who complete MassCore or AP coursework compared to those who don’t?

X X X

What are the persistence and degree obtainment rates of students who complete MassCore or AP coursework?

X

What is the postsecondary experience of students from a specific subgroup? (CVTE, ELL, SWD, high needs, etc)

X X X

What percentages of students enroll in and complete remedial courses?

X X

In what remedial subjects to do students enroll? XWhat are the MCAS scores of students who take remedial coursework in math and reading?

X X

How many credits, on average, do public high school graduates earn in their first year of college?

X X

38

CR301: all institutions CR302: MA public onlyPostsecondary data from National Student Clearing House (NSC)

Postsecondary data from MA Department of Higher Education

Enrollment anywhere in the USAAcademic Preparation

Persistence to 2nd yearDegree ObtainmentEnrollment by Institution Name

Enrollment at MA Public Postsecondary OnlyAcademic Preparation1st Term Developmental Coursework1st Year Credit ObtainmentPersistence to 2nd yearDegree ObtainmentEnrollment by Institution Name

Comparing Reports

39

CR303: Postsecondary Outcomes by Academic Preparation

For each of the following high school metrics: MassCore Completion AP Course Completion MCAS 10th Grade ELA MCAS 10th Grade Math MCAS High School Science...we can look at the following outcomes: Postsecondary Enrollment, Persistence, and Degree Obtainment (all

postsecondary institutions) MA Public Postsecondary Enrollment, Persistence, and Degree

Obtainment MA Public 1st Yr. Avg Credit Obtainment MA Public 1st Term Developmental Enrollment MA Public 1st Yr Avg. Developmental Credit Obtainment

40

Refining your search

41

What else is coming?

Spring 2013: Postsecondary Readiness and Success for Adult Basic Education (ABE) graduatesClassroom-level reports for educatorsSchool readiness reports for K-3 educators

Fall 2013:Educator evaluation reportsDistrict financial analysis 42

43

For more information… Watch the Edwin website for updates, including

materials and professional development opportunities: www.doe.mass.edu/Edwin

Follow Edwin on Twitter! @ Edwin_DESE Questions can be submitted to:

Edwin@doe.mass.edu

If you need access to Edwin Analytics – contact your district directory administrator (List is available at http://www.doe.mass.edu/infoservices/data/diradmin/list.aspx )