76
USING DATA TO MAKE DECISIONS: Results from the Minnesota Statewide DDDM Readiness Study Dr. Scott McLeod Dr. Karen Seashore University of Minnesota

McLeod 2007 MN-SDC PowerPoint

Embed Size (px)

DESCRIPTION

2007 Minnesota Staff Development Council Annual Forum. May 16, 2007. Dr. Scott McLeod, CASTLE, www.scottmcleod.net.

Citation preview

Page 1: McLeod 2007 MN-SDC PowerPoint

USING DATA TO MAKE DECISIONS:Results from the Minnesota Statewide

DDDM Readiness Study

Dr. Scott McLeodDr. Karen Seashore

University of Minnesota

Page 2: McLeod 2007 MN-SDC PowerPoint

Get this presentation

See the RESOURCES

section of your handout!

Page 3: McLeod 2007 MN-SDC PowerPoint

Frequent formativeassessments

Professional learningcommunities rooted

in student information

Making instructionalchanges

•Data safety Data transparency

•TechnologyAlignment for results

Go

od

b

ase

line

da

taM

easurableinstructional goals

9 essential elements of data-driven PLCs

Page 4: McLeod 2007 MN-SDC PowerPoint

Respondents

Page 5: McLeod 2007 MN-SDC PowerPoint

Respondents

• Teachers (n = 3,135 / 11,120?) (28%?)

• Principals (n = 791 / 1,770) (45%)

• Superintendents (n = 202 / 351) (58%)

• District technology coordinators (n = 139 / 351) (40%)

4,267 Minnesota educators

Awesome!

Page 6: McLeod 2007 MN-SDC PowerPoint

Respondents by gender, race / ethnicity

96% White

Page 7: McLeod 2007 MN-SDC PowerPoint

Respondents by urbanicity

Page 8: McLeod 2007 MN-SDC PowerPoint

Respondents by level

Page 9: McLeod 2007 MN-SDC PowerPoint

Respondents by AYP status

Page 10: McLeod 2007 MN-SDC PowerPoint

Assessment Intensity

Page 11: McLeod 2007 MN-SDC PowerPoint

Frequent formativeassessments

Professional learningcommunities rooted

in student information

Making instructionalchanges

•Data safety Data transparency

•TechnologyAlignment for results

Go

od

b

ase

line

da

taM

easurableinstructional goals

9 essential elements of data-driven PLCs

Page 12: McLeod 2007 MN-SDC PowerPoint

I receive state assessment results each year [teachers]

Page 13: McLeod 2007 MN-SDC PowerPoint

I receive state assessment results each year [teachers]

Page 14: McLeod 2007 MN-SDC PowerPoint

I receive other yearly assessment results each year [teachers]

Page 15: McLeod 2007 MN-SDC PowerPoint

I receive other yearly assessment results each year [teachers]

Page 16: McLeod 2007 MN-SDC PowerPoint

Teachers collaborate to create and use common periodic assessments for

student progress monitoring [teachers]

Page 17: McLeod 2007 MN-SDC PowerPoint

Teachers collaborate to create and use common periodic assessments for

student progress monitoring [teachers]

Page 18: McLeod 2007 MN-SDC PowerPoint

Teachers use other (not teacher-created) periodic assessments for student progress monitoring [teachers]

Page 19: McLeod 2007 MN-SDC PowerPoint

Teachers use other (not teacher-created) periodic assessments for student progress monitoring [teachers]

Page 20: McLeod 2007 MN-SDC PowerPoint

Summary

• Lots of teachers are NOT intersecting with yearly data

• Some differences between secondary subject areas

• Clear, consistent downward gradient from elementary to secondary

Let’sRecap

Page 21: McLeod 2007 MN-SDC PowerPoint

Beliefs About Types of Assessments

Page 22: McLeod 2007 MN-SDC PowerPoint

Frequent formativeassessments

Professional learningcommunities rooted

in student information

Making instructionalchanges

•Data safety Data transparency

•TechnologyAlignment for results

Go

od

b

ase

line

da

taM

easurableinstructional goals

9 essential elements of data-driven PLCs

Page 23: McLeod 2007 MN-SDC PowerPoint

Assessments are aligned withstate curriculum standards

Page 24: McLeod 2007 MN-SDC PowerPoint

Assessment results are easy tounderstand and interpret

Page 25: McLeod 2007 MN-SDC PowerPoint

Assessment results are detailed enough to adequately inform teachers’ instruction

Page 26: McLeod 2007 MN-SDC PowerPoint

Assessment results are timely enough to adequately inform teachers’ instruction

Page 27: McLeod 2007 MN-SDC PowerPoint

Summary

• Weak agreement that assessments are aligned with standards

• Non-state assessments are– easier to understand– more detailed– much more timely

Let’s Recap

Page 28: McLeod 2007 MN-SDC PowerPoint

Other Components of the Core

Page 29: McLeod 2007 MN-SDC PowerPoint

Frequent formativeassessments

Professional learningcommunities rooted

in student information

Making instructionalchanges

•Data safety Data transparency

•TechnologyAlignment for results

Go

od

b

ase

line

da

taM

easurableinstructional goals

9 essential elements of data-driven PLCs

Page 30: McLeod 2007 MN-SDC PowerPoint

Measurable instructional goals

Page 31: McLeod 2007 MN-SDC PowerPoint

Measurable instructional goals

Page 32: McLeod 2007 MN-SDC PowerPoint

Measurable instructional goals

Page 33: McLeod 2007 MN-SDC PowerPoint

Teacher teams (PLCs) that meet regularly

Page 34: McLeod 2007 MN-SDC PowerPoint

Teacher teams (PLCs) that meet regularly

Page 35: McLeod 2007 MN-SDC PowerPoint

Teacher teams (PLCs) that meet regularly

Page 36: McLeod 2007 MN-SDC PowerPoint

Making instructional changes

Page 37: McLeod 2007 MN-SDC PowerPoint

Making instructional changes

Page 38: McLeod 2007 MN-SDC PowerPoint

Making instructional changes

Page 39: McLeod 2007 MN-SDC PowerPoint

Summary

• Administrators less positive about teacher behavior

• Teachers feel collaboration time is inadequate

• Clear, consistent downward gradient from – elementary to

secondary– AYP to No AYP

Let’s Recap

Page 40: McLeod 2007 MN-SDC PowerPoint

Supporting Conditions

Page 41: McLeod 2007 MN-SDC PowerPoint

Frequent formativeassessments

Professional learningcommunities rooted

in student information

Making instructionalchanges

•Data safety Data transparency

•TechnologyAlignment for results

Go

od

b

ase

line

da

taM

easurableinstructional goals

9 essential elements of data-driven PLCs

Page 42: McLeod 2007 MN-SDC PowerPoint

Data access and transparency

Page 43: McLeod 2007 MN-SDC PowerPoint

Data access and transparency

Page 44: McLeod 2007 MN-SDC PowerPoint

Data access and transparency

Page 45: McLeod 2007 MN-SDC PowerPoint

Data safety

Page 46: McLeod 2007 MN-SDC PowerPoint

Data safety

Page 47: McLeod 2007 MN-SDC PowerPoint

Data safety

Page 48: McLeod 2007 MN-SDC PowerPoint

Technology

Page 49: McLeod 2007 MN-SDC PowerPoint

Technology

Page 50: McLeod 2007 MN-SDC PowerPoint

Technology

Page 51: McLeod 2007 MN-SDC PowerPoint

Alignment for results

Page 52: McLeod 2007 MN-SDC PowerPoint

Alignment for results

Page 53: McLeod 2007 MN-SDC PowerPoint

Alignment for results

Page 54: McLeod 2007 MN-SDC PowerPoint

Summary

• Teachers less positive about supporting conditions

• Clear, consistent downward gradient from – elementary to secondary– AYP to No AYP

Page 55: McLeod 2007 MN-SDC PowerPoint

Other Factors

Page 56: McLeod 2007 MN-SDC PowerPoint

Leadership and support

Page 57: McLeod 2007 MN-SDC PowerPoint

Leadership and support

Page 58: McLeod 2007 MN-SDC PowerPoint

Leadership and support

Page 59: McLeod 2007 MN-SDC PowerPoint

Professional development

Page 60: McLeod 2007 MN-SDC PowerPoint

Professional development

Page 61: McLeod 2007 MN-SDC PowerPoint

Professional development

Page 62: McLeod 2007 MN-SDC PowerPoint

Beliefs

Page 63: McLeod 2007 MN-SDC PowerPoint

Beliefs

Page 64: McLeod 2007 MN-SDC PowerPoint

Beliefs

Page 65: McLeod 2007 MN-SDC PowerPoint

Summary

• Teachers less positive about– administrator support– staff development

• Teachers more likely to believe achievement is out of their control

• Clear, consistent downward gradient from– elementary to secondary– AYP to No AYP

Let’srecap

Page 66: McLeod 2007 MN-SDC PowerPoint

A Few Last Things

Page 67: McLeod 2007 MN-SDC PowerPoint

Teachers most likely to agree that…

1. They have the knowledge and skills to improve student learning

2. They can significantly affect students’ achievement levels by trying different teaching methods

3. If they constantly analyze what they do and adjust to get better, they will improve

4. District goals were focused on student learning

5. They feel some personal responsibility when school improvement goals are not met

Page 68: McLeod 2007 MN-SDC PowerPoint

Teachers most likely to disagree that…

1. They are given adequate time for collaborative planning

2. State assessments are timely enough to adequately inform instruction

3. They have significant input into data management and analysis practices

4. State assessments are detailed enough to adequately inform instruction

5. They have received adequate training to effectively interpret and act upon yearly state assessment results

Page 69: McLeod 2007 MN-SDC PowerPoint

Miscellaneous comments

Page 70: McLeod 2007 MN-SDC PowerPoint

Our success as educators should be determined primarily by our impact upon student learning

Page 71: McLeod 2007 MN-SDC PowerPoint

Our success or failure in teaching students is primarily due to factors beyond our control

rather than to our own efforts and ability

Page 72: McLeod 2007 MN-SDC PowerPoint

• State test data aren’t very useful

• Teachers feel less positively about school and district DDDM activity than do administrators

• Significant percentages of teachers are not intersecting with DDDM

• Clear, consistent differences between– elementary and

secondary– AYP and NO AYP

Overall summary of descriptive statistics

Let’srecap

Page 73: McLeod 2007 MN-SDC PowerPoint

Frequent formativeassessments

Professional learningcommunities rooted

in student information

Making instructionalchanges

•Data safety Data transparency

•TechnologyAlignment for results

Go

od

b

ase

line

da

taM

easurableinstructional goals

9 essential elements of data-driven PLCs

Page 74: McLeod 2007 MN-SDC PowerPoint

Next steps = more sophisticated statistics

• Factor analysis

Example

P34 (goals) +P41 (transparency) + P43 (technology) + P47 (prof devt) + P51 + P53 + P54 + P55 (alignment) = ADMIN BEHAVIOR

Page 75: McLeod 2007 MN-SDC PowerPoint

Next steps = more sophisticated statistics

• Regression, SEM, maybe HLM– dependent variables

• DDDM study results (including factors)• MDE attendance / mobility• MDE enrollment• MDE languages• MDE licensed staff• NCES Common Core of Data

– independent variables• DDDM study results (including factors)• MDE achievement (AYP status, MCAs)• MDE dropouts / graduation

Page 76: McLeod 2007 MN-SDC PowerPoint

Wrap-up

• Questions?

• Reactions?

• Implications for action?