Bayh College of EducationSeptember 23, 2011

The Educator as Mediator of Learning

Assessment Day 2011

Bayh College of EducationConceptual Framework

Becoming a Complete Professional

Assessment Day 2011

Place CF image here

Becoming aComplete

Professional

Educator as an Expert or Mediator

of Learning

Educator as a

Member of

CommunitiesEducator as a

Person

Past AssessmentsProgram Assessments

Discussion

Implement

Intuitive decision makingProgram meetingsDepartment meetings

Program-levelWhatever is required by an accrediting body

Where we have beenAssessment Day 2011

Unit Assessment System (UAS)

Program Assessments

Unit Assessment

Discussion

Implement

• Program meetings• Department meetings• UAS/TEC meetings• Assessment Day

Program levelUnit level

New stuff

Key assessments across all programs:• Field Experiences• Dispositions• Technology• Work Sample• Diversity• Unit Operations*Transition PointsSPA

Aggregation of program data, and disaggregation of Unit data:• UAS Committee• Assessment Center• Assessment Handbook • Candidate Complaints

Where we are goingAssessment Day 2011

See UAS Program Assessment Matrix

Where we are

2009-2011 Data

Assessment Day 2011

Student TeachingWork SamplesField Evaluations

CIMT Unit Report 2009-2010 and 2010-2011

• Exceeds expectations ranges from 53.1% - 77.4%, means from 2.52-2.79 in 2009-2010.• Exceeds expectations ranges from 59.9% - 78.1%, means from 2.50-2.81 in 2010-2011.• Evidences overall strength – highest area being Activities in the Unit, lowest being

Evaluation of Effectiveness of the Unit.• No basis is 16.9% - 23.4% for Fostering Relationships with Colleagues and Community.

Assessment Day 2011

What’s working?What needs to be changed?

What would that change look like?

An ongoing theme….

“You are the average of the five people you spend the most time with.”

- E. James Rohn

Look around…..

CIMT Field Evaluation of Teaching • Composite Area Means range from 2.46 – 2.59 in 2009-2010.• Composite Area Means range from 2.40 – 2.75 in 2010-2011.• Evidences stable and strong scores.• Some standards are receiving sizable percentages of No Basis marks: Engages students in

testing hypotheses, Uses knowledge of student backgrounds, Uses instructional technology effectively (2009-2010 only), Maintains useful records, Encourages self assessment by students, Interacts productively with other professionals, Participates in school activities beyond the classroom.

• 65.3% No Basis 2009-2010.• 73.0% No Basis 2010-2011.

Assessment Day 2011

ELED Field Evaluation of Teaching

• Numeric ratings from 2009-2010 are missing from the system.• Vast majority of ratings indicate Meets Expectations.• All standards appear equally strong, with composite means ranging from 2.05 to 2.21.

Assessment Day 2011

School Psychology Field Evaluation

• Majority of ratings at Exceeds Expectations.• Means range from 1.88 to 2.38.• Three items evidence one student at Does Not Meet, one item evidences two students

at Does Not Meet.

Educational Leadership M.Ed. Program Field Evaluation

• All ratings at Exceeds or Meets Expectations.• Means range from 2.00 to 2.17.

Educational Leadership Ed.S. Program Field Evaluation

• All ratings at Exceeds or Meets Expectations.• Means range from 2.60 to 2.80.

Assessment Day 2011

Special Education Program Field Evaluation

• All ratings at Exceeds or Meets Expectations.• Vast majority are at Exceeds Expectations.

Educational Technology Field Evaluation • All ratings at Exceeds or Meets Expectations.• Means range from 2.54 to 2.88 2009-2010.• Means range from 2.67 to 2.93 2010-2011.

Assessment Day 2011

What’s working?What needs to be changed?

What would that change look like?

Field Evaluations

Student Teaching Evaluations

• Small N in 2009-2010 urges caution in interpretation.• Majority of ratings indicate Exceeds Expectations.• Exceeds Expectations range from 44.8% to 86.2% in 2010-2011.• All areas appear equally strong, with composite means ranging from 2.60 to 2.75 (2010-

2011).• Three items show sizable No Basis percentages 2010-2011; Engages students in testing

hypotheses (10.5%), Interacts productively with parents and guardians (21.5%), and Participates in school activities beyond the classroom (14.7%).

Assessment Day 2011

What’s working?What needs to be changed?

What would that change look like?

Student Teaching

…those who were dancing were considered insane by those who could not hear the music.

ELED Teacher Work Sample

• Small N in 2009-2010 stymies overall interpretation.• 2010-2011 Exceeds expectations range from 36.5% - 95.2%, with means from 2.27 -2.94.• Evidences overall strength. • A few areas show near or above 10% of Does Not Meet Expectations; Active Engagement

(14.5%), Daily Formative Assessments (9.7%), Includes teacher-made assessment or rubric (14.3%), Modifications Based on Analysis (12.7%), Collaboration with Families (9.5%) and Revisions/Edits (9.5%).

Assessment Day 2011

Educational Leadership Ed.S. Program Work Sample

• Small N in 2010-2011.• All ratings indicate Exceeds or Meets Expectations.• Means range from 2.00 to 2.61 2009-2010.

Assessment Day 2011

Educational Leadership M.Ed. Program Work Sample

• All ratings indicate Exceeds or Meets Expectations.• Means range from 2.09 to 2.13 2009-2010.• Means range from 2.39 to 2.66 2010-2011.

School Counseling Program Work Sample

• All ratings indicate Exceeds or Meets Expectations.• Means range from 2.36 to 2.80 2009-2010.• Means range from 2.00 to 2.89 2010-2011.

Communication Disorders Program Work Sample

• Majority of ratings are at Meets Expectations.• Means range from 1.44 to 2.00 2009-2010.• Means range from 1.83 to 2.00 2010-2011.• Intervention Plan and Data Collection and Analysis have sizable percentages at Does Not

Meet Expectations 2009-2010.

School Psychology Program Work Sample

• Small N 2010-2011.• Majority of ratings are at Meets Expectations.• Indicates strong scores with three areas of relative difficulty

1. Clearly operationalized (42.9% and 66.7% Does not meet), 2. Barriers to success (71.4% and 66.7% Does not meet) and 3. Available strengths (42.9% and 66.7% Does not meet).

Assessment Day 2011

Elementary Education Program Work Sample

• Small N 2010-2011.• All ratings are at Exceeds or Meets Expectations.• Majority of ratings are Exceeds 2009-2010. Majority are Meets 2010-2011.

Curriculum and Instruction Program Work Sample

• All ratings at Exceeds or Meets Expectations, with the vast majority being Exceeds.

Educational Technology Program Work Sample

• All ratings at Exceeds or Meets Expectations.• Majority of ratings are at Exceeds Expectations.• Standards one and two evidence consistently higher ratings.

Assessment Day 2011

What’s working?What needs to be changed?

What would that change look like?

Work Samples

The role of the parent is to prepare the child for the path, not to prepare the path

for the child.

Breakout Sessions

Work Samples Room 111

Student Teaching Room 113

Internships Room 114

SPA Reports Room 215

Culture of Assessment Survey results

Assessment Day 2011

Assessment Day Debrief

Work Samples

Student Teaching

Internships

SPA Reports

Next Steps….

Thanks for coming!

Assessment Day 2011