Data-Driven Transformation

•What is Assessment?

•What is the Purpose of Assessment?

•Why Should We Care?

Definition

• Grading - Evaluate individual student learning and performance

• Assessment – Collect and use data to improve student learning

• Accreditation is a secondary objective

What is the Purpose?

• Collect data to help inform enhancement and remove any bottlenecks

• Reflection promotes critical thinking by promoting deep learning

• Increase knowledge and skills acquisition and retention

• Improves comprehension and motivation

How does it work?

• Asks Questions…

• What do we want our students to be able to do when they graduate?

• How well do we want them to be able to do it?

• How do we know if we are doing what we think we are?

• Are we performing at the best possible level?

Carnegie Mellon Eberly Center for Teaching Excellence & Educational Innovation

• Learning Objectives

• Assessments

• Instructional Strategies

Why We Should Care - ABA Standards

• No longer optional, but make no mistake, we still have to sell it

• Standard 314 – Assessing Student Learning

• Standard 315 – Program Level Assessment

Challenges to Assessment

• Large change, added burdens can become overwhelming• Ostrich Effect

• Fear of criticism• Porcupine Response

Additional Challenges

• Lack of relevance – How does it help? Why would we need it?

• Academic vs. practical skills

• Students are a product of a different educational process

• Different, competing motivations for study

Program Level Assessment

Program Objectives

Direct Measures

Indirect Measures Findings Actions

Review Process Impetus for Review

Buy-in for change

Identifying Desired

State

Comparison between

desired and current state

Findings

Decisions and Actions

Plan and Structure to

Assess RevisionTools include:

Mastery Grid and Outcomes Matrix – Carnegie Mellon

Individual Assessments

• Diagnostic – Current conceptions prior to learning process

• Formative – Monitor student understanding during the process

• Summative – Evaluate learning at the end of a process

Formative vs. Summative Assessment

• Formative: Regular assessment that monitors student learning progress during the learning process and is typically low-value

• Summative: Evaluates student learning product at the end of learning process and is typically high-value

Summative Assessment Model

• Instructor Pace

• Student Learning Pace

Final Exam

Formative and Summative

Continuous feedback throughout learning process

Instructor Pace

Student Pace

Summative Assessments

• Final Exams

• Midterms

• Final Projects

• Final Paper

• High value and no opportunity for improvement

Examples of Formative Assessments

• Begin to think less linear and more conceptually

• “You teach yourselves the law, but I train your minds. You come in here with a skull full of mush; you leave thinking like a lawyer.” - Charles Kingsfield Jr.

• Alignment - Carefully consider what is your objective and then determine what assessments will best measure progress

Formative Assessments

• Feedback is the central function of formative assessment.

• Allows students to restructure and improve their learning by identifying strengths and weaknesses and areas for improvement

• Help faculty recognize where students are struggling and address problems quickly

• Low value and offer feedback while there is still an opportunity for enhancement

• Assess process, not just product

Examples of Assessments

• Concept Maps or Quizzes

• Clicker polling

• Peer-to-Peer Assessment

• Group Work

• Students begin to look for feedback opportunities

Additional Examples

• CAT’s – Muddiest point, 1 minute essays, main point, directed paraphrasing, hypos, application cards, summaries, etc.

• Online quizzing

• Examsoft Rubrics – Each assessment measure is tied to a learning outcome objective

• Individual Assessment Rubrics – Share rubrics with students in advance of assessment

Establishing Faculty Buy-in

• Faculty Advisory Council

• Keep it relevant

• Keep it simple

• Make faculty stakeholders – They determine how they will use gathered data

Continued…

• 5 J’s Approach

• High degree of support

• Not coerced compliance

• Ownership in the process

• Feedback offers opportunities

for enhancement

Recap: Benefits of Assessment

• Reveals blind spots and surprises

• Removes needless barriers to excellence

• Provide Opportunities for Enhancement

• Increase student motivation, comprehension, and engagement

Twitter Thread

•#CALIassessment15

• 1. Post what your school is doing to address Standard 314

• 2. What are obstacles you have encountered?

• 3. What are solutions you have developed?