Welcome to Student Learning Outcomes · Student Learning Outcomes The proper use of student...

Welcome to Student Learning Outcomes

The proper use of student learning outcomes is an

educational institutions best

gateway to continuous academic

improvement

Student Learning Outcomes

What should a GRU student in a particular academic program be able to demonstrate

they know and be able to do upon graduation?

The Big questions we need to ask about student learning: – Do they know it? – How do we know they know it?

The big question for faculty:

– How does this information help improve the quality of my program at GRU?

Student Learning Outcomes

The use of Student Learning Outcomes (SLOs): – Serves as the backbone of a continual

improvement process within academic planning. – Provides data to support:

• Curriculum modifications • Revision of program requirements • The coordination of teaching efforts, and • The production of more knowledgeable graduates

Student Learning Outcomes

In addition to driving continuous improvement the SACS Principles of Accreditation require that:

All institutions identify expected outcomes • assesses the extent to which it achieves these

outcomes, and • provides evidence of improvement based on analysis

of the results

This activity is required for all educational degree programs

Student Learning Outcomes

Additionally: SACS defines educational programs to include all classes offered: – on-campus, – off-campus, and – Through distance learning (See SACS/COC 3.4)

The focus of SACS Institutional Effectiveness requirements has changed from:

Instructor-focused Teaching To

Student-focused Learning

Student Learning Outcomes

GRU faculty have a critical role to play when it comes to SLO assessment: – Identification of desired learning outcomes for

academic programs. – Development of appropriate assessments to document

student learning. – Review of assessment data to identify areas of possible

improvement for student learning. – Implementation of appropriate changes to improve the

quality of student learning at GRU.

Student Learning Outcomes

So what are Student Learning Outcomes? (SLOs)

• Statements that specify what students will be able to do, or demonstrate, when they complete an academic program.

• Outcomes are expressed as knowledge, skills, attitudes or values that students will be able to demonstrate.

“Program Level” SLOs

Program level SLOs include: • Outcomes and overarching concepts that span

several courses. These should not be confused with individual course learning outcomes found inn each syllabus

• Are characterized by measurable behavior

Measurable Student Learning Outcomes

Focus on: • Student behavior and work products • The behaviors, activities, or products that will be

used to determine that understanding or learning has occurred

• What students will be able to do or produce as a result of learning that occurs?

Measurable Student Learning Outcomes

Use simple, specific action verbs to describe what the students are expected to demonstrate upon completion of your program. – Action verbs result in overt behavior that can

be observed and measured. – Avoid verbs that are unclear and call for

behavior that cannot be observed or measured.

Measurable Student Learning Outcomes

Action verbs that are commonly used:

– Analyze, apply, compare, create, estimate, demonstrate, illustrate (see Bloom’s Taxonomy)

Verbs to avoid: – Appreciate, understand, learn, know, become

familiar with Other Problems:

– Compound outcomes

Problematic Language in SLOs

Words that do not produce measureable SLOs: – Know – Understand – Appreciate These are laudable learning goals, but how would you

demonstrate that these have occurred?

Solution: Identify behaviors and activities or describe the quality of products that would provide evidence for these outcomes.

Student Learning Outcomes

–Measurable or observable, –Manageable, and –Meaningful

TEACHing Does Not Equal

LEARNing

Student Learning Outcomes

Outcomes focus on observable student behavior that can produce as a work product at the end of your program – How do you know the students have learned

what you want them to learn? • Describe the behaviors, activities, or

products that will be used to determine that understanding or learning has occurred

– What does it look like? – How will you identify it?

Refining SLOs to Describe Measurable Student Behavior

Original SLO: Explore in depth the literature on an aspect of

teaching strategies. Evaluation of this language:

Exploration is not a measurable activity but the quality of the product of exploration would be measurable.

How do we Improve this SLO: Students will be able to write a paper based on an

in-depth exploration of the literature.

Write SMART Student Learning Outcomes for Assessment

• S Specific: Designed to produce diagnostic assessment data

• M Measurable: Assessments track improvements in student learning

• A Action-oriented: Findings will suggest strategies to implement improvements

• R Relevant to Discipline • T Timely: Focus on questions the program is

ready to asses

Examples: Measurable and Not Measurable SLOs

Not Measurable

Measurable

Not Measurable

Measurable

Demonstrate an historical knowledge of the symphonic, string orchestra, and chamber ensemble repertoire Recognize

Describe the historical development of the symphonic, string orchestra, and chamber ensemble repertoire

Recognize a need for lifelong learning and plan for personal and professional growth

Describe and adopt a plan for ongoing professional development and lifelong learning.

Examples: Measurable and Not Measurable SLOs

Not Measurable

Measurable

Not Measurable

Measurable

Students will demonstrate a readiness for advanced level digital multi-media coursework

Students will be able to employs digital multi- media and techniques required for progression to advanced level coursework.

Students will show a working knowledge of the major theories of American government.

Students will be able to write a paper outlining the major theories of American government and their relations to one another.

Examples: Measurable and Not Measurable SLOs

Not Measurable

Measurable

Not Measurable

Measurable

Students will demonstrate an in-depth understanding of one specific software engineering process.

Students will be able to completes a detailed study of one specific software engineering process.

Students will demonstrate an understanding of key nutritional concepts.

Students will be able to identify, define, and explain key nutritional concepts.

Examples: Measurable and Not Measurable SLOs

Not Measurable

Measurable

Not Measurable

Measurable

Students will obtain a working knowledge of linear algebra to solve linear equations using matrix-vector formulation

Students will be a able to use matrix-vector formulations to solve a variety of linear equations

Programs will demonstrate knowledge of how to write a good student learning outcome

Programs will create student Learning outcomes that are measurable and relevant to the discipline

Student Learning Outcomes

Evaluate the learning outcomes with these question: • Can it be measured? • Is learning being demonstrated?

SLOs tend to fail when they are:

• Too general and hard to measure For example:

Students will value exercise as a stress reduction tool. vs.

Students will be able to explain how exercise affects stress.

Measuring Student Learning Outcomes

Appropriate measures of Learning Outcomes include: Direct Measures (all students)

– Course embedded assessment – Capstone projects/senior projects – Samples of student work – Project-embedded assessment – Observations of student behavior (internships) – Performance on a case study/problem – Pre-and post-tests

Measuring Student Learning Outcomes

Indirect Measures (sample)

– Alumni, employer, student surveys – Focus groups – Job placement statistics – Exit interviews with graduates

Measuring Student Learning Outcomes

Common problems with assessment reports reviewed by SACS:

Using grades, final exam scores, student

GPAs or graduation rates as the principle criteria for assessing learning. • These indicators generally do not

provide sufficient information to guide program improvement.

Learning Outcomes: Guidelines

1. Identify at least 3 student learning outcomes for every program, and 2 additional SLO for each track

2. Write outcomes that are Measurable, Manageable, Meaningful

3. Identify 1-2 appropriate assessment strategies for each learning outcome (at least one direct)

4. Develop a scoring guide/rubric, when needed 5. Identify the target Level of success (80% of students 6. Identify the course(s) and other locations where

assessment will occur 7. Assess learning and respond to your findings

Using Assessment for Improvement

So you have a valid SLO and its been assessed. Now what? The program faculty must meet and consider all

the information gained from assessments of this SLO and:

• Determine if the target performance level has been met

• Identify areas of weakness • Identify what changes must be made to improve

student learning • Identify a new goal based on satisfactory performance

Where this Step (closing the loop) Usually Fails

1. Programs tend to change the SLO assessment tool rather teaching activities

2. Programs make no change in teaching imputes, even when SLO assessment indicates that the program goal was not meet

3. Programs “Copy and Past” outcomes from one year to the next, without doing any actual assessment of learning

4. After two years of meeting a target goal, programs fail to increase the targeted level or change the goal

Thank you for all you do to improve

Student Learning at GRU