1. Welcome Tk20 Sponsored Session –Anthony Cyplik ACyplik@tk20.comACyplik@tk20.com University of...

1

Welcome

• Tk20 Sponsored Session www.Tk20.com – Anthony Cyplik ACyplik@tk20.com

• University of St. Thomas– Lucy L. Payne

LLPayne@stthomas.edu – Sarah Smith SCSmith

@stthomas.edu – Kristine Baker

Overview of Presentation

• Institutional Background• Tk20 Selection and Implementation• Integration of Tk20 into Campus Systems• Three Types of Departments– Full embrace assessment– Transitional– “Tell me what to do”

• What We’ve Learned• Next Steps, Q & A

Institutional Background

University of St. ThomasEstablished in 1885Diocesan AffiliationCampuses / Sites

Saint PaulMinneapolisRome, ItalyOwatonna, Minnesota21 active off campus sites (graduate programs)

Academic Structure

Seven Colleges & Schools• College of Arts & Sciences• Opus College of Business• College of Education, Leadership, and

Counseling• School of Engineering• School of Law• School of Social Work• School of Divinity

Academic Support UnitsGrants & Research RegistrarInternational EducationInstitutional EffectivenessAcademic Counseling

Additional Academic Information108 Undergraduate Majors51 Undergraduate Minors51 Master’s Programs4 Doctoral Programs4 1st Professional Programs2 Specialist Programs

437 Full Time Faculty 466 Part Time Faculty Regional Accreditation (HLC) site visit - November 2013

Students (Fall 2012)Undergraduate6,33647% female14% students of color96% full time80% from Minnesota93% live on campusAverage age = 21

Graduate3,98052% female15% students of color31% full time84% from MinnesotaAverage age = 32

Tk20 Selection and Implementation

Selection of Campus Wide

• Tk20 Webinar – “Evaluating Online Assessment Systems: Successful Strategies for the Selection Process”

• http://www.tk20.com/events/noncaptch_evaluating_assessment.html

Regional Accreditation

Where is the data?Rotating department chairsPersonal computers

How do we close the loop?

AccountabilityHow do we report up the system?

DeansEVP/CAO

Assessment Culture

• Reinvigorate the Assessment Conversation

• Connect the Pieces– Program assessment– Program review–Mission assessment

• Recognize Faculty Expertise

Tk20 Implementation

• UST Structures (decentralized)– Evaluation of assessment plan is dean

responsibility

• No Standard …– Assessment plan format– Storage / organization – Reporting

• Support Group or Negative Energy?• Lack of Technical Skills

Implementation – Year 1

• Known Administrator and Staff • Arts and Sciences–Collaboration with dean’s office–Existing assessment plans–Problem solving and honesty–Assessment as add on

• Professional Programs (NCATE, APA)

Implementation Changes – Year 2

• New Staff Position• Shift in Approach– Type of department• Fully embrace

assessment (complex)• Transitional• “Tell me what to do”

(simplistic)

– Share – What do you need?

Types of Departments

Fully Embrace Assessment

Assessment Plan

Previous Reports

Previous Assessment Reporting included collecting scores on nine rubrics, for both their undergraduates and graduate students, from a variety of faculty and then the chair had to generating five year running totals. This is one example of the 18 spreadsheets that needed to be created and calculated.

New Reports (Less Manual calculations)

In Tk20, assessment reporting consists of faculty filling out the rubrics online, the numbers are automatically generated for each semester and eventually, once we have five years of data we will be able to automatically pull five-year running averages.

Back Data

Year-End Assessment Reporting

Outcomes

• Department data review leads to course improvements

• Assessment is made easier with the software

• Better (easier) reporting• Faculty recognition for expertise in

assessment• Transparency – access for all faculty

members in department• Longitudinal data sets – trend analysis

Tell me what to do

• What’s required?• Limited assessment

knowledge and interest

• Fear of “doing it” wrong

• No interest in changing assessment plan, tools or process

Tell me what to do

• Complete grid to have program built out– SLO–Measure and Target– Assessment type used– Target course– Person responsible– Frequency

• Collect data• Complete reports

Reporting - First Steps

Next Steps …

• Look at data sets• Use data to

encourage dean level conversation on the assessment plan

• Meet with individual faculty who show interest in data

Transition Programs

• Shows interest in learning / doing more• Great variety– Update plan– Explore what software can offer– Tweak reports

• Faculty becoming more interested in assessment and moving from “add on” to integrated assessment perspective

Transitional

• Senior assessment ties back to courses – course improvements

Transitional

• Tk20 automatically grades the assessment – saving instructors time

Transitional

• Tk20 report displays results at course level

Allows departments to identify strengths and weaknesses.

Transitional

• Tweaking of reports to get needed data

• More departmental conversations

Beginning Transitional

• Expanding assessment – asking what else can the system do for us?– Can we administer a test in Tk20 and have

it auto calculate?• Yes, the system allows for administering tests,

reporting on testing results and grading.

– Can we assess student presentations in Tk20? Can we have multiple assessors per student?• Yes, faculty can assess student presentations

using Observations and multiple people can assess the same student.

Assessment Report

Early Transitional

• Assessment as “add on”• Assessment plan and data collected

alignment issue• Assessment plan not followed• Grab resources (people) when

available• Asking questions• More conversations

Outcomes

• More conversations at the department level

• New interest in assessment

• Realizing assessment was “add on”

• Looking at student, course and program

• Asking for help, feedback, suggestions

Tk20’s connection to other assessment systems

Annual Reporting

• Not another spreadsheet!!• Online shared reporting– Interdisciplinary programs– Joint degrees

• Allied requirements and assessment data• Dashboard– Transparency

• Sharing reports

Program Review

• Required component– Student outcomes reports–Mission assessment reports (in

development)

• Transparency• Support units – more focused on

assessment

What did we learn and advice

What did we learn…

• Slow thoughtful implementation• Learning by doing• Transition reporting – Hold all accountable at the same level

• I want more! I want to do it all!• Program review connections• Course assessment, student

assessment

Great Side effects

• Relationship building– Partnership with dean’s office– Academic Affairs and Assessment Faculty– University Assessment Committee

• Renewal of assessment culture on campus– Summer Faculty Development Workshop

• Critical review of assessment plans by departments

Advice

• Communication is key– Internal and external

• Role and responsibilities clearly defined– Implementation– Evaluation

• Flexibility– Blessed are the flexible, for they shall not

be bent out of shape ~ Michael McGriffy MD

Next Steps

Now what?

• Complete implementation– Departments– Professional Programs– Administrative Units

• Mission assessment • Assessment reporting for regional

accreditation• Continuous improvement• General education• Tie to strategic planning

Strategic PlanningRoll objectives up to Strategic Level

Q & A

Thank you!

Special thanks to our product specialists

Abby – Campus WideSteven – Higher Ed

Presented by

• Lucy Payne– LLPayne@stthomas.edu

• Tk20– www.Tk20.com