10
K.I.S.S. KEEP IT SUPER SIMPLE Who Said Collecting Data Had to be So Hard? Prepared & Presented by: Cleopatra Allen, Director Outcomes Assessment and Quality Management

Keep it Super Simple: Who Said Collecting Data Had to be So Hard

Embed Size (px)

Citation preview

Page 1: Keep it Super Simple: Who Said Collecting Data Had to be So Hard

K.I.S.S.KEEP IT SUPER SIMPLE

Who Said Collecting Data Had to be So Hard?

Prepared & Presented by: Cleopatra Allen, Director Outcomes Assessment and Quality Management

Page 2: Keep it Super Simple: Who Said Collecting Data Had to be So Hard

In 45 minutes, you will learn:• How to efficiently plan for and

collect data• What sources of data exist• What instrument to use to

collect data

SESSION OVERVIEWWhat you should know and what we will not discuss:• The importance of data• The assessment process• What to assess

Page 3: Keep it Super Simple: Who Said Collecting Data Had to be So Hard

ASSESSMENT IS…

MORE Thinking & Discussing LESS of a Science

Page 4: Keep it Super Simple: Who Said Collecting Data Had to be So Hard

ASSESSMENT…

…IS FOR IMPROVEMENTOverwhelming! Manageable!

Page 5: Keep it Super Simple: Who Said Collecting Data Had to be So Hard

ASSESS EFFICIENTLY 1. Identify what needs to be assessed

• Efficiency/productivity Outcomes• Quality Outcomes• Learning Outcomes

2. Identify where outcomes are assessed• Classroom• Capstone Project• Across the Curriculum (Portfolio)• High Stakes Testing

3. Identify who is collecting and assessing the data?• Director • Direct Report • External Evaluator• Institutional Office

4. When and what year is the data collected and assessed?• Annually, biennially• First year, second year, last semester• Point-of-Service

Don’t allow only one person to collect dataDon’t use too many measuresDo use one measure to assess multiple outcomesDo collect data in your natural settingDo discuss where outcomes are assessed Do identify 1 or 2 measures & use them consistently

Don’t assess in isolation, department effortDon’t ask for data at the last minute Do discuss results as a department Do allow person collecting data to assess, preliminarily Do use external sources Do use institutional data when available

Page 6: Keep it Super Simple: Who Said Collecting Data Had to be So Hard

EXERCISE (3 MIN)

Review the Sample Assessment PlansWhat are your observations?

Page 7: Keep it Super Simple: Who Said Collecting Data Had to be So Hard

• Operational Data• Time• Cost• Volume of Work

• Standardized Surveys• Content Analysis• Point-of-Service Assessment• Locally Developed Surveys

DATA SOURCES

• Course Data• High Stakes Assessment

(Pass or Fail consequences)• Standardized Exams• Final Exams

Page 8: Keep it Super Simple: Who Said Collecting Data Had to be So Hard

MATCH

Directly related to the outcome

APPROPRIATE

Direct and Indirect measures

TARGET

Identifies the appropriate level of performance

USEFUL

Helps to identify what to improve

RELIABLE

Provides consistent data

EFFECTIVE AND EFFICIENT

MATURE ASSESSMENT MEASURES

Student Learning Outcome: Students should be able to recognize and articulate the foundational assumptions, central ideas, and dominant criticisms of the psychoanalytic, Gestalt, behaviorist, humanistic, and cognitive approaches to psychology.

Program Outcome: Employee compensation will be processed in a timely manner. Measure 1: 95% of the results are properly analyzed and provided to the client within two weeks of survey administration as obtained by measuring the time it takes to deliver the survey from the time of administration (direct measurement of timeliness) Measure 2: 95% of the clients are “satisfied” or “very satisfied” with the perceived timeliness obtained through a customer survey given at the point of service (indirect measurement of timeliness)

Measure 1: 95% of the students will score a 4 or a 5 on the research project as scored by the rubric. The rubric categories are: presentation, style, APA, timeliness, length, and grammar and mechanics.

Page 9: Keep it Super Simple: Who Said Collecting Data Had to be So Hard

ENGAGE WITH ME!

Group DiscussionCase Studies

Page 10: Keep it Super Simple: Who Said Collecting Data Had to be So Hard

QUESTIONS

Please complete your evaluations!

Check the website for case studies!