Upload
others
View
0
Download
0
Embed Size (px)
Citation preview
Trinity CollegeCourse EvaluationsOFFICE OF ASSESSMENT, TRINITY COLLEGE
DUKE UNIVERSITY
Topics for today’s meetingCourse evaluation administration
-Department responsibilities
-Faculty responsibilities
-Fall 2017 dates
Changes to course evaluation questionnaire -New student form
SACES updates-How to opt-in to SACES
-SACES reports
Accessing and navigating reports in Tableau-Logging in
-Available Reports
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 2
Course Evaluation Administration
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 3
Department Responsibilities
Review and approve list of eligible courses for Fall 2017
Encourage instructors to follow best practices
Notify instructors of important dates
Support instructors use of Tableau CE reports
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 4
Department Responsibilities
Review and approve list of eligible courses for Fall 2017
Encourage instructors to follow best practices
Notify instructors of important dates
Support instructors use of Tableau CE reports
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 5
• Email sent to departments on October 5th
• Email includes list and instructions for review
• List returned to OATC by October 20th
Are all courses that your department would like to have evaluated listed on your course list worksheet?
Should any courses be eliminated from the evaluation list? *As a rule: do not remove any crosslistedcourses*
Is the correct instructor listed for each course? Do any courses have blank fields or missing entries?
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 6
Review and Approve List of Eligible Courses:
Review and Approve List of Eligible Courses:
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 7
Best Practices for Trinity College Course EvaluationsCommunicate to students the value of course evaluations
Share access instructions with students (OATC website or available PDF)
Set aside a few minutes in class to let students get started
Check return rate monitor in Duke Hub
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 8
Best Practices for Trinity College Course EvaluationsCommunicate to students the value of course evaluations
Share access instructions with students (OATC website or available PDF)
Set aside a few minutes in class to let students get started
Check return rate monitor in Duke Hub
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 9
• Messaging from departments and instructors to students can
help boost return rates
• Share ways in which course evaluation results inform
decisions in the classroom and in your department
Important Dates – Fall 2017October 20th
◦ Return reviewed list of eligible courses to OATC
November 1st
◦ Notifications and instructional memos sent to departments
November 21st
◦ 12:01AM – Trinity College course evaluations open
◦ Notifications sent to students and instructors
December 11th
◦ 11:59PM – Trinity College course evaluations close
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 10
Important Dates – Fall 2017Week of December 18th
◦ Publish Course Evaluation Reports in Tableau
December 20th
◦ Trinity College course evaluations close for GEO courses
Early January◦ OATC holds office hours to support departments
use of Course Evaluations reports in Tableau
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 11
Important Dates – Fall 2017Week of December 18th
◦ Publish Course Evaluation Reports in Tableau
December 20th
◦ Trinity College course evaluations close for GEO courses
Early January◦ OATC holds office hours to support departments
use of Course Evaluations reports in Tableau
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 12
• Can’t publish reports until critical mass of grades have been
reported
• Encourage your faculty to get grades published ASAP
Updates to Trinity College Course Evaluation Questionnaire
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 13
What’s new?
Single form-Student form only
-No faculty form
Shorter form-No Mode of Inquiry questions
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 14
What’s the same?
Department review of eligible course list
Students complete questionnaire through Duke Hub
Trinity Learning outcomes
Reports published in Tableau
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 15
Trinity College Course Evaluation Questionnaire
Overall rating 1 2 3 4 5
The course has clearly defined
student learning objectives
Strongly disagree Disagree Neither agree or disagree
Agree Strongly agree
The course had clear expectations for assignments and
other work
Strongly disagree Disagree Neither agree or disagree
Agree Strongly Agree
Overall the course was:
Poor Marginal Average Very Good Excellent
Overall the instructor (Instructor 1) was:
Poor Marginal Average Very Good Excellent
Overall the instructor (Instructor 2) was:
Poor Marginal Average Very Good Excellent
Overall the instructor (Instructor 3) was:
Poor Marginal Average Very Good Excellent
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 16
Trinity College Course Evaluation Questionnaire
Trinity College learning
objectives
1 2 3 4 5
This course helped me gain factual knowledge
Strongly disagree Disagree Neither agree or disagree Agree Strongly agree
This course helped me understand fundamental concepts and principles
Strongly disagree Disagree Neither agree or disagree Agree Strongly agree
This course helped me learn to apply knowledge, concepts,
principles, or theories to a specific situation or problem
Strongly disagree Disagree Neither agree or disagree Agree Strongly agree
This course helped me learn to analyze ideas, arguments, and
points of view
Strongly disagree Disagree Neither agree or disagree Agree Strongly agree
This course helped me learn to synthesize and integrate
knowledge
Strongly disagree Disagree Neither agree or disagree Agree Strongly agree
This course helped me learn to conduct inquiry through methods
in the field
Strongly disagree Disagree Neither agree or disagree Agree Strongly agree
This course helped me learn to evaluate the merits of ideas and
competing claims
Strongly disagree Disagree Neither agree or disagree Agree Strongly agree
This course helped me to effectively communicate ideas
orally
Strongly disagree Disagree Neither agree or disagree Agree Strongly agree
This course helped me to effectively communicate ideas in
writing
Strongly disagree Disagree Neither agree or disagree Agree Strongly agree
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 17
Trinity College Course Evaluation Questionnaire
Course
Dynamics
1 2 3 4 5
The course had a welcoming and
inclusive classroom environment
Strongly disagree Disagree Neither agree or disagree
Agree Strongly agree
Compared to the requirements of other classes of this type, please characterize the course difficulty
Very low Low Moderate High Very High
How much did you learn from this
course
Nothing A little A moderate amount
A lot A great deal
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 18
Trinity College Course Evaluation Questionnaire
Student
Engagement
1 2 3 4 5 6 7 8 9 10
How many hours per week on
average did you spend on this
course (outside of class
meetings)? Examples include
study groups, attending office hours, reading,
writing, working on practice
problems, etc.
1 Hour 2 Hours 3 Hours 4 Hours 5 Hours 6 Hours 7 Hours 8 Hours 9 Hours 10 Hours
About what percent of the class meetings
(including discussions, labs,
etc.) did you attend in person?
10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 19
Trinity College Course Evaluation Questionnaire
What would you like to say about this course to a student who is considering taking it in the future?
Would you like to provide any other comments about this course?
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 20
Student Accessible Course Evaluation System
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 21
Student Accessible Course Evaluation System
Student access to quantitative results
Written comments not shared
Instructor must opt-in to make data available
Encourage and support instructors in joining SACES
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 22
Student Accessible Course Evaluation System
Student access to quantitative results
Written comments not shared
Instructor must opt-in to make data available
Encourage and support instructors in joining SACES
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 23
• Students want to know what their peers are saying!
• SACES provides a platform for sharing this feedback that is more
representative of the overall course experience.
Accessing SACES reportsAccessed via a hyperlink in DukeHub’s course search function
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 24
Accessing SACES reportsAccessed through the OATC website
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 25
Accessing SACES reports
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 26
Accessing SACES reports
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 27
Accessing SACES reports
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 28
How to opt-in to SACESWebform available within Instructor Tableau Reports
Webform available on OATC website
Encourage instructors to opt-in immediately following the publication of reports
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 29
Navigating Course Evaluation Reports in Tableau
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 30
Tableau Reports – Log In
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 31
To access Tableau go to:Tableau.oit.duke.edu
Tableau Reports - Workbooks
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 32
Tableau Reports - Workbooks
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 33
Tableau Reports – Department View
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 34
Department Report – Courses Evaluated
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 35
Department Report – Basic Report
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 36
Department Report – Course with Comparisons
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 37
Department Report – Department Overall
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 38
Department Report – Written Comments
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 39
Department Report – Means by Course
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 40
Department Report – APT
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 41
Tableau Reports – Resources Tableau Quick Start Guide
◦ http://assessment.trinity.duke.edu/tableau-quick-start-guide
Tableau Users Guide◦ http://assessment.trinity.duke.edu/tableau-user-guide
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 42
Upcoming EventsMaking use of the information you already have (or have access to)
Tuesday, October 24, 2017 – 10:00am – Perkins 217◦ Report examples include COFHE enrolled student and senior surveys, Tableau program informational
reports, course evaluations.
◦ Participants will identify and report the types of data they’re already collecting.
◦ Participants will be become familiar with other types/sources of data (course, program and college wide) they already have access to.
◦ Participants will brainstorm the ways in which these data sources support the program’s student learning outcomes.
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 43
Questions?
How is your department using course evaluation data?
Do you feel comfortable supporting faculty in your department with their course evaluations?
Have you reviewed your list of eligible course for Fall 2017?
OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 44
Thank you for the work you do to support student learning assessment in your department!P L EA S E CO N TAC T T H E O F F I C E O F A S S ES S M E N T, T R I N I T Y CO L L EG E W I T H A N Y Q U EST I O N S :
A S S ES S M E N T @D U K E .ED U