Effective Evaluation Of Teaching And

LearningSTEPHEN BRADFORTH

ADAM LEIBOVICHWILL DICHTELTOBY SMITH

ANDREW FEIGJIM MARTIN

FUNDED BY RCSA AS PART OF THE COTRELL SCHOLARS COLLABORATIVE

Effective Evaluation of Teaching and Learning (EETL) - Searching for New Approaches to R1 STEM Teaching Evaluation

Premise: student evaluation is not an effective way to promote excellent teaching

Seek: new but easily implementable metrics need to be identified (menu of choices appropriate to different institutions)

Strategy: Align with AAU Undergraduate STEM Education Initiative

Output: workshop, white paper

Project funded: Aug. 20122 year scope

Project Progress Conference call to establish detailed

work plan and milestones

Involvement of AAU fellow, Kristen Hodge

Each investigator made contact with leaders in area of Teaching Evaluation

Meetings with campus organizations such as Centers for Excellence in Teaching, Education Faculty, Administrators responsible for current evaluation

Creation of a primer on previous projects

1.75 day meeting of investigators in Washington, DC in early November

Consultants

Diane O’Dowd (HHMI Professors Group)

James Fairweather

Linda Slakey

Noah Finkelstein

Charles Henderson

Jay Labov

Matthew Hora

Robert Mathieu

Gisele Ragusa

Project Progress

DC meeting established:

Narrowed down list of effective approaches that project would like to learn more about

Detailed survey prepared addressed at CS Scholars, CCSA awardees and department chairs

Timeline for workshop, grant applications, paper submission: possible locations, dates, grid of invitees and promotion

Project Progress

December-January:

Finalization of Survey

Institution Review Board submission for authorization of survey (future use for publication requires human-subject approval)

Survey sent out mid-January

Collection and analysis of results

Survey

Asked about:

Current Methods Used to Gauge Teaching Effectiveness, under evaluation of student learning and Faculty teaching effectiveness and Academic Program Effectiveness

Perception of Desirability of Several Best Practices for Assessment of Teaching Effectiveness

Data can be examined by discipline, faculty rank and institution type, and size of academic program.

Response rate (1 week out)

Chairs (124 surveyed): 30%

CCSA (776 surveyed): 16%

CS (243 surveyed): 6% response

TOTAL RESPONSES: 215

Current Practice: student learning assessments used

4: Used Always3: Used Often2: Used Sometimes1: Used Rarely0: Never Used

Current Practice: student learning assessments used

4: Used Always3: Used Often2: Used Sometimes1: Used Rarely0: Never Used

Current Practice: methodologies to evaluate faculty teaching

4: Used Always3: Used Often2: Used Sometimes1: Used Rarely0: Never Used

Current Practice: methodologies to evaluate faculty teaching

4: Used Always3: Used Often2: Used Sometimes1: Used Rarely0: Never Used

Current Practice: assessing majors program for student learning

4: Used Always3: Used Often2: Used Sometimes1: Used Rarely0: Never Used

Current Practice: assessing majors program for student learning

4: Used Always3: Used Often2: Used Sometimes1: Used Rarely0: Never Used

Desirability of Best Practices for Faculty teaching assessment

Tracking Alumni Outcomes is Desirable…

Tracking Alumni Job Placement

s

Relative Survey Response

… but is performed infrequently!

What methodologies are used to determine the effectiveness of the overall curriculum and the student learning outcomes from the curriculum?

Desirability of Best Practices for Faculty teaching assessment

EETL project

Connections with

AAU initiative

CS Collaborative Think and Do Tank

HHMI Professor initiative

Next steps

Add investigator from Physics (as defined by survey responses or our wish-list

Follow up survey participants who have particular interesting suggestions

Submit proposal to NSF-DUE for additional workshop funding to expand reach

Finalize workshop, issue invites

Complete white paper after workshop

Tentative Structure of Workshop

Week 2 or 3 of Nov 2013In Washington DC at AAAS / AAU or ACS HQ