© University of California San Francisco Medical School The Educator’s Portfolio: Creation and Evaluation Brian Schwartz, MD David M. Irby, PhD Kanade

© University of California San Francisco Medical School

The Educator’s Portfolio: Creation and Evaluation

Brian Schwartz, MD

David M. Irby, PhD

Kanade Shinkai, MD, PhD

University of California, San Francisco Academy of Medical Educators


Creative Commons LicenseAttribution-NonCommercial-Share Alike 3.0 Unported

You are free:• to Share — to copy, distribute and transmit the work • to Remix — to adapt the work Under the following conditions:• Attribution. You must give the original authors credit (but not in any way

that suggests that they endorse you or your use of the work).• Noncommercial. You may not use this work for commercial purposes. • Share Alike. If you alter, transform, or build upon this work, you may

distribute the resulting work only under a license identical to this one.

See http://creativecommons.org/licenses/by-nc-sa/3.0/ for full license.

http://creativecommons.org/licenses/by-nc-sa/3.0/


Agenda for the session

• Introduction and overview of EP 2.0 (20 min)• Create an Executive Summary (30 min)• Write Detailed Descriptions (30 min)• Evaluate Detailed Descriptions (30 min)• General discussion (10 min)


Purpose of the Educator Portfolio1. Highlight current, best work and impact

– Who are you as an educator?

2. Describe contributions in format for review– Promotions committees– Letter writers– Annual review with supervisor

3. Align with CV in ADVANCE and AME continuation metrics

Purpose and Educ. Roles

Executive Summary Detailed Descriptions

Evaluation Criteria


EP 2.0 – how is it different?

1. Quality not quantity!

2. New role; learner assessment

3. Scholarship embedded into all roles

4. 2 components of EP 2.0:–Executive Summary (5)–Detailed Description (1-3 from Exec Sum)


What are Educator’s Roles?

Teaching Activities

Curriculum Development

LearnerAssessment

Mentoring & Advising

Educ Leadership & Administration



Evaluation Criteria


Executive Summary

• List up to 5 of your most significant contributions to education in the following roles:

1. Teaching (mandatory)

2. Curriculum Development, Instructional Design/Tech

3. Educational Leadership

4. Mentoring

5. Learner Assessment



Evaluation Criteria


Executive Summary




3. Educational Leadership

4. Mentoring




Evaluation Criteria


Executive Summary





4. Mentoring




Evaluation Criteria


Executive Summary

• Identify and describe each significant contribution in one sentence. The first contribution must be teaching.

• Using no more than two or three additional sentences under each contribution, explain the activity, your contribution, what was achieved and any impact.



Evaluation Criteria


Executive Summary Example

Vanya Douglas, MD Assistant Clinical Professor of NeurologyMember of the Academy of Medical Educators



Evaluation Criteria



Exercise A

• Use the Executive Summary template– Describe your 1-5 most important

contributions to education at UCSF– Label by educator role (e.g., teaching,

mentoring, leadership, etc.)• Pair and share• Report



Evaluation Criteria


EP 2.0: Detailed Descriptions

• 1-3 Detailed Descriptions–Select from Executive Summary–2 pages maximum–Templates for all 5 educator roles

• You will be using a teaching role for the workshop



Evaluation Criteria


Template for Detailed Description: Teaching Role

• Your role• Learners and contact• Builds on best evidence/practice• Goals and learning objectives• Methods• Results impact• Dissemination• Reflective critique


Criteria for Excellence in Teaching


Exercise B

• Using the template for the “teaching role”, pick one of your important contributions and begin filling out the template for it

• Consult with person next to you



Evaluation Criteria


Development of Criteria

Education as Scholarship

- 1990 Boyer

- 1997 Glassick

- 2000 Fincher

Documentation standards for Educational Scholarship

-2006 Kirkpatrick

-2007 Simpson

Criteria for Evaluating Educational Scholarship

- 2013 Gusic

Criteria for evaluating roles

Advocated for teaching as scholarship, guidelines for evaluation teaching

Defined roles and documentation standards



Evaluation Criteria


Excellence, Scholarly, ScholarshipCriteria Teaching

ExcellenceScholarly Teaching

Scholarship of Teaching

Quantity & Quality

Builds on the Field

Public

Peer Review

Advances the Field

Simpson D, et al. Advancing educators and education by defining the components and evidence associated with educational scholarship. Med Educ. 41:1002–1009, 2007.


Criteria for Excellence in Teaching


Exercise C• Apply Criteria

– Use the evaluation criteria to evaluate the sample teaching activity

• Discuss– How do the criteria help you judge the

faculty member’s work? How could it be strengthened?

– How can the criteria help you write your entry?

• Report outPurpose and Educ.

RolesExecutive Summary Detailed

DescriptionsEvaluation Criteria


Survey

http://tinyurl.com/oqdgv8w


Frequently Asked Questions

• FAQs: http://medschool2.ucsf.edu/academy/Educators_Portfolio/FAQs_EP_2015.pdf

• Templates and instructions: http://medschool2.ucsf.edu/academy/Educators_Portfolio/



Evaluation Criteria


Summary of Portfolio 2.0

• Executive summary of 1-5 significant contributions to teaching and education (in 1 page)

• 1-3 specific examples of most significant contributions to teaching and education (no more than 2 pages per example)


Resources• These Slides

– Will be posted on AME website for reference

• UCSF Academy of Medical Educators Portfolio– http://medschool2.ucsf.edu/academy/

Educators_Portfolio/

• AAMC Toolbox– Gusic M, Amiel J, Baldwin C, Chandran L, Fincher R,

Mavis B, et al. Using the AAMC Toolbox for Evaluating Educators: You be the Judge!. MedEdPORTAL; 2013. Available from: www.mededportal.org/publication/9313.

http://www.mededportal.org/publication/9313

Documents

© University of California San Francisco Medical School The Educator’s Portfolio: Creation and Evaluation Brian Schwartz, MD David M. Irby, PhD Kanade