Harvard Medical School Center for Evaluation Annual Report ...mycourses.med.harvard.edu/clerkships/Assessment_Unit_Annual.pdf · Overview The Center for ... Systems: Endocrine/Reproduction

Center for Evaluation AY1213 Annual Report page 1

Harvard Medical School Center for Evaluation Annual Report of Required Course and Clerkship Ratings Academic Year 2012-2013

Overview The Center for Evaluation Annual Report of Required Course and Clerkship Ratings AY1213 summarizes students’ evaluations of preclerkship courses, HST courses, core clerkships and advanced electives at HMS and HMS affiliates for academic year 2012-2013. Brief comparative references are made to previous years. The report is designed to provide leaders within the Program in Medical Education (PME) with a curricular overview and information to assist with policy decisions and preparations for future offerings of the courses. Preclerkship Courses The average overall student rating for AY1213 HMS Year 1 preclerkship courses is 1.68 (SD=0.45) with a range of 1.27-2.881. The average overall student rating for AY1213 HMS Year 2 preclerkship courses is 1.75 (SD=0.38) with a range of 1.25-2.45. The average overall student rating for all AY1213 preclerkship courses is 1.70 (SD=0.40). This overall rating is essentially unchanged from the AY1112 overall rating (1.73). In this report we make note of courses that received ratings one standard deviation greater or lesser than the average rating. In Year 1, one course, Scholarship in Medicine, received a rating more than one standard deviation less favorable than the average rating. This course was similarly positioned from AY0809 through AY1112. In Year 2 two courses, Human Systems: Gastroenterology and Human Systems: Respiratory Pathophysiology, received a rating more than one standard deviation more favorable than the average rating. In Year 2 two courses, Psychopathology and Intro to Clinical Psychiatry and Human Systems: Orthopedics, received a rating more than one standard deviation less favorable than the average rating. Although small changes occur in the ratings of almost all courses from one academic year to the next, in this report we make note only of courses that experienced a change in rating greater than 0.50. In AY1213 two FOM courses met this criteria: Human Systems: Endocrine/Reproduction declined in rating from 1.44 to 1.94 and Human Development improved in rating from 3.55 to 2.10. See Table 1 and Charts 1 and 2 for a full listing of preclerkship course ratings. Preclerkship Course Components Each year, students are asked to rate each learning format or course component of each course (e.g., tutorial, laboratory, lecture) in terms of its contribution to their learning. Even though all courses are not comprised of the same learning formats or components, it is possible to make comparisons among courses that offer similar formats. While these data are most useful viewed within the context of an individual course, some general information is presented here as overview. Lectures were rated in 23 courses. The average student rating of lectures is 1.94 with a range of 1.35-2.45. Tutorials were rated in 20 courses. The average student rating of tutorials is 1.82 with a range of 1.36- 1 All courses and clerkships are rated on a standard scale (1 = excellent, 5 = poor).


3.44. Small group sessions were rated in 5 courses. The average student rating of small group sessions is 2.01 with a range of 1.49-2.40. Laboratories were rated in 11 instances in 10 courses (the Human Body course offers both gross anatomy and histology labs). The average student rating of labs is 1.93 with a range of 1.28-2.40. Although not widely employed as a learning format, patient clinics were rated in five courses. In four of the five courses in which they were rated, patient clinics were rated the most favorable learning format. The average student rating of patient clinics is 1.60 with a range of 1.34-1.91. Please see Table 4 and Charts 3 - 5 for a listing of course component ratings. Average Tutor Rating by Course The average overall student rating for tutors (by course) in Year 1 and Year 2 preclerkship courses and Patient Doctor III is 1.79 with a range of 1.25-3.44. These data give a sense of students’ overall impression of the value of tutors in the educational process. Individual overall tutor ratings are not reported because they may not be reliable indicators due to variations in student response rate and the generally small numbers of possible respondents, as well as variability of tutorial contact hours per course. HST Course Ratings The average overall student rating for AY1213 HST Year 1 courses is 2.17 (SD=0.78) with a range of 1.20-3.72. The average overall student rating for AY1213 HST Year 2 courses is 1.81 (SD=0.59) with a range of 1.28-2.82. The average overall student rating for all AY1213 HST preclerkship courses is 2.02 (SD=0.71). This rating essentially unchanged from the AY1112 HST average rating 2.03 (SD=0.68). In HST Year 1, two courses, HT 010 Anatomy and HT030 Human Pathology, received a rating more than one standard deviation more favorable than the average rating. Two courses, HT120 Gastroenterology, and the HST offering of PS700M.J Psychopathology and Introduction to Clinical Psychiatry received a rating more than one standard deviation less favorable than the average rating. Three courses in the HST curriculum had a change in rating greater than 0.50: HT146 Human Biochemistry & Metabolic Diseases improved in rating from 3.06 to 2.44; HT040 Mechanisms of Microbial Pathogenesis improved in rating from 2.61 to 1.54; and HST120 Gastroenterology declined in rating from 2.06 to 2.74. Please see Table 2 for a full listing of HST course ratings. Clerkship Ratings The average overall student rating for all HMS core clerkships, including PDIII, PCC and the PCE is 1.58 (SD=0.17) with a range of 1.31-1.79. This rating, which represents the average rating for each clerkship across all sites within a given specialty, is slightly less favorable than the AY1112 overall rating of 1.53 (SD=0.15). See Tables 3-6, Charts 6-10, and the clerkship summary sheets at the back of this report for a full listing of individual clerkship ratings. Psychiatry and Medicine II received a rating more than one standard deviation more favorable than the average rating. Surgery received a rating more than one standard


deviation less favorable than the average rating. Although small changes occur in the rating of almost all clerkships from one academic year to the next, in this report we typically make note only of courses that experienced a change in rating greater than 0.50. In AY1213 no clerkship met this criteria. Student Response Rates The average response rate for Year 1 preclerkship course evaluations is 92% (range of 66%-99%). This is a slight decline from the AY1112 response rate of 96%. The average response rate for Year 2 preclerkship course evaluations is 83% (range of 68%-97%). This is rate is unchanged from the AY1112. The average response rate for HST course evaluations is 87% (range of 58%-100%). This rate is also unchanged from AY1112. The average student response rate for clerkship evaluations has declined from 97% last year to 83% this year (range of 58%-100%). Abbreviations used in the Report AMB ..................... Ambulatory BIDMC ................. Beth Israel Deaconess Medical Center CHB ...................... Children's Hospital Boston CIC ....................... Cambridge Integrated Clerkship Clin Epi ................ Clinical Epidemiology and Population Health HS Card ............... Human Systems: Cardiology HS GI .................... Human Systems: Gastrointestinal HS Hem ............... Human Systems: Hematology HS HNSB ............. Human Systems: Nervous System and Behavior HS Resp ............... Human Systems: Respiratory IHP ....................... Integrated Human Physiology IMP ....................... Immunology, Microbiology and Pathology INPT ..................... Inpatient MAH .................... Mount Auburn Hospital MCM .................... The Molecular and Cellular Basis of Medicine MGH .................... Massachusetts General Hospital OB/GYN ............. Obstetrics and Gynecology PCC ...................... Primary Care Clerkship PCE ....................... Principal Clinical Experience PD ......................... Patient Doctor Course PIC ........................ Pursuing Inquiry in Medicine Psych 700 ............. Psychopathology and introduction to Clinical Psychiatry


Summary Charts and Tables


Table 1: Five-Year Comparison – PME Preclerkship Course Ratings Arranged in descending order from AY1213 most favorable to AY1213 least favorable rating. (Please Note: ratio in parentheses indicates response rate) YEAR 1 AY1213 AY1112 AY1011 AY0910 AY0809

MCM 1.27 (167/169)

1.24 (172/171)

1.12 (163/170)

1.11 (169/171)

1.12 (166/169)

Med Ethics and Professionalism 1.31 (112/170)

1.43 (129/136)

1.51 (124/137)

1.68 (96/135)

2.11 (35/134)

Intro to Health Care Policy 1.34 (133/138)

1.37 (133/137)

1.47 (130/141) 1.34 & 2.01 2.32

(103/137) Genetics 1.37

(160/170) 1.63

(164/170) 1.46

(166/170) 1.47

(157/170) 1.64

(131/169) Immunology, Microbiology, Path 1.48

(163/168) 1.49

(1.57/1.69) 1.27

(161/173) 1.41

(149/169) 1.42

(158/169) Clinical Epidemiology 1.48

(166/171) 1.60

(164/172) 1.78

(154/170) 1.45

(148/170) 1.46

(136/170) Intro to the Profession 1.64

(191/199) 1.78

(200/200) 1.47

(180/200) 1.46

(180/200) 1.45

(181/200) Patient Doctor I 1.65

(161/171) 1.59

(162/170) 1.52

(170/173) 1.41

(162/170) 1.67

(166/169) Intro to Social Medicine 1.77

(111/134) 2.11

(127/136) 2.01

(130/135) 1.76

(110/135) 1.71

(83/137) Integrated Human Physiology 1.90

(162/170) 1.44

(167/171) 1.34

(161/179) 1.27

(163/172) 1.37

(167/168) Human Body (Anatomy) 2.07

(162/171) 1.90

(168/170) 2.04

(159/170) 2.12

(162/170) 2.37

(163/169) Pursuing Inquiry in Medicine 2.88

(157/170) 3.36

(143/167) 2.90

(91/93) 2.81

(62/96) 3.67

(45/98) YEAR 2 AY1213 AY1112 AY1011 AY0910 AY0809

Gastroenterology 1.25 (148/172)

1.17 (158/174)

1.15 (133/168)

1.24 (79/166)

1.16 (111/175)

Respiratory Pathophysiology 1.36 (139/171)

1.27 (121/173)

1.30 (124/170)

1.15 (23/168)

1.21 (114/175)

Dermatology 1.40 (153/171)

1.27 (128/172)

1.37 (126/170)

1.82 (134/169)

1.69 (132/175)

Cardiovascular 1.40 (148/172)

1.35 (146/172)

1.83 (103/171)

2.38 (120/166)

1.77 (139/175)

Nervous System & Behavior 1.42 (129/171)

1.30 (171/173)

1.47 (149/167)

1.34 (105/167)

1.22 (141/175)

Hematology 1.51 (148/172)

1.34 (155/174)

1.26 (129/169)

1.49 (107/167)

1.64 (124/175)

Renal 1.64 (144/172)

1.27 (159/175)

1.74 (140/170)

1.76 (101/166)

1.59 (144/175)

Patient Doctor II 1.71 (170/175)

1.61 (169/178)

1.71 (109/176)

1.88 (154/170)

1.84 (163/175)

Rheumatology 1.74 (149/171)

2.08 (120/172)

1.98 (124/170)

2.16 (126/169)

2.50 (128/175)

Endocrine/Reproduction 1.94 (134/172)

1.44 (160/174)

1.61 (137/167)

1.60 (105/167)

1.91 (132/175)

Clinical Nutrition 2.01 (129/171)

2.00 (124/173)

2.19 (122/169)

2.28 (86/166)

2.89 (66/176)

Human Development 2.10 (117/171)

3.55 (128/173)

2.46 (111/169)

2.19 (43/166)

2.60 (63/173)

Pharmacology 2.11 (132/171)

1.65 (131/173)

1.66 (121/168)

1.92 (83/167)

1.89 (79/175)

Intro to Psychiatry (Psych 700) 2.21 (160/185)

2.16 (173/195)

2.14 (160/197)

2.01 (85/198)

2.31 (193/204)

Orthopedics 2.45 (142/171)

2.25 (125/172)

2.77 (131/170)

2.52 (128/169)

2.30 (127/175)

YEAR 1: 12 Courses evaluated, average overall rating = 1.68 (SD=0.45). Overall response rate = 92% YEAR 2: 15 Courses evaluated, average overall rating = 1.75 (SD=0.38). Overall response rate = 83%


Table 2: Five-Year Comparison - HST Course Ratings Arranged in descending order from AY1213 most favorable to AY1213 least favorable rating (Please Note: ratio in parentheses indicates response rate) YEAR 1 AY1213 AY1112 AY1011 AY0910 AY0809

HT010 Anatomy 1.20 (31/35)

1.61 (34/38)

1.21 (35/38)

1.32 (31/34)

1.39 (48/46)

HT030 Pathology 1.35 (46/34*)

1.17 (52/56)

1.11 (56/57)

1.37 (54/56)

1.23 (57/51)

HT175 Immun. 1.78 (32/42)

1.39 (51/50*)

1.52 (32/36)

1.52 (40/44)

1.46 (29/40)

HT090 Cardio Path 1.53 (32/47)

1.50 (39/47)

1.16 (25/49)

1.28 (36/58)

1.15 (27/31)

HT100 Resp Path 1.61 (33/43)

1.63 (42/50)

1.91 (33/47)

1.83 (42/63)

1.79 (38/41)

HT060 Endocrin 1.77 (32/32)

1.73 (30/33)

1.40 (31/31)

1.57 (30/34)

1.62 (30/32)

HT220 Care of Pts (Spring) 2.04 (29/30) ~ 2.00

(13/30) 1.95

(22/30) ~

HT146 Metabolism 2.44 (33/32*)

3.06 (33/33)

2.57 (31/31)

1.97 (37/40)

3.35 (37/41)

HT190 Biostats 2.58 (34/38)

2.50 (38/42)

2.15 (14/55)

2.27 (31/49)

2.24 (40/52)

HT160 Mol Bio 2.94 (36/34*)

2.64 (39/54)

3.00 (25/31)

2.23 (31/41)

2.37 (42/53)

HT934 Global Med 3.07 (29/34)

2.97 (31/33) ~ 2.48

(26/37) 2.17

(19/31)

HT110 Renal Path 3.72 (30/30)

3.37 (31/32)

2.61 (31/38)

3.83 (30/41)

2.62 (39/40)

YEAR 2 AY1213 AY1112 AY1011 AY0910 AY0809

HT080 Hem 1.28 (31/32)

1.27 (31/34)

1.56 (27/36)

1.26 (33/35)

1.00 (22/31)

IN710 Intro to Clin Med 1.36 (29/30)

1.66 (32/32)

1.32 (25/30)

1.54 (29/31)

1.12 (17/26)

HT070 Repro 1.43 (28/29)

1.43 (30/36)

1.67 (27/34)

1.76 (30/31)

1.63 (32/37)

HT040 Microb 1.54 (29/32)

2.61 (32/32)

2.03 (29/31)

1.67 (31/32)

1.44 (27/31)

HT150 Pharm 1.59 (29/30)

1.44 (34/40)

1.48 (27/36)

1.34 (30/31)

1.37 (30/33)

HT020 Musk 1.64 (26/30)

1.56 (32/34)

1.46 (13/20)

1.55 (43/47)

2.52 (32/35)

HT130 Neurosc 1.93 (30/51)

2.24 (34/57)

1.81 (36/64)

1.90 (30/41)

2.43 (30/39)

HT120 Gastro 2.74 (29/29)

2.06 (33/35)

2.03 (29/32)

2.97 (29/30)

2.18 (28/32)

HST PS700M.J 2.82 (28/29)

2.73 (30/32)

1.64 (25/30)

1.81 (18/31)

1.86 (28/31)

YEAR 1: 12 Courses evaluated, average overall rating = 2.17 (SD=0.78). Overall response rate = 87%✰ YEAR 2: 9 Courses evaluated, average overall rating = 1.81 (SD=0.59). Overall response rate = 89% ~ Data not available é There were more respondents than enrollees for this survey ✰ The overall response rate is based on corrected response numbers


Table 3: Five-Year Comparison - Average Overall Clerkship Ratings Arranged in descending order from AY1213 most favorable to AY1213 least favorable rating. (Please Note: Ratio in parentheses indicates response rate)

CLERKSHIP AY1213 AY1112 AY1011 AY0910 AY0809

Psychiatry 1.31 (148/147*)

1.34 (154/151*)

1.27 (145/150)

1.37 (109/158)

1.36 (102/167)

Med II 1.33 (150/98*)

1.60 (139/105)

1.49 (131/94é)

1.43 (73/107) ~

Med I 1.45 (147/167)

1.36 (155/183)

1.42 (156/174)

1.33 (103/172)

1.48 (94/68)

Radiology 1.48 (147/153)

1.51 (163/169)

1.89 (165/171)

2.42 (127/154)

1.54 (129/148)

PCE 1.49 (68/158)

1.51 (110/167)

1.51 (97/167)

1.59 (99/162) ~

OB/GYN 1.67 (150/156)

1.34 (159/163)

1.63 (161/166)

2.03 (136/171)

1.79 (130/166)

PCC 1.68 (78/136)

1.57 (136/142)

1.67 (133/143)

1.53 (126/159)

1.51 (63/113)

Neurology 1.73 (152/149*)

1.67 (160/159*)

1.89 (150/152)

1.80 (88/154)

1.71 (97/174)

Pediatrics 1.73 (148/158)

1.46 (157/164)

1.54 (152/163)

1.50 (96/156)

1.28 (103/164)

PDIII 1.74 (84/158)

1.81 (139/165)

1.69 (130/168)

2.06 (149/162)

1.86 (146/158)

Surgery 1.79 (151/158)

1.68 (160/167)

1.75 (159/170)

1.72 (134/159)

1.73 (135/165)

~ Data not reported é There were more respondents than enrollees for this survey Table 4: Preclerkship Course Component Ratings Number of Course

Ratings Average Range

Patient Clinics 5 1.60 1.34-191 Tutorials 20 1.82 1.36-3.44 Laboratories 11 ratings in 10 courses* 1.96 1.28-2.40 Lectures 23 1.94 1.35-2.45 Small Groups 5 2.01 1.49-2.40

* The Human Body course offers both gross anatomy and histology labs


1.27 1.31 1.34 1.37 1.48 1.48 1.64 1.65 1.77 1.90 2.07 2.88

1

2

3

4

5

MC

M

Med

Eth

ics

Hea

lth C

are

Pol

Gen

etic

s

IMP

Clin

Epi

ITP

PD

I

Soc

ial M

ed

IHP

Hum

an B

ody

Pur

suin

g in

quiry

in

Med

CHART 1: PRECLERKSHIP YEAR 1 COURSE RATINGS

Average = 1.68

Poor

Excellent

1.25 1.36 1.40 1.40 1.42 1.51 1.64 1.71 1.74 1.94 2.01 2.10 2.11 2.21 2.45

1

2

3

4

5

HS

GI

HS

Res

p

HS

Der

m

HS

Car

d

HS

HN

SB

HS

Hem

HS

Ren

al

PD

II

HS

Rhe

um

HS

End

o/R

epro

HS

Nut

ritio

n

HS

Hum

an D

ev

HS

Pha

rm

Psy

ch 7

00

HS

Orth

o

CHART 2: PRECLERKSHIP YEAR 2 COURSE RATINGS

Average = 1.75

Excellent

Poor


1.25

1.39

1.42

1.49

1.53

1.54

1.58

1.58

1.68

1.69

1.71

1.72

1.75

1.82

1.86

1.92

1.93

1.98

2.22

2.26

2.33

2.34

2.39

1

2

3

4

5

Med

Eth

ics

HS

GI

HS

Res

p

PD

II*

HS

Car

d

MC

M

Soc

ial M

ed

HS

Der

m*

HS

Hem

IHP

HS

Ren

al

Clin

Epi

Gen

etic

s

HS

HN

SB

Hea

lth C

are

Pol

IMP

HS

Rhe

um

HS

End

o/R

epro

Hum

an B

ody

IMP

*

HS

Orth

o*

PD

I

HS

Nut

ritio

n*

CHART 3: PRECLERKSHIP TUTORIALS AND SMALL GROUP SESSIONS [* INDICATES SMALL GROUP]

Average = 1.80

Poor

1.28 1.61 1.70 1.87 1.92 1.95 2.00 2.11 2.19 2.21 2.40

1

2

3

4

5

HS

HN

SB

HS

GI

Hum

an B

ody-

Gro

ss

HS

Car

d

IMP

HS

Res

p

IHP

HS

Ren

al

HS

Hem

Hum

an B

ody-

His

tolo

gy

HS

End

o/R

epro

CHART 4: PRECLERKSHIP LABORATORIES Excellent

Average = 1.93

Poor

Excellent

1.35

1.52

1.55

1.60

1.61

1.72

1.78

1.81

1.84

1.84

1.89

1.96

1.97

1.99

2.02

2.07

2.07

2.18

2.29

2.35

2.39

2.44

1

2

3

4

5

Hea

lth C

are

Pol

Gen

etic

s

HS

Der

m

HS

Res

p

HS

GI

MC

M

HS

Car

d

PD

II

HS

Nut

ritio

n

HS

Rhe

um

IMP

Soc

ial M

ed

HS

Hum

an D

ev

HS

Ren

al

HS

Hem

HS

End

o/R

epro

HS

HN

SB

Clin

Epi

Psy

ch 7

00

HS

Pha

rm

HS

Orth

o

IHP

CHART 5: PRECLERKSHIP LECTURES

Excellent

Average = 1.94

Poor

TABLE 4: Summary of HMS Student Clerkship Evaluation Data AY1213: Three-Month Clerkships (Sorted by Clerkship)Data compiled from MyCourses. 1 = Excellent; 5 = Poor

Clerkship and Site

Total Number of Students in AY1213

Total Response

Response Rate

How well were the objectives stated at the outset

Were the criteria used to evaluate you explained at the outset

Rate the organization

Were the faculty accessible

Rate the quality of the teaching overall

Was there enough content to master core knowledge of subject

How appropriate was the responsibil-ity you were given for patients

Rate the clerkship overall

BIDMC-Inpt 55 53 96% 1.34 1.53 1.28 1.36 1.38 1.49 1.34 1.25BWH-Inpt 49 45 92% 1.56 1.67 1.50 1.51 1.53 1.82 1.53 1.58CIC^ 12 6 50% 1.33 1.50 1.67 1.33 1.50 1.33 1.33 1.50MGH-Inpt 51 43 84% 1.26 1.30 1.30 1.31 1.28 1.37 1.36 1.28BIDMC-Amb 55 52 95% 1.48 1.67 1.38 1.40 1.60 1.77 1.62 1.54BWH-Amb 49 46 94% 1.74 1.98 1.74 1.50 1.70 1.85 2.00 1.69MGH-Amb 51 43 84% 1.30 1.51 1.49 1.28 1.29 1.42 1.23 1.33Total/Average 167 147 88%✘ 1.43 1.59 1.48 1.38 1.47 1.58 1.49 1.45

OB/GYNBIDMC 53 53 100% 1.26 1.43 1.26 1.37 1.52 1.52 1.66 1.51BWH 46 46 100% 1.15 1.30 1.35 1.30 1.48 1.39 1.61 1.41CIC 12 6 50% 1.83 2.33 2.50 1.83 2.33 1.50 1.17 2.17MGH 45 45 100% 1.33 1.38 1.51 1.42 1.71 1.69 1.80 1.58Total/Average 156 150 96% 1.39 1.61 1.66 1.48 1.76 1.53 1.56 1.67

PEDIATRICSCIC 12 6 50% 1.83 1.83 1.83 1.33 1.67 1.67 1.83 2.00CHB 98 97 99% 1.40 1.52 1.61 1.44 1.50 1.68 1.42 1.53MGH 48 45 94% 1.40 1.44 1.67 1.42 1.52 1.71 1.64 1.67Total/Average 158 148 94% 1.54 1.60 1.70 1.40 1.56 1.69 1.63 1.73

SURGERYBIDMC 52 51 98% 1.94 2.16 2.06 2.00 2.29 2.20 1.80 1.98BWH 47 47 100% 1.54 1.61 1.26 1.74 2.04 2.17 2.00 1.70CIC 12 6 50% 1.17 2.00 2.33 2.00 2.17 2.33 2.00 2.17MGH 47 47 100% 1.26 1.60 1.83 1.68 1.68 1.64 1.62 1.32Total/Average 158 151 96% 1.48 1.84 1.87 1.86 2.05 2.09 1.86 1.79^ Because of the integrated nature of the CIC curriculum one survey was used to evaluate both the inpatient and ambulatory portions of the Medicine I Clerkship.✘ Inpatient responses used to calculate response rate.

Center for Evaluation AY1213 Annual Report

page 10

MEDICINE I (Inpatient average overall rating = 1.40; Ambulatory average overall rating = 1.52)

TABLE 5: Summary of HMS Student Clerkship Evaluation Data AY1213: One-Month Clerkships (Sorted by Clerkship)Data compiled from MyCourses. 1 = Excellent; 5 = Poor

Clerkship and Site


Total Response

Response Rate









NEUROLOGYBIDMC* 49 52 100% 1.80 1.75 2.17 2.08 2.06 2.38 2.08 2.19BWH* 44 48 100% 1.52 1.63 1.85 1.45 1.45 1.77 1.49 1.53CIC 12 6 50% 1.33 1.33 1.33 1.17 1.50 1.50 1.33 1.67MGH* 44 46 100% 1.35 1.35 1.85 1.33 1.39 1.89 1.52 1.54Total/Average 149 152 96%✰ 1.50 1.52 1.80 1.51 1.60 1.89 1.61 1.73

PSYCHIATRYBIDMC* 48 50 100% 1.24 1.30 1.50 1.26 1.34 1.64 1.28 1.28BWH* 27 31 100% 1.35 1.47 1.32 1.19 1.48 1.55 1.35 1.19CAMB^ 7 7 100% 1.29 1.29 1.29 1.00 1.57 1.29 1.43 1.43CIC 12 6 50% 1.50 1.50 1.17 1.00 1.17 1.17 1.17 1.17MGH*^ 37 38 100% 1.58 1.71 1.79 1.32 1.53 1.47 1.43 1.53McLEAN* 16 16 100% 1.33 1.27 1.47 1.07 1.27 1.20 1.20 1.27Total/Average 147 148 96%✰ 1.38 1.42 1.42 1.14 1.39 1.39 1.31 1.31

RADIOLOGYBIDMC* 46 47 100% 1.06 1.09 1.11 1.15 1.15 1.11 1.67 1.17BWH 50 49 98% 2.21 2.51 3.02 1.96 2.09 2.24 2.47 2.38CIC 12 6 50% 1.17 1.00 1.00 1.00 1.00 1.00 1.33 1.00MGH 45 45 100% 1.33 1.64 1.51 1.16 1.52 1.49 2.04 1.36Total/Average 153 147 95%✰ 1.44 1.56 1.66 1.32 1.44 1.46 1.88 1.48* There were more respondents than enrollees for these surveys. The source of the error is not known.

✰The overall response rate is based on corrected response numbers

^ A subset of MGH PCE students have the opportunity to do a traditional 4-week block rotation at Cambridge. This experience is a distinct from the CIC Psychiatry rotation and for the purposes of this report is called "CAMB."


page 11

TABLE 6: Summary of HMS Student Clerkship Evaluation Data AY1213: PCE/ PDIII/ PCC/Med II (Sorted by Clerkship)Data compiled from MyCourses. 1 = Excellent; 5 = Poor

Clerkship and Site


Total Response

Response Rate

Amount of mentoring received

Atmosphere for learning

Quality of feedback received

Quantity of feedback received

Tutorials and/or longitudinal conferences

Longitudinal contact with faculty and/or housestaff

Longitudinal contact with patients


Principal Clinical Experience**BIDMC 51 18 35% 1.50 1.28 1.50 1.61 1.39 1.50 2.06 1.28BWH 49 18 37% 2.44 2.28 2.50 2.61 2.78 2.33 2.83 2.11CIC 12 6 50% 1.50 1.67 2.00 2.17 1.17 1.00 1.17 1.17MGH 46 26 57% 1.69 1.50 1.77 1.77 1.65 1.85 2.46 1.38Total/Average 158 68 43% 1.78 1.68 1.94 2.04 1.75 1.67 2.13 1.49

Clerkship and Site


Total Response

Response Rate


Were the criteria used in evaluating you explained at the outset

Tutorial Required Readings

Clincial Exercise

Ethics Curriculum

Reflection Papers


Patient Doctor III**BIDMC 51 24 47% 1.71 1.91 1.88 2.57 2.04 2.17 2.57 2.08BWH 49 34 69% 1.65 2.06 2.12 2.26 1.91 2.44 2.85 1.97CIC 12 4 33% 2.00 1.50 1.25 1.67 1.25 1.67 1.25 1.25MGH 46 22 48% 1.41 1.55 1.50 2.39 1.91 2.09 2.64 1.64Total/Average 158 84 53% 1.69 1.76 1.69 2.22 1.78 2.09 2.33 1.74

Clerkship and Site


Total Response

Response Rate









Primary Care Clerkship**BIDMC 47 28 60% 1.61 1.71 1.68 1.14 1.54 1.68 1.36 1.61BWH 42 25 60% 1.72 1.96 1.76 1.48 1.56 1.84 1.40 1.84CIC No survey postedMGH 47 25 53% 1.44 1.46 1.60 1.28 1.48 1.80 1.40 1.60Total/Average 136 78 57% 1.59 1.71 1.68 1.30 1.53 1.77 1.39 1.68

MEDICINE IIBIDMC* 41 51 100% 1.20 1.48 1.44 1.59 1.56 1.58 1.08 1.30BWH* 19 39 100% 1.33 1.61 1.56 1.44 1.38 1.59 1.19 1.38MAH* 12 15 100% 1.33 1.87 1.33 1.13 1.53 1.29 1.53 1.29MGH* 26 45 100% 1.42 1.80 1.47 1.40 1.48 1.56 1.36 1.36Total/Average 98 150 100%✰ 1.32 1.69 1.45 1.39 1.49 1.51 1.29 1.33* There were more respondents than enrollees for these surveys. The source of the error is not known.

✰The overall response rate is based on corrected response numbers.


** See the clerkship summary sheets at the back of this report for a complete list of questions and ratings.

page 12


1.31 1.33 1.45 1.48 1.49 1.67 1.68 1.73 1.73 1.74 1.79

1

2

3

4

5

Psy

chia

try

Med

icin

e II

Med

icin

e I

Rad

iolo

gy

PC

E

OB

/GY

N

PC

C

Ped

iatri

cs

Neu

rolo

gy

PD

III

Sur

gery

CHART 6: CORE CLERKSHIP RATINGS: By Specialty

Average = 1.76 Excellent

Poor


1.33 1.28 1.54 1.58 1.60 1.38 1.64 1.67 1.53 1.36 1.32

1

2

3

4

5

Med

icin

e I A

MB

Med

icin

e I I

NP

T

Neu

rolo

gy

OB

/GY

N

PC

C

PC

E

PD

III

Ped

iatri

cs

Psy

chia

try

Rad

iolo

gy

Sur

gery

Chart 7: Core Clerkship ratings by PCE Site: MGH

Average = 1.48

Excellent

Poor

1.69 1.58 1.53 1.41 1.84 2.11 1.97 1.53 1.19 2.38 1.70

1

2

3

4

5

Med

icin

e I A

MB

Med

icin

e I I

NP

T

Neu

rolo

gy

OB

/GY

N

PC

C

PC

E

PD

III

Ped

iatri

cs (C

HB

)

Psy

chia

try

Rad

iolo

gy

Sur

gery

Chart 8: Core Clerkship ratings by PCE Site: BWH

Average = 1.72

Excellent

Poor

1.54 1.25 2.19 1.51 1.61 1.28 2.08 1.53 1.28 1.17 1.98

1

2

3

4

5

Med

icin

e I A

MB

Med

icin

e I I

NP

T

Neu

rolo

gy

OB

/GY

N

PC

C

PC

E

PD

III

Ped

iatri

cs (C

HB

)

Psy

chia

try

Rad

iolo

gy

Sur

gery

Chart 9: Core Clerkship Ratings by PCE Site: BIDMC

Average = 1.58

Excellent

Poor

1.50 1.67 2.17 1.17 1.25 2.00 1.17 1.00 2.17

1

2

3

4

5

Med

icin

e I

Neu

rolo

gy

OB

/GY

N

PC

E

PD

III

Ped

iatri

cs

Psy

chia

try

Rad

iolo

gy

Sur

gery

Chart 10: Core Clerkship Ratings by PCE Site: CIC [CIC does not offer a PCC]

Average = 1.57 Excellent

Poor


Clerkship CharacteristicsSite Number of

StudentsNumber of Responses

Response Rate

BIDMC 51 18 35%BWH 49 18 37%CIC 12 6 50%MGH 46 26 57%Total 158 68 43%

Other Ratings

CLERKSHIP SUMMARY SHEET: PCE(1=Excellent, 5=Poor)

DirectorD. RobertsE. AlexanderD. HirshS. Calderwood, A. Puig

1.17 1.28 1.38 2.11

1.00

2.00

3.00

4.00

5.00 CIC BIDMC MGH BWH

Overall Rating!

Excellent!

Poor!

Average = 1.49!

BIDMC BWH CIC MGH AVERAGE1.50 2.44 1.50 1.69 1.781.28 2.28 1.67 1.50 1.681.50 2.50 2.00 1.77 1.941.61 2.61 2.17 1.77 2.041.39 2.78 1.17 1.65 1.751.50 2.33 1.00 1.85 1.672.06 2.83 1.17 2.46 2.13

BIDMC BWH CIC MGH AVERAGE1.61 1.61 2.67 1.69 1.902.00 2.22 1.17 2.00 1.851.83 2.28 1.33 2.04 1.871.89 2.22 2.17 1.69 1.991.61 2.00 1.17 1.69 1.621.39 1.94 1.33 1.62 1.57

The quality of feedback you have received on your performance

Considering your PCE experiences only, how satisfied have you been with:

The amount of mentoring you have receivedThe atmosphere for learning that you have encountered

The quantity of feedback you have received on your performanceThe tutorials/longitudinal conferences in which you have participatedThe longitudinal contact you have had with faculty and/or housestaffThe longitudinal contact you have had with patients

Understand patient care from an interdisciplinary perspectiveUnderstand your areas of strength and weakness

Considering your PCE experiences only, how prepared do you feel to:

Practice as a physician in the hospital environmentPractice as a physician in the ambulatory environmentUnderstand the workings of the health care systemIntegrate basic sciences with clinical practice



studentsNumber of Responses

Response rate

55 53 96%55 52 95%49 45 92%49 46 94%

CIC^ 12 6 50%51 43 84%51 43 84%

Total 167 147 88%❖

Other Ratings

Site






Was there enough content to master the core knowledge of the subject

How appropriate was the responsibility you were given for patients

BIDMC/Inpt 1.34 1.53 1.28 1.36 1.38 1.49 1.34BIDMC/Amb 1.48 1.67 1.38 1.40 1.60 1.77 1.62BWH/Inpt 1.56 1.67 1.50 1.51 1.53 1.82 1.53BWH/Amb 1.74 1.98 1.74 1.50 1.70 1.85 2.00CIC^ 1.33 1.50 1.67 1.33 1.50 1.33 1.33MGH/Inpt 1.26 1.30 1.30 1.31 1.28 1.36 1.28MGH/Amb 1.30 1.51 1.49 1.28 1.29 1.42 1.23Average 1.43 1.59 1.48 1.38 1.47 1.58 1.48

❖ Inpatient responses used to calculate response rate

CLERKSHIP SUMMARY SHEET: MEDICINE I

Director

Ambulatory: S. Fazio

Ambulatory: L. Simmons

Inpatient: J. Danziger

Inpatient: R. Thadhani, S. Gregory

BIDMC

D. Hirsh, B. Ogur

^ Because of the integrated nature of the CIC curriculum one survey was used to evaluate both the inpatient and ambulatory portions of the Medicine I Clerkship at that site

Inpatient: E. AlexanderAmbulatory: N. Osman, V. Mitchell-Gonzalez

(1=Excellent, 5=Poor)

BWH

MGH

1.25 1.28 1.50 1.58 1.54 1.33 1.69

1

2

3

4

5 BIDMC MGH CIC^ BWH

Overall Rating!

Inpt Amb

Excellent!

Poor!

Inpt Average = 1.40; Amb Average = 1.52; Overall Average = 1.45!



studentsNumber of responses

Response rate


Other Ratings

Site








BIDMC 1.26 1.43 1.26 1.37 1.52 1.52 1.66BWH 1.15 1.30 1.35 1.30 1.48 1.39 1.61CIC 1.83 2.33 2.50 1.83 2.33 1.50 1.17MGH 1.33 1.38 1.51 1.42 1.71 1.69 1.80Average 1.39 1.61 1.66 1.48 1.76 1.53 1.56

(1=Excellent, 5=Poor)CLERKSHIP SUMMARY SHEET: OB/GYN

DirectorH. Ricciotti, M. Atkins, M. MackenzieR. Barbieri, N. Johnson, C. Kralios

C. York-Best, H. Khachadoorian-Elia, U. Wosu

J. Retsinas

1.41! 1.51! 1.58! 2.17!

1!

2!

3!

4!

5!BWH! BIDMC! MGH! CIC!

Overall Rating!

Excellent!

Poor!

Average = 1.67!




Response rate

CIC 12 6 50%CHB 98 97 99%MGH 48 45 94%Total 158 148 94%

Other Ratings

Site








CIC 1.83 1.83 1.83 1.33 1.67 1.67 1.83CHB 1.40 1.52 1.61 1.44 1.50 1.68 1.42MGH 1.40 1.44 1.67 1.42 1.52 1.71 1.64Average 1.54 1.60 1.70 1.40 1.56 1.69 1.63

(1=Excellent, 5=Poor)CLERKSHIP SUMMARY SHEET: PEDIATRICS

DirectorJ. KasperV. Chiang, A. Growdon, K. O'DonnellB. Kinane, L. Carter

1.53 1.67 2.00

1

2

3

4

5 CHB MGH CIC

Overall Rating!

Excellent!

Poor!

Average = 1.73!!




Response rate


Other Ratings

Site









(1=Excellent, 5=Poor)CLERKSHIP SUMMARY SHEET: SURGERY

DirectorM. Cahalane, T. KentE. Breen

M. de Moya, D. DonahoeS. Schwaitzberg, A. Ghosh

1.32 1.70 1.98 2.17

1

2

3

4

5 MGH BWH BIDMC CIC

Overall Rating!

Excellent!

Poor!

Average = 1.79!




Response rate

BIDMC 49 52 100%*BWH 44 48 100%*CIC 12 6 50%MGH 44 46 100%*Total 149 152 96%✰

Other Ratings

Site









* There were more respondents than enrollees for these surveys.✰The overall response rate is based on corrected response numbers.

(1=Excellent, 5=Poor)CLERKSHIP SUMMARY SHEET: NEUROLOGY

DirectorF. Drislane, A. TarulliJ. Stankiewicz, J. Klein

T. Cho, V. FridmanR. Nardin

1.53 1.54 1.67 2.19

1

2

3

4

5 BWH MGH CIC BIDMC

Overall Rating!

Excellent!

Poor!

Average = 1.73!




Response rate

BIDMC 48 50 100%*BWH 27 31 100%*CAMB^ 7 7 100%CIC 12 6 50%MGH^ 37 38 100%*McLEAN 16 16 100%Total 147 148 96%✰

Other Ratings

Site








BIDMC 1.24 1.30 1.50 1.26 1.34 1.64 1.28BWH 1.35 1.47 1.32 1.19 1.48 1.55 1.35CAMB^ 1.29 1.29 1.29 1.00 1.57 1.29 1.43CIC 1.50 1.50 1.17 1.00 1.17 1.17 1.17MGH^ 1.58 1.71 1.79 1.32 1.53 1.47 1.43McLEAN 1.33 1.27 1.47 1.07 1.27 1.20 1.20Average 1.38 1.42 1.42 1.14 1.39 1.39 1.31

* There were more respondents than enrollees for these surveys.✰The overall response rate is based on corrected response numbers.

(1=Excellent, 5=Poor)CLERKSHIP SUMMARY SHEET: PSYCHIATRY

DirectorM. Kahn, M. SegundoF. Meyer

^ A subset of MGH PCE students have the opportunity to do a traditional 4-week block rotation at Cambridge. This is a distinct experience from the CIC Psychiatry rotation and for the purposes of this report is called "CAMB."

T. Griswold

J. Alpert, D. Greenberg, T. GorrindoT. Griswold

B. Forester, S. Seiner

1.17 1.19 1.27 1.28 1.43 1.53

1

2

3

4

5 CIC BWH McLEAN BIDMC CAMB^ MGH^

Overall Rating!

Excellent!

Poor!

Average = 1.34!!




Response rate

BIDMC 46 47 100%*BWH 50 49 98%CIC 12 6 50%MGH 45 45 100%Total 153 147 95%✰

Other Ratings

Site









* There were more respondents than enrollees for these surveys✰The overall response rate is based on corrected response numbers

(1=Excellent, 5=Poor)CLERKSHIP SUMMARY SHEET: RADIOLOGY

DirectorG. LibermanD. DiSalvo, P. Clarke

T. McLoud, L. Avery, R. UppotA. Shabashov, A. Chang

1.00 1.17 1.36 2.38

1

2

3

4

5 CIC BIDMC MGH BWH

Overall Rating!

Excellent!

Poor!

Average = 1.48!




Response rate

BIDMC 47 28 60%BWH 42 25 60%MGH 47 25 53%Total 136 78 57%

Other Ratings

Site








BIDMC 1.61 1.71 1.68 1.14 1.54 1.68 1.36BWH 1.72 1.96 1.76 1.48 1.56 1.84 1.40MGH 1.44 1.46 1.60 1.28 1.48 1.80 1.40Average 1.59 1.71 1.68 1.30 1.53 1.77 1.39

*The Cambridge Integrated Clerkship does not post a Primary Care Clerkhsip Evaluation

S. Seward, K. Wood

CLERKSHIP SUMMARY SHEET: PCC*(1=Excellent, 5=Poor)

DirectorS. FranklR. Cunningham

1.60 1.61 1.84

1

2

3

4

5 MGH BIDMC BWH

Overall Rating!

Excellent!

Poor!

Average = 1.68!




Response rate


Other Ratings

Site



Tutorials Inter-sessions

Clinical Exercises

Ethics Papers

Reflection Papers


E. Beresin

CLERKSHIP SUMMARY SHEET: PDIII(1=Excellent, 5=Poor)

DirectorE. Beresin, A. ShipE. Beresin, T. MilliganE. Beresin, E. Gaufberg

1.25! 1.64! 1.97! 2.08!

1

2

3

4

5 CIC MGH BWH BIDMC

Overall Rating!

Excellent!

Poor!

Average = 1.74!




Response rate

BIDMC 41 51 100%*BWH 19 39 100%*MAH 12 15 100%*MGH 26 45 100%*Total 98 150 100%✰

Other Ratings

Site








BIDMC 1.20 1.48 1.44 1.59 1.56 1.58 1.08BWH 1.33 1.61 1.56 1.44 1.38 1.59 1.19MAH 1.33 1.87 1.33 1.13 1.53 1.29 1.53MGH 1.42 1.80 1.47 1.40 1.48 1.56 1.36Average 1.32 1.69 1.45 1.39 1.49 1.51 1.29

* There were more respondents than enrollees for these surveys✰The overall response rate is based on corrected response numbers

E. AlexanderC. Hatem, B. BlairB. Davis

CLERKSHIP SUMMARY SHEET: MEDICINE II(1=Excellent, 5=Poor)

DirectorA. Carbo, P. Hartzband

1.29 1.30 1.36 1.38

1.00

2.00

3.00

4.00

5.00 MAH BIDMC MGH BWH

Overall Rating!

Excellent!

Poor!

Average = 1.33!

Documents

Harvard Medical School Center for Evaluation Annual Report ...mycourses.med.harvard.edu/clerkships/Assessment_Unit_Annual.pdf · Overview The Center for ... Systems: Endocrine/Reproduction