Rater Training for Clinical Skills VerificationModule 5

Performance Standards

Michael Jibson, M.D., Ph.D.Jeffrey Hunt, M.D.David Kaye, M.D.

Richard Summers, M.D.

Pre-testModule 5

1. The Clinical Skills Verification Examination requires that residents demonstrate competency all of the following areas except:

a. conduct of the interview

b. doctor-patient relationship and rapport development

c. case formulation

d. case presentation

Pre-testModule 5

2. The Clinical Skills Verification Examination defines competency:

a) based on a developmental sequence of skills over the four years of the adult psychiatry residency

b) based on the expected competency of PGY2 psychiatry residents

c) based on the expected skills of a competent general psychiatrist in the community

d) based on the standards of the live patient ABPN examination

Pre-testModule 5

3. Residents must:

a) pass all items on the CSV forms in order to pass the assessment

b) pass all three sections in order to pass the assessment

c) pass the majority of items on the CSV form in order to pass the

assessment

d) Have a global passing grade on the examination if they have failed one

section in order to pass the assessment

Pre-testModule 5

4. Which of the following statements is true about the anchor points on the CSV form?

a) the anchor points have been validated using standardized patient

interviewsb) the anchor points assist in the process of

developing inter-rater reliabilityc) the anchor points assist in the process of

developing test validityd) the anchor points are derived from

ACGME competencies

CSV Form

• 3 Major items• Physician-patient relationship

• Conduct of the interview

• Case presentation

• 10 Subscores with anchors

• Must score >5 of 8 on each major item

CSV Form

• 3 major item scores are global impressions• They are informed by subscores

• They need not be an average of the subscores • Subscores may be given different weights depending on the

clinical situation

CSV Form

• Subscore anchors for a score of 5-6 define the minimum expectations in each category

• Anchors assist with inter-rater reliability

• Major items, subscores, and anchors have not yet been validated

CSV Standards

A score of 5 represents:

• the minimum acceptable standard

• for a general psychiatrist

• practicing in the community

CSV Standards

Scoring should NOT:

• be adjusted to the resident’s level of training

• require excellent or outstanding performance

• expect performance at the level of a subspecialist

Videos

• All videos include actual patients

• All patients and residents have consented to the use of these videos for educational purposes

• Your responses will be saved for quality assurance assessment

• It is possible that these data will eventually be used for a research study, but no IRB proposal has been submitted

Videos

• The videos have been edited. Rate the residents performance on what you see

• If the resident presents material in the case presentation, assume it was obtained during the patient interview

• The videos are found in the accompanying slide set

Post-TestModule 5

1. The Clinical Skills Verification Examination requires that residents demonstrate competency all of the following areas except:

a. conduct of the interview

b. doctor-patient relationship and rapport development

c. case formulation

d. case presentation

Post-TestModule 5

1. The Clinical Skills Verification Examination requires that residents demonstrate competency all of the following areas except:

c. case formulation

The CSV exam requires competency in establishing a Doctor-Patient Relationship, Conduct of interview and Case Presentation.

Post-TestModule 5

2. The Clinical Skills Verification Examination defines competency:

a) based on a developmental sequence of skills over the four years of the adult

psychiatry residencyb) based on the expected competency of PGY2

psychiatry residentsc) based on the expected skills of a competent

general psychiatrist in the communityd) based on the standards of the live patient

ABPN examination

Post-TestModule 5

2. The Clinical Skills Verification Examination defines competency:

c) based on the expected skills of a competent general psychiatrist in

the community

Post-TestModule 5

3. Residents must:

b) pass all three sections in order to pass the assessment

Residents must demonstrate competence on the global ratings of Doctor-Patient Relationship, Conduct of the interview and Case presentation. They do not have to pass each individual anchor under these categories.

Post-TestModule 5

4. Which of the following statements is true about the anchor points on the CSV form?

a) the anchor points have been validated using standardized patient interviews

b) the anchor points assist in the process of developing inter-rater reliability

c) the anchor points assist in the process of developing test validity

d) the anchor points are derived from ACGME competencies

Post-TestModule 5

4. Which of the following statements is true about the anchor points on the CSV form?

b) the anchor points assist in the process of developing inter-rater reliability