Transcript

Practice Readiness Assessments: Applicant Manual (Specialist) Page 1 Updated January 31st, 2013

Applicant Manual (Specialist)

1.0 Description and Purpose

2.0 Applicants

3.0 Clinical Objectives for Specialists

4.0 Responsibilities of Applicants

5.0 Responsibilities of Assessors and Practice Supervisors

Schedule A: Supervised Practice Assessment Report Schedule B: Chart Review and Chart Stimulated Recall Worksheet and instructions

Provincial Physician Assessment Program Practice Readiness Assessments

Practice Readiness Assessments: Applicant Manual (Specialist) Page 2 Updated January 31st, 2013

1.0 DESCRIPTION & PURPOSE To qualify for an assessment, applicants must first apply through Registration for a practice permit. Physicians who do not meet the full requirements of the General Register must undergo and successfully pass a practice readiness assessment prior to obtaining a practice permit on the Provisional Register. There are two unique components to a practice readiness assessment, and most, but not all, physicians (see below for exceptions) must undergo and successfully pass both components:

1. Preliminary Clinical Assessment: The applicant (candidate) is placed in the practice setting of an approved assessor, who assesses the applicant’s clinical competence through direct observation. The duration of the preliminary clinical assessment is typically three months.

In some cases, the College may elect to waive the preliminary clinical assessment (e.g., some U.S. applicants, applicants with previous practice experience in a Canadian setting, distinguished applicants appointed to full-time academic appointments, Canadian-trained applicants who have not passed the national certification exams, etc.).

2. Supervised Practice Assessment: For a supervised practice assessment, the applicant acts as the

most responsible physician in his or her own practice and bills for services provided. An approved assessor visits on a regular basis and assesses the applicant’s clinical competence by reviewing charts, having case-based discussions with the applicant and providing multi-source feedback. The duration of a supervised practice assessment is typically three months.

Capacity within the two medical schools in Alberta sometimes doesn’t support the performance of competency-based assessments on behalf of the College for physicians seeking a practice permit to practice independently. Consequently, community physicians, ideally with experience evaluating student physicians in a specialist practice setting, help conduct practice readiness assessments. The assessments are based on defined objectives, explicit performance standards, and clear statements as to the competence achieved. A practice readiness assessment is only part of the information the College uses to reach a decision about an applicant’s eligibility for registration. The mere completion of any assessment required by the College does not guarantee a practice permit will be issued. The possible outcomes of an assessment range from eligibility for registration, to registration with conditions, to denial of registration. A practice readiness assessment is not intended to be a training experience. Its purpose is to give applicants opportunities to demonstrate their core knowledge and proficiency in clinical skills, patient management and resource utilization in the specialist practice setting. The College's goal is to register only competent and effective practitioners. These and other standards set by the College help to ensure that Albertan's receive the best care that our profession can offer.

Practice Readiness Assessments: Applicant Manual (Specialist) Page 3 Updated January 31st, 2013

2.0 APPLICANTS Applicants for College-approved practice readiness assessments may be:

1. Graduates of foreign medical schools who have: • successfully completed a postgraduate program of at least 48 months discipline-specific

specialty training obtained outside of Canada, specialty certification and recognition in the discipline of training by another medical regulatory authority, or

• successfully completed a postgraduate program of at least 36 months specialty training obtained outside Canada, specialty certification and recognition in the discipline of training by another medical regulatory authority. (Candidate may not be eligible for specialist recognition in Alberta.)

2. Graduates of Canadian medical schools who have not successfully completed the national certification exam.

3. Specialist physicians who seek to return to practice after three or more years away from clinical or specialty practice.

4. Other physicians who are required by the College to demonstrate their fitness to practice medicine in this setting.

3.0 CLINICAL OBJECTIVES FOR A PRACTICE READINESS ASSESSMENT The clinical objectives identified in the assessment evaluation tools represent the College’s minimum expectation for independent specialized practice. The objectives for a specific applicant may be modified after consultation between the applicant, the assessor and a College designate who is familiar with the candidate's background and intended practice location. Where specific objectives cannot be met within the assessor’s practice, the College may need to make other arrangements in consultation with the assessor. The applicant and the assessor/supervisor should review the objectives for the assessment at their first meeting. Assessment should be a dynamic activity, and objectives should be met and recorded throughout the assessment. The assessor/supervisor is required to submit formal evaluation reports of the applicant’s performance to the College at prescribed intervals (see 5.0 Responsibilities of Assessors/Supervisors). FITERs from the respective specialty discipline will be used as an evaluation report for the Preliminary Clinical Assessment. A copy of the final evaluation report for the Supervised Practice Assessment is included as Schedule A. Both the applicant and the assessor/supervisor should review and sign the evaluation reports before submitting them to the College. Signature by the applicant does not necessarily mean agreement with the findings but does mean he or she agrees the evaluation has been discussed with him or her.

Practice Readiness Assessments: Applicant Manual (Specialist) Page 4 Updated January 31st, 2013

4.0 RESPONSIBILITIES OF APPLICANTS Preliminary Clinical Assessment:

1. The primary responsibility for demonstrating proficiency in patient care rests with the applicant. The applicant must be fully aware of the objectives of the preliminary clinical assessment and take the initiative to achieve them.

2. The applicant must respect the final authority of the assessor, whose primary responsibility is to his or her patient. The degree of independence afforded the applicant is decided by the assessor after consideration of the applicant's proficiency with the consent of the patient. The applicant is not registered for independent practice and must be under the supervision of the assessor at all times.

3. The applicant must integrate into the assessor's practice and function in accordance with the custom of the practice in matters such as hours of work, on-call responsibility and relationships with office staff and consultants.

4. The applicant must provide quality patient care commensurate with his or her level of training and recent experience. Applicants must ask for supervision in novel or complex cases, and in order to be observed achieving an objective.

5. The applicant must review all clinical work with the assessor at regular intervals, and seek and attend to feedback and to any recommendations of the assessor.

6. The applicant is expected to discuss any difficulty in meeting any requirements or objectives of the preliminary clinical assessment with the assessor. In the event of disagreement between the applicant and the assessor with respect to the purpose or conduct of the preliminary clinical assessment, the applicant is expected to discuss the problem with the appropriate Assistant Registrar at the College.

7. The applicant must respect the assessor's evaluation of the applicant's performance and discuss any outstanding difference of opinion with the Assistant Registrar. The assessor's evaluation report is only part of the information used in reaching a decision about eligibility for registration.

8. The applicant must remain in good standing on the Provisional Register – Physician Undergoing Assessment at the College of Physicians & Surgeons of Alberta and carry adequate professional liability insurance throughout the assessment.

Supervised Practice Assessment:

1. The primary responsibility for demonstrating proficiency in patient care rests with the applicant. The applicant must be fully aware of the objectives of the supervised practice assessment and take the initiative to achieve them.

2. The applicant is the most responsible physician whose primary responsibility is to his or her patient. The applicant must remain in good standing on the Provisional Register – Conditional Practice at the College of Physicians & Surgeons of Alberta and carry adequate professional liability insurance throughout the assessment.

3. The applicant will be visited in his or her office by the practice supervisor, initially on a weekly basis, to review charts, hold case-based discussions and provide advice on issues as they arise. The case reviews should include a broad cross section of medical conditions including chronic

Practice Readiness Assessments: Applicant Manual (Specialist) Page 5 Updated January 31st, 2013

disease management and common presenting complaints. The practice supervisor will review and discuss between five and 10 charts per visit. Each visit is expected to take approximately two hours.

4. The applicant is expected to discuss any difficulty in meeting any requirements or objectives of the supervised practice assessment with the practice supervisor. In the event of disagreement between the applicant and the supervisor with respect to the purpose or conduct of the supervised practice assessment, the applicant is expected to discuss the problem with the appropriate Assistant Registrar at the College.

5. The applicant must respect the practice supervisor's evaluation of the applicant's performance and discuss any outstanding difference of opinion with the Assistant Registrar. The practice supervisor's evaluation reports, which will be submitted to the College, are only part of the information used in reaching a decision as to eligibility for registration.

5.0 RESPONSIBILITIES OF ASSESSORS/SUPERVISORS Preliminary Clinical Assessment:

1. Concerns or inquiries regarding the applicant's progress in the preliminary clinical assessment should be directed to the appropriate Assistant Registrar of the College.

2. The assessor shall immediately report any issues of significant concern (i.e. patient safety) to the appropriate Assistant Registrar.

3. Although the primary responsibility for meeting the objectives of the preliminary clinical assessment rests with the applicant, the assessor is expected to facilitate the applicant’s completion by providing opportunities to manage patients in the specialty practice setting in accordance with the objectives of the preliminary clinical assessment and the applicant's level of proficiency.

4. At the start of the preliminary clinical assessment, the assessor and the applicant are expected to establish an agreement for assessment based on the objectives.

5. Assessors should always be available for interaction with the applicant, both for advice and for evaluation of proficiency. The applicant is not registered for independent practice and must be under the supervision of the assessor at all times.

6. Assessors must review the applicant's clinical work at regular intervals and provide immediate feedback and recommendations. Feedback is most useful when it consists of what observed behaviors were effective and what behaviors need improvement.

7. Assessors or their office staff are expected to inform patients of the applicant's status within the practice and seek their consent to be seen by the applicant.

8. Any difficulties encountered in completing the evaluation reports should be reported to the appropriate Assistant Registrar immediately.

9. Assessors are required to complete and submit evaluation reports to the College at the following prescribed intervals:

Practice Readiness Assessments: Applicant Manual (Specialist) Page 6 Updated January 31st, 2013

• Three (3)-Month Preliminary Clinical Assessment:

o Interim Evaluation Report must be completed and submitted to the College six (6)

weeks after the assessment has commenced, and o Final Evaluation Report must be completed and submitted to the College within

one (1) week following conclusion of the assessment. Supervised Practice Assessments: 1. Concerns or inquiries regarding the applicant's progress in the supervised practice assessment

should be directed to the appropriate Assistant Registrar of the College. 2. The practice supervisor shall immediately report any issues of significant concern (i.e. patient safety)

to the appropriate Assistant Registrar.

3. The practice supervisor shall conduct regular office visits to the applicant to review between five and 10 charts, hold case-based discussions, obtain feedback on the applicant from staff and colleagues, and provide advice on issues. It is anticipated that each office visit could take approximately two hours of time.

4. The case reviews should include a broad cross section of medical conditions including chronic

disease management and common presenting complaints. I Assessment of the charts will be documented on a “Chart Review & Chart Stimulated Recall Worksheet” for submission to the College at a later time (see Appendix B for instructions and template).

5. Following sufficient interaction between the supervisor and the applicant of no less than one month,

the practice supervisor may, at his or her discretion, reassess the frequency of the office visits. Completion of any further Chart Review & Chart Stimulated Recall Worksheets is also at the discretion of the assessor in the case where the records have been found to be satisfactory (after a review of a minimum of 15 charts).

6. Practice supervisors are required to complete and submit evaluation reports to the College as well as all

completed Chart Review & Chart Stimulated Recall Worksheets at the following prescribed intervals:

• Interim Evaluation Report and Worksheets must be completed and submitted to the College six (6) weeks after the assessment has commenced, and

• Final Evaluation Report and Worksheets must be completed and submitted to the College within one (1) week following conclusion of the assessment.

SCHEDULE AFINAL - Supervised Practice Assessment

CPSA: Number Process ID: Number

Provincial Physician Assessment Program

Version 2 - March 28, 2011 Document Name: Assessment - Supervised Practice Interim Report 1 of 3

Consider all competency components under each Primary Competency Category (PCC) before assigning overall assessment rating.

PCC: HISTORY TAKING

Provide documentation to support those competency components that need improvement.1. Key historical features of the presenting complaint are documented.

2. Problem labels or diagnoses are documented and those with ongoing implications for future care are readily identifiable at future visits.

3. Significant past medical history (e.g. major diseases, major surgical procedures, results of significant investigations) is available.

4. Allergies are readily identifiable.

5. A list of active medications is available.

6. Relevant prevention and health promotion issues are documented.

Consider all competency components under each Primary Competency Category (PCC) before assigning overall assessment rating.

PCC: PHYSICAL EXAMINATION & TECHNIQUES

Provide documentation to support those competency components that need improvement.1. Physical findings are documented.

2. Evidence of examining patients in a manner which is focused on determining the presence or absence of relevant clinical signs, and which is appropriate to the context of the visit.

Consider all competency components under each Primary Competency Category (PCC) before assigning overall assessment rating.

PCC: DIAGNOSTIC AND PROBLEM DEFINITION

Provide documentation to support those competency components that need improvement.

1. Evidence is documented of a search for the root cause.

2. Evidence of appropriate clinical reasoning.

3. Evidence of a differential diagnosis that is based on an interpretation and prioritization of related history, physical examination and investigation.

4. Considerations of relevant psychological, social and lifestyle issues are evident.

GENERAL COMMENTS:

UNSATISFACTORY

GENERAL COMMENTS:

Check appropriate assessment rating below(Double Click to type)

SATISFACTORY UNSATISFACTORY

Check appropriate assessment rating below(Double Click to type)

GENERAL COMMENTS:

SATISFACTORY UNSATISFACTORY

Check appropriate assessment rating below(Double Click to type)

SATISFACTORY

SAMPLE

SAMPLE

Check appropriate assessment rating below

SAMPLE

Check appropriate assessment rating below

SAMPLE

SAMPLE

SAMPLE

SAMPLE

SAMPLE

SAMPLE

SATISFACTORY

SAMPLE

SATISFACTORY

SAMPLE

SAMPLE

SAMPLE

SAMPLE

SAMPLE

SAMPLE

SAMPLE

2. Evidence of examining patients in a manner which is focused on determining the

SAMPLE

2. Evidence of examining patients in a manner which is focused on determining the presence or absence of relevant clinical signs, and which is appropriate to the

SAMPLE

presence or absence of relevant clinical signs, and which is appropriate to the

SAMPLE

SAMPLE

SAMPLE

Consider all competency components under each Primary Competency Category SAMPLE

Consider all competency components under each Primary Competency Category SAMPLE

PCC: DIAGNOSTIC AND PROBLEM DEFINITIONSAMPLE

PCC: DIAGNOSTIC AND PROBLEM DEFINITIONSAMPLE

SAMPLE

SAMPLE

SAMPLE

SAMPLE

SAMPLE

DO NOT U

SE

DO NOT U

SECheck appropriate assessment rating below

DO NOT U

SECheck appropriate assessment rating belowDouble Click to type)

DO NOT U

SEDouble Click to type)

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

Provide documentation to support those competency components that need

DO NOT U

SE

Provide documentation to support those competency components that need

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

3. Evidence of a differential diagnosis that is based on an interpretation and DO NOT U

SE

3. Evidence of a differential diagnosis that is based on an interpretation and prioritization of related history, physical examination and investigation.DO N

OT USE

prioritization of related history, physical examination and investigation.DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

4. Considerations of relevant psychological, social and lifestyle issues are evident.DO NOT U

SE

4. Considerations of relevant psychological, social and lifestyle issues are evident.DO NOT U

SE

SCHEDULE AFINAL - Supervised Practice Assessment

CPSA: Number Process ID: Number

Provincial Physician Assessment Program

Version 2 - March 28, 2011 Document Name: Assessment - Supervised Practice Interim Report 2 of 3

Consider all competency components under each Primary Competency Category (PCC) before assigning overall assessment rating.

PCC: COMMUNICATION/RELATIONSHIP SKILLS

Provide documentation to support those competency components that need improvement.

1. Communicates clearly and is easily understood by patients and their families, office staff and colleagues.

2. Demonstrates respect for patients and their families, office staff and colleagues.

3. Demonstrates an understanding of the key components of patient/family communication.

4. Interacts collaboratively with other physicians.

Consider all competency components under each Primary Competency Category (PCC) before assigning overall assessment rating.

PCC: INVESTIGATION AND MANAGEMENT

Provide documentation to support those competency components that need improvement.

1. Investigations, referrals and treatment (including name, dosage and quantity of prescriptions) are documented.

2. Uses diagnostic and treatment resources appropriately.

3. Advises on/prescribes medications appropriately.

4. Makes appropriate use of consultants and allied personnel.

5. Evidence of providing education to patients and families, and of enlisting their participation in the management plan.

Consider all competency components under each Primary Competency Category (PCC) before assigning overall assessment rating.

PCC: MEDICAL KNOWLEDGE

Provide documentation to support those competency components that need improvement.

1. Management choices adhere to practice standards or variance is explained.

2. Ongoing and preventative care can be referenced to specific sources of information (e.g. evidence-based literature) when asked.

Consider all competency components under each Primary Competency Category (PCC) before assigning overall assessment rating.

PCC: PUBLIC HEALTH, MEDICO-LEGAL, ETHICAL

Provide documentation to support those competency components that need improvement.1. Evidence of compliance with the CMA Code of Ethics.

2. Documented awareness of, and attention to public health and social issues.

3. Evidence of informed consent obtained where appropriate.

4. Demonstrates evidence of “duty to report” in circumstances that present a danger to others (communicable diseases, child abuse, etc.).

GENERAL COMMENTS:

UNSATISFACTORY SATISFACTORY

Check appropriate assessment rating below(Double Click to type)

GENERAL COMMENTS:

GENERAL COMMENTS:

Check appropriate assessment rating below(Double Click to type)

SATISFACTORY UNSATISFACTORY

GENERAL COMMENTS:

Check appropriate assessment rating below(Double Click to type)

SATISFACTORY UNSATISFACTORY

Check appropriate assessment rating below(Double Click to type)

SATISFACTORY UNSATISFACTORY

SAMPLE

SAMPLE

SAMPLE

SAMPLE

5. Evidence of providing education to patients and families, and of enlisting their

SAMPLE

5. Evidence of providing education to patients and families, and of enlisting their

Consider all competency components under each Primary Competency Category SAMPLE

Consider all competency components under each Primary Competency Category

Check appropriate assessment rating below

SAMPLE Check appropriate assessment rating below

SAMPLE

SAMPLE

SATISFACTORY

SAMPLE

SATISFACTORY

SAMPLE

SAMPLE

SAMPLE

SAMPLE

SAMPLE

SAMPLE

SAMPLE

SAMPLE

SAMPLE

SAMPLE

SAMPLE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

Consider all competency components under each Primary Competency Category

DO NOT U

SE

Consider all competency components under each Primary Competency Category

Provide documentation to support those competency components that need

DO NOT U

SE

Provide documentation to support those competency components that need

Check appropriate assessment rating below

DO NOT U

SECheck appropriate assessment rating below

DO NOT U

SE

DO NOT U

SE UNSATISFACTORY

DO NOT U

SE UNSATISFACTORY

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

1. Management choices adhere to practice standards or variance is explained.

DO NOT U

SE

1. Management choices adhere to practice standards or variance is explained.

DO NOT U

SE

DO NOT U

SE

2. Ongoing and preventative care can be referenced to specific sources of

DO NOT U

SE

2. Ongoing and preventative care can be referenced to specific sources of information (e.g. evidence-based literature) when asked. DO N

OT USE

information (e.g. evidence-based literature) when asked. DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

SCHEDULE AFINAL - Supervised Practice Assessment

CPSA: Number Process ID: Number

Provincial Physician Assessment Program

Version 2 - March 28, 2011 Document Name: Assessment - Supervised Practice Interim Report 3 of 3

Consider all competency components under each Primary Competency Category (PCC) before assigning overall assessment rating.

PCC: FOLLOW-UP

Provide documentation to support those competency components that need improvement.

1. Arrangements for follow-up are documented (for all chronic problems and for acute problems, when necessary).

2. A system is in place to ensure follow-up of critical issues, results and/or reports.

Consider all competency components under each Primary Competency Category (PCC) before assigning overall assessment rating.

PCC: PROFESSIONALISM

Provide documentation to support those competency components that need improvement.

1. Demonstrates the ability to recognize own limitations and gaps and seek out appropriate resources-reading, electronic, consultation.2. Demonstrates responsibility for continuing care of patients and, when appropriate, for transfer of care of patients to another physician.

Sources of information include:

_________ Chart Audit _________ Interviews with Peers

_________ Formal Discussion _________ Interviews with Non-Physician Coworkers

_________ Direct Observation _________ Other:____________________________________________________________

SATISFACTORY UNSATISFACTORY

Check appropriate assessment rating below(Double Click to type)

Check appropriate assessment rating below(Double Click to type)

SATISFACTORY UNSATISFACTORY

Please submit signed and completed evaluation report to: Provincial Physician Assessment Program College of Physicians & Surgeons of Alberta

2700, 10020 – 100 Street NWEdmonton, AB T5J 0N3

Fax: (780) 420-0651Email: [email protected]

GENERAL COMMENTS:

GENERAL COMMENTS:

The following signatures acknowledge that this evaluation report, which has been completed by Dr. Practice Supervisor for Dr. Applicant, has been reviewed prior to submission to the College of Physicians & Surgeons of Alberta by the following individuals:

Signature Signature

Print Name Print Name

Date Date

APPLICANT PRACTICE SUPERVISORSAMPLE SATISFACTORY

SAMPLE SATISFACTORY

SAMPLE

SAMPLE

SAMPLE

SAMPLE

_________ Chart Audit _________ Interviews with Peers

SAMPLE

_________ Chart Audit _________ Interviews with Peers

_________ Formal Discussion _________ Interviews with Non-Physician Coworkers

SAMPLE

_________ Formal Discussion _________ Interviews with Non-Physician Coworkers

_________ Direct Observation _________ Other:____________________________________________________________

SAMPLE

_________ Direct Observation _________ Other:____________________________________________________________

SAMPLE

The following signatures acknowledge that this evaluation report, which has been completed by Dr.SAMPLE

The following signatures acknowledge that this evaluation report, which has been completed by Dr.the College of Physicians & Surgeons of Alberta by the following individuals:SAMPLE

the College of Physicians & Surgeons of Alberta by the following individuals:

APPLICANT PRACTICE SUPERVISORSAMPLE

APPLICANT PRACTICE SUPERVISORSAMPLE

SAMPLE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE_________ Formal Discussion _________ Interviews with Non-Physician Coworkers

DO NOT U

SE_________ Formal Discussion _________ Interviews with Non-Physician Coworkers

_________ Direct Observation _________ Other:____________________________________________________________

DO NOT U

SE_________ Direct Observation _________ Other:____________________________________________________________

DO NOT U

SE

The following signatures acknowledge that this evaluation report, which has been completed by Dr.

DO NOT U

SE

The following signatures acknowledge that this evaluation report, which has been completed by Dr. Practice Supervisor

DO NOT U

SE

Practice Supervisor

APPLICANT PRACTICE SUPERVISOR

DO NOT U

SE

APPLICANT PRACTICE SUPERVISOR

DO NOT U

SE

Signature Signature

DO NOT U

SE

Signature Signature

DO NOT U

SE

Print Name Print NameDO NOT U

SE

Print Name Print NameDO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

Date DateDO NOT U

SE

Date DateDO NOT U

SE

Supervised Practice Assessment Chart Review and Chart Stimulated Recall

Introduction Applicants have already demonstrated that they have the requisite medical knowledge, skills and attributes to practice as the most responsible physician on the Provisional Register as a result of successfully completing the preliminary clinical assessment component of a practice readiness assessment. Alternatively, the College may have waived the requirement for the preliminary clinical assessment as it is believed that the applicant already possess sufficient training and/or experience such that these conditions have been met. In either situation, the purpose of the supervised practice assessment is to assess whether an applicant is continuing to demonstrate good medical practice in his/her own practice setting in the role of the most responsible physician. As opposed to the preliminary clinical assessment, direct observation is not the method of assessment for the supervised practice component. Assessment in this component is achieved through chart review, chart stimulated recall and through interviews with an applicant’s colleagues or staff. The Interim and Final assessment reports for the supervised practice assessment have already been provided for reference (see Appendix B in the PPAP Information Manual – Section 1). The College has also prepared the following additional tools for use while the supervisor performs each supervised practice visit; Chart Review Guide, Chart Stimulated Recall Interview Guide and the Chart Review and Chart Stimulated Recall Worksheet (attached). The Chart Review Guide is intended to assist the supervisor to evaluate the applicant’s competence as evidenced in the charts, while the Chart Stimulated Recall Interview Guide is intended to assist the supervisor formulate questions to ask the applicant in order to gain information not readily apparent in the chart. The Chart Review and Chart Stimulated Recall Worksheet acts as a means to document the supervisor’s findings following the chart review and the subsequent discussions with the applicant. The supervisor is asked to judge the quality and organization of the chart notes, and in doing so, to look for internal consistency (for example, are historical problems followed through with appropriate examinations and investigations?) and for discordances (for example, does the assessment align with the history and physical findings?). Finally, the supervisor is asked to engage in case-based discussions that probe the applicant’s medical knowledge, and clinical decision making and judgment. Applicant – Supervisor Practice Visits Supervisors are expected to meet regularly with the applicant over the course of the assessment. Prior to each visit or at the beginning of each visit, the supervisor should request between 5-10 charts be made available for his/her review to provide the basis for the chart stimulated recall. The chart reviews should involve a broad cross section of medical conditions including chronic disease management and common presenting complaints. Once the supervisor has reviewed the cases and completed the associated worksheets, he/she should arrange to meet with the applicant to conduct chart stimulated recall. The supervisor should begin the discussion with open ended questions to reduce bias and to provide insight into the applicants thought processes. The questions should be asked in a nonjudgmental, non biased approach and the supervisor should be prepared to provide advice and feedback to the applicant throughout the supervised practice visit. Questions related to professionalism can be included in the discussion. Notes captured on the worksheets should be kept by the supervisor after each visit to assist with completion of either the Interim or Final Progress Report for submission to the College at the designated intervals. These notes will provide support to substantiate the associated evaluation results through concrete examples gathered from each of the supervised practice visits and can be valuable in the event that an assessment finding is ever challenged by an applicant. Note: Any worksheets or notes completed over the course of the assessment relating to an applicant must be submitted to the College with the assessment reports following completion of the Supervised Practice Assessment.

Supervised Practice Assessment – CSR Interview Guide

Page 2

Supervised Practice Assessment – Chart Simulated Recall Interview Guide A. Individual Visit Questions

1. General – “Please tell me about this visit.” [Alternative: “Please outline your approach to the presenting complaint and highlight the key points.”]

2. Clinical Assessment – “What specific features led you to this diagnosis or clinical impression?” Were there

any other conditions that you ruled out?”

3. Investigations and Referrals - “What specific features led you to the investigations/referrals you chose?” Were there any other investigations/referrals that you thought about, deferred or ruled out?

4. Treatment - “What specific features led you to the management you chose?” “Were there any other

treatments that you thought about, deferred or ruled out?” [Alternative: “I note that you ordered ‘XYZ’. What factors influenced your choice?” “Were there any other medications you considered?”

5. Follow-up - “Do you recall if there was a decision about follow-up?” “What were the factors that influenced

your decision?”

6. Patient Factors - “Patient characteristics sometimes influence decision-making. Was there anything special about this patient that influenced your decisions regarding management? (e.g. psychosocial issues, compliance, past medical history, current medications, support systems, employment)”. “On reflection, is there anything about this patient you wish you knew more about?”

7. Practice/System Factors - “Is there anything special about your practice setting that influenced your

management in this case? (e.g. a nurse educator, lack of access to laboratory or x-ray)”. “On reflection, what changes would improve your ability to deliver care to this patient?”

B. Broader Practice Issue Questions

1. Getting Timely Answers To Clinical Questions

Purpose: To determine the physician’s awareness and processes to find reliable/current clinical information.

When you don’t know the answer to a clinical question, what do you do to get a timely answer? Do you use the Internet/reference books/journals to search for clinical information? Are those sources serving your needs? Tell me about a particularly challenging patient where you needed urgent knowledge and could not

contact a colleague. What additional resources would help you to find timely answers to clinical questions?

A strong response will indicate use of multiple sources (web-based; paper resources; colleague support); will indicate openness to new sources and methods; and is willing to adapt to available resources.

Supervised Practice Assessment – CSR Interview Guide

Page 3

2. Use Of Optimal Office Systems

Purpose: To determine the physician’s awareness of the impact of office processes on patient care and provider satisfaction.

What frustrates you about your office practice? Which systems in your office for management of people, paper and patients work well? Which don’t?

o How well is intra-office communication working? o How well is inter-office communication working? o How up-to-date and readily available are your medical records? o How are third party requests for reports being handled? How can they be handled better? o How are phone calls managed (to front desk/ to physician)? What works and what isn’t? o How is follow-up of lab results/ notification of patients handled? How well is that working?

What are the barriers to improving office functioning? What problems/barriers are office issues versus health system issues?

A strong response will indicate awareness of the strengths and weakness in the office; will acknowledge responsibility for it; and will have processes to adjust as problems are identified.

3. Utilizing Illness Prevention Strategies

Purpose: To determine the physician’s capacity and commitment to health promotion / risk reduction strategies.

How do you see your role in promoting healthy lifestyles? What health promotion / risk reduction strategies do you use in your practice? How do you / how often do you encourage lifestyle modification? How do you / how often do you address smoking, weight management, exercise, alcohol and other risk

factors in disease management? What screening tests do you recommend for (disease: e.g. diabetes) (age- and sex-specific populations)?

A strong response will indicate responsibility for promoting healthy living among patients; will demonstrate (document in the record) a routine implementation of established preventive interventions (preferably in a flow sheet or summary page) and have reminder systems in place; will demonstrate routine questioning about risk factors; will have written material for patients; and will identify frequently used resources in the community to assist patients with these factors.

4. Empowering Patients In Self-Care

Purpose: To determine the physician’s commitment to promoting and facilitating patients’ active participation in their care.

How do you encourage patients to take responsibility for their care? How do you facilitate their active participation in care plans? What written information do you provide to your patients? Do you help your patients set targets/goals for improvement? Do you use homework assignments for patients? Do you refer patients to community resources to assist in reaching goals?

A strong response will indicate commitment to achieving a partnership with the patient in a treatment plan; will provide written material or refer to resources available; will offer treatment choices to patients; will assign homework and will assist the patient to set goals; will measure successes.

Supervised Practice Assessment – CSR Interview Guide

Page 4

Supervised Practice Assessment - Chart Review Guide (Evidence of Care Provided)

ITEMS

a) Do the recorded history and physical findings support the problem or diagnosis?

Yes, if: there is evidence of any elaboration of the presenting complaint and evidence of examination, when appropriate, of: the offending part, an organ system, including features to distinguish the seriousness of the problem, and vital signs.

Yes, if: I, as a colleague, could take over care of this patient safely without having to talk to the doctor.

Comment if important history is not evident (e.g. the features of a chest pain; the cause of an injury; suicidal ideation in a case of depression; the features that distinguish among important diagnoses.)

b) Are problems or diagnoses recorded in the chart?

Yes, if: problem labels (e.g. hip pain) or diagnoses (e.g. osteoarthritis) are recorded.

Comment if patients’ undifferentiated complaints are simply restated without evidence of being defined by the physician (e.g. chest pain without history or physical examination or apparent attempt to characterize the pain).

Comment if major medical problems are overlooked.

c) Do x-rays and laboratory tests support the problem or diagnosis?

Yes, if: investigations ordered reflect modern choices for laboratory and imaging studies AND are sufficient in each case to assess a problem or diagnosis. They may or may not be noted in the visit record.

d) Are abnormal findings or results properly followed-up?

Yes, if: appropriate action is taken on abnormal findings on laboratory and imaging studies (i.e. advice, further investigation, treatment)

e) Are the names, dosages and quantities of prescribed medications recorded?

Self-explanatory.

f) Are treatments, referrals and other interventions recorded and appropriate?

Yes, if: advice or management strategy is recorded.

g) Are plans for follow-up recorded when follow-up is important?

Yes, if: there is evidence of responsibility being taken for monitoring the course of an injury or illness, or the effect of advice or treatment.

Monitoring & Compliance / Supervised Practice Assessment – Chart Review

Please copy this form as many times as needed

Supervised Practice Assessment – Chart Review & Chart Stimulated Recall Worksheet

Applicant Name: __________________________ Applicant CPSA No._______________________

Examples where the clinical record raises questions about: responses to abnormal findings; evidence for diagnoses; choices of investigations or treatments; or diligence of follow-up. Record either chart ID #, or the combination of patient initials and date of birth and recent date of visit. Do not record

patients’ names.

Chart ID#: OR Patient’s Initials: DOB: Date of Visit:

(a) Do the recorded history and physical findings support the problem or diagnosis? Yes No N/A (b) Are problems or diagnoses recorded in the chart? Yes No N/A (c) Do x-rays and laboratory tests support the problem or diagnosis? Yes No N/A (d) Are abnormal findings or results properly followed-up? Yes No N/A (e) Are the names, dosages and quantities of prescribed medications recorded? Yes No N/A (f) Are treatments, referrals and other interventions recorded and appropriate? Yes No N/A (g) Are plans for follow-up recorded when follow-up is important? Yes No N/A

Field Notes & Chart Stimulated Recall (CSR)

Impressions

Physician: ___________Supervisor: ___________

Date: ___________

SAMPLE problem or diagnosis?

SAMPLE problem or diagnosis?

upport the problem or diagnosis?

SAMPLE

upport the problem or diagnosis?Are abnormal findings or results properly followed

SAMPLE

Are abnormal findings or results properly followed-

SAMPLE

-up?

SAMPLE

up?osages and quantities of prescribed medications recorded?

SAMPLE

osages and quantities of prescribed medications recorded?Are treatments, referrals and other interventions recorded and appropriate?

SAMPLE

Are treatments, referrals and other interventions recorded and appropriate?up recorded when follow

SAMPLE

up recorded when follow-

SAMPLE

-up is important?

SAMPLE

up is important?

SAMPLE

Field Notes & Chart Stimulated Recall (CSR)

SAMPLE

Field Notes & Chart Stimulated Recall (CSR)

SAMPLE

SAMPLE

SAMPLE

SAMPLE

SAMPLE

SAMPLE

DO NOT U

SEYes

DO NOT U

SEYes

DO NOT U

SEYes

DO NOT U

SEYes

DO NOT U

SE

DO NOT U

SE No

DO NOT U

SENo Yes

DO NOT U

SEYes

DO NOT U

SE

DO NOT U

SE No

DO NOT U

SENo

DO NOT U

SEYes

DO NOT U

SEYes

DO NOT U

SE

DO NOT U

SE No

DO NOT U

SENo Yes

DO NOT U

SEYes

DO NOT U

SE

DO NOT U

SE Are treatments, referrals and other interventions recorded and appropriate?

DO NOT U

SEAre treatments, referrals and other interventions recorded and appropriate? Yes

DO NOT U

SEYes

DO NOT U

SEYes

DO NOT U

SEYes

DO NOT U

SEField Notes & Chart Stimulated Recall (CSR)

DO NOT U

SEField Notes & Chart Stimulated Recall (CSR)

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE

DO NOT U

SE


Recommended