The American Board of Pediatrics

Training Requirements for Subspecialty Certification

APPD Meeting – May 2, 2009Forum for Fellowship Directors Presented By:

The American Board of Pediatrics

Training Requirements forSubspecialty Certification

APPD Meeting – September 8, 2011 Forum for Fellowship Directors

Arlington, VA

1. Requirements for Certification-- PD Role in Evaluation-- Scholarly Activity

2. Time Limited Eligibility for Certification Examinations

3. Miscellaneous Items-- Exam Security-- Computer-based Testing-- MOC

4. Initiative on Subspecialty Clinical Training and Certification

Role of PDs in Certification ProcessTracking and Evaluation

• Part of the certifying process

• PDs and faculty are key in determining who is eligible for the examination

• PDs provide annual roster of trainees and evaluation of clinical competence and professionalism

In-Training Evaluation Issues

• ABP asks PDs for end of year evaluation in two areas: clinical competence & professionalism

• Unsatisfactory evaluation means trainee receives no credit for year; must repeat

• Unsatisfactory in professionalism alone: at ABP’s discretion and PDs recommendation, a period of observation in lieu of a repeat year

• Marginal: if trainee receives 2 consecutive marginal ratings must repeat the latter year

Role of PDs in Certification ProcessTracking and Evaluation

• Structured evaluation system- Clear decision on annual status of resident or

fellow- Documentation of problems and remediation

• Transfers, leave, new additions communicated to ABP

• Transfers:- ABP will release information regarding

summary evaluations obtained through tracking, dates of training, and credit provided

ABP Requirements for Subspecialty Certification effective July 2004

Scholarly Activity• Core curriculum

• Greater flexibility in the type of activities that can meet the requirement

• Evaluation of scholarly accomplishments to be made at local level

• Institutional Scholarship Oversight (thesis-like)Committees for mentoring and evaluation of fellows

Core Curriculum

The ABP has developed additional content specifications for subspecialty examinations based on the competencies related to the core curriculum in scholarly activities

Content outline with annotated bibliography was sent to all PDs in Spring 2008 and posted on ABP Web site

Questions on exams in 2010 / 2011

Eligibility for Certifying Examination

Upon completion of training, the ABP will requiresubmission of:1. Verification of Competence Form completed by

program director2. A document written by the fellow describing the

scholarly activity, the fellow’s role in the activity, and how it relates to a career development plan

3. The written “work product” of the scholarly activity

Signature of fellow, program director, and membersof committee on documents 2 and 3

All three documents sent to ABP in one packet

Personal Statement of Fellow

• Several pages in length

• Comment on intended career path upon entry to fellowship and reasons for choosing specific area of Scholarly Activity

• Describe Scholarly Activity and fellow’ role, as well as any preparation beyond core curriculum needed to ensure successful completion

• Describe how Scholarly Activity furthers fellow’s career plan and reflect upon educational value of project

Scholarly Activity Work Product

• ABP allows many options for engagement in SA, but has not diluted the rigor expected

• The work product should be result of completed project of substantive scholarly exploration and analysis

• Abstracts, case reports, review articles, and proposals would not be expected to meet the requirements

Scholarly Activity Work Product

Examples of products include:- Peer-reviewed publication in which a fellow played

a substantial role

- In-depth manuscript describing a completed project

- Thesis written in connection with the pursuit of anadvanced degree

- Extramural grant application that has either beenaccepted or favorably reviewed

- Progress report for projects of exceptional complexity, such as a multi-year clinical trial

Scholarship Oversight Committee

• Review of scholarly activity will occur at the local level

• Each fellow must have a Scholarship OversightCommittee to consist of three or more individuals, at least one of whom is based outside the subspecialty discipline

• The program director may serve as a trainee’s mentor and participate in the activities of the committee, but should not be a standing (ie, voting) member

Scholarship Oversight Committee

The committee will:- Determine whether a specific activity is appropriate to

meet the ABP guidelines

- Determine a course of preparation to ensuresuccessful completion of the project

- Evaluate the fellow’s progress

- Meet with the fellow early in the training period andregularly thereafter

- Require the fellow to present/defend the project

- Advise the program director on the fellow’s progressand assess whether the fellow has met the requirement for scholarly activity

Graduating Cohort (2010)Under Scholarly Activity Requirements

Verification Forms Returned = 944Requirement Met = 907 (96%)Requirement Not Met = 24 (3%)Invalid Response = 13 (1%)

Of Those Who Met Requirement = 907Enroll in Graduate Degree Program = 121 (13%)Degree Awarded = 52 (6%)

2010 Scholarly ActivityFor Those Who Met Requirement

Area Pursued All Subspecialties

Basic Biomedical Science 223 (25%)

Clinical Biomedical Science 463 (51%)

Translational Biomedical Science 116 (13%)

Health Services 33 (4%)

Quality Improvement 31 (3%)

Bioethics 8 (1%)

Education 17 (2%)

Public Policy 5 (1%)

Other, Specified 5 (1%)

Invalid Response 6 (1%)

Total 907 (100%)

2010 Scholarly ActivityFor Those Who Met Requirement

Work Product Generated All Subspecialties

A Peer-Reviewed Publication 183 (20%)

An In-Depth Manuscript 521 (57%)

A Thesis or Dissertation 24 (3%)

An Extramural Grant Application 61 (7%)

A Progress Report 100 (11%)

Other, Specified 11 (1%)

Not Applicable; Work Product Not Submitted 3 (0%)

Invalid Response 4 (0%)

Total 907 (100%)

Time Limit on Eligibility for Initial Certifying Examination

• Candidates will no longer have an unlimited time to become certified

• Beginning with 2014 administration of initial certifying exams in GP and its subspecialties, applicants must have completed training required for certification within the previous seven years

• If training was not completed within that time frame an additional period of accredited training will be required

• Detailed policy is available on ABP Web site and has been widely disseminated

Time Limit on Eligibility for Initial Certifying Examination

Rationale• Public accountability re: meaning of certification

• Consistent with continuous evaluation of competencies

Special Considerations• “Time-limit clock” begins upon completion of training

• Completion of fellowship before general pediatrics residency by IMGs may be risky

• Fewer opportunities to take exam available for those who train out of sequence

• Training beyond three years required for certification will not re-set the clock (e.g.: chief residency, advanced subspecialty and research)

Test Security

• Exam material is confidential and protected by federal copyright law

• Sharing of exam content post-administration is violation of honor code

• Honor code signed during application and exam administration

SITE Security

• Reports of potential misconduct during SITE provided to PDs based on irregularities reported to ABP from Prometric Testing Centers

• SITE examinees are provided with guidelines about what is permissible while in the testing centers

• ABP will not take action – but rely on PDs to interpret data and address issues as appropriate

• Ensure that your trainees understand importance of maintaining security of examination and integrity of certification process

Computer-Based Testing

• ABP is transitioning all written initial certification exams to computer-based format administered at secure testing centers

• Fall 2011 – subspecialty exams will be offered via single day administration at Prometric Testing Centers in US, Canada, and selected int’l sites

• Exam will remain 4.5 hours but will be divided into two sections with an optional break. Section 1 will no longer be accessible after the break.

• Results reported in usual time frame; usual quality control procedures followed

Maintenance of Certification (MOC)

As of 2010 - Important Changes to Note:

• For those certified in 2010 and beyond: no end date on certificate and automatic enrollment in MOC

• Five year cycles to accumulate points inPart 2 (Self-assessment & Life Long Learning) andPart 4 (Performance in Practice) with a menu of options

• Fellows will receive 20 points per year (10 Part 2 and 10 Part 4) toward MOC in general pediatrics

• Secure exam every 10 years (Part 3)

MOC Credit During Fellowship

• MOC credit awarded after a fellow has completed 12 months of accredited fellowship

• Fellow must be currently certified in general pediatrics at end of each 12 month training period in order to be eligible

• Automated process based on tracking and evaluation forms submitted by Program Director

• Fellow will receive electronic notification when credit is posted to his/her online portfolio

Subspecialty Clinical Training and Certification (SCTC)

• ABP undertook initiative to consider nonclinical aspects (research/scholarly activity) of subspecialty training and made recommendations for changes in its requirements for certification that were implemented in 2004.

• No recommendations about clinical training despite increasing influence of competency-based educational training model on expectations for clinical performance and certification

• All subspecialists are held to the same training model: three years of training , including a scholarly component without specification of duration of time of the latter.

Invitational Conference on SCTCJuly 2010, Durham, North Carolina

• Sponsored by ABP Foundation; chaired by David Stevenson

• Wide range of stakeholders invited with interest in subspecialty GME representing: ABP, AAP, ACGME, AMSPDC, APPD, CoPS, ABIM, NACHRI

• Representatives from fourteen subspecialties: • AAP sections, • Subspecialty Societies• Program Director Organizations• ABP Subboards

Questions for Consideration

1. What is the goal of fellowship training and certification?

2. Should there be minimum requirements which are common to specific subspecialties and/or to all the subspecialties?

3. Is there a need for change in subspecialty training (including content and duration) and certification?

4. What change, if any, is needed?

Questions for Consideration

5. What would be the impact of change on recruitment into the subspecialties and the ultimate competence of the trainees?

6. How should a specific subspecialty best determine its essential professional activities and core competencies (clinical, scholarly, and procedural) expected upon the completion of training?

Common Themes

• One size training of three years for all subspecialties requires reevaluation

• Considerable inter/intra subspecialty training program variation already exists, as well as variation in career paths of graduates.

• Many felt the three years for all subspecialties served no one:

• Physician scientist needs longer training with protected time and financial support

• Clinicians may benefit from shortened training or training in which third-tier competencies or advanced clinical training is embedded.

Common Themes

• Discussion about how individual subspecialties should determine core professional activities (clinical, scholarly, and procedural) and what should be expected upon completion of training

• Strong sentiment that scholarship is a core value and fellows must learn to analyze, interpret and apply research evidence at the point of care

• Need for flexibility during fellowship; yet the flexibility that is currently available is not fully utilized

• ABP has appointed a Task Force to examine the current model of pediatric fellowship training with emphasis on competency-based clinical training and to make recommendations for change if warranted.

• Expected to take 2-3 years – this process will include input and feedback from the pediatrics community

Initiative on Subspecialty Clinical Training and Certification (SCTC)

• CoPS will serve as network for communication efforts

• Visit ABP website to view issues under consideration

• Watch for open fora at national meetings (PAS and APPD)

Initiative on Subspecialty Clinical Training and Certification (SCTC)

www.abp.org

- Eligibility and training requirements for general pediatrics and all subspecialties, PD information, ABP policies, etc.

- 2010 – 2011 Workforce Data available for viewing and downloading from ABP Web site

- Look for info on MOC for you and your trainees

ABP Web Site