Assessment of a Health Systems Rotation for Orthopaedic
Residents Learning of the Systems Based Practice Competency AOA
Annual Meeting June 15, 2013
Slide 2
Funded by the Woodward Endowment for Medical Science
Education
Slide 3
Core Competencies
Slide 4
Systems Based Practice Requires residents to demonstrate an
awareness of and responsiveness to the larger health care system
and the ability to effectively call on system resources to provide
care that is optimal and effective
Slide 5
Systems Based Practice Expectations l Work effectively in
various health care delivery settings and systems relevant to their
clinical specialty l Coordinate patient care within the health care
system relevant to their clinical activity l Incorporate
considerations of cost awareness and risk-benefit analysis in
patient and/or population-based care
Slide 6
Systems Based Practice Expectations l Advocate for quality
patient care and optimal patient care systems l Work in
interprofessional teams to enhance patient safety and improve
patient care quality l Participate in identifying system errors and
implementing potential systems solutions
Slide 7
Systems Based Practice l Care not provided in a vacuum l
Internal and external factors influence the health of their
patients and the care they receive n Familiarity with various
factors n Ability to interact with various facets and participants
in health care system
Slide 8
Evaluation Methods
Slide 9
Slide 10
Systems Based Practice Wasnick: Academic Medicine, 2010 l
73/193 4 th year medical students reported having no knowledge of
any of the core competencies l 10% reported knowledge of SBP
Slide 11
Systems Based Practice David: Mt Sinai J Med, 2005 Residents
focus more on medical knowledge and patient care; SBP viewed as
less important
Slide 12
Systems Based Practice Harris: Int J Radiat Oncol Biol Physics,
2009 l Lack of knowledge among educators l Uncomfortable with
content, teaching and assessment
Slide 13
Chairs Question l COBRA violations l RBRVS l SNF vs. LTACH l
Informed consent l DRG Not perfect! Important for the resident to
know Measurable Recordable
Slide 14
360s and SBP? l Does the resident demonstrate an appreciation
for the role of all members of the health care team, and
communicate the plan of care to them appropriately? l Does the
resident demonstrate an understanding of treatment options in the
post acute continuum of care, and work with nursing, care
coordination and social services to identify the most appropriate
location for the patient?
Slide 15
360s and SBP l Is the resident active in the discharge planning
process and do they complete their discharge responsibilities
accurately and in a timely manner?
Slide 16
Key Questions l What must be learned? l How to teach it? l
Optimal delivery method? l How to assess resident performance?
Slide 17
Literature Review
Slide 18
Previous SBP Research l Lecture (ARS): Mitchell, Varkey l
Morbidity/Mortality Conferences: Davison l Group Projects: Delphin,
Patterson l Simulation: Larkin, Wang and Volzenilek l Experiential
Systems: Eiser, Buchmann, Sutkin, Turley
Slide 19
Previous SBP Research Web Based Eskildsen: J Am Geriatr Soc,
2010 Ideally, this product should be used in the context of a
clinical rotation so that learners can expand their learning and
acquire transferable skills using this online tool as a starting
point.
Slide 20
Systems Based Practice: Is It Being Taught?, How Is It Being
Taught?, and How Is It Being Assessed? Focus Group Sessions Survey
Data JBJS, 2012
Slide 21
Is It Being Taught?
Slide 22
How Is It Being Taught?
Slide 23
How Is It Being Assessed?
Slide 24
Focus Group Sessions Orthopaedic l Ortho residents l Ortho
faculty l Community ortho Non-Orthopaedic l Nursing l Allied
health, Support l Administrative Leadership l Quality/Safety
Slide 25
Focus Groups Faculty demonstrated poor understanding and
frustration with this competency and largely focused upon
efficiency in task completion
Slide 26
SBP: Taught and Assessed? The most commonly reported method for
teaching Systems Based Practice was clinical observation.
Slide 27
Focus Groups Excluding Orthopaedic Surgeons and Residents l
Communication l Collaboration l Understanding complex processes l
Hospital operations l Finance l Law l Medical error l Systems
impact on patient care
Slide 28
Focus Groups Strong consensus to provide a standardized,
experiential, learning experience for resident with assessment of
knowledge and performance
Slide 29
The Penn State Hershey Orthopaedic Residency Experience
Slide 30
Next Step l Need to prepare our residents and students to
provide health care in the 21 st century n Quality and safety n
Collaboration in multidisciplinary team n Managing disease in large
populations n Continuous improvement beyond your own individual
care
Slide 31
SBP Education and Penn State Hershey l Two, one week rotations
during orthopaedic months in PGY-1 year l Reading assignments l
Focus on experiential learning l Patient assignments as an observer
of health care through the eye of the patient l What can be done,
individually and collectively, to provide a safer, better and more
efficient experience?
Slide 32
SBP and Penn State Hershey Focus Areas l Weeks one and two:
Quality/Safety l Week two: E&M coding, IP documentation,
Finance l Week two: Analysis of DRG report for 4 surgeons on the
joint arthroplasty service n Supplemental reading: Medicare and
Hospital Prospective Payment System How DRG Rates are Calculated
and Updated
Slide 33
SBP at Penn State Hershey Week One l Interview and follow
patients l Morning nursing report l Risk/Quality Conference l
Interview care coordinators, therapists, utilization review l
Operating room processes l Transitions to OP care
Slide 34
Slide 35
How to measure the outcome?
Slide 36
Resident Feedback I am hopeful that with more courses such as
this, and the training of new interns about the pitfalls and
dangers of the system, that we can, with time, create overdue and
necessary changes to our healthcare system.
Slide 37
Resident Feedback The other two interns and I have already
spoken amongst ourselves regarding ways in which we, as individuals
and a small group who will progress through the ranks of the
orthopaedic residency program at Penn State, can affect the
necessary changes to our system.
Slide 38
Holy Grail?
Slide 39
Challenges The Faculty and More Senior Residents
Slide 40
Slide 41
Challenges Labor Intensive
Slide 42
Challenges If the ultimate outcome is improvement in patient
safety, quality and efficiency, there are countless other
confounding variables
Slide 43
Summary SBP has evolved from a peripheral and frustrating
nuisance to an integral component of resident education.
Slide 44
Slide 45
Systems Based Practice
Slide 46
Summary RVUs, coding, insurance, malpractice are each important
topics to understand, but
Slide 47
Summary 21 st century health care requires the application of
individual knowledge and skills to the excellence of a
multidisciplinary team
Slide 48
Summary l Based upon our two years of experience with this
rotation we believe: n This rotation is valued by the residents n
They are developing an improved understanding of the health care
system in which they work n They are developing an improved
understanding of the roles of other members of the health care
team
Slide 49
Summary l Based upon our two years of experience with this
rotation we believe: n They are developing an improved
understanding of issues pertaining to patient safety, quality and
efficiency relative to health care n They are developing an
improved understanding of the need for efficient, consistent
communication within the team