2_[K2]_Fischer

Embed Size (px)

Citation preview

  • 8/14/2019 2_[K2]_Fischer

    1/46

    ICVP-Conference - Krakow June 5th, 2009 1

    Virtual patients: From pragmaticimplementation to educational research

    and back Martin Fischer, MD, MME (Berne)

    Institute for Teaching and Educational Research in Health SciencesMedical Faculty

    Private University Witten/[email protected]

  • 8/14/2019 2_[K2]_Fischer

    2/46

    ICVP-Conference - Krakow June 5th, 2009 2

    Circumstances matter1989 until now

  • 8/14/2019 2_[K2]_Fischer

    3/46

    ICVP-Conference - Krakow June 5th, 2009 3

    http://rcpsc.medical.org/canmeds/index.php

  • 8/14/2019 2_[K2]_Fischer

    4/46

    ICVP-Conference - Krakow June 5th, 2009 4

    We have done it like

    this for a long timeWhy change?

    Show me the data.

    What is the evidence?

  • 8/14/2019 2_[K2]_Fischer

    5/46

    ICVP-Conference - Krakow June 5th, 2009 5

    ICT and Learning: Instruction vs.construction

    Valcke & De Wever 2005

  • 8/14/2019 2_[K2]_Fischer

    6/46

    ICVP-Conference - Krakow June 5th, 2009 6

    What is a virtual patient?

    A virtual patient has been defined as "aninteractive computer simulation of real-life

    clinical scenarios for the purpose of healthcare and medical training, educationor assessment" (Ellaway, Candler et al.,2006).

  • 8/14/2019 2_[K2]_Fischer

    7/46

  • 8/14/2019 2_[K2]_Fischer

    8/46ICVP-Conference - Krakow June 5th, 2009 8JAMA 2009

  • 8/14/2019 2_[K2]_Fischer

    9/46ICVP-Conference - Krakow June 5th, 2009 9

    in concluding that Internet-based learning iseducationally beneficial and can achieve resultssimilar to those of traditional instructional methods.

    Cook et al. JAMA 2009

  • 8/14/2019 2_[K2]_Fischer

    10/46ICVP-Conference - Krakow June 5th, 2009 10

    Elucidating how to effectively implementInternet-based instruction will be answered mostefficiently through research directly comparingdifferent Internet-based interventions.

    Cook et al. JAMA 2009

    2193 studies identified

  • 8/14/2019 2_[K2]_Fischer

    11/46ICVP-Conference - Krakow June 5th, 2009 11

  • 8/14/2019 2_[K2]_Fischer

    12/46ICVP-Conference - Krakow June 5th, 2009 12

    Best Evidence Medical Education(BEME)A legitimate child of Evidence-based Medicine

    Best evidence medical education (BEME) is theimplementation, by teachers in their practice, of methods and approaches to education based on

    the best evidence available.

    It involves a professional judgement by theteacher about their teaching taking into account

    a number of factors []

    Harden 1999

  • 8/14/2019 2_[K2]_Fischer

    13/46ICVP-Conference - Krakow June 5th, 2009 13

    BEME: Q U E S T SA multi-dimensional approach

    1. Q uality: How good is the evidence?

    2. U tility: To what extent can the method be transferred anadopted without modification?

    3. E xtent What is the extent of the evidence?

    4. S trength How strong is the evidence?

    5. T arget What is the target? What is being measured? Howvalid is the evidence?

    6. S etting? How close does the context or setting approximatHow relevant is the evidence?

  • 8/14/2019 2_[K2]_Fischer

    14/46ICVP-Conference - Krakow June 5th, 2009 14

    Harden et al. Medical Teacher 1999

  • 8/14/2019 2_[K2]_Fischer

    15/46ICVP-Conference - Krakow June 5th, 2009 15

    Medical EducationResearch

    Those who cant do teach. Those who cant teach

    teach how to teach. Those who cant teachhow to teach do research

    on teaching.adapted from Bernhard ShawThe doctor's Dilemma 1906

  • 8/14/2019 2_[K2]_Fischer

    16/46

    Winner of the 50.000 Karolinska InstitutetAward for Excellence in Research into MedicalEducation.

    Who will be next?

    R. HardenGP, Endocrinologist

    Scotland

    H. SchmidtPsychologistNetherlands

    G. NormanEpidemiologist & Statistician

    Canada

    A VP-researcher from Europe?

  • 8/14/2019 2_[K2]_Fischer

    17/46

    ICVP-Conference - Krakow June 5th, 2009 17

    More research needed...

    Descriptive studies (What wasdone?)

    Justification studies (Did it work?)

    Clarification studies (Why or how did

    it work?)H. Schmidt, AMEE 2005

  • 8/14/2019 2_[K2]_Fischer

    18/46

    ICVP-Conference - Krakow June 5th, 2009 18

    And the distribution is

    110 articlespublished in 2003 and 2004 inAcad MedicineAdv in Health Sciences Education

    American J of Surgery J of General Internal MedicineMedical Education

    Teaching and Learning in Medicine

    75 (72%) justification studies17 (16%) description studies13 (12%) clarification studies

    Cook, Bordage & Schmidt; Med. Educ. 2008

  • 8/14/2019 2_[K2]_Fischer

    19/46

  • 8/14/2019 2_[K2]_Fischer

    20/46

    ICVP-Conference - Krakow June 5th, 2009 20

    Adding subtitles

    Localization (medical documentation)

  • 8/14/2019 2_[K2]_Fischer

    21/46

  • 8/14/2019 2_[K2]_Fischer

    22/46

    ICVP-Conference - Krakow June 5th, 2009 22

    Credits drives case use

    0

    50

    100

    150

    200

    250

    300

    350

    20.05.2004 27.05.2004 03.06.2004 10.06.2004 17.06.2004 24.06.2004

    Psychology, n=3009

    Internal Med I, n=939

    Internal Med II, n=18Tuesday

    Sessions

    Hege et al. 2007

  • 8/14/2019 2_[K2]_Fischer

    23/46

    ICVP-Conference - Krakow June 5th, 2009 23

    Learning by teaching: law FacultyLMU

    Students create their own case in smallteams in a tutorial context with assistance of a content expertCredits for completed case (after

    presentation)Status quo: 33 cases (21 peer reviewed)created by 45 studentsPromising acceptance, motivation andsuccessIntegration of the cases into the curriculumafter review

    Hege et al. 2007

  • 8/14/2019 2_[K2]_Fischer

    24/46

    ICVP-Conference - Krakow June 5th, 2009 24

    Voluntary use and a case-basedexam

    200 students attend an integrated PBL course(rheumatology, emergency med., orthopedics,traumasurgery).

    10 exam-related cases are provided asvoluntary learning tool.Exam case (paper/online)

    High acceptance

  • 8/14/2019 2_[K2]_Fischer

    25/46

    ICVP-Conference - Krakow June 5th, 2009 25

    Assessment drives the case use

    0

    50

    100

    150

    200

    250

    300

    350

    400

    25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0

    Summerterm 03

    Winterterm 02/03

    Sessions

    Days prior to exam

  • 8/14/2019 2_[K2]_Fischer

    26/46

    ICVP-Conference - Krakow June 5th, 2009 26

    Combining VPs

  • 8/14/2019 2_[K2]_Fischer

    27/46

  • 8/14/2019 2_[K2]_Fischer

    28/46

    ICVP-Conference - Krakow June 5th, 2009 28

    Clinical skills online CAU &LMU: Blended Learning

    Karsten et al. 2009

    Face-to-face: Course physical examination

    Summative assessment - OSCE

    Typical cases plusbasics Skills lab training

    Questions for formative self-assessment

    Case (1):Introduction of

    Patient

    Theoreticalbasics

    Presentation &Explanation

    of skills

    Case (2):Cont. &

    finish

    Questions for formative self-assessment

  • 8/14/2019 2_[K2]_Fischer

    29/46

  • 8/14/2019 2_[K2]_Fischer

    30/46

    ICVP-Conference - Krakow June 5th, 2009 30

    Obstetrical skills CTG-interpretation

    high-fidelity

    low-fidelity

    high-fidelity

    low-fidelity

    2

    4

    6

    8

    10

    12

    *

    5

    10

    15

    20

    *

    A B

    High- versus Low-Fidelity

    Scholze, Jenderek et al. 2009 (submitted)

  • 8/14/2019 2_[K2]_Fischer

    31/46

    ICVP-Conference - Krakow June 5th, 2009 31

    Induction of fetal lung maturity anddelivery after 48 h

    Oxytocin i.v. to accelerate contractions

    Ventouse extraction

    Immediate delivery by cesareansection

    CT-scan to exclude pulmonary embolism

    1

    2

    3

    4

    high-fidelity

    low-fidelity

    5

    6

    Obstetrical decision making

    Maternal paramters HR: 115 bpmNIBP: 105/60 mmHgRR: 25 bpmTemp.: 38.2 oC

    Pelvic examination Dilatation: early effacementPresentation: Vertex; LOAStation: -4

    Plan

    28 (1G/0P) 34.5 weeks of gestation.Estimated fetal weight on 10th percentile.lower UTI - treated withAmocixillin (500mg, po, tid) since 24h

    History

    CTG

    x

    High- versus Low-Fidelity

  • 8/14/2019 2_[K2]_Fischer

    32/46

    ICVP-Conference - Krakow June 5th, 2009 32

    Worked examples: learning fromerrors

    Objective: fostering medical students` diagnostic knowledge:conceptual knowledgestrategic knowledgeconditional knowledge

    Worked examples with errors versus without errors

    Errors as learning opportunities (Oser, 2005), but: errors needto be understood to foster learning

    Elaborated feedback versus knowledge of result (KOR-)feedback

    Elaborated feedback facilitates understanding in complexdomains

  • 8/14/2019 2_[K2]_Fischer

    33/46

    ICVP-Conference - Krakow June 5th, 2009 33

    Design & Instruments forAssessing diagnostic knowledge

    Conceptual knowledgeMultiple-choice (MC) tests, 23 items

    Strategic knowledge10 key-feature problems

    Conditional knowledge3 problem-solving tasks

    Feedback format

    elaborated KOR

    Example format

    with errors n = 38 n = 38

    without errors n = 39 n = 37

  • 8/14/2019 2_[K2]_Fischer

    34/46

    ICVP-Conference - Krakow June 5th, 2009 3434

    Results for Arterial hypertension

    Main effect error: p < .05, Interaction effect: p < .01

    40

    42

    44

    46

    48

    50

    with errors without errors

    elaboratedFeedback

    KOR

    Kopp et al. 2008

    S

    c o r e

    ( p o

    i n t s )

    N = 153 medical students

    Findings replicated for hyperthyroidismSustained effect in the field

  • 8/14/2019 2_[K2]_Fischer

    35/46

    ICVP-Conference - Krakow June 5th, 2009 35

    Session Manager Learning Systems

    Holzer et al. 2005

    From CASEPORT

  • 8/14/2019 2_[K2]_Fischer

    36/46

    ICVP-Conference - Krakow June 5th, 2009 36

    to the eViP Project

    http://www.virtualpatients.eu

    3-years project co-funded by the EuropeanUnion until Sept. 2010, 4 systems, 9 partners

    Aims

    Creating large international repository of virtual patientsSharing/exchanging of virtual patientsRepurposing of virtual patientsImplementation of virtual patients into thelocal medical curricula

  • 8/14/2019 2_[K2]_Fischer

    37/46

    ICVP-Conference - Krakow June 5th, 2009 37www.ims-m.de

    Item-banking and VP-systems

  • 8/14/2019 2_[K2]_Fischer

    38/46

  • 8/14/2019 2_[K2]_Fischer

    39/46

    ICVP-Conference - Krakow June 5th, 2009 39

    Theory-grounded

    vs.pragmatic approaches?

  • 8/14/2019 2_[K2]_Fischer

    40/46

    ICVP-Conference - Krakow June 5th, 2009 40

    Quantitative

    vs.Qualitative?

  • 8/14/2019 2_[K2]_Fischer

    41/46

    ICVP-Conference - Krakow June 5th, 2009 41

    Interprofessional

    andInter-institutional?

  • 8/14/2019 2_[K2]_Fischer

    42/46

    ICVP-Conference - Krakow June 5th, 2009 42http://www.gmc-uk.org/education/index.asp

    Room for improvement

    Finally, although our findingsregarding the quality of thisbody of research are notunique to research inInternet-based instruction,therelatively low scores for methodological quality andthe observed reporting

    deficiencies suggest room for improvement.

    Cook et al. 2009

  • 8/14/2019 2_[K2]_Fischer

    43/46

    More challenges to do research on

    e-Learning/virtual Patients Peer-assisted learningCommunicationInterprofessional learningSimulationsAssessmentFaculty developmentProfessionalismStudent selectionMentoringCME/CPD

    .

  • 8/14/2019 2_[K2]_Fischer

    44/46

    ICVP-Conference - Krakow June 5th, 2009 44

    Perspectives

    More research on case-basedlearning needed (from VPs to realpatients and back)Integration of learning assessmentFostering interdisciplinary andinterinstistutional approaches

  • 8/14/2019 2_[K2]_Fischer

    45/46

    ICVP-Conference - Krakow June 5th, 2009 45

    Outcomes: Improving patient care!

  • 8/14/2019 2_[K2]_Fischer

    46/46

    Many thanks!

    [email protected]