1

EU-ACME PROGRAMME

From attendance control to knowledge assessment

3 European CME Forum16-17 November 2010, Berlin

Prof. Dr. H. MadersbacherChairman EU-ACME OfficeB. AdamczykManager EU-ACME

„„CME CME –– A Lifelong CommitmentA Lifelong Commitment““

2

EU-ACME Committee and Programme

Committee:� Constituted on January 6th, 2004.� A joined committee of the European Association of

Urology (EAU) and the European Board of Urology (EBU).� Three member of both, the EAU and the EBU, are

represented in the EU-ACME committee.

Main goal of the programme:� To assist national and international urological societies

in the implementation, promotion and organization of the CME/CPD credit management system among European urologists.

� registration and administration of CME/CPD credit points.

3

EU-ACME programme

Status 2010

� National urological societies - 2121Direct:Direct: Austria, Bulgaria, Cyprus, Estonia, Greece, Latvia, Malta, Poland, Serbia, Slovak Republic, Spain, the Netherlands

Via EAU:Via EAU: Czech Republic, Denmark, Finland, Hungary, Italy, Norway, Romania, Slovenia, Turkey

� International urological societies - 33European Association of Urology, European Society of Paediatric Urology, International Continence Society

2010 2010 -- more than more than 1800018000urologists urologists –– including EAU including EAU

Junior MembersJunior Members

2009 2009 -- 40 %40 % actively actively collected creditscollected credits

4

EU-ACME programme

The EU-ACME office offers:

� Registration of accredited CME events

� Registration and administration of credits for members of EU-ACME programme

� The EU-ACME membership card

� Access to the online CME/CPD credit management system via www.eu-acme.org

� Yearly Credit Registry Report for participating urologists

� On-site assistance for attendance control

� Assistance in obtaining European accreditation for the international CME events from the EBU/EACCME.

Table scanners and EUTable scanners and EU--ACME cardACME card

EU-ACME programme

6

EU-ACME programme

On-site assistance in organising electronic attendance control

Estonian Urological SocietyEstonian Urological SocietyTallinn Tallinn -- EstoniaEstonia

ESPU Annual MeetingESPU Annual MeetingBrugge Brugge -- BelgiumBelgium

7

8

EU-ACME programme

Who used already knowledge testing for CME?

1. Pre-course evaluation

2. Post-course evaluation

3. Pre- and post-course evaluation

9

From attendance controlFrom attendance control

to knowledge assessmentto knowledge assessmentFor the fist time in two ESU courses the gained knowledge was assessed by pre and post knowledge evaluation by using the MCQs; The participants were asked to answer the MCQs before the course starts and again the same MCQs after the course.

Course 4Course 4 ––RetropubicRetropubic radical prostatectomy radical prostatectomy –– tips, tricks and pitfallstips, tricks and pitfalls-- Chair: H. Van Poppel, Leuven (BE)Chair: H. Van Poppel, Leuven (BE)Course 9Course 9 –– Advanced management of urethral stricture diseaseAdvanced management of urethral stricture disease–– Chair: C.R. Chapple, Sheffield (GB)Chair: C.R. Chapple, Sheffield (GB)

Moreover 3 months after the course participants were contacted to ask them about an ongoing benefit of this course (method/pilot).

EU-ACME programme

10

ESU Pilot Pre and post course evaluationResults – ESU Course 4 and 9

Course 4Course 4•• registered registered –– 105105•• present present –– 7171•• 5 MCQs5 MCQs4545 participants took part participants took part in this pilot pre and post in this pilot pre and post knowledge evaluationknowledge evaluation

Course 9Course 9••registered registered –– 8282•• present present –– 6969•• 7 MCQs7 MCQs3636 participants took part in pilot pre and post participants took part in pilot pre and post knowledge evaluationknowledge evaluation

11

ESU Pilot Pre and post course evaluationResults – ESU Course 4

1. In open retropubic radical prostatectomy the pubo-prostatic ligaments:

11

0

94

56

80

112

13 13

0

10

20

30

40

50

60

70

80

90

100

must bepreserved to

improvecontinence

must be ligated toavoid bleeding

must besectioned forproper apicalpreparation

are an extensionof the endopelvic

fasia

No answ er

BEFORE AFTER

%

12

ESU Pilot Pre and post course evaluationResults – ESU Course 9

2: The Johansen procedure described in 1953 is:

%

11 83 3 3 0

72

56

11

33

0

10

20

30

40

50

60

70

80

90

100

a one stagetechnique using a

skin f lap

a posteriorurethroplasty

using a bladdertube

a meatoplastyusing bladder

mucosa

a tw o stagetechnique

No answ er

BEFORE AFTER

13

ESU Pilot Pre and post course evaluationResults – ESU Course 9

3: Optical urethrotomy is:

39

25

17

39

30

25 28

17

8

0

10

20

30

40

50

60

70

80

90

100

more successfulthan urethral

dilatation

unlikely to besuccessful w ith a

penile urethralstricture

associated w ith a70% success ratefor strictures of 2-

3cm in length

associated w ith a30% success rate

after previousfailed urethrotomy

No answ er

BEFORE AFTER

%

14

EU-ACME programmeESU 4 Comparison before - after

0

1

1

2

2

3

3

4

4

5

5

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45

Candidate

Sco

re

score beforescore after

SCORES BEFORE AND AFTER

66% improved

14% unchanged

20% worse

15

EU-ACME programme

0

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 52 54 55 56 57 58

score before score after

ASU – comparison before and afterSCORES BEFORE AND AFTER

78% improved

15% unchanged

7% worse

Evaluation questions Evaluation questions –– 3 months after the pilot3 months after the pilot

EU-ACME programme

13 participants have returned completed evaluation form

0 2 6 5

1 8 2 2

0 2 8 3

0% 20% 40% 60% 80% 100%

1.Did this course increase yourknowledge?

2. If yes, did the gain ofknowledge change your daily

practice?

3. If did not change your dailypractice, did the course provide

positive reassurance of whatyou are currently doing in your

daily practice?

no a little much very much

Information from pre and post course knowledge Information from pre and post course knowledge assessmentassessment

• For the participants (urologist)For the participants (urologist)

� How good was my knowledge before the course – mayor deficits?

� Could I increase my knowledge, did I perform better afterwards?

• For the lecturerFor the lecturer

� Was my estimation of participants knowledge adequate (content of the lecture)?

� Could I improve the participants knowledge?

� Were the MCQs adequate?

EU-ACME programme

AnalysisAnalysis

EU-ACME programme

Content:• Quality of presentations• Chosen method of education• Length of the session

Measures:• Quality of the MCQs• Questions not related to the content

• Number of questions• Time for reading and answering the questions

Faculty:• Language issue• Chosen teaching method• Teaching skills• Working with new tool

Learners:Learners:•• Language issueLanguage issue•• Target groupTarget group•• New tool (ARS)New tool (ARS)

Procedure: Procedure: •• Clear goal of the trainingClear goal of the training•• Presentations and questions Presentations and questions delivery timedelivery time

•• Not mandatoryNot mandatory

Facility:Facility:•• Number of participants in a Number of participants in a lecture roomlecture room

•• Lecture room set upLecture room set up

19

GENERAL REMARKSGENERAL REMARKS

• The knowledge of the participants increased after the course.

• Questions and answers should be clearly stated - only one answer should be possible without doubts.

• More time for reading and answering questions.

EU-ACME programme

Future Aspects Future Aspects –– Pre and post knowledge testPre and post knowledge test

•Implementation for more ESU courses during the EAU congress – 8 courses in 2011

•Implementation at national meetings for some parts of the scientific programme with logistic support of the EU-ACME office.

EU-ACME programme

21

EUEU--ACME goals related to pre and post evaluationACME goals related to pre and post evaluation

• Promotion of pre and post knowledge evaluation among European national urological societies

• Assistance in implementation / organisation of knowledge assessment (pre and post course evaluation) at national and international meetings

EU-ACME programme

22

All about the EU-ACME programme:

www.euwww.eu--acme.orgacme.org

EU-ACME Office

Mr. E.N. van Kleffenstraat 5PO Box 300166803 AA ArnhemTel.: +31 (0) 26 3890846Fax: +31 (0) 26 3890848E-Mail: eu-acme@uroweb.orgTwitter @euacme

EU-ACME programme