Introductory Supervision Training Day 3: Evaluation

Katherine Hildyard & Katharine Boon June 2015

Aims for the morning…

n  To review your learning and development n  To consider evaluation from trainee and

supervisor perspectives n  To increase awareness of trainee evaluation

– the how and the what n  Dealing with difficulties – what happens

when things go wrong and how to handle them

Reviewing Learning and Development

n  Clarifying your expectations; what are you hoping to get from today?

n  Discuss your learning and development so far

n  Identify your needs

Evaluating Competency from Different Perspectives

n  ‘Evaluation troubles most supervisors’ n  Bernard and Goodyear, 2013

Exercise: 1 – Challenging Scenarios . . .

n  Do any of these YouTube clips resonate with you?

n  What are the issues relevant to evaluation?

n  http://www.youtube.com/watch?

v=wfWvWDymehY

n  http://www.youtube.com/watch?v=xlgJI1ZpJ1M

n  http://www.youtube.com/watch?

v=PrzlUw8Xdek

Exercise 2

n  What does the term ‘evaluation’ mean to you?

n  What difficulties/dilemmas can occur in evaluation processes?

n  How might these difficulties be overcome?

Understanding the Trainee’s Context

n  A model by Michael Carroll of: n  – Survival mode n  Versus n  – Competency mode (frontal lobe)

Survival Mode

n  Fight n  Flight n  Freeze n  Fragment

Frontal Cortex Thinking

Frontal Cortex Thinking: The biology of meaning-making

n  Plans for the future n  Imagination and prediction n  Self development n  Ability to reflect n  Introspection n  Ethical decisions n  Managing emotions n  Creativity and change – “open mind, open

heart, open will”, (Scharmer 2007)

Frontal Lobe Cortex (cont’d)

n  Speaking n  Writing n  Reasoning n  Abstracting n  Problem solving

(Carroll, Centre for Supervision Training, 2009)

A Compassionate Mind perspective: Gilbert, 2009

Drive seeking and acquisition focused system

Designed to pay attention to advantageous resources and experience ‘activation’ to try to acquire them and pleasure in pursuing and securing them.

Threat and self-protection focused system Designed to attract attention to, detect, process and respond to threats.

Designed to enable a state of peacefulness and openness when individuals are no longer threat focused or seeking resources.

Contentment, soothing and affiliative focused system

Exercise 3

n  1. How can you recognise if you or your trainee are in survival mode?

n  2. What might be useful to help you / your trainee to move into competency mode?

Measures of Supervisor Competency

n  Trainee competency – pre and post supervision

n  Client outcome (supervisee’s clients) n  Supervisee feedback n  External ratings / feedback – e.g. ‘the

Session Rating Scale’, supervision of supervision

Issues Relating to Supervisor Competency Evaluation

¡  Generic versus specific model of therapy ¡  Generic versus specific model of

supervision n  Method of evaluation – Reliable and

valid measure n  Who evaluates – self, supervisee,

supervisor, external person

Evaluating Trainee Competencies: A Model of Good Practice

n  Contract with the trainee within the first 2-3 weeks of the placement. Be specific about what is expected using the course documentation as guidance.

n  Be explicit about your own model of competence.

n  Negotiate the need to ‘challenge’. n  Use direct observation (sitting in, audio or video

tapes, live supervision) on which to form your opinion and be explicit about which aspect of the trainee’s work you are assessing.

n  Use objective measures if applicable.

Evaluating Competencies: A Model of Good Practice cont’d

n  Be aware of any barriers from either you or the trainee, which may affect the possibility of open reflecting on skills.

n  Be open throughout (there should be no surprises at formal evaluation points).

n  Consider the need for your supervision on being a supervisor.

n  Use the clinical tutor for advice and follow the course guidelines if there are any major areas of concern.

A new way of evaluating . . .model specific competencies

n  Evaluation of CBT competencies – Roth & Pilling

n  CAT, Systemic, Psychodynamic competency frameworks

n  Count towards accreditation in a model specific therapy . . .?

Methods of Evaluation:

n  Competencies assessed by supervisor using Assessment of Clinical Competence at mid and end of placement on 8 competencies

n  Case Studies (1-4) in first 2 years of training

n  Log books (self appraisal)

Other Methods of Evaluation - Course

Formal: n  Literature review, single case study, service

evaluation, SAQs n  Formative feedback from service users and

staff members during clinical skills teaching n  Assessment of clinical skills (CSA-RF) Informal: n  PBEIS / Core-Net n  Research and case study presentations

General Methods of Evaluation

n  Live supervision/Joint working n  Role-playing within supervision n  Formal / objective measures n  Feedback from trainee – self report n  Feedback from service users/carers

(e.g. Friends & Family Test)

n  Feedback from colleagues e.g. team members

n  Case notes

n  Supervision records n  Letters/reports n  Audio tapes n  Video tapes n  Presentations n  Exercises/role plays

Tackling Difficulties n  Tackle it when you see it – competency mode n  Listen to the individual – don’t make

assumptions n  Negotiate how and when the feedback can be

given n  Be clear and consistent about the message n  Avoid a defensive or confrontational

approach n  Understand your own philosophy re. learning

(remember Kolb)

Kolb’s Learning Cycle

Tackling Difficulties (cont’d)

n  Don’t ask people to do what you haven’t done yourself

n  Deal with the emotion (watch for shame)

n  Use the relationship – and be aware of what you bring to this

n  Ask for help! n  And follow due process

Exercise 5: Role Plays

n  Identifying and managing difficulties in evaluation processes

n  Managing placement failure issues

A Model of Core Qualities

n  1. Core quality n  2. Pitfall n  3. Allergy n  4. Challenge n  Ofman 2001

Exercise 6

n  Use the model for one of your own core qualities

n  Can you identify a core quality of someone you are supervising?

n  How might you use this model to give feedback const ruc t ive ly w i th in supervision – and help you manage difficulties?

You might want to think about the following . . .

Peer Supervision

n  Peer supervision groups n  Your next assignment

Action Plans

n  Review what you have learnt today n  Consider your learning in the next six

months n  Plan what steps you can actively take

to ensure this learning occurs n  GAS form

Questions and Reflections ?

n