Page 1 of 24

West Midlands Clinical Senate Assembly Event

27th November 2019 Coventry University

Post-Event Evaluation

NHS England and NHS Improvement

Page 2 of 24

Contents

1. Introduction ………………………………………………………………………...... 3

2. Aims and Objectives ………………………………………………………………... 3

3. Event Planning, Promotion and Communications …………………………….… 4

4. Attendance ……………………………………………………………………………4

5. Mentimeter Presentation – Real Time Feedback ……………………………...…4

6. Lessons Learned and Recommendations …………………………………..…….5

7. Post-Event Survey (Evaluation) ……………………………………………….…...7

8. Appendix …………………………………………………………………………..…13

8.1 Appendix 1: Agenda ……………………………………………………..….13 8.2 Appendix 2: Save the Date ……………………………………………….. 15 8.3 Appendix 3: Online Registration ……………………………………….… 16 8.4 Appendix 4: Mentimeter Results ………………………………………..…17 8.5 Appendix 5: Survey (Evaluation) ………………………………………..…19 8.6 Appendix 6: Survey Comments ………………………………………..…. 21

Page 3 of 24

1. Introduction

The West Midlands Clinical Senate (WMCS) Assembly Event, 27th November 2019, focused on digital transformation within the NHS (Appendix 1) and was approved by the Federation of the Royal Colleges of Physicians of the United Kingdom for 3 category 1 (external) CPD credits.

The target group for the event included representatives from local Clinical Commissioning Groups (CCGs), WMCS Assembly and Council Members, clinical leaders, patient & public leaders, and other stakeholders interested in current digital development within the NHS. The event was also seen as a method of generating interest for WMCS Assembly membership from clinicians, professionals from public health & social care, academic health and science networks, and leaders with responsibility for the delivery of Sustainably Transformation Programmes (STP) and Integrated Care Services (ICS).

2. Aim and Objectives

The aim of the event was to bring together a diverse range of clinicians (from both the

WMCS Assembly and the regional health economy), and patient representatives to

learn about the future vision of the NHS. This was in regard to how innovation and

advancement in digital technology is supporting NHS professionals specifically in:

▪ contributing to improved quality to deliver safer care

▪ addressing health inequalities

▪ improving life expectancy

▪ delivering improved patient outcomes.

Event Objectives 1. Support and help raise the profile of the WMCS amongst stakeholders, increasing

stakeholders’ understanding of the work of the Senate and encourage engagement with the Senate’s work programme.

2. Contribute in developing productive relationships with key stakeholders (internal and external).

3. Promote the benefits of joining the WMCS and actively recruit to the Assembly.

Page 4 of 24

3. Event Planning, Promotion and Communication

A project plan was produced and supplemented with clearly defined roles and a communication plan, to ensure milestones were achieved and deliverables met. The event promotion was conducted with the support of the NHS England and Improvement (NHSE&I) Communications Team (Appendix 2) who circulated the event details to their counterparts across the West Midlands. Event details were also circulated to the following entities across the West Midlands footprint: NHS Trusts (including mental health), CCGs, STPs, ICSs, Local Authorities, other public sector services, Academic Health Science Network, Public Health England, Health Education England, WMCS Council and Assembly Members, Clinical Networks, Patient and Public Involvement Groups, NHSE&I Midlands Newsletter, and our nearest Clinical Senates (East Midlands, and East of England). Delegate Registration Delegates benefitted from online registration (Wufoo), allowing for quick and easy registration and tracking (Appendix 3).

4. Attendance

The event was attended by a range of professionals from different disciplines including managers, IT and digital leads, clinicians, and patient & public representatives from across the West Midlands. 122 delegates registered to attend the event, the day’s total attendance was 81 (30% Clinicians, 70% Non-Clinicians).

5. Mentimeter Presentation – Real Time Feedback

This year’s agenda included pre and post-event presentations allowing for real-time feedback. Mentimeter allowed the WMCS to engage with and assess the audience’s self-defined knowledge base. Delegates submitted their answers via their smart devices / laptops which instantaneously displayed the results on screen via bar charts or a word cloud. Delegates were asked three questions, one question pre-event and two questions post-event: Question 1: How would you rate your current knowledge of digitalisation within the

NHS? (pre-event question. 66 delegates responded). Question 2: How would you rate your current knowledge of digitalisation within the

NHS? (post-event question 49 delegates responded).

Page 5 of 24

Question 3: What have you learnt? (post-event question. word cloud allowed delegates to submit multiple comments).

Questions 1 and 2 provided a useful metric, with the results demonstrating a post-event increase in delegates’ self-reported knowledge of digitalisation (Appendix 4).

6. Lessons Learned and Recommendations

The following lessons learned, and recommendations, have been informed from experiential learning whilst project managing the event, and the post-event feedback forms. Agenda/Speaker Management

• A General Election was announced in late October 2019, the Keynote Speaker for this event withdrew due to purdah guidance relating to events, which asked employees to: ‘Avoid attending events where you may be asked to respond to questions about policy or on matters of public controversy. This may mean withdrawing from previously agreed engagements.’ The cancellation of the Keynote Speaker was handled smoothly, and a member of the WMCS Council was able to step in.

• Delays in circulating the agenda had an impact in achieving one of the objectives of the event (encouraging the attendance and recruitment of clinicians to the WMCS Assembly) as most clinicians require at least six weeks’ notice to attend learning events.

• During the event, some of the presentations ran over their allocated time which resulted in shortening the break period. Post-event, delegates requested that more time should be allocated for networking.

Recommendations:

• Ensure back-up speaker(s) are secured to provide cover for any cancellations.

• Dedicate time on the agenda to promote WMCS Assembly membership and the benefits of being a member.

• Improved management of confirmed speakers to ensure presentations and topic titles are delivered to time.

• Allow more time for delegates to network, extend Q&A sessions, and consider holding an all-day event.

Page 6 of 24

Delegates/Marketing/Communications

• 122 delegates registered to attend the event, the total attendance on the day was 81 (inclusive of WMCS staff and presenters). Approximately 30% of the delegates were clinicians, indicating the WMCS should improve its methods in increasing attendance from clinicians at future Assembly events.

• The WMCS catered for a figure under the actual number of delegates to help mitigate food wastage. Despite this, food wastage was still experienced after the lunch service.

Recommendations:

• Schedule reminder emails ahead of the event emphasising the importance of cancelling if a delegate is unable to attend. This should result in fewer non-attendances and less food wastage.

• Enlist support from presenters, WMCS Council and Assembly Members to disseminate and promote event information, particularly to clinicians.

• Twitter is a useful platform for engagement with clinicians, using the correct hashtags can generate discussions in a Twitter chat which can include topics to be presented at the event, or use influential names of confirmed event speakers to attract delegates. This could be facilitated by the West Midlands NHSE&I Communications Team.

• Promote on LinkedIn - this can be useful when attempting to attract a professional audience. The West Midlands NHSE&I Communications Team can publish on the NHSE&I LinkedIn page.

• NHSE&I Communications Team to promote and announce speakers as they are confirmed to generate interest.

Audio Visual Equipment

• Some delegates reported poor sound quality and requested better use of microphones.

Recommendation:

• The Chair could encourage delegates and presenters to use microphones during presentations and Q&A sessions.

Page 7 of 24

7. Post-Event Survey (Evaluation) Evaluation Methods Delegates were asked to complete a short survey, with reminders provided during and at the end of the event. The surveys were available in two formats:

1. Online (hosted on Microsoft Forms, accessed via smartphones/electronic devices)

2. Paper version (Appendix 5). The survey contained 12 questions, consisting of 8 rating scales and 4 open ended questions. Delegates were also encouraged to provide comments for each presentation. This mixture provided a useful balance of quantitative and qualitative data. The following rating scale was utilised: A follow-up email, and a link to the online survey, was circulated a few days after the event to capture those who did not have a chance to complete and return their evaluations on the day.

• 12 paper forms were completed and returned (11 on the day, 1 from the follow-up email)

• 18 forms were completed online.

• 30 out of 81 surveys completed = 37% response rate

Survey Analysis: Quantitative Data Table 1 shows the following information:

▪ The individual tallied scores for each presentation ▪ The combined score for each presentation (a graph can be found on page 12)

1 2 3 4 5

Not directly relevant in

current post but of interest

Not useful Fairly useful Useful Extremely useful

Page 8 of 24

Table 1: Combined Scores for Each Presentation

The following can be denoted from Table 1:

Presentations Combined

Score Total

Responses

Presentation 1: What Does Digital Mean to Me and My Patients – General Practice Perspective 118

30

Blank 1 2 3 4 5

0 0 1 8 13 8

Presentation 2: National Data Analysis to Support Improvement of Health and Care 110

30

Blank 1 2 3 4 5

0 1 0 11 14 4

Presentation 3: Digital Opportunities for The Midlands

111

Blank 1 2 3 4 5 30

0 0 2 9 15 4

Presentation 4: How to Implement Technology in The Workplace – Example from Staffordshire STP 115

30

Blank 1 2 3 4 5

0 0 2 9 11 8

Presentation 5: Mental Health Global Digital Exemplar Mental Health Data Sharing. The Merit Programme 124

30

Blank 1 2 3 4 5

0 0 0 7 12 11

Presentation 6: Ambulance Global Digital Exemplar. What Does This Mean for Staff and Patients? GED Programme – What Does This Mean for Other Organisations? 113

30

Blank 1 2 3 4 5

0 0 2 7 17 4

Presentation 7: Digital Services UHB Patient Perspective of Digital.

124

29 Blank 1 2 3 4 5

1 0 1 5 8 15

Page 9 of 24

• Presentations 5 and 7 were the highest scoring presentations, both scoring 124.

• Presentation 7 received the most ‘5’ ratings.

• All presentations (bar one) received scores from all 30 responders. This gap is denoted in the ‘blank’ column.

Delegates were also asked to rate the overall event, the results for which can be found below in Table 2: Table 2: Combined Score for Overall event

Overall Event Combined

Score Total

Responses

How useful did you find this event (overall)?

108

26

Blank 1 2 3 4 5

4 0 0 5 12 9

Page 10 of 24

118

110111

115

124

113

124

100

105

110

115

120

125

130

Presentation 1 Presentation 2 Presentation 3 Presentation 4 Presentation 5 Presentation 6 Presentation 7

Table 1: Combined Scores for Each Presentation

Page 11 of 24

Survey Analysis: Qualitative Data

• The survey provided an opportunity for qualitative feedback for each presentation (Appendix 6).

• Comments pertaining to the event overall were positive, with multiple comments provided for each section:

What were the

best and/or worst aspects of

this event?

What impact will this event have on your

future practice?

To what extent did the presenters provide a balance (evidence based where possible) view of the topics?

Any comments regarding the event overall?

Number of

comments 37 26 26 26

• Presentation 7 received the most positive comments, which demonstrated for this event that patient and public involvement added real value and a different perspective to the event.

• All comments were generally positive, particularly those which related to the event in general, with delegates stating they would review how digital can better aid their respective departments. Below shows themed analysis with examples of comments from the survey.

Range of topics covered All respondents commented positively. ▪ “Very interesting background which brought me up-to-date on the wider agenda” ▪ “Lots of practical examples to help my local NHS community take this huge

agenda in manageable chunks” ▪ “Excellent, varied and comprehensive” ▪ “I thought they provided a well-balanced view"

Organisation of the event All respondents responded positively.

▪ “High quality” ▪ “Very good” ▪ “Very enjoyable” ▪ “Well organised” ▪ “Excellent”

Page 12 of 24

Improvements for future events 1. Improving the sound quality and encouragement to use microphones for

speakers and Q&A sessions.

2. More time for networking.

3. More time for Q&A sessions. Summary There was a real appetite at the event to understand digital enablement in the NHS and Social Care Services. The event provided a platform for debate and discussion where key messages for NHSE&I were noted, these will be conveyed in the form of a short report to the regional team for further consideration. The qualitative and quantitative data from the event survey demonstrate that the delegates valued the presentations, particularly the patient perspective, and the ensuing question and answer sessions.

Page 13 of 24

8. Appendix

8.1 Appendix 1 – Agenda

Clinical Senate Assembly Event

What Does Digital Really Mean?

Wednesday 27th November 2019 09.00 to 13.00 hours

Venue – Coventry University, Technology Park, Puma Way

Coventry, CV1 2TT

Agenda

'West Midlands Clinical Senate Assembly Event' has been approved by the Federation of the

Royal Colleges of Physicians of the United Kingdom for 3 category 1 (external) CPD credit(s).

Timings Item(s)

Presented by

09:00

Arrival and Refreshments

09:30

Welcome, Introduction

Professor Adrian Williams Professor of Neurology Chair Neurosciences NNAG/CRG & West Midlands Clinical Senate

09:35

What Does Digital Mean to Me and My Patients - General Practice Perspective

Dr Masood Nazir GP and Managing Partner at Hall Green Health Associate CCIO for Primary Care Chief Clinical Information Officer| NHS Birmingham and Solihull Clinical Commissioning Groups

10.00

National Data Analysis to Support Improvement of Health & Care

Daniel Ray Director of Data (DSP, Analytics, Insights, Statistics, and Research Enablement) Professor of Health Informatics (hon) NHS Digital

10.15 Digital Opportunities for The Midlands Eddie Olla Director for Digital Transformation Midlands NHS England and NHS Improvement

Page 14 of 24

10:30

How to Implement Technology in The Workplace; Example from Staffordshire STP

Dr Ruth Chambers OBE Staffordshire STP’s Clinical Lead for Technology Enabled Care Services Programme, Digital Workstream and Honorary Professor Keele University, Visiting Professor Staffordshire University

10:45

Panel Q&A

11:05

Break & Networking

11:30

Mental Health Global Digital Exemplar Mental Health Data Sharing The Merit Programme

Dr James Reed Consultant Psychiatrist Chief Clinical Information Officer Birmingham and Solihull Mental Health NHS Foundation Trust

11:50

Ambulance Global Digital Exemplar What Does This Mean for The Staff and Patients? GDE Programme – What Does This Mean for Other Organisations?

Phil Collins Head of IM&T West Midlands Ambulance Service

12:10

Digital Services UHB Patient Perspective of Digital

Dr Tanya Pankhurst Consultant Nephrologist Director of Digital Healthcare University Hospital Birmingham Gary Taylor Patient Leader MyHealth Access Board of Trustees, PSC Support University Hospital Birmingham

12:30

Panel Q&A

12:50

Summary & Close

Professor Adrian Williams Dr Masood Nazir

13:00 LUNCH & Networking

All

Electronic copies of the presentations will be circulated after the event.

Page 15 of 24

8.2 Appendix 2 – Save the Date

Page 16 of 24

8.3 Appendix 3 – Online Registration

Page 17 of 24

8.4 Appendix 4 – Mentimeter Results

Page 18 of 24

Page 19 of 24

8.5 Appendix 5 – Survey (Evaluation) Form

Page 20 of 24

Online registration https://forms.office.com/Pages/ResponsePage.aspx?id=kp4VA8ZyI0umSq9Q55CtvxDmUNdF5fhClMuJVTd8jZlURjBVUVdDMlRPUUtZWEU2NDRYSE1WVVBXWC4u

Page 21 of 24

8.6 Appendix 6 – Survey Comments

How useful did you find this event (overall)?

The rooms acoustics weren’t very good, and the microphones didn’t really help including the roaming mikes among the audience, the questions were difficult to hear.

Presentation 1

Whether it was the rooms acoustics or just speaking very quickly, the presenter was rather difficult to understand.

Presentation 2

Very interesting background which brought me up to date on the wider agenda.

Presentation 3

No comments .

Presentation 4

Good examples

Lots of practical examples to help my local NHS community tackle this huge agenda in manageable ‘chunks’.

Presentation 5

Real explanation of practical application in the mental health trust.

Very clear.

Interesting in sharing the ‘works and all’ of a nine year programme

Presentation 6

Very understandable and interesting.

Pitched well for a mixed audience

Presentation 7

Hearing the patient rep presenter was the best.

The second part especially the patient rep

The patient rep presenter particularly good.

Great to hear patient view.

Brilliant.

Patient rep presenter - brilliant.

I particularly appreciated the patient rep presenter’s input as to what can be achieved for patients, recognising the huge gap in competence currently.

What aspects of the event did you enjoy? What could be improved upon?

All

The patient experiences. The West Midlands ambulance experience.

Usefulness to patients.

Patient perspective.

Everything was excellent.

Patient perspective.

Would have been positive to have non-medical CCIOs representing a diverse clinical leadership stance promoting wider professional representation in the Senate.

Patient perspective.

Some good content, some of it was repetitive and been seen at other events.

Very good speakers. Acoustics in venue challenging. More networking opportunity.

Page 22 of 24

More space for networking around coffee area. Time very limited, so presenters rushing through content. Audio quality could be better. More encouragement to use microphones.

I was impressed with the way the patient experience and outcomes were considered as part of most of the presentations. There is a need for more technical people of explain their work more clearly and stop using acronyms.

Mental Health Talk.

Mental health examples.

Presenter 5

Understanding of how digital can be implemented and facts.

Questions

Brisk presentations, very focused.

Good overview

Insight and networking.

Enjoyed update on patient care.

Good networking

Overall picture of current situation.

Variety of talks, networking

Wide range of presentations offered interesting perspective.

Good mixture of national overview and regional initiatives. Really pleased to see patient perspective.

What impact will this event have on your future practice?

Better understanding of digital

I have taken away ideas for change management and benefits

Look into digital innovations which help my patients

Will reflect on digital options

Not sure already bought in for the change but implementation is multi stake holder job but optimistic for future.

Useful to connect with partners about their experiences.

As a commissioner I will continue to pursue the digital agenda particularly by engaging clinicians.

Increase focus on sharing of information and lessons required regionally and nationwide.

Generally helpful and some useful takeaways

Encourage sharing of experience and benefits between GP practices and NHS trusts

I am going to develop a digital enabler to prescribing end of life drugs

At Healthwatch Warwickshire we are undertaking a project on Digital and has provided a clear insight into thoughts and benefits from a clinical point of view. It will allow us to communicate some of these elements to the public where there is a thirst for communication to work better vs concerns over security and affordability of connection or lack of knowledge on how to use new systems. Taking people on the journey is essential as is changing cultures and trust.

Aware

Helps learning to develop digital priorities for mental health.

More enthusiasm for pushing our hospital to develop more technology

Some good ideas to take into IAPT

Looking to use data for improvement

Significantly

Page 23 of 24

More confidence in embracing/supporting digital.

Review how IT can aid my own/department’s practice.

More aware of local programmes.

Positive change.

Will share with West Midlands Healthwatch network.

More focused on small digital wins.

Keep enthusiastic.

To what extent did the presenters provide a balance (evidence based where possible) view of the topics?

At times.

Good examples of what worked and didn’t.

Variable.

Good.

Excellent, varied and comprehensive.

Not sure but personal experience from people does support the idea.

As far as they could - more examples of co-production would be useful to share.

Very well.

Fair.

I thought they provided a very balanced view.

Difficult to answer.

Yes.

Very well.

Could be more practical.

Yes, very well.

Very balanced.

Good.

Good question and answer session.

Evidence base involved.

Very good.

Minimal evidence-based view. Little on real impact on outcomes.

Overall yes, some danger of elevating expectations, without addressing culture and legacy.

Mostly.

Very good.

Very good.

Not strong but time limited. Poorly addressed.

Any comments regarding the event overall?

Really useful event

Good event

Excellent

Location slightly difficult to access for traveling by road

Would appreciated a focus on more inclusive engagement with colleagues and patients. Behaviour change, and modelling is key to invest in workforce

Good event maybe more needed on solutions and more time for questions?

Good.

Great collection of expertise in one place. Would be good to expand access to these people in collaborative groups.

Very good.

Excellent- learned a lot. Well done.

Page 24 of 24

Helpful and informative.

Excellent event - need more time for networking.

Good.

All good.

Many thanks.

High Quality.

Very good, poor time management.

Good.

Good venue.

Some of the ‘the’ language was (for me) difficult to follow, but a copy of the presentation will help me.

Very enjoyable – feel enthused

A lot about development of apps, requiring the patient to initiate the interaction but no real discussion on ‘remote’ links between clinicians to allow direct access to expert opinions. I like the final question - what would panel members want from digital enablement of their healthcare.