43
MOBILIZING FOR IMPACT David Phipps, PhD. MBA, Executive Director, Research & Innovation Services @researchimpact

Research impact assessment workshop eawag 170317

Embed Size (px)

Citation preview

Page 1: Research impact assessment workshop eawag 170317

MOBILIZING FOR IMPACT

David Phipps, PhD. MBA, Executive Director, Research & Innovation Services @researchimpact

Page 2: Research impact assessment workshop eawag 170317

Time Activity 1330-1400 Research Impact Planning - tool 1400-1430 Research Impact Assessment - tool 1430-1515 Research Impact Assessment case study

1515-1530 Break 1530-1600 Skills and Qualities of Knowledge Brokers 1600-1620 Research impact at Eawag 1620-1630 Summary and Farewell

Page 3: Research impact assessment workshop eawag 170317

Planning for Impact

Page 4: Research impact assessment workshop eawag 170317

http://www.kmbtoolkit.ca/

Page 5: Research impact assessment workshop eawag 170317
Page 6: Research impact assessment workshop eawag 170317
Page 7: Research impact assessment workshop eawag 170317
Page 8: Research impact assessment workshop eawag 170317
Page 9: Research impact assessment workshop eawag 170317
Page 10: Research impact assessment workshop eawag 170317
Page 11: Research impact assessment workshop eawag 170317

What type of indicators will you use to measure your KMb efforts? Reach indicators (# distributed, # requested, # downloads/hits, media exposure) Usefulness indicators (read/browsed, satisfied with, usefulness of, gained knowledge, changed views) Doing more with what you know • use indicators (# intend to use, # adapting the information, # using to inform • policy/advocacy/enhance programs, training, education or research, # using to improve practice or

performance) Partnership/collaboration indicators (# products/services developed or disseminated with partners, # or type of capacity building efforts, social network growth, influences, collaborativeness) Practice change indicators (intent or commitment to change, observed change, reported change) Program or service indicators (outcome data, documentation, feedback, process measures) Policy indicators (documentation, feedback, process measures) Knowledge change (quantitative & qualitative measures) Attitude change (quantitative & qualitative measures) Systems change (quantitative & qualitative measures)

Page 12: Research impact assessment workshop eawag 170317
Page 13: Research impact assessment workshop eawag 170317

Questions about planning for impact?

Page 14: Research impact assessment workshop eawag 170317

Impact Assessment (it’s more than just here)

Page 15: Research impact assessment workshop eawag 170317
Page 16: Research impact assessment workshop eawag 170317

Knowledge Mobilization

Communications 1 2

3a

3b

Page 17: Research impact assessment workshop eawag 170317

What type of indicators will you use to measure your KMb efforts? Reach indicators (# distributed, # requested, # downloads/hits, media exposure) Usefulness indicators (read/browsed, satisfied with, usefulness of, gained knowledge, changed views) Doing more with what you know • use indicators (# intend to use, # adapting the information, # using to inform • policy/advocacy/enhance programs, training, education or research, # using to improve practice or

performance) Partnership/collaboration indicators (# products/services developed or disseminated with partners, # or type of capacity building efforts, social network growth, influences, collaborativeness) Practice change indicators (intent or commitment to change, observed change, reported change) Program or service indicators (outcome data, documentation, feedback, process measures) Policy indicators (documentation, feedback, process measures) Knowledge change (quantitative & qualitative measures) Attitude change (quantitative & qualitative measures) Systems change (quantitative & qualitative measures)

Page 18: Research impact assessment workshop eawag 170317

Collecting the evidence of impact

documents, testimonials, surveys

throughout

interviews

end users / partners

demonstrate impact

on line, in person

Impact

Page 19: Research impact assessment workshop eawag 170317
Page 20: Research impact assessment workshop eawag 170317
Page 21: Research impact assessment workshop eawag 170317

• 6,975 impact case studies • 149 fields of research • 60 impact topics • 36 UoAs • 3,709 unique pathways to impact • £7,000/REF submission (estimate)

Page 22: Research impact assessment workshop eawag 170317
Page 23: Research impact assessment workshop eawag 170317
Page 24: Research impact assessment workshop eawag 170317
Page 25: Research impact assessment workshop eawag 170317
Page 26: Research impact assessment workshop eawag 170317

Reflecting on your own research project/program: 1. Review the sections in the template with reference to the

guidelines 2. Exercise 1: Imagine asking stakeholders the questions in

Appendix 1 of the Guidelines. Write down their answers. 15 minutes

3. Exercise 2: Complete the template. 15 minutes 4. Report back to the group

Page 27: Research impact assessment workshop eawag 170317
Page 28: Research impact assessment workshop eawag 170317

What do you want your impact to be?

Page 29: Research impact assessment workshop eawag 170317
Page 30: Research impact assessment workshop eawag 170317

SKILLS

QUALITIES

Page 31: Research impact assessment workshop eawag 170317
Presenter
Presentation Notes
Knowledge mobilisation is an increasingly vital part of academic research and the achievement of impact. Despite a growing body of literature on the processes of knowledge translation, there are as yet no clearly defined skillsets for personnel undertaking these tasks. Prospect of a comprehensive framework for was initiated at the 2015 UK Knowledge Mobilisation Forum in Edinburgh, UK. This methods-focused paper summarises the process of developing a conceptual framework for impact/KMb competencies.
Page 32: Research impact assessment workshop eawag 170317

1. Identify and select frameworks: • commercialization competency frameworks were

excluded focus on university based knowledge brokers 2. Collation and qualitative synthesis of frameworks →

final set 3. Survey 4. Analysis (underway) 5. Self Assessment Tool (to come)

Page 33: Research impact assessment workshop eawag 170317

1. Identification and selection of frameworks

Melanie Barwick

Ed Stevens

Megan Harris Anne Wales

Presenter
Presentation Notes
Focus on university based knowledge brokers Commercialization competency only frameworks were excluded Identified four competency frameworks: Barwick Wales Harris Stevens
Page 34: Research impact assessment workshop eawag 170317

2. Collation and qualitative synthesis

94 → 80 competencies → 11 categories

• Wording modified to produce discrete, action based

statements • Ongoing iteration within team to:

− Agree categorisation − Agree competency wording

Page 35: Research impact assessment workshop eawag 170317

3. Final competency set 80 competencies in 11 categories A. Change management B. Communication C. Creating, sourcing and synthesising (research) knowledge D. Evaluating impact of KT E. Facilitating and negotiating F. Leading, managing and driving KT G. Managing legal issues and IP H. Managing partnerships/relationships I. Networking and engaging stakeholders J. Training and capacity building K. Understanding, creating and using KT tools, products and

practices

Page 36: Research impact assessment workshop eawag 170317

Sample

Page 37: Research impact assessment workshop eawag 170317

1. Internal communication skills 2. Developing and maintaining professional

relationships 3. Working in teams, communities and

networks 4. Managing multiple conversations 5. External communication skills 6. Active listening 7. Organizational link: acting as a connection

point to your organisation 8. Facilitating sharing of knowledge 9. Partnership and relationship management

skills and processes 10. Reporting and presenting knowledge

Presenter
Presentation Notes
Over 75% scored crucial/highly related Presented in order
Page 38: Research impact assessment workshop eawag 170317

1. Intellectual property skills and management

2. Commercialization techniques: skills and knowledge in commercializing research

3. Managing legal issues related to knowledge translation

4. Licensing and patents 5. Conducting deals and decision

making in legal and commercial activities

6. Conducting valuations of technologies/business/IP

7. Setting up or supporting spin off / start-up businesses

Presenter
Presentation Notes
>75% low /unrelated ALL legal and IP!
Page 39: Research impact assessment workshop eawag 170317

1. Broad partnership and communication skills crucial

2. Commercial and legal skills are niche; highly relevant only for those whose role focuses on this.

3. Very broad range of organisations, job types, job functions, job titles: ‘One size does not fit all’

4. Internationally relevant 5. Competencies appear to split

between: 1) Core [needed by all working in KMb space]; 2) Specialised [highly focused expertise in specific areas]

Page 40: Research impact assessment workshop eawag 170317

Brokers qualities

Fleet Footed

Cheerleader

Creative

Therapist

Page 41: Research impact assessment workshop eawag 170317

Brokers qualities Courage

Commitment

Tact, Negotiation

Page 42: Research impact assessment workshop eawag 170317

What does a broker look like?

Page 43: Research impact assessment workshop eawag 170317

Research Impact at Eawag