32
Embedded Research Dr. James Duggan ESRI [email protected]

Embedded Research - seminar

Embed Size (px)

Citation preview

Page 1: Embedded Research - seminar

Embedded Research

Dr. James Duggan

ESRI

[email protected]

Page 2: Embedded Research - seminar

Post-it Notes

• What do you want to know/ have explored by the end of the seminar?

• At least 2 things!

Page 3: Embedded Research - seminar

The Academia of Pale Imitations

• ‘Embedded journalism’ in the 2003 Iraq war (Ignatius 2010; Tuosto 2006)– The nature of information sharing– The meaning of informed consent and confidentiality,– Moral responsibility and positionality – Whose stories were being told and voices were being heard

(Feinstein and Nicholson 2005, Haigh et al 2006, Pfau et al 2004).

• ‘Embedded teachers’ (Hale 2012) • ‘Embedded librarians’ (Feliu and Fraser 2012; Shumaker

2013) • Embedded researchers (McGinity and Salokangas 2014)

Page 4: Embedded Research - seminar

The Academia of Minor Differences

• Consultancy and evaluation • Critical friendship• Development and research (D&R) • ‘Insider’ and ‘outsider’ research • Ethnography and ethnomethodology • Action and practitioner research • Critical secretaries• Embedded research?

Page 5: Embedded Research - seminar

Embedded Research

• Embedded research describes an arrangement whereby researchers join non-academic organisations in order to conduct mutually-beneficial research projects (McGinity and Salokangas 2012; Duggan 2014)

• Not a single methodological approach • Characteristics: Formal contract, resources,

status in organisation • Key issue: PhD student

Page 6: Embedded Research - seminar

Rationale

• Evidence-based police and practice (New Labour…)

• Diversification of funding for research • Building closer relationships between

knowledge producers and users • Increased access for researchers (Malfroy

2011) • Inform the development of initiatives by

providing evidence (Enders, 2005)

Page 7: Embedded Research - seminar

Implications of ER for PhDs

• Ethical (Rowley 2014; Cheek, 2005)• Pedagogical (Salminen-Karlsson & Wallgren 2008) • ER as acknowledged and/or integral• Acknowledged: – Ethics of receiving money – Access, familiarity and ‘going native’

• Integral – Space to develop appropriate methods to make a

contribution to knowledge

Page 8: Embedded Research - seminar

My PhD

• Stockborough MBC and University of Manchester, School of Education

• ESRC Case Studentship• Research the Stockborough Challenge • The Every Child Matters agenda • Improving collaboration in Stockborough

children’s services

Page 9: Embedded Research - seminar

Stockborough Challenge - Timeline

• Stockborough Challenge One – DCS writes ‘Bringing Together’ Sep 2007– My PhD begins Oct 2008– DCS retires Nov 2008 – Baby P, financial crisis, corporate re-organisation,

government changes policy emphasis • Stockborough Challenge Two– SC refocused – Acting-DCS resigns June 2009, new DCS – SC Director resigns & fieldwork begins Sep 2009 – Ofsted Inspection and ‘notice to improve’ Jan 2010

• I submit my thesis November 2012

Page 10: Embedded Research - seminar

Policy Context

• Every Child Matters agenda – 5 interdependent, holistic outcomes– New roles (e.g., Lead Professional) – New information systems (e.g. Common Assessment

Framework) – New structures (e.g., Children’s Trust)

• Leadership and cultural change – Senior managers must lead on workforce reform and drive

culture change to embed integrated working and common processes, communicating to their staff and to external stakeholders a clear vision of integrated working and how to achieve it… (DCSF 2007: §7.45)

Page 11: Embedded Research - seminar

Stockborough Challenge One

• Vision document ‘Bringing Together’ - Rationale • 7 challenges ‘we need to’

– Narrowing the gap: we need to understand more about the different needs and challenges for children, young people and families in localities and communities throughout Stockborough and develop community based multi-agency integrated services that respond effectively to this range of needs, recognising that all Stockborough’s children and young people are different and we need to be able to meet the full diversity of their needs if they really do matter. (Bringing Together §2.12.1)

• Collaboration WPR 1. Learn more about collaboration 2. Develop appropriate conditions and arrangements 3. Leadership

Page 12: Embedded Research - seminar

Stockborough Challenge Two

• “A campaign of cultural change within and on behalf of the Stockborough Children’s Trust”

• Collaboration not defined – What we do not yet know is quite what we are hoping

to achieve through the big thinking and the small starts, what the partnership working of 2013 will look actually look like and how we will get to the point at which we know. (Developing the Detail §1.5)

– ‘Schools as Children’s Trusts in the community’ (DtD §3.1)

Page 13: Embedded Research - seminar

‘One culture’• Targets identified as the barrier to collaboration… ‘the

corporate beast’ & ‘a target obsessed culture’ • The ‘one culture’

– This additional creativity will come through both system leadership approaches, in which leaders move beyond their own team or institution and, with the credibility their success gives them, influence others, and through wider collaboration. (Rationale §4.3)

– Stockborough Council will continue to have its high stakes targets; the Stockborough Challenge, if successful in creating the leadership, culture and environments to enable the Council’s vision to be fulfilled, will impact in any case on those targets. (Rationale §4.7)

• “We’ll do what needs to be done and tick the box afterwards” (Head teacher)

Page 14: Embedded Research - seminar

What we do not yet know is quite what we are hoping to achieve through the big thinking and the small starts, what the partnership working of 2013 will look actually look like, and how we

will get to the point at which we know. (Stockborough Challenge 2007, Developing the

Detail).

Page 15: Embedded Research - seminar

The Moving Aim

• An external advisor explained: • It’s strange how you have these things called

Children’s Trusts, and they had one in Stockborough but they didn’t know they had one, and then they were drip fed the guidance, and then there was a moment when they said ‘oh, it’s about commissioning.’

• Collaboration then cultural change around the Children’s Trust, finally commissioning

Page 16: Embedded Research - seminar

‘Transient Vacuum’

• Spaces that emerge processes of neolib/ managerialisation in the public sector

• ‘Transience’ – temporal, spatial and dynamic aspects of public sector reforms

• ‘Vacuum’ – the intangible and hard-to-describe experience of researching an initiative where the ‘centre did not hold’,

Page 17: Embedded Research - seminar

Policy Issues

• Leadership lacked clarity (Frost 2009; Booker 2011; Close 2012)

• Collaboration defined by ‘policy condensates’ (Clarke et al, 2006; Clarke et al, 2008; Ball 2008)

• Children’s Trust initiative or subsequent changes not based on evidence (Audit Commission 2008)

• Contradictions – Divergence and convergence at the local level– Competition (targets, markets) and collaboration – Holistic outcomes and existing targets (Frost and Parton

2009)

Page 18: Embedded Research - seminar

Literature on LfC

• Collaboration unspecified and de-contextualised – The term “collaboration”… [is used] from here on to cover

all aspects and styles of joint working practice. (Salmon 2004: 157).

• Self-report methods (Lumby 2009) & ‘goldilocks factors’

• The ideological context of leadership and cultural change not acknowledged– Why collaboration and leadership – The managerialisation of the public sector

Page 19: Embedded Research - seminar

The ‘wisdom deficit’

• Flyvbjerg (2001) rule-based approaches to making decisions that exclude experience and situated, intuitive or contextualised knowledge.

• New Labour’s centralisation of interpretation (e.g., Deliverology, Barber 2008), that sought to define practitioners’ actions and meanings from the centre, closing the scope for local interpretations (Bevir 2005).

• Policy construed managers as ‘ventriloquists’ (Smyth 1998), compliantly implementing rational, technocratic and managerial reforms without the space, time or legitimacy to disrupt, resist, question or dialogically engage with directives.

• Wisdom deficit (Schwartz and Sharpe 2010)

Page 20: Embedded Research - seminar

Self-Report Methods

• Self-report methods – interviews, questionnaires, focus groups etc

• Existing research public sector evaluation studies

• What people say and do… halo effect, over rational accounts, popular discourses

• What I was I told and what I heard • De-contextualised policy and knowledge • Critical orphanship – opportunity

Page 21: Embedded Research - seminar

" NC"

'* U:'54#', . &"4. +"'. 2:( %. 5%&", 2"'. &'+%0. %&&"#$0, ( 6$, ( #"* 1"0%&%405$O"4. +"D"0%#( 0. "#, "

#$'&"'&&( %"S $%. "4&&%&&'. 6"#$%"\ ( 4:'#1", 2"* 1"0%&%405$"Q&%%"U46%&"<P>Y<P<RW"""

B;>C@C<?@! " FH"@; !

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

"

9Dh- I A"PL"! "&5$%* 4#'5", /%0/'%S ", 2"#$%"0%&%405$"+%&'6. ""

@8<>J9<A<EDH!>H" ::; ?D; !

"

@($%52$*$U!

>) +#6*/ - U1!

8*' 1(!

!

"

BFI D!

!

"

"

"

B&#/ 3 $$6!

H+4) !

@%) $$#!

!

C7*$4!

! 5#', . "0%&%405$"

D. #%0/'%S "

740#'5'U4. #", ) &%0/4#', . "

!

F*$0/ 11+$- &#!1$%+&#!- / (3 $*5!

8 %&'6. "%ZU#!

D. #%0/'%S "

740#'5'U4. #", ) &%0/4#', . "

!

B"8" !"?" :G@C@!!

I / R2/ *!%) / %5"

BFI D!

D. #%0/'%S "740#'5'U4. #"", ) &%0/4#', . "

"

B"8" !"?" :G@C@!!

@($%52$*$U!>) &##/ - 4/ !

K$%, 01", 2"5$4. 6%"S , 0T&$, U"

"

>W"AZU:, 04#, 01"+4#4"

5, ::%5#', . "

"

<W"I %&%405$'. 6"

#$%"J $4::%. 6%"

"

CW"I %U:'54#', . "

4. +"/%0'2'54#', . "

J 4&%"&#( +1""

"

7':, #""

8 %&'6. "54&%""

"

J $, , &%"( . '#&""

"

3 %#$, +&"

"

! . 4:1#'54:"&#04#%61""

"

A; =:; >8C<?!!

I %Y2, 5( &'. 6"#$%"0%&%405$""

"

BW"I %2:%5#', . ""

"

Page 22: Embedded Research - seminar

ER’s Contribution

• My research contextualised leadership, collaboration and cultural change

• My status enabled me excellent access • Get beyond self-report methods (action

research & design experiment) • Get beyond ‘safe’ research • Not only in terms of ER

Page 23: Embedded Research - seminar

Ethics and Anxieties

Research is a strange thing: not listening to someone as they talk is impolite; listening to someone intently and

responding appropriately is polite; listening to someone intently and then spending three or more years talking to

many of their colleagues to ‘fact’ check what they said and reading extensively to critically engage with what

they were saying seems to me a particular form of malice. So thanks to all those working at ‘Stockborough

Children’s Services’ for taking time out from their earnest attempts to improve the lives of the children and young

people they work with every day. (Duggan, 2012: 8)

Page 24: Embedded Research - seminar

‘Ethical’ Issues

• Institutional Review Board version of ethics • BERA Ethical Guidelines (2004) – Researchers must avoid agreeing to any sponsor’s

conditions that could lead to serious contravention of any aspect of these guidelines of that undermine the integrity of the research by imposing unjustifiable conditions on the methods to be used or the reporting of outcomes.

• Covenantal approach to ethics (Brydon-Millar)

Page 25: Embedded Research - seminar

Accepting Funding

• Cheek (2005: 400) Accepting funding involves entering into a contractual and intellectual agreement with a funder that has consequences for the research… Taking money from a sponsor is not a neutral activity; it links the researcher and research inexorably with the values of that funder.

• Not always so stark in ER• Critical orphanship in my case but some

partner/ funding organisations are interested

Page 26: Embedded Research - seminar

Ethical Issues

• All the usual ethical issues + • Confidentiality • Data leakage• Informed consent

– Proffers and throffers • Bias…

• “You didn’t get that money…” • Covenantal Ethics:

– Political… – Mutually-benefical relationship

Page 27: Embedded Research - seminar

Mutually-beneficial?

• Stockborough Council – Discussions with Mel and Alan– 4 reports– Social network – App = £107k – But…

Page 28: Embedded Research - seminar

Professional social network

Page 29: Embedded Research - seminar

‘Welcome research as part of our improvement strategy’

Page 30: Embedded Research - seminar

Researching ‘Failure’• Paul Omerod – why most things fail • Discourse of derision (Ball 1990), is a cornerstone of the neoliberal

argument for the continued re-organisation of society along market principles (Johnston and Kouzmin, 1998).

• the, ‘neoliberal playbook: attack the legitimacy of government, assume power, impose various neoliberal market/ government “reforms”, wait for failures, rinse, repeat.’ (Mirowski, 2013, unpaged)

• Conservative pressure group, Bright Blue. In the chapter on ‘Accelerating education reform’ the author writes, – Sometimes, however, markets can be unfair and inefficient, and

government has a positive role to play in redressing this: indeed, if you believe in markets, you need to be prepared to make them work, not just leave them to fail. (Shorthouse, 2013, p. 61)

Page 31: Embedded Research - seminar

Tips on Doing ER

• Start researching straight away! • Do lots of research • Identify (and re-negotiate) your relationship to

research commissioner, the organisation and everyone else

• Understand power relations• Protect your privileged position • Defend your thesis’ neutrality, offer micro-research• Play the long game

Page 32: Embedded Research - seminar

ER Networkhttp://embeddedresearchers.wordpress.com/