Upload
others
View
4
Download
0
Embed Size (px)
Citation preview
Why does our opinion on the success and failure of sanctions
change so often?Peter van Bergeijk
Key Note for the Conference on "Political Economy of Sanctions" (December 13, 2019, Phillips University, Marburg)
With a little help of my friends
Binyam Afewerk Demena
Alemayehu Sisay Reta
Gabriela Benalcazar
Jativa
Patrick Bitandaro
Kimararungu
Muhammad Shahadat Hossain
Siddiquee
Sajjad Faraji Dizaji
What to expect?
• A short history of disagreement• Critical discourse analysis; traditional narrative review; time line
• Policy and research cycles (Goldstein, Wallenstein)
• Intrinsic motivation (including national interests)
• Three forms of bias• Unreported revisions
• Publication bias (meta analysis)
• data construction
• Suggestions for future research
1. A short history of disagreement
Discourse analysis
Constant factors in the sanction debate
0
5000
10000
15000
20000
25000
1950s 1960s 1970s 1980s 1990s 2000s 2010s
success failure
effectiveness threat
total economic sanctions
• Google scholar hits on keyword combinations
Discourse analysis
Constant factors in the sanction debate
0
5000
10000
15000
20000
25000
1950s 1960s 1970s 1980s 1990s 2000s 2010s
success failure
effectiveness threat
total economic sanctions
and some dynamics
0%
25%
50%
75%
100%
1950s 1960s 1970s 1980s 1990s 2000s 2010s
success failure effectiveness
punishment threat reward
Discourse analysis
and some more dynamics
• Ineffective & ineffectiveness become part of the common language in the sanction discourse since 1990.
0%
25%
50%
75%
100%
1950s 1960s 1970s 1980s 1990s 2000s 2010s
success failure effective
ineffective effectiveness ineffectiveness
Overview of studies of the determinants of sanction success in leading journals
Study Journal Trade linkage Prior relations DurationDashti-Gibson et al. (1997) American Journal of Political Science * *Drury (1998) Journal of Peace Research * *Drezner (2000) International Organization + +Hart (2000) Political Research Quarterly + *Nooruddin (2002) International Interactions * *Jing et al (2003) Journal of Peace Research +Ang and Peksen (2007) Political Research Quarterly * + *Lektzian and Souva (2007) Journal of Conflict Resolution *Bapat and Morgan (2009) International Studies Quarterly * *
Chan (2009) International Political Science Review – –
Major (2012) International Interactions +Whang et al (2013) American Journal of Political Science +Woo and Verdier (2014) Journal of Semantics * –
Lektzian and Patterson (2015) International Studies Quarterly * + *
van Bergeijk & Siddiquee (2017) International Interactions * + –
Kleinberg (2018) Journal of Peace Research * –
Peterson (2018) Conflict Management and Peace Science –
Why trade linkage, duration and prior relations?
Trade disruption in a simple neoclassical model Time profile of utility
uA
uF
uD
T
Time
Kernel plots of key determinants of sanction success (t values in 36 primary studies published 1985-2018)
Trade linkage Prior relationsDuration
Key cases of a century of sanctions
1921 Yougoslavia
1925 Greece
1935 Italy
1920s 1930s
1948 US –Netherlands
1958 USSR –Finland
1950s
1962 US Cuba
1965 UN Rhodesia
1960s
1973 Arab oil embargo
1977 UN Apartheid
1970s
1980 US Grain
embargo
1980s
UN Apartheid
1990s 2000s 2010s
“Although there are some difficulties of evaluation, there is a strong consensus that sanctions have not been successful in achieving their primary objectives” Barber (Foreign Affairs 1979:384)
“Economic sanctions are more effective than most analyst suggest. Their efficacy is underrated (…) their successes are widelyunreported, while their failures are exaggerated by those with an interest in either avoiding their use, or in using other instruments” Rogers (Security Studies 1996: 72)
“While the literature has identified many factors as possible determinants of sanctions success, the empirical findings regarding these hypotheses have been inconclusive.” Bapat et al (International Interactions 2013: 80)
Research CyclesRobert Goldfarb Peter Wallensteen
"The economist-as-audience needs a methodology of plausible inference." Journal of Economic Methodology (1995):
A century of economic sanctions: A field revisited. Uppsala: Department of Peace and Conflict Research, Uppsala University, 2000.
Views on the sanction instrument may drive reported results
Intrinsic motivation National interest
Unreported revisions
Publication bias (meta analysis)
data construction
2. Three forms of bias
Unreported revisions generate differences and may also reflect bias
Cumulative frequency distribution success score (common cases)
Foreign policy goals (common cases;inpercent)
"Methodological Change and Bias in Economic Sanction Reconsidered." International Interactions (2017)
Bias and genuine effectMultivariate Meta Regression Analysis for precision and sources of Heterogeneity
27 primary studies on the effectiveness of economic sanctions published over the years 1985-2017 inclusive
Sources:
Sources: Benalcazar Jativa (2018), Kimararungu (2018) and Reta (2018)
-3
-2
-1
0
1
2
3
Trade linkage (N=100) Duration (N=73) Prior relations (N=60)
genuine effect Bias
Determinants of Absolute Bias (331 regressions of 36 studies (1985-2018)
(1) (2) (3) (4) (GTS)
Peer Reviewed -0.3 -0.2 -0.3 -0.4 -0.3
No. of citations a 0.1 0.1 0.1 0.1 0.1
No. Obs. primary study a -0.2 -0.2 -0.2 -0.2
Co-authored -0.9* -0.8* -0.9* -1.0* -0.9*
US affiliation 0.3 0.5 0.4 0.3
Academic affiliation 0.1 0.1 0.1 0.2
PhD -0.5 -0.5 -0.5 -0.5Homogenous gender 0.2 0.2 -0.3
Journal Rank 0.4 0.3 0.4 0.4 0.5Political scientist -0.2 -0.2 -0.2 0.1Publication year (base 1985) 0.04* 0.04 0.05* -0.16* 0.04*
Idem squared 0.005**
**, * stand for 1 and 5% level of significance, respectively.
Data construction
Hufbauer, Schott, Elliot, OeggEconomic Sanctions reconsidered, 1985, 1990, 2008.
Morgan, Bapat, Kobayashi, KrustevThreat and imposition of economic sanctions2009, 2014
Felbermayr, Kirilakha, Syropoulos, Yalcin, YotovThe Global Sanctions Data Base.2019
The sanction black box
Traditionally recognized sanction black box
Implicit unrecognized sanction black box
Politics, economics, psychology
Success or failure
Sanction
Success or failure
Sanction
The sanction black box
Traditionally recognized sanction black box
Implicit unrecognized sanction black box
Politics, economics, psychology
Success or failure
Sanction
Coding of selected sanction episodes
Success or failure
Sanction
Four stylized facts
• the empirical post Second World War shows an increasing association between economic sanctions and their ineffectiveness since the 1990s,
• the findings that are reported in the empirical literature show an increasing dispersion and inconclusiveness since the turn of the Millennium and
• the post 1985 empirical literature suffers from significant and since 2000 increasing bias in the reported results.
• the literature is dominated by an episode, endpoint, (inter)subjective evaluation of success and failure
3. Suggestions for future sanction research
Prevent p-hacking
• Problems reflect fit the so-called replication crisis that is a general and disturbing trend in science
• Large N is better than small N.
• Require more significance (at least 5%)
• Stimulate replication
Alternative approach: country studies
• Establish relationship between instrument and target variable (goal of the sanction)
• Dynamics: time dimension.
• Perspective on (in) significance of impact determined by model
• Agnostic about VAR, CGE, SAM, structural model
• Research synthesis via meta-analysis
Imp
act
of
oil
san
ctio
n s
ho
ck o
n p
olit
y
Years Case: Iran (JPR 2013)