Embed Size (px)
Citation preview
American Chemical Society
The ACS International Center presents….
Global Scientific Collaboration: A Key to Scientific Success Preparing for a future in global science Joe Francisco, PhD (University of Nebraska-Lincoln) ACS Past-President Matt Michalska-Smith (University of Chicago) Author: The Scientific Impact of Nations Christopher LaPrade Office of International Activities-ACS
Moderator: Joe Francisco, PhD Dean, College of Arts & Sciences, University of Nebraska-Lincoln ACS Past-President 2010
Dr. Francisco is Dean of the College of Arts & Sciences at the University of Nebraska-Lincoln. As an atmospheric chemist, Dr. Francisco has worked across borders with collaborators around the globe. Dr. Francisco is a recipient of numerous honorary degrees and an award for U.S. Senior Scientist from the Alexander von Humboldt Foundation of Germany.
In addition to his many awards and positions of leadership in the scientific community, Dr. Francisco was ACS Past-President in 2010. He has over 475 peer review publications in the field.
Speaker: Matthew J. Michalska-Smith University of Chicago
Matthew received his B.S. from the University of Notre Dame in biological sciences. He is now a second year graduate student at the University of Chicago in the department of Ecology & Evolution. His research interests center around theoretical ecology, especially the interactions between network structures and biological processes. He also has a deep interest in the "science of science," looking critically at the processes behind science and publication. Matthew was author of the article, “The Scientific Impact of Nations: Journal Placement and Citation Performance” published in PLoSONE in October 2014.
American Chemical Society
American Chemical Society
20.8%23.4%
26.8%27.7% 29.3%
39.0%
0%
10%
20%
30%
40%
50%
Educational institution Government Business/industry
International Collaboration by Employment Sector of U.S. Scientists and Engineers, 2006
Females Males
Source: Frehill, Lisa M. 2010, analysis of National Science Foundation restricted-use Survey of Doctorate Recipients, 2006. The use of NSF data does not imply NSF approval of the research, research methods or conclusions. This work was support by NSF #0936970.
13.3%
25.0%
45.6%
23.0%27.7%
48.4%
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
Academic Institution* Government Business/Industry
International Collaboration Among U.S. Doctoral-Degreed Chemists, 2006
Females Males
* Academic Institutions includes four-year colleges/universities and medical institutions.
Source: Frehill, Lisa M. 2010. Weighted analysis of National Science Foundation, public use Survey of Doctorate Recipients, 2006. The use of NSF data does not imply NSF approval of the research, research methods or conclusions. This work was support by NSF #0936970.
The Scientific Impact of Nations…
Global Scientific Collaboration:A Key to Scientific Success
Matthew J. Michalska-SmithUniversity of Chicago
25 February 2015
http://olihb.com/2014/08/11/map-of-scientific-collaboration-redux/
Question: Some inspirations
1982 Peer-review practices of psychologicaljournals: The fate of published articles,submitted again (Peters and Ceci 1982)
1997 The scientific wealth of nations (May 1997)
2004 The scientific impact of nations (King 2004)
2013 Collaborations: The fourth age ofresearch (Adams 2013)
Question: Some inquiries
Does the number of countriesrepresented in a paper’s author listpredict publication performance?
Do the identities of those countriesmake a difference?
Question: Some inquiries
Does the number of countriesrepresented in a paper’s author listpredict publication performance?
Do the identities of those countriesmake a difference?
Data: Collection methods
I Extracted 1.25 million “article” records fromscopus.com from subject-specific journals in 8disciplines
I For each article, we recorded:Date of publicationJournal of publicationNumber of authorsCountries found in affiliationsJournal Impact FactorNumber of citations received
History: Shoulders to stand on
1982 Peer-review practices of psychologicaljournals: The fate of published articles,submitted again (Peters and Ceci 1982)
1997 The scientific wealth of nations (May 1997)
2004 The scientific impact of nations (King 2004)
2013 Collaborations: The fourth age ofresearch (Adams 2013)
History: Room to grow
(King 2004)
Method: Quantifying success
I What journal did you get your paper into?I How many citations did your paper receive?
relative to “peer” publications?I i.e., papers published in the same journal:year
Method: Quantifying success
I What journal did you get your paper into?I How many citations did your paper receive?
relative to “peer” publications?I i.e., papers published in the same journal:year
Method: Statistical analysis
Bin Data small differences in performance may bedue to stochasticity or reporting error
Run Models Proportional Odds Model and LinearModels
Compare Models Evaluate relative fit vs number ofexplanatory parameters using AIC
Metadata Multiple regression with country-specificeconomic data
Results
Aside: Cumulative Probability Distribution
0.00
0.25
0.50
0.75
1.00
V IV III II I Ranking
Pro
port
ion
Results: Effect of number of countries
0.00
0.25
0.50
0.75
1.00
V IV III II I V IV III II IJournal Tier Citation Tier
Pro
port
ion
Art
icle
s
Number of Countries
1
2
3
4
5+
Results: Effect of number of countriesCondensed−Matter Physics Ecology
0.00
0.25
0.50
0.75
1.00
V IV III II I V IV III II IJournal Tier
Pro
port
ion
Art
icle
s
1
2
3
4
5+
0.00
0.25
0.50
0.75
1.00
V IV III II I V IV III II ICitation Tier
Pro
port
ion
Art
icle
s
Discussion: Effect of number of countries
I International collaboration is correlated withbetter journals and more citations
I Not all Countries are created equal andcountries can combine non-linearly
I Discrepancies between citation performanceand journal placement can indicate bias ordifferences in academic culture
I Journal placement has strong predictive powerin determining number of citations, but somecountries still over or underperform
Results: Specific country effectsAnalytical Chemistry—Journal Placement
Singa
pore
Sweden
Aust
ria
Hong
Kong
Nethe
rland
s
Irela
nd
Spain
Switzer
landUK
Canad
a
Taiw
anUSBel
gium
Ger
man
y
Finl
and
Isra
el
US+Ger
man
y
Aust
ralia
South
Kor
ea
Denm
ark
Fran
ce
Italy
Canad
a+US
Czech
Rep
ublic
Portu
gal
Thai
land
Hong
Kong
+Chi
na
US+Chi
na
Gre
ece
US+Jap
an
South
Afri
ca
Norway
UK+US
Argen
tina
Japa
n
Oth
er
China
Brazil
Japa
n+Chi
na
Iran
Hunga
ry
Mex
ico
Indi
a
Turk
ey
Egypt
Pola
nd
Roman
ia
Pakis
tan
Russia
Ukrai
ne
Iran
Switzer
land
Singa
pore
Turk
ey
Pakis
tan
Norway
Denm
ark
UK+US
US+Ger
man
y
Ger
man
y
UK
Nethe
rland
s
Aust
ria
Sweden
Irela
nd
Belgi
um
Brazil
USAust
ralia
Spain
Japa
n+Chi
na
Canad
a
Czech
Rep
ublic
US+Chi
na
Hong
Kong
Canad
a+US
Finl
and
Indi
a
China
Gre
ece
Thai
land
Egypt
Portu
gal
Italy
South
Afri
ca
Isra
el
Oth
er
Japa
n
Taiw
an
Hong
Kong
+Chi
na
Fran
ce
Russia
Pola
nd
Roman
ia
Hunga
ry
South
Kor
ea
Argen
tina
US+Jap
an
Mex
ico
Ukrai
ne
Singa
pore
Hong
Kong
Sweden
Aust
ria
Nethe
rland
s
Irela
nd
Switzer
land
Ger
man
y
Taiw
anUK
Canad
a
Belgi
um
Spain
USUS+Ger
man
y
Finl
and
Denm
ark
Isra
el
South
Kor
ea
Fran
ce
Aust
ralia
Italy
Czech
Rep
ublic
Canad
a+US
Thai
land
Portu
gal
Hong
Kong
+Chi
na
Norway
South
Afri
ca
US+Chi
na
Argen
tina
Gre
ece
US+Jap
an
Oth
er
UK+US
China
Brazil
Japa
n+Chi
na
Iran
Japa
n
Mex
ico
Hunga
ry
Pola
nd
Indi
a
Egypt
Turk
ey
Roman
ia
Russia
Pakis
tan
Ukrai
ne
Iran
Switzer
land
Singa
pore
Turk
ey
Norway
Pakis
tan
Brazil
Aust
ria
Denm
ark
Irela
nd
SwedenUK
Gre
ece
Thai
land
China
UK+US
Czech
Rep
ublic
Hong
Kong
US+Ger
man
y
Nethe
rland
sUSG
erm
any
Finl
and
Spain
Indi
a
Canad
a
Canad
a+US
Portu
gal
Japa
n+Chi
na
Belgi
um
Aust
ralia
US+Chi
na
Hong
Kong
+Chi
na
Taiw
an
Italy
Egypt
South
Kor
ea
Isra
el
Argen
tina
Oth
er
South
Afri
ca
Pola
nd
Japa
n
Fran
ce
US+Jap
an
Roman
ia
Hunga
ry
Mex
ico
Russia
Ukrai
ne
Journals Citations
Pro
port
iona
l Odd
sLi
near
Results: Specific country effectsAnalytical Chemistry—Citation Performance
Singa
pore
Sweden
Aust
ria
Hong
Kong
Nethe
rland
s
Irela
nd
Spain
Switzer
landUK
Canad
a
Taiw
anUSBel
gium
Ger
man
y
Finl
and
Isra
el
US+Ger
man
y
Aust
ralia
South
Kor
ea
Denm
ark
Fran
ce
Italy
Canad
a+US
Czech
Rep
ublic
Portu
gal
Thai
land
Hong
Kong
+Chi
na
US+Chi
na
Gre
ece
US+Jap
an
South
Afri
ca
Norway
UK+US
Argen
tina
Japa
n
Oth
er
China
Brazil
Japa
n+Chi
na
Iran
Hunga
ry
Mex
ico
Indi
a
Turk
ey
Egypt
Pola
nd
Roman
ia
Pakis
tan
Russia
Ukrai
ne
Iran
Switzer
land
Singa
pore
Turk
ey
Pakis
tan
Norway
Denm
ark
UK+US
US+Ger
man
y
Ger
man
y
UK
Nethe
rland
s
Aust
ria
Sweden
Irela
nd
Belgi
um
Brazil
USAust
ralia
Spain
Japa
n+Chi
na
Canad
a
Czech
Rep
ublic
US+Chi
na
Hong
Kong
Canad
a+US
Finl
and
Indi
a
China
Gre
ece
Thai
land
Egypt
Portu
gal
Italy
South
Afri
ca
Isra
el
Oth
er
Japa
n
Taiw
an
Hong
Kong
+Chi
na
Fran
ce
Russia
Pola
nd
Roman
ia
Hunga
ry
South
Kor
ea
Argen
tina
US+Jap
an
Mex
ico
Ukrai
ne
Singa
pore
Hong
Kong
Sweden
Aust
ria
Nethe
rland
s
Irela
nd
Switzer
land
Ger
man
y
Taiw
anUK
Canad
a
Belgi
um
Spain
USUS+Ger
man
y
Finl
and
Denm
ark
Isra
el
South
Kor
ea
Fran
ce
Aust
ralia
Italy
Czech
Rep
ublic
Canad
a+US
Thai
land
Portu
gal
Hong
Kong
+Chi
na
Norway
South
Afri
ca
US+Chi
na
Argen
tina
Gre
ece
US+Jap
an
Oth
er
UK+US
China
Brazil
Japa
n+Chi
na
Iran
Japa
n
Mex
ico
Hunga
ry
Pola
nd
Indi
a
Egypt
Turk
ey
Roman
ia
Russia
Pakis
tan
Ukrai
ne
Iran
Switzer
land
Singa
pore
Turk
ey
Norway
Pakis
tan
Brazil
Aust
ria
Denm
ark
Irela
nd
SwedenUK
Gre
ece
Thai
land
China
UK+US
Czech
Rep
ublic
Hong
Kong
US+Ger
man
y
Nethe
rland
sUSG
erm
any
Finl
and
Spain
Indi
a
Canad
a
Canad
a+US
Portu
gal
Japa
n+Chi
na
Belgi
um
Aust
ralia
US+Chi
na
Hong
Kong
+Chi
na
Taiw
an
Italy
Egypt
South
Kor
ea
Isra
el
Argen
tina
Oth
er
South
Afri
ca
Pola
nd
Japa
n
Fran
ce
US+Jap
an
Roman
ia
Hunga
ry
Mex
ico
Russia
Ukrai
ne
Journals Citations
Pro
port
iona
l Odd
sLi
near
Discussion: Specific country effects
I International collaboration is correlated withbetter journals and more citations
I Not all Countries are created equal andcountries can combine non-linearly
I Discrepancies between citation performanceand journal placement can indicate bias ordifferences in academic culture
I Journal placement has strong predictive powerin determining number of citations, but somecountries still over or underperform
Results: Comparing measures
ARG
AUS
AUT
BEL BRA
CAN
CAN+USA CHN
CZE
DNK
EGYFIN
FRA
DEU
GRC
HKG
HKG+CHN
HUN
IND
IRN
IRL
ISR ITA
JPN
JPN+CHN
KOR
MEX
NLD
NOR
Other
PAK
POL
PRT
ROMRUS
SGP
ZAF
ESP
SWE
CHE
TWN
THA
TUR
UKR
GBR
GBR+USA
USA+CHN
USA+DEU
USA+JPN
USA
0.403 (p = 0.0040)
Analytical Chemistry
0
10
20
30
40
50
0 10 20 30 40 50Rank of Country by Journal Placement
Ran
k of
Cou
ntry
by
Cita
tion
Per
form
ance
Results: Comparing measures
ARG
AUS AUT
BEL
BRA
CAN
CHE
CHN
CZE
DEU
DEU+FRA
DEU+RUS
EGY
ESP
FIN
FRA
GBR GBR+DEU
GBR+USA
GRC
HKG
HKG+CHN
IND
IRN
ISR
ITA
ITA+FRA
JPN
JPN+CHN
JPN+DEU
KOR
MEX
NLD
Other
POL
ROM
RUS
RUS+FRA
SGP
SWE
TUR
TWN
UKR
USA
USA+CHN
USA+DEU
USA+FRA
USA+JPN
USA+KOR
USA+RUS
0.288 (p = 0.0427)
ARG
AUS
AUT
BEL
BRA
BRA+USA
CAN
CAN+GBR
CAN+USA
CHE
CHE+USA
CHLCHN
CZE
DEU
DNK
ESP
FIN
FRA
GBR
GBR+AUS
GBR+DEU
GBR+ESPGBR+FRA
GBR+USA
IND
ISR
ITA
JPNMEX
NLD
NOR
NZL
OtherPOL
PRT
RUS
SWE
TUR
USA
USA+AUS
USA+CHN
USA+DEU
USA+ESP
USA+FRA
USA+JPNUSA+MEX
USA+NZL
VEN
ZAF
0.615 (p < .0001)
Condensed−Matter Physics Ecology
0
10
20
30
40
50
0 10 20 30 40 50 0 10 20 30 40 50Rank of Country by Journal Placement
Ran
k of
Cou
ntry
by
Cita
tion
Per
form
ance
Discussion: Comparing measures
I International collaboration is correlated withbetter journals and more citations
I Not all Countries are created equal andcountries can combine non-linearly
I Discrepancies between citation performanceand journal placement can indicate bias ordifferences in academic culture
I Journal placement has strong predictive powerin determining number of citations, but somecountries still over or underperform
Results: Performance through time
Analytical Chemistry
0.15
0.20
0.25 United S
tates
1996 2001 2006 2011
Results: Performance through time
Analytical Chemistry Condensed−Matter Physics Ecology
0.15
0.20
0.25
0.10
0.15
0.20
0.25
0.20
0.25
0.30
0.35
0.050.100.150.200.25
0.05
0.10
0.15
0.00
0.01
0.02
0.03
0.04
0.06
0.08
0.03
0.06
0.09
0.12
0.010
0.015
0.020
0.025
0.040.050.060.07
0.010
0.015
0.020
0.015
0.020
0.025
0.030
United S
tatesC
hinaJapan
Spain
1996 2001 2006 2011 1996 2001 2006 2011 1996 2001 2006 2011
Discussion: Performance through time
I International collaboration is correlated withbetter journals and more citations
I Not all Countries are created equal andcountries can combine non-linearly
I Discrepancies between citation performanceand journal placement can indicate bias ordifferences in academic culture
I Journal placement has strong predictive powerin determining number of citations, but somecountries still over or underperform
Summary: What does it all mean?
I Why are international collaborations beneficial?I Increased sphere of visibilityI Increased generality
I Getting into “good” journals still pays off ...I Yet, the journal ranking systems are imperfect
and can lead to inequality
Future: time and resolution
I Do papers experience a lag before becomingcitation classics?
I How does this aging process differ for differentcompositions of authors?
I Use university affiliations to better refine thepositive effects of who’s who in an author list
I Does predictability of citation performancefrom journal placement change through time?
thank youStefano AllesinaCody WeinbergerEmilio M. Bruna
The Transnational Practice of Chemistry and Allied Sciences and Engineering: Study, Research and Careers without Borders
Experts from industry, academe, and government provide perspectives on the ‘global-readiness’ of the STEM graduate in the U.S. and worldwide Featured speakers include:
ACS National Meeting in Denver, CO USA Sunday, March 22, 2015 8:00am-12:00pm Colorado Convention Center, Mile High Ballroom 3A
Diane Schmidt, ACS President Judy Benham, 3M and Former Chair, ACS Board of Directors Thomas Connelly, ACS CEO Jay Steven Siegel, Tianjin University, School of Pharmaceutical S&T Joe Francisco, University of Nebraska and ACS Past President Luis Echegoyen, University of Texas El Paso and Director Emeritus, NSF Chemistry Division Deva Hupaylo, Head, Industry Verification Branch, OPCW Angela Diaz, California Council on Science and Technology
ACS INTERNATIONAL CENTER™ www.acs.org/ic
• Information on over 600 international STEM scholarships, internships, and travel awards
• 16 regions worldwide
• 6 experience levels
• Insider tips on upcoming calls for proposals, eligibility updates, and deadline extensions
• Live webinars and events with representatives
from embassies and international organizations
The ACS International Center™ is the essential guide for scientists and engineers looking to study, work, and conduct research overseas.
International Center Homepage
Two ways to search!
Browse by location Browse by level of experience
Want more information?
Visit www.acs.org/ic
E-mail [email protected]
Subscribe by contacting [email protected]
Follow us on Twitter at @AmerChemSociety
Watch our archive of webinars!
QUESTIONS? Submit them into your Gotowebinar chat box
now*
Or, visit:
www.acs.org/ic
*Unanswered questions will be addressed after the session and posted online at www.acs.org/ic, along with a webinar
recording and presentation slides, after the session
Thank you for tuning in!
