Embed Size (px)
Citation preview
Dismantling a Single-Discipline Journal Bundle: A
Triangulation Method for Assessment
Diane (DeDe) DawsonScience Liaison Librarian,
University of SaskatchewanNISO Virtual Conference: Expanding the Assessment Toolbox
April 29, 2015
The Setting
University of Saskatchewan:
21 000+ students
(~3000 grad students)
1100+ faculty
Public university, largest in province
200+ academic programs
Medical/Doctoral
Member of the U15 (“research intensive”)
Image credit: Wikipedia
Background
• Canadian Research Knowledge Network (CRKN)
– Canada’s national consortium
• In late 2012 CRKN negotiations with American Chemical Society (ACS) broke down
Background
• Canadian Research Knowledge Network (CRKN)
– Canada’s national consortium
• In late 2012 CRKN negotiations with American Chemical Society (ACS) broke down
• Appeared that individual libraries nationwide would need to handle their own negotiations with ACS for bundle of journals
Background
• It became clear that UofS would likely not be able to afford the entire bundle
= unbundle a big deal
Purpose
• ACS Web Editions bundle is a very important package to chemistry researchers
= need to make evidence-based decisions
Purpose
• ACS Web Editions bundle is a very important package to chemistry researchers
= need to make evidence-based decisions
• Recent SUNY Potsdam controversy (2012)
= heightened awareness & sensitivity
Objective
Use data available to develop a ranked list of most important ACS titles to subscribe to
“Triangulation” Method:Three data sources
1. Usage data (# of full text downloads / year)
– Most recent 3 yrs: 2011-2013
“Triangulation” Method:Three data sources
1. Usage data (# of full text downloads / year)
– Most recent 3 yrs: 2011-2013
2. Citation analysis
– Chemistry researcher’s publication venues
(Most recent 3 yrs: 2011-2013)
– Reference lists in those articles
“Triangulation” Method:Three data sources
1. Usage data (# of full text downloads / year)
– Most recent 3 yrs: 2011-2013
2. Citation analysis
– Chemistry researcher’s publication venues
(Most recent 3 yrs: 2011-2013)
– Reference lists in those articles
3. User Survey
More on Methods
• Bradford’s Law
–Citation analysis method
– Finds core journals in particular disciplines
More on Methods
• Bradford’s Law
–Citation analysis method
– Finds core journals in particular disciplines
–Divide total citations into several roughly equal zones (of decreasing importance)
–# of citations constant in each zone, but # of journal titles will increase across zones
Image credit: http://hlwiki.slais.ubc.ca/index.php/Bradford%27s_law_of_scattering
More on Methods
• Three zones I use based on terminology in survey:
– Essential
–Good to have
–Unnecessary
Usage Data
0
1000
2000
3000
4000
5000
6000
7000
8000
9000
10000
Jou
rnal
of
the
Am
eri
can
Ch
emic
al S
oci
ety
Jou
rnal
of
Agr
icu
ltu
ral a
nd
Fo
od
Ch
emis
try
Envi
ron
men
tal S
cie
nce
& T
ech
no
logy
The
Jo
urn
al o
f O
rgan
ic C
hem
istr
y
Lan
gmu
ir
An
alyt
ical
Ch
em
istr
y
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
C
Org
anic
Le
tter
s
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
B
Bio
che
mis
try
Jou
rnal
of
Med
icin
al C
he
mis
try
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Res
earc
h
Ino
rgan
ic C
he
mis
try
Ch
em
ical
Rev
iew
s
Ener
gy &
Fu
els
Nan
o L
ett
ers
Jou
rnal
of
Ch
em
ical
& E
ngi
ne
erin
g D
ata
Org
ano
met
allic
s
AC
S N
ano
Jou
rnal
of
Ch
em
ical
Ed
uca
tio
n
Ch
em
istr
y o
f M
ater
ials
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
A
Mac
rom
ole
cule
s
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
Acc
ou
nts
of
Ch
emic
al R
esea
rch
Bio
mac
rom
ole
cule
s
Ch
em
ical
Res
earc
h in
To
xico
logy
Jou
rnal
of
Nat
ura
l Pro
du
cts
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
Lett
ers
Jou
rnal
of
Pro
teo
me
Res
earc
h
Org
anic
Pro
cess
Re
sear
ch &
Dev
elo
pm
ent
AC
S C
atal
ysis
Bio
con
juga
te C
hem
istr
y
AC
S A
pp
lied
Mat
eria
ls &
Inte
rfac
es
Cry
stal
Gro
wth
& D
esi
gn
Mo
lecu
lar
Ph
arm
ace
uti
cs
AC
S C
hem
ical
Bio
logy
Jou
rnal
of
Ch
em
ical
Info
rmat
ion
an
d M
od
elin
g
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
AC
S C
hem
ical
Ne
uro
scie
nce
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Pro
cess
Des
ign
an
d D
ev.
..
AC
S C
om
bin
ato
rial
Sci
ence
Jou
rnal
of
Ch
em
ical
Th
eo
ry a
nd
Co
mp
uta
tio
n
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Fun
dam
enta
ls
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Pro
du
ct R
ese
arch
an
d D
...
AC
S M
edic
inal
Ch
emis
try
Lett
ers
Bio
tech
no
logy
Pro
gres
s
AC
S M
acro
Le
tte
rs
AC
S Su
stai
nab
le C
hem
istr
y &
En
gin
eer
ing
AC
S Sy
nth
eti
c B
iolo
gy
Ch
em
ical
& E
ngi
nee
rin
g N
ews
Arc
hiv
e
Envi
ron
men
tal S
cie
nce
& T
ech
no
logy
Let
ters
ACS Journals Full-Text Downloads, 2011-2013
2011
2012
2013
0
1000
2000
3000
4000
5000
6000
7000
8000
9000Jo
urn
al o
f th
e A
me
rica
n C
hem
ical
So
ciet
y
Jou
rnal
of
Agr
icu
ltu
ral a
nd
Fo
od
Ch
emis
try
Envi
ron
men
tal S
cie
nce
& T
ech
no
logy
The
Jo
urn
al o
f O
rgan
ic C
hem
istr
y
Lan
gmu
ir
An
alyt
ical
Ch
em
istr
y
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
C
Org
anic
Le
tter
s
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
B
Bio
che
mis
try
Jou
rnal
of
Med
icin
al C
he
mis
try
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Res
earc
h
Ino
rgan
ic C
he
mis
try
Ch
em
ical
Rev
iew
s
Ener
gy &
Fu
els
Nan
o L
ett
ers
Jou
rnal
of
Ch
em
ical
& E
ngi
ne
erin
g D
ata
Org
ano
met
allic
s
AC
S N
ano
Jou
rnal
of
Ch
em
ical
Ed
uca
tio
n
Ch
em
istr
y o
f M
ater
ials
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
A
Mac
rom
ole
cule
s
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
Acc
ou
nts
of
Ch
emic
al R
esea
rch
Bio
mac
rom
ole
cule
s
Ch
em
ical
Res
earc
h in
To
xico
logy
Jou
rnal
of
Nat
ura
l Pro
du
cts
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
Lett
ers
Jou
rnal
of
Pro
teo
me
Res
earc
h
Org
anic
Pro
cess
Re
sear
ch &
Dev
elo
pm
ent
AC
S C
atal
ysis
Bio
con
juga
te C
hem
istr
y
AC
S A
pp
lied
Mat
eria
ls &
Inte
rfac
es
Cry
stal
Gro
wth
& D
esi
gn
Mo
lecu
lar
Ph
arm
ace
uti
cs
AC
S C
hem
ical
Bio
logy
Jou
rnal
of
Ch
em
ical
Info
rmat
ion
an
d M
od
elin
g
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
AC
S C
hem
ical
Ne
uro
scie
nce
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Pro
cess
Des
ign
an
d…
AC
S C
om
bin
ato
rial
Sci
ence
Jou
rnal
of
Ch
em
ical
Th
eo
ry a
nd
Co
mp
uta
tio
n
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Fun
dam
enta
ls
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Pro
du
ct R
ese
arch
an
d…
AC
S M
edic
inal
Ch
emis
try
Lett
ers
Bio
tech
no
logy
Pro
gres
s
AC
S M
acro
Le
tte
rs
AC
S Su
stai
nab
le C
hem
istr
y &
En
gin
eer
ing
AC
S Sy
nth
eti
c B
iolo
gy
Ch
em
ical
& E
ngi
nee
rin
g N
ews
Arc
hiv
e
Envi
ron
men
tal S
cie
nce
& T
ech
no
logy
Let
ters
Average (Mean) Downloads / Title / Year
0
1000
2000
3000
4000
5000
6000
7000
8000
9000Jo
urn
al o
f th
e A
me
rica
n C
hem
ical
So
ciet
y
Jou
rnal
of
Agr
icu
ltu
ral a
nd
Fo
od
Ch
emis
try
Envi
ron
men
tal S
cie
nce
& T
ech
no
logy
The
Jo
urn
al o
f O
rgan
ic C
hem
istr
y
Lan
gmu
ir
An
alyt
ical
Ch
em
istr
y
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
C
Org
anic
Le
tter
s
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
B
Bio
che
mis
try
Jou
rnal
of
Med
icin
al C
he
mis
try
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Res
earc
h
Ino
rgan
ic C
he
mis
try
Ch
em
ical
Rev
iew
s
Ener
gy &
Fu
els
Nan
o L
ett
ers
Jou
rnal
of
Ch
em
ical
& E
ngi
ne
erin
g D
ata
Org
ano
met
allic
s
AC
S N
ano
Jou
rnal
of
Ch
em
ical
Ed
uca
tio
n
Ch
em
istr
y o
f M
ater
ials
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
A
Mac
rom
ole
cule
s
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
Acc
ou
nts
of
Ch
emic
al R
esea
rch
Bio
mac
rom
ole
cule
s
Ch
em
ical
Res
earc
h in
To
xico
logy
Jou
rnal
of
Nat
ura
l Pro
du
cts
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
Lett
ers
Jou
rnal
of
Pro
teo
me
Res
earc
h
Org
anic
Pro
cess
Re
sear
ch &
Dev
elo
pm
ent
AC
S C
atal
ysis
Bio
con
juga
te C
hem
istr
y
AC
S A
pp
lied
Mat
eria
ls &
Inte
rfac
es
Cry
stal
Gro
wth
& D
esi
gn
Mo
lecu
lar
Ph
arm
ace
uti
cs
AC
S C
hem
ical
Bio
logy
Jou
rnal
of
Ch
em
ical
Info
rmat
ion
an
d M
od
elin
g
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
AC
S C
hem
ical
Ne
uro
scie
nce
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Pro
cess
Des
ign
an
d…
AC
S C
om
bin
ato
rial
Sci
ence
Jou
rnal
of
Ch
em
ical
Th
eo
ry a
nd
Co
mp
uta
tio
n
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Fun
dam
enta
ls
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Pro
du
ct R
ese
arch
an
d…
AC
S M
edic
inal
Ch
emis
try
Lett
ers
Bio
tech
no
logy
Pro
gres
s
AC
S M
acro
Le
tte
rs
AC
S Su
stai
nab
le C
hem
istr
y &
En
gin
eer
ing
AC
S Sy
nth
eti
c B
iolo
gy
Ch
em
ical
& E
ngi
nee
rin
g N
ews
Arc
hiv
e
Envi
ron
men
tal S
cie
nce
& T
ech
no
logy
Let
ters
Average (Mean) Downloads / Title, 2011-2013
Zone 13 titlesESSENTIAL
0
1000
2000
3000
4000
5000
6000
7000
8000
9000Jo
urn
al o
f th
e A
me
rica
n C
hem
ical
So
ciet
y
Jou
rnal
of
Agr
icu
ltu
ral a
nd
Fo
od
Ch
emis
try
Envi
ron
men
tal S
cie
nce
& T
ech
no
logy
The
Jo
urn
al o
f O
rgan
ic C
hem
istr
y
Lan
gmu
ir
An
alyt
ical
Ch
em
istr
y
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
C
Org
anic
Le
tter
s
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
B
Bio
che
mis
try
Jou
rnal
of
Med
icin
al C
he
mis
try
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Res
earc
h
Ino
rgan
ic C
he
mis
try
Ch
em
ical
Rev
iew
s
Ener
gy &
Fu
els
Nan
o L
ett
ers
Jou
rnal
of
Ch
em
ical
& E
ngi
ne
erin
g D
ata
Org
ano
met
allic
s
AC
S N
ano
Jou
rnal
of
Ch
em
ical
Ed
uca
tio
n
Ch
em
istr
y o
f M
ater
ials
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
A
Mac
rom
ole
cule
s
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
Acc
ou
nts
of
Ch
emic
al R
esea
rch
Bio
mac
rom
ole
cule
s
Ch
em
ical
Res
earc
h in
To
xico
logy
Jou
rnal
of
Nat
ura
l Pro
du
cts
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
Lett
ers
Jou
rnal
of
Pro
teo
me
Res
earc
h
Org
anic
Pro
cess
Re
sear
ch &
Dev
elo
pm
ent
AC
S C
atal
ysis
Bio
con
juga
te C
hem
istr
y
AC
S A
pp
lied
Mat
eria
ls &
Inte
rfac
es
Cry
stal
Gro
wth
& D
esi
gn
Mo
lecu
lar
Ph
arm
ace
uti
cs
AC
S C
hem
ical
Bio
logy
Jou
rnal
of
Ch
em
ical
Info
rmat
ion
an
d M
od
elin
g
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
AC
S C
hem
ical
Ne
uro
scie
nce
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Pro
cess
Des
ign
an
d…
AC
S C
om
bin
ato
rial
Sci
ence
Jou
rnal
of
Ch
em
ical
Th
eo
ry a
nd
Co
mp
uta
tio
n
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Fun
dam
enta
ls
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Pro
du
ct R
ese
arch
an
d…
AC
S M
edic
inal
Ch
emis
try
Lett
ers
Bio
tech
no
logy
Pro
gres
s
AC
S M
acro
Le
tte
rs
AC
S Su
stai
nab
le C
hem
istr
y &
En
gin
eer
ing
AC
S Sy
nth
eti
c B
iolo
gy
Ch
em
ical
& E
ngi
nee
rin
g N
ews
Arc
hiv
e
Envi
ron
men
tal S
cie
nce
& T
ech
no
logy
Let
ters
Average (Mean) Downloads / Title, 2011-2013
Zone 28 titlesGood to have
Zone 13 titlesESSENTIAL
0
1000
2000
3000
4000
5000
6000
7000
8000
9000Jo
urn
al o
f th
e A
me
rica
n C
hem
ical
So
ciet
y
Jou
rnal
of
Agr
icu
ltu
ral a
nd
Fo
od
Ch
emis
try
Envi
ron
men
tal S
cie
nce
& T
ech
no
logy
The
Jo
urn
al o
f O
rgan
ic C
hem
istr
y
Lan
gmu
ir
An
alyt
ical
Ch
em
istr
y
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
C
Org
anic
Le
tter
s
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
B
Bio
che
mis
try
Jou
rnal
of
Med
icin
al C
he
mis
try
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Res
earc
h
Ino
rgan
ic C
he
mis
try
Ch
em
ical
Rev
iew
s
Ener
gy &
Fu
els
Nan
o L
ett
ers
Jou
rnal
of
Ch
em
ical
& E
ngi
ne
erin
g D
ata
Org
ano
met
allic
s
AC
S N
ano
Jou
rnal
of
Ch
em
ical
Ed
uca
tio
n
Ch
em
istr
y o
f M
ater
ials
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
A
Mac
rom
ole
cule
s
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
Acc
ou
nts
of
Ch
emic
al R
esea
rch
Bio
mac
rom
ole
cule
s
Ch
em
ical
Res
earc
h in
To
xico
logy
Jou
rnal
of
Nat
ura
l Pro
du
cts
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
Lett
ers
Jou
rnal
of
Pro
teo
me
Res
earc
h
Org
anic
Pro
cess
Re
sear
ch &
Dev
elo
pm
ent
AC
S C
atal
ysis
Bio
con
juga
te C
hem
istr
y
AC
S A
pp
lied
Mat
eria
ls &
Inte
rfac
es
Cry
stal
Gro
wth
& D
esi
gn
Mo
lecu
lar
Ph
arm
ace
uti
cs
AC
S C
hem
ical
Bio
logy
Jou
rnal
of
Ch
em
ical
Info
rmat
ion
an
d M
od
elin
g
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
AC
S C
hem
ical
Ne
uro
scie
nce
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Pro
cess
Des
ign
an
d…
AC
S C
om
bin
ato
rial
Sci
ence
Jou
rnal
of
Ch
em
ical
Th
eo
ry a
nd
Co
mp
uta
tio
n
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Fun
dam
enta
ls
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Pro
du
ct R
ese
arch
an
d…
AC
S M
edic
inal
Ch
emis
try
Lett
ers
Bio
tech
no
logy
Pro
gres
s
AC
S M
acro
Le
tte
rs
AC
S Su
stai
nab
le C
hem
istr
y &
En
gin
eer
ing
AC
S Sy
nth
eti
c B
iolo
gy
Ch
em
ical
& E
ngi
nee
rin
g N
ews
Arc
hiv
e
Envi
ron
men
tal S
cie
nce
& T
ech
no
logy
Let
ters
Average (Mean) Downloads / Title, 2011-2013
Zone 28 titlesGood to have Zone 3
All the rest“Unnecessary”
Zone 13 titlesESSENTIAL
To Keep (Based on Usage)
ACS Journal Title
Journal of the American Chemical Society
Journal of Agricultural and Food Chemistry
Environmental Science & Technology
The Journal of Organic Chemistry
Langmuir
Analytical Chemistry
The Journal of Physical Chemistry A, B, & C
Organic Letters
Biochemistry
Journal of Medicinal Chemistry
Zone 1ESSENTIAL
Zone 2Good to have
Citation Analysis
Citation Analysis Part 1:Chemistry Researchers’ Publication Venues
• affiliation searches of Scopus & WoS for 2011-2013
• Scopus = 185; WoS = 175
Citation Analysis Part 1:Chemistry Researchers’ Publication Venues
• affiliation searches of Scopus & WoS for 2011-2013
• Scopus = 185; WoS = 175
Citation Analysis Part 1:Chemistry Researchers’ Publication Venues
• affiliation searches of Scopus & WoS for 2011-2013
• Scopus = 185; WoS = 175
• 185 articles in 93 unique titles (ALL publishers)
• 53 of 93 titles were only published in once in the three years
• 15 of 93 titles are ACS journals (16.1%)
0
2
4
6
8
10
12Jo
urn
al o
f C
ollo
id a
nd
Inte
rfac
e Sc
ien
ce
Jou
rnal
of
Ch
em
ical
Ph
ysic
s
Ch
em
ical
Co
mm
un
icat
ion
s
Ph
ysic
al C
hem
istr
y C
he
mic
al P
hys
ics
Can
adia
n J
ou
rnal
of
Ch
emis
try
Org
anic
Le
tter
s
Bio
che
mis
try
Elec
tro
chim
ica
Act
a
Jou
rnal
of
Ph
ysic
al C
hem
istr
y B
Org
anic
an
d B
iom
ole
cula
r C
he
mis
try
Ph
yto
che
mis
try
AC
S C
atal
ysis
Aip
Co
nfe
ren
ce P
roce
edin
gs
Bio
che
mic
al J
ou
rnal
Fun
gal G
enet
ics
and
Bio
logy
Jou
rnal
of
Bio
logi
cal C
he
mis
try
Jou
rnal
of
Org
anic
Ch
emis
try
Jou
rnal
of
the
Am
eri
can
Ch
emic
al S
oci
ety
Ph
ysic
al R
evie
w E
Sta
tist
ical
No
nlin
ear
and
So
ft M
atte
r…
Spe
ctro
chim
ica
Act
a P
art
A M
ole
cula
r an
d B
iom
ole
cula
r…
AC
S A
pp
lied
Mat
eria
ls a
nd
Inte
rfac
es
An
gew
and
te C
he
mie
Inte
rnat
ion
al E
dit
ion
Car
bo
hyd
rate
Po
lym
ers
Cat
alys
is T
od
ay
Ch
em
ical
Ph
ysic
s Le
tter
s
Ch
em
susc
he
m
Cu
rre
nt
Org
anic
Ch
emis
try
Euro
pe
an J
ou
rnal
of
Ph
arm
ace
uti
cs a
nd
Bio
ph
arm
ace
uti
cs
Gen
e Th
erap
y
Ind
ust
rial
an
d E
ngi
nee
rin
g C
hem
istr
y R
esea
rch
Ino
rgan
ica
Ch
imic
a A
cta
Inte
rnat
ion
al J
ou
rnal
of
Nan
om
edic
ine
Jou
rnal
of
Bio
chem
istr
y
Jou
rnal
of
Dis
per
sio
n S
cie
nce
an
d T
ech
no
logy
Jou
rnal
of
Ele
ctro
n S
pe
ctro
sco
py
and
Rel
ate
d P
he
no
men
a
Jou
rnal
of
Mo
lecu
lar
Cat
alys
is B
En
zym
atic
Jou
rnal
of
Nan
ob
iote
chn
olo
gy
Jou
rnal
of
Ph
ysic
s an
d C
hem
istr
y o
f So
lids
Mar
ine
Dru
gs
Mat
eri
als
Lett
ers
Mo
lecu
lar
Pla
nt
Pat
ho
logy
Nat
ura
l Pro
du
ct R
ep
ort
s
Org
ano
met
allic
s
Plo
s O
ne
Pro
tein
Sci
ence
Sem
ico
nd
uct
or
Scie
nce
an
d T
ech
no
logy
Syn
thes
is
Chemistry Researchers’ Publication Venues (2011-2013)
0
2
4
6
8
10
12Jo
urn
al o
f C
ollo
id a
nd
Inte
rfac
e Sc
ien
ce
Jou
rnal
of
Ch
em
ical
Ph
ysic
s
Ch
em
ical
Co
mm
un
icat
ion
s
Ph
ysic
al C
hem
istr
y C
he
mic
al P
hys
ics
Can
adia
n J
ou
rnal
of
Ch
emis
try
Org
anic
Le
tter
s
Bio
che
mis
try
Elec
tro
chim
ica
Act
a
Jou
rnal
of
Ph
ysic
al C
hem
istr
y B
Org
anic
an
d B
iom
ole
cula
r C
he
mis
try
Ph
yto
che
mis
try
AC
S C
atal
ysis
Aip
Co
nfe
ren
ce P
roce
edin
gs
Bio
che
mic
al J
ou
rnal
Fun
gal G
enet
ics
and
Bio
logy
Jou
rnal
of
Bio
logi
cal C
he
mis
try
Jou
rnal
of
Org
anic
Ch
emis
try
Jou
rnal
of
the
Am
eri
can
Ch
emic
al S
oci
ety
Ph
ysic
al R
evie
w E
Sta
tist
ical
No
nlin
ear
and
So
ft M
atte
r…
Spe
ctro
chim
ica
Act
a P
art
A M
ole
cula
r an
d B
iom
ole
cula
r…
AC
S A
pp
lied
Mat
eria
ls a
nd
Inte
rfac
es
An
gew
and
te C
he
mie
Inte
rnat
ion
al E
dit
ion
Car
bo
hyd
rate
Po
lym
ers
Cat
alys
is T
od
ay
Ch
em
ical
Ph
ysic
s Le
tter
s
Ch
em
susc
he
m
Cu
rre
nt
Org
anic
Ch
emis
try
Euro
pe
an J
ou
rnal
of
Ph
arm
ace
uti
cs a
nd
Bio
ph
arm
ace
uti
cs
Gen
e Th
erap
y
Ind
ust
rial
an
d E
ngi
nee
rin
g C
hem
istr
y R
esea
rch
Ino
rgan
ica
Ch
imic
a A
cta
Inte
rnat
ion
al J
ou
rnal
of
Nan
om
edic
ine
Jou
rnal
of
Bio
chem
istr
y
Jou
rnal
of
Dis
per
sio
n S
cie
nce
an
d T
ech
no
logy
Jou
rnal
of
Ele
ctro
n S
pe
ctro
sco
py
and
Rel
ate
d P
he
no
men
a
Jou
rnal
of
Mo
lecu
lar
Cat
alys
is B
En
zym
atic
Jou
rnal
of
Nan
ob
iote
chn
olo
gy
Jou
rnal
of
Ph
ysic
s an
d C
hem
istr
y o
f So
lids
Mar
ine
Dru
gs
Mat
eri
als
Lett
ers
Mo
lecu
lar
Pla
nt
Pat
ho
logy
Nat
ura
l Pro
du
ct R
ep
ort
s
Org
ano
met
allic
s
Plo
s O
ne
Pro
tein
Sci
ence
Sem
ico
nd
uct
or
Scie
nce
an
d T
ech
no
logy
Syn
thes
is
Chemistry Researchers’ Publication Venues (2011-2013)
ACS titles in red
0
2
4
6
8
10
12
Chemistry Researchers’ Publication Venues (2011-2013) ACS Titles in Red
Zone 111 titles (5 ACS)ESSENTIAL
Zone 3All the rest“Unnecessary”
Zone 229 titles (7 ACS)Good to have
0
2
4
6
8
10
12
Chemistry Researchers’ Publication Venues (2011-2013) ACS Titles in Red
Langmuir (8x)
J. Phys. Chem. C (5x)
J. Phys. Chem. A; Organic Letters (4x each)
Analytical Chemistry; Biochemistry; J. Phys. Chem. B (3x each)
ACS Catalysis; J. Org. Chem.; J. Phys. Chem. Lett.; JACS (2x each)
Chem. Mater.; J. Agric. Food. Chem.; Organometallics (1x each)
Inorganic Chemistry (6x)
To Keep (Based on Citation Analysis Part 1)
ACS Journal Title
Langmuir
Inorganic Chemistry
The Journal of Physical Chemistry A, B, & C
Organic Letters
Analytical Chemistry
Biochemistry
ACS Catalysis
Journal of Organic Chemistry
Journal of Physical Chemistry Letters
Journal of the American Chemical Society
Zone 1ESSENTIAL
Zone 2Good to have
Citation Analysis Part 2:Chemistry Researcher’s Reference Lists
• From the 185 articles published in 2011-2013...
6733 references cited
• List of 6733 sorted by most cited titles
Citation Analysis Part 2:Chemistry Researcher’s Reference Lists
• From the 185 articles published in 2011-2013...
6733 references cited
• List of 6733 sorted by most cited titles
• Used Bradford’s Law to divide list into 3 roughly equal parts
• First 1/3 = 26 journals (10 ACS)
= ESSENTIAL
Source Title Times Cited
Journal of the American Chemical Society 310
Langmuir 157
Journal of Organic Chemistry 139
Journal of Chemical Physics 134
Journal of Physical Chemistry B 126
Angewandte Chemie - International Edition 104
Tetrahedron Letters 97
Tetrahedron 81
Chemical Communications 78
Physical Review Letters 77
Organometallics 76
Proceedings of the National Academy of Sciences of the United States of America 74
Science 73
Journal of Electroanalytical Chemistry 71
Journal of Physical Chemistry C 69
Journal of Biological Chemistry 64
Chemical Reviews 61
Journal of Physical Chemistry A 60
Nature 54
Journal of Physical Chemistry 52
Physical Review B 50
Physical Review B - Condensed Matter and Materials Physics 50
Organic Letters 49
Journal of Colloid And Interface Science 48
Journal of Organometallic Chemistry 48
Chemistry - A European Journal 46
ACS Journal Title
Journal of the American Chemical Society
Langmuir
The Journal of Organic Chemistry
The Journal of Physical Chemistry A, B, & C
Organometallics
Chemical Reviews
Organic Letters
To Keep (Based on Citation Analysis Part 2)
Zone 1ESSENTIAL
ACS Journal Title
Analytical Chemistry
Inorganic Chemistry
Biochemistry
Accounts of Chemical Research
Chemistry of Materials
Environmental Science & Technology
Nano Letters
ACS Nano
Journal of Medicinal Chemistry
Macromolecules
Energy & Fuels
Crystal Growth & Design
Journal of Agricultural and Food Chemistry
Journal of Physical Chemistry Letters
To Keep (Based on Citation Analysis Part 2)
Zone 2Good to have
User Survey
Survey Details
• Opinions of chemistry faculty, grad students, & other individuals in dept
• Asked to rank each ACS journal by
– Essential
–Good to have
–Unnecessary
Survey Details
• Link sent through Department of Chemistry email list
• Remained open for 3 weeks (Aug/Sept 2013)
• One reminder sent
Survey Details
• 48 responses (of a possible 130)
= 36.9% response rate
• 12 of 18 faculty responded
• 26 of 80 grad students responded
0
5
10
15
20
25
30
35
40
45Jo
urn
al o
f th
e A
me
rica
n C
hem
ical
So
ciet
y
Ch
em
ical
Rev
iew
s
The
Jo
urn
al o
f O
rgan
ic C
hem
istr
y
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
A
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
B
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
C
Ino
rgan
ic C
he
mis
try
Org
anic
Le
tter
s
Ch
em
istr
y o
f M
ater
ials
Lan
gmu
ir
Nan
o L
ett
ers
AC
S N
ano
An
alyt
ical
Ch
em
istr
y
The
Jo
urn
al o
f P
hys
ical
Ch
emis
try
Lett
ers
Jou
rnal
of
Ch
em
ical
Ed
uca
tio
n
Mac
rom
ole
cule
s
AC
S A
pp
lied
Mat
eria
ls &
Inte
rfac
es
Org
ano
met
allic
s
Acc
ou
nts
of
Ch
emic
al R
esea
rch
Bio
che
mis
try
Jou
rnal
of
Nat
ura
l Pro
du
cts
Envi
ron
men
tal S
cie
nce
& T
ech
no
logy
AC
S C
atal
ysis
AC
S C
hem
ical
Bio
logy
Jou
rnal
of
Med
icin
al C
he
mis
try
Bio
mac
rom
ole
cule
s
Cry
stal
Gro
wth
& D
esi
gn
Ener
gy &
Fu
els
Jou
rnal
of
Ch
em
ical
Th
eo
ry a
nd
Co
mp
uta
tio
n
Org
anic
Pro
cess
Re
sear
ch &
Dev
elo
pm
ent
Jou
rnal
of
Agr
icu
ltu
re a
nd
Fo
od
Ch
em
istr
y
Jou
rnal
of
Ch
em
ical
& E
ngi
ne
erin
g D
ata
Jou
rnal
of
Ch
em
ical
Info
rmat
ion
an
d M
od
elin
g
Ch
em
ical
& E
ngi
nee
rin
g N
ews
(C&
EN)
Jou
rnal
of
Pro
teo
me
Res
earc
h
Mo
lecu
lar
Ph
arm
ace
uti
cs
Bio
con
juga
te C
hem
istr
y
Ch
em
ical
Res
earc
h in
To
xico
logy
AC
S C
om
bin
ato
rial
Sci
ence
Ind
ust
rial
& E
ngi
ne
erin
g C
he
mis
try
Res
earc
h
AC
S C
hem
ical
Ne
uro
scie
nce
Unnecessary
Good to Have
Essential
0
5
10
15
20
25
30
35
40
45Unnecessary
Good to Have
Essential
Zone 18 titlesESSENTIAL
Zone 210 titlesGood to have
Zone 3All the rest“Unnecessary”
ACS Journal Title
Journal of the American Chemical Society
Chemical Reviews
The Journal of Organic Chemistry
The Journal of Physical Chemistry A, B, & C
Inorganic Chemistry
Organic Letters
To Keep (Based on Survey)
Zone 1ESSENTIAL
ACS Journal Title
Chemistry of Materials
Langmuir
Nano Letters
ACS Nano
Analytical Chemistry
Journal of Physical Chemistry Letters
Journal of Chemical Education
Macromolecules
ACS Applied Materials & Interfaces
Organometallics
To Keep (Based on Survey)
Zone 2Good to have
Pulling it all together!
To Keep (Overall) – Essentials (10)
ACS Journal Title
Journal of the American Chemical Society
Chemical Reviews
The Journal of Organic Chemistry
The Journal of Physical Chemistry A, B, & C
Inorganic Chemistry
Organic Letters
Journal of Agricultural and Food Chemistry
Environmental Science & Technology
Langmuir
Organometallics
To Keep (Overall) – Good to Haves (8)
ACS Journal Title
Analytical Chemistry
Journal of Physical Chemistry Letters
Biochemistry
Journal of Medicinal Chemistry
Chemistry of Materials
Nano Letters
ACS Nano
Macromolecules
To Keep (Overall) – Wildcards (2)
ACS Journal Title
Accounts of Chemical Research
Journal of Chemical Education
Conclusions
• This analysis was a lot of work but...
– Enables me to feel more confident in making the hard choices
– Several sources of data supporting my decisions = easier to convince researchers (evidence-based)
Conclusions
• This analysis was a lot of work but...
– Enables me to feel more confident in making the hard choices
– Several sources of data supporting my decisions = easier to convince researchers (evidence-based)
– Including researchers in the decisions gives them a voice and “gets them on side”
Conclusions
• Dept of Chem researchers NOT only users of this bundle (as we previously assumed)
–Might have important implications down the road
Limitations
• Only Dept of Chem researchers studied (except for usage data)
• Bradford’s Law works best for sub-disciplines (i.e. not entire field of chemistry!)
Limitations
• Only Dept of Chem researchers studied (except for usage data)
• Bradford’s Law works best for sub-disciplines (i.e. not entire field of chemistry!)
• Only the last 3 yrs of data included
• Data represents a current “snapshot”
–Cannot necessarily predict future patterns
Limitations
• Only Dept of Chem researchers studied (except for usage data)
• Bradford’s Law works best for sub-disciplines (i.e. not entire field of chemistry!)
• Only the last 3 yrs of data included
• Data represents a current “snapshot”
–Cannot necessarily predict future patterns
• Not a “bullet-proof” analysis
Discussion
• Comprehensive methodology necessary?
– Time consuming, labour intensive
– Likely not practical for much larger, multi-disc bundles (e.g. SD Freedom Collection)
Discussion
• Worthwhile in some cases, such as when...
– Faculty have strong connection to package
–Politics/controversy involved
= necessary to have evidence-based data to support case for which titles to cancel
Questions?
Acknowledgements:C. Sorensen helped supply usage data and provided valuable comments on analysisJ. Lamothe & J. McLean assisted with various collections-related detailsThe entire Department of Chemistry, UofS, was engaged and supportive during this process
