Embed Size (px)
Citation preview
Research Assessment for Ranking Purposes
Dr. Walid HassanHead of Consultancy Services and Client Education
Clarivate Analytics 2018
2
The world of today: major challenges and opportunities
Data growing in volume and
complexity
Cyber threats and data privacy
compliance
Difficulty predicting the future amidst constant change
Doing morewith less
Knowing who to partner with
and how
Interdisciplinary data for research
“Free information”/ open science/
open data
AI / text mining
Globalization & regionalization
Spotting emerging research trends
Clarivate operates at the center of the innovation lifecycle
4
Scientific and academic research
Patent research intelligenceIndustry codes and standards
Life sciences intelligence
Trademark researchand protection
Domain and brand protection Intellectual property management
A portfolio of trusted brands
5
More than a century and a half of trusted insights
BIOSIS founded by Society of Bacteriologists and Botanical SocietySCIENTIFIC AND ACADEMIC RESEARCH
Zoological Records founded by
Zoological Society of London and
British MuseumSCIENTIFIC AND
ACADEMIC RESEARCH
Dr. Eugene Garfield invents citation indexing
and searchingSCIENTIFIC AND
ACADEMIC RESEARCH
Monty Hyams begins selling patent bulletins
from his home, DerwentIP AND STANDARDS
ISI foundedSCIENTIFIC AND ACADEMIC RESEARCH
1864
1926
1955
1957
1963 1980s
1997
2011
2012
2016
2017
Thomson acquired trademark research companies Thomson & Thomson and COMPUMARK
Web of Science launchedSCIENTIFIC AND
ACADEMIC RESEARCH
Cortellis launchedLIFE SCIENCES
Thomson Reuters acquired
MARKMONITOR
Clarivate Analytics launched, following sale of Thomson Reuters Intellectual Property and Science businessCLARIVATE ANALYTICS
Publons acquiredSCIENTIFIC AND
ACADEMIC RESEARCH
6
Businesses run on Clarivate Analytics insights
Academicinstitutions
Commercialenterprises
Governments 49 of the top 50 pharma companies use Cortellis
More than half of Fortune 100 uses MarkMonitor
9 in 10 of the world’s most valuable brands use CompuMark
40+Patent issuing authorities worldwide use
Derwent World Patents Index
1 billioncited references are accessible through Web of Science
Universities should be about more thandeveloping work skills. They must alsobe about producing civic-minded andcritically engaged citizens
Dr. Henry Giroux
8
Agenda
Why University ranking?What are the main ranking systems?Diagnosis of the research-dose in the ranking systemsHow to boost ranking via “better” researchStrategize and mobilize your research activitiesCase Study
9
Why Universities rankings?
Attract best researchers
Get more governmental funding
Attract more students, better financial situation
Gain an international profile and complete the institution portfolio
10
What are the main ranking systems?
Rank
ing
Agen
cies
/Ass
ocia
tions
Magazines
Newspapers
Websites
Governments
Academics
11
Diagnosis of ranking systems
Shanghai (ARWU)1. Quality of education (Nobel prizes and field medals)2. Quality of faculty (Prizes and highly cited researchers)3. Research output4. Per capita performance
12
Diagnosis of ranking systems
13
Diagnosis of ranking systems
Research-dose in Shanghai (ARWU)
1. Number of indexed publications: 20%2. Highly cited researchers: 20%3. Articles in Nature or Science: 20%
14
Diagnosis of ranking systems
TIMES higher education
1. Teaching2. Research3. Citations4. Industry Income5. International outlook
15
Diagnosis of ranking systems
16
Diagnosis of ranking systems
Direct Research dose in TIMES higher education
1. Research: 30%2. Citations: 30%3. Number of articles with international collaborations: 2.5%
17
Diagnosis of ranking systems
QS1. Academic reputation: 40%2. Employer reputation: 10%3. Faculty students ratio: 20% 4. International faculty: 5%5. International students: 5%6. Citations per faculty: 20%
18
Diagnosis of ranking systems
CWTS Leiden Ranking
1. Largest number of Publications2. Mean citation score3. Proportion of top 10% of publications
19
Diagnosis of ranking systems
Research dose in CWTS Leiden Ranking (100%)
1. Number of publications2. Number of citations3. Number of articles with international/industrial/etc. collaboration4. Number/percent of articles in the most cited position
20
Diagnosis of ranking systems
Reuters
Solely on Research Articles and Patents !
21
Diagnosis of ranking systems
Research dose in Reuters
1. Number of publications2. Number of citations3. Number of articles with industry collaboration4. Industry articles citation5. Patents filled6. Patents awarded7. Patents filled globally8. Number of publications cited by patents9. Percent of Industry Collaborative Articles
22
Rethinking: Where all starts
Benchmarking
BENCHMARKING
The main Pillar of Strategic Planning
24
BENCHMARKINGBENCHMARKING
Strategizing the Step from A to B
Check Strategic Planning Services Provided by Clarivate Analytics
25
BENCHMARKING IN RESEARCH
26
GOALS AND OBJECTIVESIn
puts Human
Resources
Funding
Facilities
Administration
Social Capital
Activ
ities Research
Education & Training
Partnership
Recruitment
Thought Leadership
Out
puts Publications
Graduates
Collaborations
Innovation
New Resources
Out
com
es Scientific Impact
Societal Impact
International Reputation
Increased Funding
27KPI’s
28
PLANNING
ARE WE DOINGTHE RIGHT THING?
• Theory Evaluations• Mission statement
development• Needs assessments• Strategic planning
ARE WE DOINGTHE RIGHT THING, SURE?
• Process Evaluations• Regular progress reports• Monitoring databases and
user interface systems• Resource usage tracking
WHAT WE CAN DO TO MAKE A DIFFERENCE?
• Outcome Evaluations• Output tracking• Performance
benchmarking• Longitudinal attribution
29
Who are the stakeholders?
Executives
Researchers
Funders
Partners
Public
What domains are being addressed?
Need
Design
Implementation
Impact and outcome
Efficiency
How is the information presented?
Summary
Detailed report
Presentation
Infographic
Campaign
What are the expected returns?
Awareness
Advocacy
Accountability
Action
Assets
CAPITALISE
30Research Organization Challenges
ResearcherProfiles
ResearchOutput Funders
Collaboration Workflow Reporting
Check CONVERIS solution Provided by Clarivate Analytics
31
Teaching Citations Publications
Patents Reputation Income
International Collaboration
Industrial Collaboration
Employer feedback
Faculty/students ratio Nobel prizes Field medals
Pool of Criteria
Opportunity !
32
Challenges and Repartition
The Start Point for a Researcher
Researchers are challenged at the first moment, when defining their research subject area
34
Topics Strategy
35 USD billions has been wasted developing things thatare already documented in a patentspecification.(Source: British Patent Office, 2000)
35Patents Versus Publications
36
Take a Breathe – 3 mins
R&D Strategy
38
Types of Research
39Pathway from Research to IP, Strategy
Fundamental
Publications
Citations, Visibility
Research Community (Academia)
Applied
Patents
Licensing
Industry
Theories, methodologies
Applications
IPKnow HowVa
luat
ion
40
Positioning of needs: University
41
University: Opportunities and Challenges
42
State of Art and Positioning of needs: Industry
43
University and Industry
44
Research Output
45Citations: coins of research
EUGENE GARFIELD’S “ASSOCIATION OF IDEAS INDEX”
Check Web of Science Provided by Clarivate Analytics
46Impact Relative to World
Impact Relative to World:
Citation impact of the set of publications as a ratio of world average
47
Normalized Citation Impact
The Normalized Citation Impact (NCI) of a document is calculated by dividing the actual count of citing items by the expected citation rate for documents with the same document type, year of publication and subject area.
For a single paper that is only assigned to one subject area:
For a single paper that is assigned to multiple subjects:
For a group of papers, the NCI value is the average of the values for each of the papers:
Check INCITES Provided by Clarivate Analytics
48REPUTATION INDICATORS
49
Research Output
50
Working on Ranking
Case Study: Research Score
51
ARW: Ranking Versus Publications
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
0
5
10
15
20
25
0
5000
10000
15000
20000
25000
52
Concentration
y = -137.34x + 8640R² = 0.063
0
5000
10000
15000
20000
25000
0 5 10 15 20 25
Num
ber o
f Pub
licat
ions
Shanghai Ranking
53
THE ranking
1 2 3 4 5 6 7 8 9 10 1012 13 14 15 16 17 18 19 20
0
5
10
15
20
25
0
5000
10000
15000
20000
25000
54
THE- Concentration
y = -64.275x + 7679.7R² = 0.0135
0
5000
10000
15000
20000
25000
0 5 10 15 20 25
Num
ber o
f Pub
licat
ions
THE Ranking
55
Affinity WOS- Shanghai Ranking
56
Affinity WOS- THE
57Shanghai and Research Quality
58
THE and Research Quality
59
QScore - Shanghai
QScore =4*Q1+3*Q2+2*Q3+1*Q4
60
THE- QScore
QScore =4*Q1+3*Q2+2*Q3+1*Q4
61
QScore per Ranking
