Embed Size (px)
DESCRIPTION
This presentation to the ASIDIC spring meeting provided a Case study from the American Association of Cancer Research and how they improved their peer review process utilizing the Collexis Reviewer Finder application.
Citation preview
Darrell W. Gunter
EVP / CMO
Collexis Holdings, Inc.
March 23, 2010
Spring ConferenceCONTENT: Uncovering the Value and Benefits of Semantic Technology
Case Study #2 - Enriching the editor’s experience with peer review
Topics for our discussion today
• The AACR situation
• The Collexis technology
• How the technology is applied to AACR’s situation
• The benefits of the solution
- The Situation
• AACR wanted to achieve the following objectiveso Expand their Peer Reviewer pool
o Find the best reviewer based on a key concept
o Find the best reviewer free of conflict
o Improve the efficiency and effectiveness of the Peer Review process
Collexis Technology
KnowledgeBase FingerprintText
Expert profiles from documents• Expert profiles are
generated automatically from documents and publications
• By “simple” aggregation of the document fingerprints
• Right: Use of the expert profiles as “science marketing” by the John Hopkins University
The Peer Review Process
• Most important factor to ensure the quality of a journal
• Peer review process – challenges and problemso Workload for the editor and editorial team
o Reviewers only coming from a "inner circle"
o Avoiding incompetent reviewers
o How to identify the best reviewer?
o How to discover conflicts of interest?
o How to balance the workload of reviewers?
o How to make the larger part of the selection process as easy so that it
can be handled by administrative stuff?
.... but still ensure a high quality of selected reviewers!
Indexation Workflow
• Verification of fingerprinting results within seconds
Collexis Peer Reviewer Selection
• Chosing the right reviewers is one of the core
processes to ensure the quality of a journal
• Identifying the reviewers is a very complicated and
time-consuming process
• Collexis expert fingerprints and extensive data mining
to ensure matching expertise and to avoid conflicts of
interest
- the Foundation for Reviewer Selection
• Fully launched in April 2008, BME is the first pre-
populated scientific social network generated from
PubMed articles
• 1.8 million expert profiles generated with the Collexis
disambiguation process
• More than 30 million co-authorship based relations
• 280,000+ registered users!
Disambiguation quality is key for the success!
Disambiguating Authors
By using our disambiguation methods, we can tell who’s who within a set of source documentation, ensuring that our ‘Fingerprint’ is an accurate proxy for that individual’s expertise.
Using identifying elements, determine who’s who:•Name•Location•Co-Authors•Key Concepts•more…
J. Smith
Disambiguating Concepts
Searching for one concept doesn’t require that you know the technical MeSH term – the tools disambiguate concepts for you as well.
Disambiguate searches based on:
•Synonyms•Related terms•Abbreviations
So without knowing MeSH, you can navigate MeSH.
A search for A search for ““neoplasm”neoplasm”
Applying Fingerprints to Organizational Units
Aggregating individual fingerprints across organizational units allows for the organization to know what individuals know and what groups know together…
• What new publications and have been published?
• Who are the emerging authors and where are they publishing?
• Who is working together? • What are the emerging
trends?• What do we know?
Individual Fingerprints
Aggregated Fingerprints
4 Steps to the right reviewerIndexing the manuscripts – basic requirement for the Collexis Reviewer selection
Identifying the author within the Collexis expert database BiomedExperts.com to be able to calculate shortest paths
Match the submitted manuscript against the expert database biomedexperts.com
Result example: matching expertise found, but a direct co-authorship between the author and potential reviewer
Reviewer Selection in 4 StepsIndexing the manuscripts – basic requirement for the Collexis Reviewer selection
Identifying the author within the Collexis expert database BiomedExperts.com to be able to calculate shortest paths
Match the submitted manuscript against the expert database biomedexperts.com
Result example: matching expertise but only a single co-authorship degree of separation between author and potential reviewer
Reviewer Selection in 4 StepsIndexing the manuscripts – basic requirement for the Collexis Reviewer selection
Identifying the author within the Collexis expert database BiomedExperts.com to be able to calculate shortest paths
Match the submitted manuscript against the expert database biomedexperts.com
Result example: matching expertise with multiple co-author degrees of separation between author and potential reviewer
Further steps
• Contacting the reviewero After entering an e-mail address an e-mail template can be generated
incorporating the expert profile of the potential reviewer asking
whether he would be willing to review
o Automated e-mail to the top three candidates with tracking and voting
o automatic assignment if one accepts the peer review offer / burden
Research Profiles: Organizational Views
Research Profiles: Research trends over time
Research Profiles: Internal and External Coauthor Relationships
Research Profiles: Visualizations of Research Network Relationships
Technical Implementation
• Collexis will provide the reviewer selection service in
two ways
Integrated as web services into workflow systems
Peer Reviewer Platform
Technical Implementation
Integrated as web services into workflow systems
Seamless integration
Customized implementation possible – e.g. Study section builder functionalities
Differentiation between internal and external reviewers
Bulk processing of existing internal reviewers
Licensing per article or journal
XML upload of volume or copy & past of single articles
Target groups: Publisher, journals, editors grant funding organizations
Academic organizations for internal reviewing
- The Situation
• AACR wanted to achieve the following objectiveso Expand their Peer Reviewer pool
o Find the best reviewer based on a key concept
o Find the best reviewer free of conflict
o Improve the efficiency and effectiveness of the Peer Review process
Key Benefits Reviewer Finder
• Clarity of manuscript
• Determine the best reviewer
• Free of conflicts
• More efficient and effective process
• Ultimately increases profitability
www.collexis.com
Collexis Reviewer Finder"Your Path To Expertise"
Darrell W. Gunter
+1.973.454.3475
