68
Session 1.4: Think Between the Boxes CASRAI interoperability approach Véronique Kiermer (Nature Publishing Group) Project CRediT: a contributor role taxonomy 0000-0001-8771-7239 @verokiermer Rebecca Lawrence (F1000) Peer Review 0000-0003-4817-8206 @rnl_s Jonas Björck (Swedish National board for research information) & Jessica Lindholm (Chalmers University) Artistic Outputs Articulated: a CASRAI pilot in Sweden 0000-0002-2103-0001 ?? 0000-0002-3634-6471 @jessili Catherine Grout (Jisc) & Ben Ryan (EPSRC) The CASRAI UK pilot

Think between the boxes: the Casrai interoperability approach

Embed Size (px)

Citation preview

Session 1.4: Think Between the BoxesCASRAI interoperability approach

Véronique Kiermer (Nature Publishing Group)Project CRediT: a contributor role taxonomy

0000-0001-8771-7239 @verokiermer

Rebecca Lawrence (F1000)Peer Review

0000-0003-4817-8206 @rnl_s

Jonas Björck (Swedish National board for research information) &Jessica Lindholm (Chalmers University) Artistic Outputs Articulated: a CASRAI pilot in Sweden

0000-0002-2103-0001 ?? 0000-0002-3634-6471 @jessili

Catherine Grout (Jisc) & Ben Ryan (EPSRC)

The CASRAI UK pilot@CatherineGrout and 0000-0003-1028-7220

ORCID-CASRAI

Session 1.4

The UK’s European university

18th May 2015

Simon KerridgeDirector of Research Services

orcid.org/0000-0003-4094-3719

@SimonRKerridge #ORCIDCASRAI15

Chair, ARMA

The Association of Research Managers and Administrators

Session Chair: 0000-0003-4094-3719

Hello! I’m Simon Kerridge, Director of Research Services at the University of Kent in the UK.I am also chair of the UK Association of Research Managers and Administrators, the professional body that represents our 2,600 members based mainly in the UK.I was originally a computer scientist and have been involved in research information management for more years that I care to remember, with a recent focus on identifiers, standards and interoperability.I am also a member of the UK advisory group on the use of metrics in research assessment. http://www.hefce.ac.uk/rsrch/metrics/

Each speaker will have 15 minutes include Q&AThere should be time for a panel session at the end

Véronique Kiermer, PhDDirector, Author and Reviewer ServicesNature Publishing Group

ORCID BoardProject CRediT working group

CRediT

CRediT | ORCID May 2015

A CASRAI – NISO collaboration

The CRediT working group

CRediT taxonomy

CRediT | ORCID May 2015

A simple taxonomy of roles intrinsic to research

Introduction

Authorship and contributions in papers

1CRediT | ORCID May 2015

Authorship current conventions (1)In Biology, complex negotiations lead to the ordering of authors

CRediT | ORCID May 2015

CRediT | ORCID May 2015

Authorship current conventions (2)In high energy physics, very large collaborations are increasingly common

Corresponding Author: The ATLAS Collaboration

[email protected]

List of authors in supplementary material:

12-page PDF for author names onlyalphabetical listing

Authorship current conventions (3)In Economics, it is customary to list authors by alphabetical order

Einav, Liran, and Leeat Yariv. 2006. "What's in a Surname? The Effects of Surname Initials on Academic Success." Journal of Economic Perspectives, 20(1): 175-187.DOI: 10.1257/089533006776526085

CRediT | ORCID May 2015

M.C., J.H., L.L., G.O., J.R.M. and P.D.K. designed the study, analysed the data, and prepared this manuscript. J.H. and L.L. performed B-cell sorting, antibody cloning, epitope mapping assay, MPER-specific neutralizing sera screening and assessed the impact of sequence variation on 10E8 neutralization. M.K.L. and J.R.M. tested the breadth and potency of 10E8. B.C., S.K.S. and R.W. performed the infected cell surface staining and antibody-virion washout assays. S.M.A. and B.F.H. performed the autoreactivity assays. G.O., Y.Y. and P.D.K. performed 10E8 structural analysis, with T.W. and B.Z. assisting with paratope alanine scanning. R.T.B. screened the B-cell culture supernatants for neutralization activity. H.I. sequenced the patient N152 virus. S.A.M. led the clinical care of the patients. M.C., L.L., N.A.D.-R. and N.S.L. optimized B-cell culture protocol.

More transparency in contributions

Nature requires an Author Contributions Statement

The ecosystem of persistent identifiers is growingContributions in a machine readable format can enrich this ecosystem

DOI

CRediT | ORCID May 2015

Micah Altman, MIT Libraries

Nature – 5 years

Taxonomy versus usual

CRediT | ORCID May 2015

With respect to accuracy of author contributions

How does this structured list compare with how you provided author contribution information on your most recent submission to ^f('journalname')^, in terms of accuracy of contributions?

Base: Biomed, n=130; Other, n=99

Biomed Other

1811

3228

3539

7 95 34

9

Much betterA bit betterAbout the sameA bit worseMuch worseDon't know/not sure

The ecosystem of persistent identifiers is growingContributions in a machine readable format can enrich this ecosystem

DOI

DOI

CRediT | ORCID May 2015

accession #DOI

CRediT | ORCID May 2015

2

Project CRediT

An open standard for expressing roles intrinsic to research

Project cycle

CRediT | ORCID May 2015

credit.casrai.org

Review Cycle: • October 2014: Survey for broad

public consultation• December 2014: workshop in

Washington DC

March 2015:Taxonomy published to the CASRAI data dictionary as a first step to standardization

CRediT taxonomy

CRediT | ORCID May 2015

A simple taxonomy of roles intrinsic to research

Important implementation points

CRediT | ORCID May 2015

Taxonomy of contributions does not define authorship!!

The CRediT taxonomy includes, but is not limited to, traditional authorship roles.

These roles are not intended to define what constitutes authorship.

Other implementation points:

• simple for broad adoption, but may require nuances

• multiple contributions

• who assigns?

• acknowledgements

• more than articles

Experiments and applications for a common vocabulary

CRediT | ORCID May 2015

To make contributions portable and machine-readable

Publishers exploring integrations for author contributions

Thank you for listening

[email protected]

CRediT where credit is due :• Amy Brand and Liz Allen for their leadership• The CrediT working group• CASRAI : David Baker, Sheri Belisle• NPG: Philip Campbell

RECOGNISING PEER REVIEW:THE PRS ORCID-CASRAI PROJECT

ORCID-CASRAI meeting, Barcelona, 18 May 2015

Rebecca LawrenceManaging Director, F1000 Research Ltd

[email protected]://f1000research.com

@f1000research | @rnl_s

AGENDA

• Why track peer review service

• The PRS project

• Use cases

• Project outputs

• Call for implementers

• Summary

@rnl_s | @f1000 | @f1000research

WHY TRACK PEER REVIEW SERVICE?

• Peer review takes a significant proportion of researchers’ time

• Peer review as a service is crucial to scientific progress

• Peer review is used in many areas:o Funding – individual and institutional grantso Career progressiono Publishing – books, journals, monographs etco Conferences

• Increasing time pressures on researchers harder to find reviewers:o Reduced funding; increased ‘publish or perish’ cultureo More peer review requests

• Community is asking for better recognition of this key service

@rnl_s | @f1000 | @f1000research

http://casrai.org/standards/subject-groups/peer-review-services

@rnl_s | @f1000 | @f1000research

@rnl_s | @f1000 | @f1000research

USE CASES

• Use Case 1 – Article Peer Review: Open Review

• Use Case 2 – Article Peer Review: Closed Review

• Use Case 3 – Conference Topic/Meeting Abstract Submission Review

• Use Case 4 – General Review Service Recognition

• Use Case 5 – University/Faculty and Department External Review

• Use Case 6 – Annotation

@rnl_s | @f1000 | @f1000research

TYPES OF PEER REVIEW

Paglione, L and Lawrence, RN. Peer review: Data exchange standards to support acknowledgement and verification. Leaned Publishing (2015), in press

@rnl_s | @f1000 | @f1000research

CLOSED–OPEN CONTINUUM OF PEER REVIEW

Paglione, L and Lawrence, RN. Peer review: Data exchange standards to support acknowledgement and verification. Leaned Publishing (2015), in press

@rnl_s | @f1000 | @f1000research

CITATION DATA ELEMENTS AGREED

PERSON: Fields, including a person identifier, describing the person who performed the review and is being recognized for this review activity.

REVIEW: Fields, including a review identifier, describing the review itself. In the case of blind or otherwise unshared reviews, this information may be left blank.

SUBJECT: Fields describing the subject of the review, for example, the paper, grant or other item. In the case of blind or otherwise unshared reviews, this information also may be left blank.

ORGANIZATION: Fields, including an organization identifier, describing the organization that is recognizing the person for review activity, such as a publisher, association or funder.

@rnl_s | @f1000 | @f1000research

WHAT STAGE IS THE PROJECT NOW?

• Draft profile created and was opened up to large Review Circle

• Profile edited based on that feedback, and first version now published: http://dictionary.casrai.org/Peer_Review_Services

• Encouraging implementation by all stakeholder groups. Early adopters include:o F1000: F1000Research and F1000Primeo American Geophysical Union, working with eJournalPresso The APSA’s Politics and Religion journalo Peerage of Scienceo Europe PubMedCentralo Kudos

• Continued monitoring and updates to data profile as necessary

@rnl_s | @f1000 | @f1000research

CALL FOR IMPLEMENTATION

• We call on all organisations that use peer review to enable their referees to get proper credit for the work they do.

• If interested, look at the standard, talk to ORCID, and let us know you are implementing so we can help promote that.

We’ll be promoting this over the next few months soplease help us spread the word!

@rnl_s | @f1000 | @f1000research

Thank you!

[email protected]

@f1000 | @f1000research | @rnl_s

Jonas Björck Chair Swedish National board for Research InformationSwedish Research Council

CASRAI Barcelona 2015

Artistic Outputs Articulated: a CASRAI pilot in Sweden

Swedish National board for Research Information

Swedish Research Council

Jessica LindholmChalmers Library

Contents

• Introduction to CASRAI Pilot• Swedish National Board for Research

Information• Research Information Ecosystem in

Sweden• Outputs pilot conclusions

Outputs Pilot

Aim

• Evaluate CASRAI as standard to be incorporated into the Swedish research information ecosystem

• Collaboration with the development project for SwePub

• Test case: categorisation of research outputs – in particular artistic research output.

Outputs pilot

Working Group

• The Swedish Royal Library, SwePub• Swedish Research Council• CASRAI

Reference group (SwePub)

• Representatives of the artistic research community. Researchers and management

• Universities. Librarians and bibliometricians• Representatives from Swedish funder

agencies

Recipient of results

• Swedish National Board for Research Information

Swedish National Board for Research Information

Composition• Chairman and secretary from the Swedish Research Council• 1 representative of the National Library• 3 representatives of universities• 2 representatives of other research funders• 1 representative of the scientific academies

Tasks• Set and renew the vision for Swedish research information• Contribute to the vision through recommendation on standards and best practice • Act as the national contact point for international collaboration

Information architecture Person

ID ORCIDEg. Personal data, CV Application

ID dnr?Eg. Grant application, ethical approval, reg.forskning

Output

ID DOIEg. publications, patents, products

Ongoing research

ID ???Eg. Projects, programmes, initiatives

Research- infrastructures

ID ???Eg. Laboratories, equipment, registries, databases

Organisation

ID ISNI?Eg. Organisational structure, roles

Subject classification

ID OECD + statistics Sweden

Process

Solu

tion

arch

itect

ure

Aktörer

N

ation

al s

ervi

ces

Fede

rate

d se

rvic

es

PrismaVR Forte Formas

Loca

l ser

vice

s

Ansökningar(Prisma)

Ansökningar(Prisma)

Ansökningar(Prisma)

Ansökningar(Prisma)

Projekt(lokala)

Övriga lärosäten

Projekt(EKO m.fl.)

Ansökningar(Prisma)

Applications

Other funders

Publikationer(EKO m.fl.)

Publications

Other univ.

ApplicationsVR Forte Formas

KI NVV

Idea Funding Projects Output Public

PublicationsSwePub

KB

OrganizationsOrg. register

SRC

ResearchersCV database

SRC

ProjectsSweCRIS

SRC

Research information for the sectorresearch.se

National board for Research Information

JournalistsvcExpertsvar

SRC

Newsforskning.se

SRC m.fl.

Permissions

Ansökningar(Prisma)

Ansökningar(Prisma)

ResearchersCV database

Universities

News

Universities

ProjectsCRIS

Other univ.

PublicationsDIVA

UU

ProjectsCRIS?

?

Ethics trial

REPN/CEPN

Reg.research

SRC

Swedish Research Information Ecosystem - target view

Results: New outputs• 16 new output types

mainly based on CASRAI definitions

• Artistic research output is included for the first time!

• Hierarchical structure based on CASRAI dictionary

Previous SwePub Types New SwePub types ovr/ publicationbok/ publication/booksam/ publication/edited-bookkap/ publication/book-chapter publication/report-chapterrap/ publication/reportart/ref publication/journal-articlefor/ publication/review-articledok/ publication/doctoral-thesislic/ publication/licentiate-thesis publication/translation publication/working-paper publication/editorial-letterrec/ publication/book-reviewart/vet publication/magazine-articleart/pop publication/newspaper-article publication/encyclopedia-entry publication/journal-issue publication/otherkon/ conference conference/poster conference/paperpro/ conference/proceeding conference/other intellectual-propertypat/ intellectual-property/patent intellectual-property/otherkfu/ artistic-work artistic-work/original-creative-work artistic-work/curated-exhibition-or-event other other/data-set

Evaluation of CASRAIConcerns

• Needs for information architecture that covers more aspects. Cf. CERIF. – Compatibility of CASRAI and CERIF not yet verified in relation to

Swedish systems in the Swedish research information ecosystem - needs to be explored further (ongoing)

• Global reach limited.

Evaluation of CASRAIStrengths• CASRAI provides a forum for collaboration.• CASRAI is supported by EuroCRIS, as complementary to

CERIF• Provides a common and agreed upon vocabulary and

definitions for objects on a conceptual and semantic level.

• Co-projects within CASRAI allow us to synchronise our efforts with discussions and developments at other organisations and in other countries.

Thank you!

iJisc-CASRAI UK Pilot : what we learnt

18th May 2o15

Orcid-Casrai Conference

46

Overview

1. UK landscape and Research Context

2. Jisc-CASRAI UK pilot

3. Outcomes and learning points

47Open Research Data – A Jisc perspective

MissionTo enable people in higher education, further education and skills in the UK to perform at the forefront of international practice by exploiting fully the possibilities of modern digital empowerment, content and connectivity

VisionTo make the UK the most digitally advanced education and research nation in the world

48

What Jisc delivers…

Open Research Data – A Jisc perspective

Digital conten

t

Network &IT

services

Advice Research & developme

ntWe provide institutions, their students and researchers secure, cost-effective access to the UK’s richest collection of digital resources.

We provide the HE sector with Janet, the Jisc network, advanced infrastructure services and collaboration platforms.

We listen to our members to ensure we offer them quality support, guidance and tools - estimated to save the sector £122 million in cost efficiencies each year.

Identifying emerging technologies and developing them around our members’ needs. Testing and learning on their behalf to ensure they are ready to take advantage of new technologies as they arrive.

49

The UK research context: General

» Many institutions and research institutes (within and outside universities)

» Many research funders (UK Research Councils represent 30% of total research income *13 other priority funders mentioned)

» Varied infrastructure – Institutional Repositories, CRIS’s, one of these, neither or both

» Changing environment › Mandates effecting research information and

research data› Increasing importance of external (non-

governmental) funding › Interdisciplinary and international focus

52

Research Councils

Je-SInterna

l System

s

GtR

ResearchFish

CRIS

Finance

Third Parties

Bibliographic Databases

Identifiers

University

Repository

The UK RIM landscape (simplified!)

53

Jisc – How do we work in this space?

› Leading and supporting implementation of key standards

› How?› Getting intelligence about what the problems/issues are

› Building consensus

› Commissioning work to understand how to implement standards and implications

› Trialling approaches in the sector/research environment

› Publishing outputs in useable form (e.g. application profiles, entries in CASRAI Data dictionary, plug-ins, guidelines, specifications for how services interact with standards)

› Implementation which involves ongoing work to make interoperability happen

54

Research Data Management

Main areas for Standardisation

Scholarly Communications

Research Information

Management

55

Jisc – What

› RIM• ORCID• Organisational Identifiers (via CASRAI group)

› RDM • Research data metadata profile(s) • Data Management Plans (via CASRAI group)• Related work - UKRDDS (discovery) and Journal Research Data Policy Bank

› Scholarly communications/Open Access• RIOXX application profile and guidelines (Supporting)RCUK and REF OA reporting)• E2E project and gathering OA metadata requirements• OA reporting (via CASRAI group)• Jisc Monitor – developing metadata profile for various use cases.• Standardisation around publisher OA policies (Sherpa Services)

http://scholarlycommunications.jiscinvolve.org/wp/2015/03/26/how-publishers-might-help-universities-implement-oa/

• Total Cost of Ownership - Jisc APC spreadsheet

56

Jisc – Standards Workflow

Research/requiremen

ts

Identify Use

case/issue

Consultation

Consensus building

Develop approach Document Implement

58

Jisc – Standards Workflow

Research/requiremen

ts

Identify Use

case/issue

Consultation

Consensus building

Develop approach Document Implement

example

Jisc Digital Infrastructur

e programme

ORCID Implementati

on Group

Jisc-ARMA ORCID Pilot

projectUK ORCID Consortiu

m

Further tech/commun

ity support

60

Jisc – Standards Workflow

Research/requiremen

ts

Identify Use

case/issue

Consultation

Consensus building

Develop approach Document Implement

CASRAI example

CASRAIData Dictionary

3 working groups• OA Reporting• DMP• Org ID

Jisc-CASRAI Pilot scoping

Post pilot work

2012-13

2013-14

2014-15

2015-

61

Working Group outputs

› Data Management Plans• to create a profile on Data Management Plans for funders• based on the Data Management Plans tool supplied by the

Digital Curation Centre (DCC)• to explore additional related use cases where institutional

subject matter experts can provide further guidance to funders and to their own internal requirements.

• Iterate profile against relevant use cases• Finalise profile for inclusion in Dictionary (by end of June)

Pilot Blog http://jisccasraipilot.jiscinvolve.org/wp/working-groups/data-management-plans/

62

Working Group outputs

› Organisational Identifiers

• Explore possible sources of authoritative lists of organisations involved in UK research, including research performing organisations, charities, industry, etc.

• Develop a sustainable process for maintaining authoritative lists of organisations in the CASRAI dictionary.

› Quite ambitious…

Pilot Blog at : http://jisccasraipilot.jiscinvolve.org/wp/working-groups/org-id/

63

Working Group outputs› Work commissioned to support this process

• Landscape study - to review current practicehttp://repository.jisc.ac.uk/5381/

• Org ID review – to identify best candidates (http://repository.jisc.ac.uk/5853/)

• (parallel development of use cases by working group)

Pilot Blog at : http://jisccasraipilot.jiscinvolve.org/wp/working-groups/org-id/

Jisc Digital Festival, 9-10 March 2015, ICC Birmingham 64

OrgId review: Recommendations

9/03/2015

One single candidate would not fulfil all the criteria it would be useful to separate the infrastructure element (the provision and maintenance of the orgID itself) and the service element (the services offered both tor registrants and to end users of the services).

4 candidates:UK PRNDigital ScienceISNIRinggold

Jisc Digital Festival, 9-10 March 2015, ICC Birmingham 65

» A hybrid approach with ISNI as the backbone.

» In considering registration solutions and value-added services, organisations should bear in mind that, in the short term, Ringgold is the most developed agency conforming to the above

» Other service providers should be encouraged to deliver value added services on top of ISNI e.g. Digital Science could be registration agency for ISNIs

» CrossRef should consider creating and maintaining a crosswalk or table of equivalence between FundRef IDs and ISNI

» Jisc should investigate the possibilities and costs of a bulk deal for UK academic institutions for value added services with Ringgold and (in time) with other service providers.

» UK stakeholders (BL, HEFCE and others) to consider the need for a UK-based registration agency and how bulk creation/checking of ISNIs (and bulk registration and/or the creation of a table of equivalence for UKPRNs) might take place for UK academic institutions and other organisations involved in research

OrgId Review – Key recommendations

09/03/2015

66

Working Group outputs

› OA Reporting Working Group

• Original intention to develop a profile covering all ‘research outcomes’

• Too much! – scope narrowed to cover only publications , and the metadata needed to report on compliance with funders OA mandates

• Still complex! (RCUK, HEFCE, EU (OpenAIRE, Horizon 2020)….) – some elements not specified by Funder turn out to be necessary after all…

• Slow but steady progress – work continues, building on RIOXX and Jisc-funded E2E

• Use-case approach helping to focus• Consultant recruited to provide dedicated resource –

analysis of minimum metadata needed to address all funder requirements.

Pilot Blog at : http://jisccasraipilot.jiscinvolve.org/wp/working-groups/open-access/

67

Jisc-CASRAI pilot key learning points

› Choose topics/areas for the process with care – maturity is key

› Bear in mind the level of work required – 3 simultaneous working groups in the UK was a lot to manage

› Engagement with some stakeholders was an issue for some groups – (range of Funders, Vendors and Publishers)

› Probably value in some face to face meetings pre-working groups to get to know you

68

Jisc-CASRAI pilot – next steps

› Have evaluated the pilot via questionnaire and some meetings

› Are working with CASRAI currently to work out how UK best engages going forward

› All those involved saw value in the work the pilot has delivered

› Also ongoing value in a co-ordinated approach to UK engagement with CASRAI

› Acknowledgement of strengths of the process

› Particular/specific value for us in the UK is a sustainable place to lodge standards agreement via the Data Dictionary

69

In Summary

“The time will come when diligent research over long periods will bring to light things which now lie hidden. A single lifetime, even though entirely devoted to the sky, would not be enough for the investigation of so

vast a subject... And so this knowledge will be unfolded only through long successive ages. There will

come a time when our descendants will be amazed that we did not know things that are so plain to

them..”

Seneca Natural Questions

70

Find out more…

Catherine Grout and Chris Brown [email protected] [email protected]

Except where otherwise noted, this work is licensed under CC-BY-NC-ND

Questions for the PanelIf there are no questions I have a great joke or two…

THE UK’S EUROPEAN UNIVERSITY

www.kent.ac.uk