View
123
Download
0
Category
Tags:
Preview:
DESCRIPTION
Presentation at the final UKRISS Workshop (November 1st, 2013) held at the British Library, London, UK.
Citation preview
www.eurocris.org
Brigitte Joerg, PhD, euroCRIS, JeiBee Ltd.
Harmonised CORE Information Reporting Profile
www.eurocris.org
Towards a Core Information Reporting Model
„Institution submits report to funder“
www.eurocris.org
UKRISS Modeling Approach
1. Bottom-Up Analysisa. ROS (ROS) objects and fieldsb. ResearchFish (RF) objects and fields
2. Consulting Best Practicesa. MICE; REF; DESCRIBE; CRISPool, etc.b. Essential: “Theory-building and logic-modelling is essential to
establish causal inference in evaluation.”
3. Top-Down Use-Case driven Modelinga. “institution submits report to funder”
www.eurocris.org
Results: Bottom-up Analysis (object-harmonisation)
Objects
Vocabu- laries
ROS ResearchFish
Impact
Staff Development
Publication Intellectual Property Dissemi
nation / Communication
Collaboration / PartnershipProduct /
Intervention
Award Recognition
DatasetKey Findings
Spinout Further FundingEvent Exploitation
● Current Harmonisation ○ Objects (e.g. Publication; IP; Partnerships, etc.)○ via e.g. Mappings to UKRISS Model
● Potential Harmonisation ○ Objects (e.g. Dataset; Event; Exploitation; Key Findings; Product/Intervention)○ via e.g. Extension assigning Objects to the UKRISS Model
www.eurocris.org
Results: Bottom-up Analysis (field-harmonisation)
Objects
Vocabu- laries
ROS ResearchFish
Impact
Staff Development
Publication Intellectual Property Dissemi
nation / Communication
Collaboration / PartnershipProduct /
Intervention
Award Recognition
DatasetKey Findings
Spinout Further FundingEvent Exploitation
● Current Harmonisation ○ Semantic Similarity such as e.g.
■ RF: “Provide a short name/title for this output.” ■ ROS: “Series Title”
● Potential Harmonisation ○ Semantic Similarity through extensions such as e.g.
■ Mapping to UKRISS:Output Types (via ROS/RF Mappings)■ Extensions such as UKRISS IDs (e.g. OrgID; PersonID, etc).
www.eurocris.org
ROS/RF Harmonisation Degrees(based on Field counts / semantic ‚similarity‘)
Total Field Counts
ROS 235
ResearchFish 99
Current Harmonisation 45
Potential Harmonisation 31
Similarity Examples:RF: “Provide a short name/title for this output.”
ROS: “Series Title”
RF: Year of Publication
ROS: Date Published
RF: Volume
ROS: Volume Number
Current Harmonisation = Semantic Field Similarity
Potential Harmonisation = via UKRISS Field Extensions
www.eurocris.org
ROS/RF Harmonisation Degrees(based on Field counts / semantic ‚similarity‘)
www.eurocris.org
ROS/RF Harmonisation Degrees(based on Field counts / semantic ‚similarity‘)
compared to total
www.eurocris.org
ROS/RF Harmonisation Degrees(Vocabulary counts following Field ‚similarity‘)
Similarity Examples:
ROS: Publication TypeRF: Type of Publication
ROS: International AudienceRF: “What was the extent of geographical "reach" of this activity (e.g. [...] region, nation, or international)?
Current Harmonisation = Semantic Field Similarity
Potential Harmonisation = via UKRISS Field Extensions
Total Vocabulary Counts
ROS 39
ResearchFish 12
Current Harmonisation 5
Potential Harmonisation Needs further Investigation
www.eurocris.org
UKRISS Modeling Approach
Following Best Practice - Recommend a higher level overarching Reporting Model as introduced in: “Measuring the Impact of Research” (2007)*
ATN = Australian Technology Network of Universities, which includes Curtin University of Technology, University of South Australia, RMIT University, University of Technology, Sydney and Queensland University of Technology
*http://www.atn.edu.au/docs/Research%20Global%20-%20Measuring%20the%20impact%20of%20research.pdf
www.eurocris.org
UKRISS Core Information Model
12
CERIF Entities
Harmonisation through conceptual alignment
Objects
Reporting Profile
Vocabularies
Research Output
Research Outcome
Research Impact
Measure- ments
ROS ResearchFish
Research Transfer
Impact
Staff Development
Publication Intellectual Property Dissemi
nation / Communication
Collaboration / PartnershipProduct /
Intervention
Award Recognition
DatasetKey Findings
Spinout Further FundingEvent Exploitation
Potential Current
UKRISS
CERIF XML
www.eurocris.org
Submission ID; Date; Version; Contact; Org; Type CERIF Mapping
Theme Sector cfClass.cfClassId
Beneficiary Sector cfClass.cfClassId
Potential Stakeholders Project; Institution; Funder; GtR; ROS; RF; cfClass.cfClassId
Cross-System-Interoperation GrantID; ProjectID; InstitutionID; FunderID cfFedId.cfFedId
Report
Reporting Types following the ATN Model
Research Outputs (OP)
Research Transfer (RT)
Research Outcomes (OC)
Research Impact (IMP)
Measurements (MM)
ATN Explanations ATN: For example: Discoveries; Publications; Patents; IPs;
ATN: Engagement with End-Users
ATN: New or improved products, services or processes
ATN: Value-added, improvements achieved
--- introduced by UKRISS ---
UKRISS Explanations UKRISS: Things done during research; research activity; tangible results describing what done
UKRISS: Changes arisen from output; e.g. invention; chance in approach people behave.
UKRISS: Measurements to verify / underly impact.
Use Case: Institution submits report to funder (1)
www.eurocris.org
Use Case: Institution submits report to funder (2)
www.eurocris.org
CERIF – Common European Research Information Format
A Formal Metadata
Model
www.eurocris.org
EuroCRIS Membership
Current membership is 172: 113 institutional, 37 personal and 22 affiliate (with altogether 325 delegates from 43 countries).
An international not-for-profit organisation, bringing together users, experts and developers of research information systems.
Main activity is the development,
maintenance and implementation of the
CERIF metadatamodel, the “Common Euopean
Research Information Format”, a standard for the
development, implementation and
interoperability of current research information
systems (CRIS) and their various application. CERIF
is an official EU Recommendation to
Member States
www.eurocris.org
EuroCRIS Strategic Partners
www.eurocris.org
EuroCRIS Board
CANADA
Greta Christina LingjaerdeIndicators
NORWAY
www.eurocris.org
UKRISS:Output Description
cf Measurement
Institution Sector
Stakeholder
cf OrgUnit
Measurement period
Date measurement was created
Date of data currency
Journal Article
cf Class
ROS/RFMapping
DescriptionNumber of outputs (cf Count)
Reference to ongoing Mapping/Work in Snowball Metrics:Anna Clements, St. AndrewsLisa Colledge, ElsevierBrigitte Jörg, euroCRIShttp://www.snowballmetrics.com
ServiceROS / RF
CERIFy e.g. Publication (UKRISS Output)
www.eurocris.org
www.eurocris.org
www.eurocris.org
Publication Counts in ROS
www.eurocris.org
Publication Counts in ROS
www.eurocris.org
Following REFSimilar to HEBCIS
www.eurocris.org
Staff Development in ROS/RF
Following REFSimilar to HEBCIS
www.eurocris.org
Staff Development in ROS/RF
www.eurocris.org
Staff Development in ROS/RF
www.eurocris.org
www.eurocris.org
www.eurocris.org
www.eurocris.org
UKRISS at ReConnect13 (Ottawa)
Research Information StandardsMachine Anatomy in UK and Germany
Annual CASRAI International ConferenceOttawa, October 16-18, 2013
Mathias Riechert, Institute for Research Information and Quality Assurance (IFQ), Berlin, GERBrigitte Jörg, euroCRIS, EU / CASRAI, INT
Joint Presentation!See also slides by
Mathias Riechert, IFQ
www.eurocris.org
UKRISS at ReConnect13 (Ottawa)
Objects
Vocabu- laries
ROS ResearchFish
Impact
Staff Development
Publication Intellectual Property Diss
emination / Communication
Collaboration / Partnership
Product / Intervention
Award Recognition
Dataset
Key Findings
Spinout
Further Funding
Event Exploitation
Current Harmonisation
Potential Harmonisation
• Publication ✓• Intellectual Property• Product/Intervention• Spin-Out• Collaboration/Partnership• Further Funding ✓• Staff Development ✓• Dissemination/Communication• Exploitation• Award / Recognition ✓• Key Findings• Impact• Dataset• Event
•Underlying Vocabularies were not considered here
✓ = UK – GER Overlap
www.eurocris.org
Remaining Work
• Further Model Verification via Data• Complete Formal CERIF Mapping (XML)
– ROS– RF– (HEBCIS)
• Definition of Vocabulary Boundaries• Final Report
www.eurocris.org
Summary - Conclusion
• Need for Harmonisation is obvious– National– International
• UKRISS Main Destination of Results– CASRAI UK Working Group on Contributions and OA Reporting
• Long-term Governance Model needs to be discussed• Business Case / Efficiency
– Re-Usability demonstrated– Standardized Interchange possible– Harmonisation (Alignment) required incrementially
• Need: Agreed Requirements (agreed questions)!!
Recommended