Upload
others
View
4
Download
0
Embed Size (px)
Citation preview
cessda.eu @CESSDA_Data
Monitoring Research Infrastructures - CESSDA performanceWidening meeting Skopje, MakedonijaIvana Ilijasic Versic, COO | CESSDA ERIC
05 November 2019
Exploitation
Impact
Proposal
Funding
Conduct
Results
StakeholdersM
onitoring
KPIs
Goals
Measurable
Challenges
Exce
llenc
e
Standards
Definitions
Indica
tors
Evaluation
Potential
Innovation
Impact
Socio-Econom
ic
Data
Missions
Horizon Europe
Horizon 2020
AnalysisFinance
3
Sustainability of Research Infrastructures
Evaluation systems for RIs
Socio-economic impact
Mission, Vision, Goals
Measurable indicators (KPIs)
Organisational structure
FUNDING
ESFRI long-term sustainabilityESFRI WG 35 recommendations in 7 key areas (June 17)EC Working Doc with 42 recommendations (Sep 17)
SCRIPTA Sustainability of Research Infrastructures7 main recommendations:
Excellence;Have the right people in the right place Vision for convergent operation of RIs and e-Infra’sRI's as innovation hubsDetermine economic and wider social value of RI’sEffective governance and sustainable long-term fundingFoster coordination at national and European levels
OECD on the socio-economic impact of RI'sDistinguish between performance, impact, time
Broader context
Members: national ministries (General Assembly)Designated national Service Providers Scientific Advisory BoardEuropean Commission (annual reports, EC projects)ESFRIERIC ForumEOSCScientific communitySpecific – e.g. technical evaluation
5
Evaluation
Socio-economic impact
KPIs
Business model
Funding
On national levelinfluencing policy trusted repositoriesstandardsjobs at Service Providersoutreach to new members
On EU level:Scientific community - data sharing and re-use, training, thematic data clusters Policy level - working groups, ERIC ForumEC funding – EOSC, widening, standards
International levelCollaborations: RDA IG SSH Research Data, IASSIST, with other Disciplines
6
Evaluation
Socio-economic impact
KPIs
Business model
Funding
Developed by ESFRIDeveloped by ERIC ForumMeasure of performanceMeasure of impactMeasurable over timeQualitative, quantitative
CESSDA – a distributed SSH RI
Not: patents, publications.
7
Evaluation
Socio-economic impact
KPIs
Business model
Funding
National example (DE)
https://www.ratswd.de/pressemitteilung/16102019
https://www.ratswd.de/pressemitteilung/16102019
ESFRIdevelopments
Objective KPIs
Achievingscientificexcellence
1.NumberofuserrequestsforaccessÖ2.NumberofusersservedÖ3.Numberofpublications4.Percentageoftop(10%)citedpublications
Deliveryofeducationandtraining
5.NumberofMScandPhDstudentsusingtheRIÖ6.TrainingofpeoplewhoarenotRIstaffÖ
EnhancingcollaborationinEurope
7.NumberofMembersoftheRIfromESFRIcountriesÖ8.ShareofusersandpublicationsperESFRImembercountryÖ
Facilitatingeconomicactivities
9. Share of users associated with industry and publications withindustry10.Incomefromcommercialactivitiesandthenumberofentitiespayingforservice
Outreachtothepublic 11.EngagementachievedbydirectcontactÖ12.OutreachthroughmediaÖ13.OutreachviatheRI’sownwebandsocialmediaÖ
Optimizingdatause 14.NumberofpubliclyavailabledatasetsusedexternallyÖ
Provisionofscientificadvice
15.ParticipationbyRIsinpolicyrelatedactivitiesÖ16.Citationsinpolicyrelatedpublications
Facilitatinginternationalco-operation
17. Share of users and publications per non-ESFRI membercountryÖ18.Internationaltrainees19.NumberofmembersoftheRIfromnon-ESFRIcountriesÖ
Optimisingmanagement 20.Revenues21.ExtentofresourcesmadeavailableÖ
Quantitative (number of)Trust:
certified repositoriesUsers:
data downloads, levels, registered, number of website visits, social media followers
Studies (datasets):new datasets added to collections, variables (if possible), published through CDC (or available in archive), openly available, restricted, data breaches (aiming at zero)
Funding: annual, share of project funding, staff (FTE equivalent)
Training: Organised seminars/training events/webinars, number of participants
…....
QualitativePurpose of use for downloaded data (i.e. study, teaching, BA/MA/ PhD thesis, research or other)Utilisation rate (i.e. the share of studies downloaded at least once)Institutional developments (non-quantitative description)FAIR metrics, policies…etc.
Relevant CESSDA KPIs
Combine list of KPIs with CESSDA strategic goals
Gap analysis of goals-KPI relationship
Explore experiences of other domains (i.e.
Humanities/CLARIN/Daan)
Precise definition and description of KPIs
Several iterations with SPs
Next steps
CANVAS Business ModelKey partnersKey activitiesKey resourcesValue propositionsCustomer relationshipsCommunication channelsCosts (investments, maintenance)Return (money, indicators/metrics)
CESSDA ERIC business model (in progress)
12
Evaluation
Socio-economic impact
KPIs
Business model
Funding
Membership fees
ministries, research councils
additional contributions
Project funding, esp. EU
Future:
Revenues from services
(business models)
CESSDA ERIC funding
13
Evaluation
Socio-economic impact
KPIs
Business model
Funding
cessda.eu @CESSDA_Data
Thank you for your attention!