Embed Size (px)
Citation preview
MetaScience An Holistic Approach for Research Modeling
Valerio Cosentino, Javier Cánovas & Jordi Cabot ICREA – Open University of Catalonia
@softmodeling modeling-languages.com
http://pixgood.com/mr-hyde-sketch.html
ResearcherReviewer
Both need to work together to have a healthy community
How can we use conceptual models to help ?
Nurture
your Com
munity
MetaScience: Modeling Research
Communities
Size doesn’t matter
-Data vs Information-Non-trivial analysis: Integration of different sources-Conceptual Schema as unifying representation-Separation of data collection from data analysis-
Conceptual Schema
DB schema
DB schema
Data Collection
Flick/skepticalview
Conferences and papers: DBLP
Table mapping
PCs and topics: web scrapping
+ a variety of other (overlapping) sources & formats
Community Analysis for everybody
Flickr/leg0fenris
Single metrics, e.g. authors per paper
19791981
19831985
19861987
19881989
19901991
19921993
19941995
19961997
19981999
20012002
20032004
20052006
20072008
20092010
20112012
20132014
20150
0.5
1
1.5
2
2.5
3
3.5
4
ρ = 0.88
Single metrics, e.g. seniority of researchers
Graph-based analysis: Co-authorship graphs
Prolific authorsFrequent
collaborationsClustersBetweenness (bridge
authors)
Historical / temporal view, e.g. PC Analysis
ARE PC MEMBERS ACTIVE IN THE CONFERENCE?60 out of the 99 members from 2015 did not publish in the previous 3 editions
ARE ACTIVE MEMBERS BEING IGNORED?Only 7 researchers published constantly from 2012 to 2014
3 of them were PC members in 2015, while the remaining 4 were not
Newcomers
% of papers with all authors new to the main track
% of papers with all authors new to the conf
NL/ Topic analysis, e.g. Top-30 keywords for last 10 edts
From paper abstracts From topics of interest
http://matt.might.net/articles/phd-school-in-pictures
And there’s much more...
Collaborating with the complex systems group: rich club ordering, small-
world behaviour, inter-conf analysis…
CORE analysis (shameless plug)
Tool Support
Flickr/JDHancock
Gitana: Integrated analysis (ER’15)
Coding platform
Issue trackers Commun. channels
Code review tools
https://github.com/SOM-Research/metaScience
Challenges
Flickr/TimPainter
The CS keeps growing
Data Collection limitations
And even more challenges….
Paper classificationo Not clear distinction of paper types o Changes on the characteristics from one edition to another (e.g. number of
pages for short papers)
Committee / topics datao Conference edition web sites may be not available anymore
Partial solution: WayBack Machineo Committee data similar but there is no common “standard”
Entity resolutiono Researchers can use different names
Partial solution: DBLP provides aliaseso Researcher names may appear misspelled (mostly in committee data)
