Embed Size (px)
Citation preview
AAAI Fall Symposium: Accelerating Science: A Grand Challenge for AI—18 November 2016
Humans, Machines, and the Future of Citizen Science
Kevin CrowstonSyracuse University School of Information [email protected]://crowston.syr.edu/
Partially supported by NSF Grants 09-68470, 12-11071 & 15-47880.Gravity Spy is the work of the Gravity Spy Team, http://gravity-spy.org/
2
4
http://galaxy-zoo.org/
Cla
ssifi
catio
ns p
er h
our
0
17,500
35,000
52,500
70,000
Hours
0 6 12 18 24 30 36 42 48
Fukugita et al. 07
1 Kevin Month
From Lintott (2015). Exploring the Moon Together : An Introduction to Moon Zoo http://documentslide.com/documents/exploring-the-moon-together-an-introduction-to-moon-zoo.html
Image: LSST
He, Zhang, Ren & Sun (2015). Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. ArXiv 1502.01852v1
8
9
ImageofLIGOLIGO (Laser Interferometer Gravitational-wave Observatory)
www.ligo.caltech.edu
Glitches
100% 0%ConfidenceofMLclassification
%ofhumanagreementwithML
100%
0%
Trainingsetforbeginners
Tobeclassifiedbytrainedvolunteers
%cutoffstobedeterminedempirically
Imagesofotherknown orunknownclasses
MLConfidence:0.998H1_meBLZbphwP
MLConfidence:0.794H1_agsp7RitSw
MLConfidence:0.627 MLConfidence:0.346
“None of the above”
Our Voorwerp: Paired Doves
50 Hz glitches seen in gravitational-wave channel
22
10 10.2 10.4 10.6 10.8 11 11.2 11.4 11.6 11.8 12101
102
103
Time-frequency: detector=H1, round=1, winner=ASC-X_TR_B_YAW_OUT_DQStart time: GPS=1126051217, UTC=2015-09-12 00:00:00
N MainChan trigs=161N vetoed trigs=35
Correlation with air compressor turn on
25
Issue found at detector (shorted vibration isolation)
26
Citizen science of the future
n Future citizen science can include volunteers and “bots”
n Need to learn how to work in mixed teams
n Need to understand organizational and social impacts
Volunteers
Scientists
Work
