Embed Size (px)
Citation preview
PHENOMENON
PytHon corrEctioN algOrithMs for nEutroN mONitors
C. Sarlanis1 , C.T. Steigies2
Session 14: Space Weather applications of the global neutron monitor network
1ISNet Scientific, Argiroupolis, Greece 2Christian-Albrechts-Universität zu Kiel, Germany
.
What is PHENOMENON?
A collection of different Correction Algorithms for Neutron Monitors written in Python
Python because: it is an open source and freely available programming language it has a large number of scientific libraries it runs on every platform [Windows, Linux, Mac]
Neutron Monitor data because: are essential for Space Weather applications (i.e. GLE Alerts) constitute a long-term reliable time series of data from many detectors around the world have a single point of access: NMDB │ www.nmdb.eu
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
There are still problems with data in NMDB.
Ran
do
m p
eri
od
de
rive
d f
rom
NES
T To
ol /
NM
DB
Why do we need PHENOMENON?
Because
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
Each NM corrects its data with a different way or with a slightly different way.
An actual common data set, in order to compare different correction methods, does not exist.
We do not know how the primary data are corrected [algorithm & efficiency].
Why do we need PHENOMENON?
Because
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
We need an open platform in order to discuss what we mean when we say:
Median Editor [Hovhannisyan & Chilingarian, Adv. Space Res., 2011] ANN Editor [Paschalis et al, Solar Physics, 2013 ] Median Editor + [Yanke et al., 32nd ICRC, 2011] Edge Editor [Paschalis & Mavromichalaki, J. Space Weather and Space Clim., 2012] Super Editor [Yanke et al., 32nd ICRC, 2011] ….
Why do we need PHENOMENON?
Because
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
Create the open platform #1:
What do we propose [PHENOMENON]?
NMDB Wiki Page http://wiki.nmdb.eu
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
Create the open platform #1:
What do we propose [PHENOMENON]?
NMDB Wiki Page http://wiki.nmdb.eu
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
What do we propose [PHENOMENON]?
Create the open platform #2:
GitLab https://gitlab.physik.uni-kiel.de/
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
What do we propose [PHENOMENON]?
Create the open platform #2:
GitLab https://gitlab.physik.uni-kiel.de/
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
Create a database (dataset) that will store:
What do we propose [PHENOMENON]?
Common input data to be used by all algorithms / efforts All outputs from all algorithms / efforts Data from each tube so that inter-corrections (parallel corrections) can be applied
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
Example of an artificial dataset (SQLite) :
What do we propose [PHENOMENON]?
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
500
550
600
650
700
750
800 1
34
67
10
0
13
3
16
6
19
9
23
2
26
5
29
8
33
1
36
4
39
7
43
0
46
3
49
6
52
9
56
2
59
5
62
8
66
1
69
4
72
7
76
0
79
3
82
6
85
9
89
2
92
5
95
8
99
1
10
24
10
57
10
90
11
23
11
56
11
89
12
22
12
55
12
88
13
21
13
54
13
87
14
20
500
550
600
650
700
750
800
850
900
950
1000
1
34
6
7
10
0
13
3
16
6
19
9
23
2
26
5
29
8
33
1
36
4
39
7
43
0
46
3
49
6
52
9
56
2
59
5
62
8
66
1
69
4
72
7
76
0
79
3
82
6
85
9
89
2
92
5
95
8
99
1
10
24
1
05
7
10
90
1
12
3
11
56
1
18
9
12
22
1
25
5
12
88
1
32
1
13
54
1
38
7
14
20
Artificial dataset with positive error peaks vs normal counter dataset
Artificial normal counter dataset
Artificial dataset with positive error peaks
Examples of the data │ PHENOMENON
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
0
100
200
300
400
500
600
700
800
900
1000 1
3
4
67
1
00
1
33
1
66
1
99
2
32
2
65
2
98
3
31
3
64
3
97
4
30
4
63
4
96
5
29
5
62
5
95
6
28
6
61
6
94
7
27
7
60
7
93
8
26
8
59
8
92
9
25
9
58
9
91
1
02
4
10
57
1
09
0
11
23
1
15
6
11
89
1
22
2
12
55
1
28
8
13
21
1
35
4
13
87
1
42
0
Examples of the data │ PHENOMENON
Artificial dataset with negative and positive steps
+ -
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
0
200
400
600
800
1000
1200
1400
1
34
6
7
10
0
13
3
16
6
19
9
23
2
26
5
29
8
33
1
36
4
39
7
43
0
46
3
49
6
52
9
56
2
59
5
62
8
66
1
69
4
72
7
76
0
79
3
82
6
85
9
89
2
92
5
95
8
99
1
10
24
1
05
7
10
90
1
12
3
11
56
1
18
9
12
22
1
25
5
12
88
1
32
1
13
54
1
38
7
14
20
Examples of the data │ PHENOMENON
Artificial dataset with positive drift
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
Typical Correction Editors │ PHENOMENON
Example of the Sum Editor and the Median Editor
3000
3200
3400
3600
3800
4000
4200
4400
4600
1
32
63
94
12
5
15
6
18
7
21
8
24
9
28
0
31
1
34
2
37
3
40
4
43
5
46
6
49
7
52
8
55
9
59
0
62
1
65
2
68
3
71
4
74
5
77
6
80
7
83
8
86
9
90
0
93
1
96
2
99
3
10
24
10
55
10
86
11
17
11
48
11
79
12
10
12
41
12
72
13
03
13
34
13
65
13
96
14
27
Simulated scenario
6 NM Counters
5/6 NM Counters operating normally (no induced errors)
1/6 NM Counters experiencing a positive drift
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
Examples of the data │ PHENOMENON
0
100
200
300
400
500
600
700
800
900
1
81
1
61
2
41
3
21
4
01
4
81
5
61
6
41
7
21
8
01
8
81
9
61
1
04
1
11
21
1
20
1
12
81
1
36
1
1000
1500
2000
2500
3000
3500
4000
4500
5000
1
81
1
61
2
41
3
21
4
01
4
81
5
61
6
41
7
21
8
01
8
81
9
61
1
04
1
11
21
1
20
1
12
81
1
36
1
0
200
400
600
800
1000
1200
1
81
1
61
2
41
3
21
4
01
4
81
5
61
6
41
7
21
8
01
8
81
9
61
1
04
1
11
21
1
20
1
12
81
1
36
1
3000
3500
4000
4500
5000
5500
6000
1
81
16
1
24
1
32
1
40
1
48
1
56
1
64
1
72
1
80
1
88
1
96
1
10
41
11
21
12
01
12
81
13
61
Examples of the Sum Editor and the Median Editor
Simulated scenario
6 NM Counters
5/6 record a
1/6 no decrease
Simulated scenario
6 NM Counters
4/6 record an
2/6 no increase
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
Artificial dataset (SQLite)│ PHENOMENON
NMDB Wiki Page http://wiki.nmdb.eu
Artificial Data
Provide the dataset(s):
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
Artificial dataset (SQLite)│ PHENOMENON
NMDB Wiki Page http://wiki.nmdb.eu
Results
Provide the result(s):
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
Improve the data quality made available by NMDB
Compare, validate and identify an optimal way for the correction of NM Data
Define how every station corrects its data, pass this know-how to the community
Make Space Weather applications that use real time data from different instrument choose NMDB as a reliable input for their prediction schemes.
Conclusions
PHENOMENON can help to:
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
Improve the proposed framework
Implement all codes (editors) in Python
Debug the codes
Conclusions
PHENOMENON future on-going steps:
Provide everything (dataset / editors / notes / material) via open platform #1 [http://wiki.nmdb.eu] and open platform #2 [https://gitlab.physik.uni-kiel.de/]
European Space Weather Week (ESWW13) Session 14
18.11.2016 Oostende
![[C.T._LEONDES_(Eds.)]_Analysis_and_Control_System_(BookZZ.org) (4).pdf](https://img.pdfslide.us/doc/110x75/55cf8ac155034654898d7e98/ctleondesedsanalysisandcontrolsystembookzzorg-4pdf.jpg)
