Monthly Operations Report - Home - Earth Online · 5/16/2017 · PROBA-V_D5_MOR-042_2017-06_v1.0 Monthly Operations Report Page 7 of 24 Table 5: Archived data volumes for this reporting

MONTHLY OPERATIONS

REPORT

MOR#042

Reporting period from 16-May-2017 to 15-Jun-2017

Reference: PROBA-V_D5_MOR-042_2017-06_v1.0 Author(s): Dennis Clarijs, Sindy Sterckx, Jan Vanhout, Erwin Wolters Version: 1.0 Date: 20/06/2017

Monthly Operations Report PROBA-V Operations Contract No. 4000111291/14/I-LG - 1310174

PROBA-V_D5_MOR-042_2017-06_v1.0 Monthly Operations Report Page 2 of 24

DOCUMENT CONTROL

Signatures Author(s) Dennis Clarijs, Sindy Sterckx, Jan Vanhout, Erwin Wolters Reviewer(s) Dennis Clarijs Approver(s) Dennis Clarijs Issuing authority

Change record

Release Date Pages Description Editor(s)/Reviewer(s)

1.0 20/06/2017 All Initial version



TABLE OF CONTENT

1. Summary .............................................................................................................................................. 4 2. System Infrastructure ........................................................................................................................... 4 3. Image Processing Services .................................................................................................................... 5 3.1. Ingested and archived products ........................................................................................................... 5 3.2. Generated and archived products ........................................................................................................ 5 3.3. Backup and archiving service ............................................................................................................... 6 3.4. Dissemination service .......................................................................................................................... 7 3.5. End-user activity .................................................................................................................................. 7 4. Image Calibration services ................................................................................................................... 10 4.1. Radiometric Calibration ...................................................................................................................... 10 4.2. Geometric Calibration ......................................................................................................................... 20 5. Anomalies ........................................................................................................................................... 21 5.1. System related issues .......................................................................................................................... 21 5.2. Image processing issues ...................................................................................................................... 22 6. Scheduled activities for the next period(s) .......................................................................................... 24 7. Operational remarks ........................................................................................................................... 24



1. Summary In this reporting period, the majority of the synthesis products were nearly complete. Most missing data in the synthesis products were caused by decompression and geometric errors and some automatic recoveries of the platform. On June 7th, a planned on-board switch from the redundant to the primary lane was performed, causing loss of data for that day. Although the amount of decompression errors increased due to this action it was decided by mission management to stay on the redundant lane until further notice. This will limit the amount of automatic recoveries of the platform that were visible when the platform was operating on the secondary lane. On May 30 2017, the VITO datacentre experienced a power issue due to load tests on the electrical network. All PROBA-V operational services automatically switched to UPS backup and remained online for the time of the power cut. No data was impacted and data was delivered on schedule. There were no major issues with the image quality during this reporting period for the radiometric or geometric quality. A complete validation of the Collection 1 data revealed some minor issues course of the reprocessing. These are currently under investigation and will be structurally addressed in the following reporting period. Documentation of the complete validation of Collection 1 will be published in the following reporting period. No new developments are expected in the coming period.

2. System Infrastructure

Category % Up Time % Down Time

Switches 100.0 0.0

Database Servers 100.0 0.0

Mid Term File Servers 100.0 0.0

Short Term File Servers 100.0 0.0

Master Servers 100.0 0.0

Worker Nodes 100.0 0.0

PDF 100.0 0.0

Table 1: System Infrastructure availability for this reporting period



3. Image Processing Services

3.1. Ingested and archived products

Product Type Total Received Missing data, ingested by VITO

Archived

METEO 248 248 0 247

TFF 310 310 0 310

Table 2: Ingested and archived products for this reporting period

3.2. Generated and archived products Product Type Total Processed Error Archived

PROBAV_L1A - Calibration 251 251 0 251

PROBAV_L1A - Nominal 2628 2626 2(*) 2627

PROBAV_L1C 2626 2626 0 2625

PROBAV_L2A_100M 918 918 0 917

PROBAV_L2A_300M 2626 2626 0 2626

PROBAV_L2A_1KM 2626 2626 0 2626

PROBAV_L3_S1_TOA_100M 31 31 0 31

PROBAV_L3_S1_TOC_100M 31 31 0 31

PROBAV_L3_S1_TOC_NDVI_100M 31 31 0 31

PROBAV_L3_S5_TOA_100M 6 6 0 6

PROBAV_L3_S5_TOC_100M 6 6 0 6


PROBAV_L3_S1_TOA_300M 31 31 0 31

PROBAV_L3_S1_TOC_300M 31 31 0 31

PROBAV_L3_S10_TOC_300M 3 3 0 3


PROBAV_L3_S1_TOA_1KM 31 31 0 31

PROBAV_L3_S1_TOC_1KM 31 31 0 31

PROBAV_L3_S10_TOC_1KM 3 3 0 3

PROBAV_L3_S10_TOC_NDVI_1KM 3 3 0 3

Table 3: Generated and archived products for this reporting period

(*) 2 x L1A error: L1A error due geometric processing



3.3. Backup and archiving service Product type Total Files(*) Total File Size (GB)

TFF 0 0

L1A 0 0

Database transaction logs 0 0

Database incremental back-up 0 0

Database full back-up 0 0

Table 4: Back-up data volumes for this reporting period

(*) Due to a configuration issue in the back-up script, no backups were taken in the past month. This issue has been fixed since Friday 16/06/2017.

Product type Total Files Total File Size (GB)

PROBAV_TRANSFERFRAMES 311 849.25

PROBAV_L1A 2929 1564.02

PROBAV_L1C 2675 3060.85

PROBAV_L2A_100M 2814 2554.29

PROBAV_L2A_300M 8083 1348.05

PROBAV_L2A_1KM 8119 175.18

PROBAV_L3_S1_TOA_100M 95 2739.60

PROBAV_L3_S1_TOC_100M 95 2759.99

PROBAV_L3_S1_TOC_NDVI_100M 91 295.06

PROBAV_L3_S5_TOA_100M 20 2091.31

PROBAV_L3_S5_TOC_100M 21 2264.93


PROBAV_L3_S1_TOA_300M 88 1081.18

PROBAV_L3_S1_TOC_300M 91 1155.45

PROBAV_L3_S10_TOC_300M 10 200.16


PROBAV_L3_S1_TOA_1KM 92 149.78

PROBAV_L3_S1_TOC_1KM 94 155.55

PROBAV_L3_S10_TOC_1KM 9 24.31

PROBAV_L3_S10_TOC_NDVI_1KM 9 1.97

ICP_GEOMETRIC_CENTRE 0 0

ICP_ GEOMETRIC _LEFT 0 0

ICP_ GEOMETRIC _RIGHT 0 0

ICP_RADIOMETRIC_CENTRE 1 0.04

ICP_RADIOMETRIC_LEFT 1 0.04

ICP_RADIOMETRIC_RIGHT 1 0.04

METEO_ECMWF 248 0.31

METEO_METEOSERVICES 247 1.32

POLARMOTION 1 0.00



Table 5: Archived data volumes for this reporting period

3.4. Dissemination service Product type Added to catalogue Ordered Delivered

PROBAV_L1C 2693 185 188

PROBAV_L2A_100M 928 20 26

PROBAV_L2A_300M 2632 118 116

PROBAV_L2A_1KM 2628 4 13

PROBAV_L3_S1_TOA_100M 32 117 110

PROBAV_L3_S1_TOC_100M 32 268 472

PROBAV_L3_S1_TOC_NDVI_100M 31 0 66

PROBAV_L3_S5_TOA_100M 6 239 242

PROBAV_L3_S5_TOC_100M 6 108 117


PROBAV_L3_S1_TOA_300M 31 206 207

PROBAV_L3_S1_TOC_300M 31 4185 4855

PROBAV_L3_S10_TOC_300M 3 170 172


PROBAV_L3_S1_TOA_1KM 31 137 146

PROBAV_L3_S1_TOC_1KM 31 192 190

PROBAV_L3_S10_TOC_1KM 3 274 370

PROBAV_L3_S10_TOC_NDVI_1KM 3 61 84

Table 6: Ordered and delivered products for this reporting period

3.5. End-user activity 22 new user(s) were registered in this reporting period. The total number of users registered for PROBA-V data and that have ordered data is 1156 with 108 different nationalities representing 874 different companies/universities.

Product type Africa Asia Europe N-America Oceania S-America

PROBAV_L1C 0 387.28 180.86 0 0 0

PROBAV_L2A_100M 0 0.01 10.70 0 0 0

PROBAV_L2A_300M 0 0.89 0.23 0 0 0

PROBAV_L2A_1KM 0 0.00 0.18 0 0 0.02

PROBAV_L3_S1_TOA_100M 0 143.47 7.81 0.04 0 0.00

PROBAV_L3_S1_TOC_100M 0 1643.03 764.85 675.34 0 0.71

PROBAV_L3_S1_TOC_NDVI_100M 0 1.24 0.75 0 0 0.03



PROBAV_L3_S5_TOA_100M 0 0.00 16.17 0 0 0.01

PROBAV_L3_S5_TOC_100M 32.56 0.01 1816.67 0 0 11.86

PROBAV_L3_S5_TOC_NDVI_100M 0 3.06 63.08 0 0 1.01

PROBAV_L3_S1_TOA_300M 0 2.59 983.13 0 0 374.00

PROBAV_L3_S1_TOC_300M 0 0.40 1173.03 304.32 0 49.86

PROBAV_L3_S10_TOC_300M 2.96 1.00 184.13 0 0 0

PROBAV_L3_S10_TOC_NDVI_300M 0.02 0.70 10.11 0.82 0 0.03

PROBAV_L3_S1_TOA_1KM 0 0 146.69 0.02 0 0.03

PROBAV_L3_S1_TOC_1KM 0.00 0 206.19 0 0 0

PROBAV_L3_S10_TOC_1KM 0 0 19.54 46.92 0 0

PROBAV_L3_S10_TOC_NDVI_1KM 0.07 0.07 1.38 0 0 0.02

Table 7: Data download (GB) in total per Origin of the User for the reporting period

Product Type Global

L1C 568.14

PROBAV_L2A_100M 10.70

PROBAV_L2A_300M 1.13

PROBAV_L2A_1KM 0.20

PROBAV_L3_S1_TOA_100M 151.32

PROBAV_L3_S1_TOC_100M 3083.94

PROBAV_L3_S1_TOC_NDVI_100M 2.02








PROBAV_L3_S1_TOA_1KM 146.74

PROBAV_L3_S1_TOC_1KM 206.19

PROBAV_L3_S10_TOC_1KM 66.46

PROBAV_L3_S10_TOC_NDVI_1KM 1.54

Table 8: Data download (GB) in total for the reporting period



Company # Downloads

METEO FRANCE 3149

IGIK 1270

IF SUL DE MINAS 843

VITO 768

GOOGLE 515

FAO 283

ECNU 192

SPACE RESEARCH INSTITUTE RAS (IKI RAN) 182

AIRBUS 161

UNIVERSITY OF TORONTO 145

Table 9: Top 10 user companies for the reporting period

Country # Users

CHINA 114

BELGIUM 97

ITALY 59

FRANCE 58

UNITED STATES 54

BRAZIL 52

UNITED KINGDOM 47

INDIA 41

GERMANY 40

NETHERLANDS 38

Table 10: Top 10 countries with most registered users List of issues raised by users:

ProbaV: *use of renewable energy in data centre *optimize of downloads



4. Image Calibration services

4.1. Radiometric Calibration

Calibration request type Total Processed Not received Error

CLOUDS 16 16 0 0

DARK CURRENT 23 22 1 0

MOON 2 2 0 0

RAYLEIGH 46 44 2 0

SNOW 0 0 0 0

SUN_GLINT 0 0 0 0

Table 11: Calibration Image requests for this reporting period

Calibration image type Total Valid Invalid(*)

PROBA_V_L1A_CALIBRATION 2 2 0

PROBA-V_L1B_CALIBRATION 246 118 128

PROBA-V_L1B_INTERSECTION 778 434 344

PROBA-V_L1B_OVERLAPREGION 0 0 0

Table 12: Processed calibration images for this reporting period

(*) Due to insufficient overlap with the calibration region of interest, not enough pixels (e.g. clouds contamination), site not sufficiently uniform (illumination), etc. Long-term monthly Libya-4 mean plots for different cameras are given in





Figure 1,





Figure 2 and



Figure 3. Deep convective clouds interband calibration results are given in Figure 4. Please note that reporting is done for ”collection 1” ICP files. The degradation model which has been implemented since 1 May 2017 to correct for the observed degradation in the calibration results for the LEFT BLUE and CENTER BLUE strips results in more stable calibration results for the last three months. The reevaluation of the coefficients of the SWIR degradation model , mainly for RIGHT SWIR2 strip, is still under investigation. Radiometric ICP file Both the SWIR and BLUE LEFT/CENTER absolute calibration coefficients will be updated following a linear degradation model. Furthermore the dark currents will be updated. The current ICP files are:

PROBAV_ICP_RADIOMETRIC#LEFT_20170601_V01

PROBAV_ICP_RADIOMETRIC#CENTER_20170601_V01

PROBAV_ICP_RADIOMETRIC#RIGHT_20170601_V01



Figure 1. Libya-4 desert calibration results: LEFT monthly averaged results (collection 1)



Figure 2. Libya-4 desert calibration results: CENTER monthly averaged results (collection 1)



Figure 3. Libya-4 desert calibration results: RIGHT monthly averaged results (collection 1)



Figure 4. DCC inter-band calibration results: LEFT, CENTER and RIGHT camera (collection 1)



4.2. Geometric Calibration

Calibration image type Total Processed Error

PROBA-V_L1C_INTERSECTION 14263 14263 0

Table13: Processed calibration images for this reporting period

Over the period 5/5 – 15/6, the average ALE was < 71 m (σ < 89 m). Daily values started off at ~75 m for SWIR and 80 – 85 m for BLUE, but rapidly decreased towards 60 – 65 m at 13/5 for all channels. After some smaller fluctuations, two major maxima occurred shortly after each other: the first at 28/5 (69 – 78 m), the second at 2/6 (72 – 81 m).This was followed again by a decrease to values of 55 – 65 m, after which a final maximum occurred at 13/6 (67 – 75 m). The geometric accuracy was within the requirement of < 300 m, with an average compliance for all cameras of 99.3% (98.93% - 99.73% from BLUE to SWIR).

Geometric ICP file

PROBAV_ICP_GEOMETRIC#LEFT_20160907_V01

PROBAV_ICP_GEOMETRIC#CENTER_20160907_V01

PROBAV_ICP_GEOMETRIC#RIGHT_20160907_V01

Figure 5. Daily ALE evolution for all PROBA-V spectral bands for 5/5/2017 – 15/6/2017



5. Anomalies

5.1. System related issues A detailed description of each issue is available in the issue tracking system http://jira.vgt.vito.be

Key Summary Status Created Component/s

PROBAVUS-7 Very small images fail to process Resolved 10/01/2014 General

PROBAVUS-63 Cloud shadow detection at high solar zenith angles not working properly

Open 11/05/2016 Software

PROBAVUS-65 Processing statuses L2 products Open 16/09/2016 Software

PROBAVUS-66 Cloud cover percentages on PDF products are not reliable

Open 19/10/2016 PDF

PROBAVUS-68 ICP file version not taken into account when processing


PROBAVUS-69 Version number of segment not filtered when querying for syntheses


PROBAVUS-70 Investigate L2A artefact in data Open 31/05/2017 Software

PROBAVUS-71 L2A - No Radiometric ICP file reference included


2 new issues were logged during this reporting period 0 issue(s) was resolved and closed during this reporting period 0 issues are resolved but remain to be closed formally 1 issue are resolved but remain in the list logging purposes 7 issue(s) is open and remain to be solved

http://jira.vgt.vito.be/browse/PROBAVUS-39











5.2. Image processing issues A detailed description of each issue is available in the Weekly Report and the image processing tracking system https://juniper.vgt.vito.be/ciptools The below table gives an overview of the S1’s of this reporting period:

# S1 Dates

Major Gaps (> 21600 km² (missing TFF)) 0

Large Gaps (< 21600 km²) 1 07/06

Medium Gaps (< 10000 km²) 0

Minor Gaps (< 3600 km²) 5 10/06, 09/06, 12/06, 17/05, 29/05

Negligible Gaps (< 1000 km²) 22 15/06, 21/05, 31/05, 05/06, 26/05, 14/06, 04/06, 30/05, 25/05, 03/06, 13/06, 08/06, 24/05, 19/05, 02/06, 28/05, 18/05, 27/05, 11/06, 01/06,

22/05, 16/05

Complete synthesis (no gaps) 3 23/05, 20/05, 06/06

Table14: Overview of S1 for this reporting period

https://juniper.vgt.vito.be/ciptools



Synthesis Missing Decom. Error

Geom. Error

Missing TFF

Autom. Recovery

VC4 Missing

Create Contours

Other

20170516 0.28% 2 10 4

20170517 1.46% 3 21 1

20170518 0.08% 2 5

20170519 0.00% 1

20170520 0.25%

20170521 0.70% 1 3

20170522 0.28% 2 3

20170523 0.00%

20170524 4.00% 1

20170525 0.01% 2 1

20170526 0.03% 2

20170527 2.70% 2 1

20170528 0.01% 2

20170529 1.48% 4 4 1

20170530 0.30% 7

20170531 0.01% 2

20170601 0.00% 1

20170602 0.02% 5

20170603 0.01% 2

20170604 0.00% 1

20170605 0.00% 1

20170606 0.00%

20170607 13.26% 5 4 1

20170608 0.39% 34

20170609 0.71% 29 4

20170610 1.22% 31 3 1 4 1

20170611 0.33% 29

20170612 1.51% 28 4 1

20170613 0.28% 21

20170614 0.29% 33 4

20170615 0.38% 25 7

Table 15: List of synthesis with an error overview of the missing percentages and errors for this reporting period



6. Scheduled activities for the next period(s)

Software upgrades: No software upgrades planned

Hardware: No hardware upgrades planned

Development: No developments planned

A complete validation of the Collection 1 data revealed some minor issues course of the reprocessing. These are currently under investigation and will be structurally addressed in the following reporting period.

7. Operational remarks

On May 30 2017, the VITO datacentre experienced a power issue due to load tests on the electrical network. All PROBA-V operational services automatically switched to UPS backup and remained online for the time of the power cut. No data was impacted and data was delivered on schedule.

Documents

Monthly Operations Report - Home - Earth Online · 5/16/2017 · PROBA-V_D5_MOR-042_2017-06_v1.0 Monthly Operations Report Page 7 of 24 Table 5: Archived data volumes for this reporting