25
e-SPACE monitoring FOSS4G 2017, Boston Speaker: Caroline Lallemand 16/08/2017 1

e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

e-SPACE monitoring

FOSS4G 2017, Boston

Speaker: Caroline Lallemand

16/08/2017 1

Page 2: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

e-SPACE monitoring

SME champion of a European space research and

development project

Solar Performance Analysis

and data Collection

for Energy monitoring

16/08/2017 2

Page 3: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Reuniwatt

■ A young company from Reunion Island

■ Develops innovative solutions for energy transition

■ Solar energy expertise

■ Continuous work on R&D

■ Solutions available through SaaS

■ Two main categories:

Forecasting

Monitoring

16/08/2017 3

Page 4: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Installed PV power capacity, 2016

Data source: « Snapshot of Global Photovoltaic Markets »International Energy Agency, 22 April 201616/08/2017 4

Page 5: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

The need of PV plant monitoring

■ Performance ratio: evaluate the plant condition over time

■ Identify the source of losses:

• Weather: cloudiness, pollution, heat

• Material damages: aging of the panels, connectors, inverters

Real energy output

Theoretical energy output

Call for action

16/08/2017 5

Page 6: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

On-site measurement of irradiance

■ Basic requirement to evaluate available solar energy

■ Instruments are fallible:

• Material damages, electrical problems

• Envrionment effect: shadows

• Drift of the sensor if not regulary calibrated

days

hoursIrradiancescale (W/m2)

16/08/2017 6

Page 7: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

e-SPACE monitoring project

■ Improve solar estimation on the ground all over the world with ...

Satellite supervision: global coverage, stability of the sensor over time

On-site autonomous and mobile sensors: local phenomena catcher

… mixed on a GIS and distributed as a service

16/08/2017 7

Page 8: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Solar radiation estimation from satellite imagery

■ Reuniwatt’s method Sunsat based on Heliosat-2 method

raw image from

geostationary satellite

Cloud index: comparison

between actual and clear sky

for each pixel

GHI: global horizontal

irradiation at ground level

Mines Paristech, Oldenburg UniversityRigollier et al. (2004), Cros et al., (2004)16/08/2017 8

Page 9: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Satellite images

■ Geostationnary satellite imagery

– Cloudiness visibility (visible/IR channels)

– Regular scans (space and time)

– Stability of the sensor over time

Satellite Resolution

MSG Prime R/PT15M, 1km

MSG IODC R/PT15M, 1km

Himawari-8 R/PT10M, 500m

GOES-E/W R/PT15M to R/PT30M, 1km

16/08/2017 9

Page 10: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Auxiliary data

■ Isolate cloud mask by removing

ground albedo effect: MODIS

products

■ Calculate ground irradiance usingelevation model (SRTM) and altmospherical turbidity model (Linke turbidity)

0

100

200

300

400

500

600

700

800

900

1000

GH

I (W

/m²)

SunSat TL=3.54 (Actual-India)SunSat TL=4SunSat TL=616/08/2017 10

Page 11: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Technical workflow: use of Mapserver, PostGIS,

GDAL

Satellite images providers

Local data feeder

Sunsat servers

GDAL

Mapserver

& PostGIS

(aux. data)

WCS

Tif + CFAC/LFAC/COFF/LOFF

Geotiff

16/08/2017 11

Page 12: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

h=35785831 # distance center of Earth – satellite

projGeos= « +proj=geos +lon_0=0 +h=35785831 +x_0=0 +y_0=0 +ellps=WGS84 +units=m +no_defs »

GT1= h * 2^16 / CFAC

GT5 = h* 2^16 / LFAC

GT0 = COFF * GT1

GT3 = LOFF * GT5

GT2 = GT4 = 0

Focus on GDAL usage

■ Different GEOS projections unified system

WGS84

■ Convert pixel/line corners to geographic

coordinates using geotransform array

16/08/2017 12

ulx(geo) = GT0 + GT1* xmin + GT2 * ymin

lrx(geo) = GT0 + GT1* xmax + GT2 * ymax

uly(geo) = GT3 + GT4* xmin + GT5 * ymin

lry(geo) = GT3 + GT4* xmax + GT5 * ymax

gdal_translate –co BIGTIFF=YES –co COMPRESS=DEFLATE –a_srs ${projGeos} -a_ullr ulx uly lrx lry ${file}

gdalwarp –s_srs ${projGeos} –t_srs EPSG:4326 ${file} ${file4326}

Page 13: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Storage into a scalable database

■ PostgreSQL/PostGIS solution (raster2pgsql)

■ For now: storage of our zones of interest

■ Data model thought to be scalable and easy to maintain: usage of

inheritance and schemas (separate real time / historical data)

sunsat

Latest.meteosat8 Oldest.meteosat8

Latest.meteosat8_yyyymmdd

16/08/2017 13

# raster2pgsql –t 128x128 –a –N 65535 –F –s EPSG:4326 MSG_2014_04_11_07_00.tif latest.meteosat10

Page 14: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Use of procedural functions

■ PL/pgSQL language: ST_MapAlgebra filters

■ C functions connexion

■ Example: real timestamp of a pixel

Start: 2017-04-11T06:30:00

End: 2017-04-11T06:42:30

Time y = start + 750 *

16/08/2017 14

180

90-ST_Y(poi) sec

Page 15: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Sunsat estimations output

■ Time series for analysis

■ Up-to-date maps of GHI Subhourly instant power (W/m2)

Monthly cumulative energy

(Wh/m2/day)

16/08/2017 15

Page 16: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Local phenomena not perceived by satellites

■ Satellite imagery performs well for big and stable clouds

■ Micro climates not perceived

16/08/2017 16

10m resolution

1km resolution

Page 17: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Irradiance ground sensors:

local environnement proof

■ Different sensitivities and prices of sensors:

– Pyranometers, pyrheliometers

– Reference cells

■ Reuniwatt bet on a autonomous, easy to deploy and low-cost

sensor

– Irradiance, humidity, temperature

– Real time observations

16/08/2017 17

Solar InCell

Page 18: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Global network of ground sensors

■ Reference networks

■ Less qualified but better located sensors

16/08/2017 18

Page 19: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Data processing and storage

■ Data quality insurance with R routine

■ Storage solutions under testing:

• Influxdb

• Warp10 (NoSQL with geolocation)

• PostgreSQL+PostGIS+timescaledb

Basic usage of timescale db

Influxdb + Grafana

16/08/2017 19

Page 20: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Ground sensors refine estimations from satellite

■ Empirical method (polynomial regression)

■ Require few months of measurements on the point of interest

■ Simply apply a correction on historical and actual estimations

16/08/2017 20

Page 21: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Cokriging for the closest sites

■ Refine satellite estimations on a non-instrumented point of interest

■ R libraries: raster, rgdal, maptools, gstat, sp

Schematic illustration of cokriging neighborhood

configurations: a all data, b multicollocated, and c

collocated (Wackernagel 2009)

16/08/2017 21

Page 22: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Ensure data quality availability worldwide

■ If the sensor is down, satellite data

are still available

■ Detection of technically possible but

obviously wrong measures

16/08/2017 22Sunsat

Ground sensor

Page 23: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Summary:

the benefits of the mix for irradiance estimation

High temporal resolution

Regulary calibrated

Satellite

estimation

Ground

measurements

(references)

Ground

measurements

(low cost)

Global coverage

Stable

Historical data

Easily deployable on POI

Coarse resolution

at a plant scale

Far from our POI

Less reliable than pyranometers

16/08/2017 23

Page 24: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Complex back-end to a user-friendly front-end

■ Complex back-end: data collection from different sources,

processing and homogenization, storage and distribution

■ Possible with OSGEO solutions (GDAL, Mapserver, PostGIS,…)

■ Served to the client through a user-friendly interface (shiny app)

16/08/2017 24

Page 25: e-SPACE monitoring - FOSS4G2017.foss4g.org/post_conference/FOSS4G_espacemonitoring.pdf · 2017-12-28 · e-SPACE monitoring SME champion of a European space research and development

Thank you

FOSS4G 2017, Boston

e-SPACE monitoring

[email protected]

16/08/2017 25