1
An estimated 1.2 billion people around the world do not have electricity access, and far more have unreliable electricity access (World Energy Outlook, 2017). Energy access is correlated with improvements in health, economic prosperity, and gender equality outcomes. Particularly, access to electricity is linked to an increase in student enrollment in schools, time students spend studying, available business hours, agricultural productivity and labor supply, and a reduction of the poverty rate (Khandker et al., 2012). We present a technique to determine regional electricity access from satellite imagery to aid electrification efforts. This project aims to fill a data gap by producing high resolution estimates of electrification rates through a case study in the Indian states Bihar and Uttar Pradesh. India has over 300 million people without access to electricity (Figure 1) and there were ground truth data available for Bihar to enable our analysis. Currently, however, electricity access estimates in India are generally available at a district level, which is still highly aggregated (Figure 2). The algorithm we developed through this work is able to classify electrification status at the village level, which is an order of magnitude improvement in spatial resolution. Using the electrification data from Bihar, we developed a process for automating the classification of satellite imagery data from a region as electrified or unelectrified (Figure 3). We curated a dataset of satellite imagery from Bihar, India, and extracted features that from those data related to electricity access. Automating Electricity Access Prediction Using Satellite Imagery Shamikh Hossain 1, 2 , Shijia Hu 1, 2 , Prithvir Jhaveri 1 , Harshvardhan Sanghi 3 , Joe Squillace 1 , Brian Wong 4 , Xiaolan You 1, 2 Faculty Advisors: Dr. Kyle Bradbury 5 , Dr. Leslie Collins 6 , Dr. T. Robert Fetter 7 , Dr. Marc Jeuland 8 , Dr. Timothy Johnson 4 1 Department of Computer Science, 2 Department of Statistical Science, 3 Department of Mechanical Engineering & Material Science, 4 Nicholas School of the Environment, 5 Energy Initiative, 6 Pratt School of Engineering, 7 Nicholas Institute for Environmental Policy Solutions, 8 Sanford School of Public Policy Our results present evidence that it may be feasible to automate electricity access assessment using satellite imagery. This approach provides higher resolution data than existing data sources and can be used to produce estimates in regions of India (or other countries) which have not been surveyed down to the village level to determine electrification status. In the future, our village level data could be combined with geospatial electricity grid data to identify the economically and environmentally optimal pathways to electrification for rural villages via grid extension, microgrid development, or off-grid systems such as solar photovoltaics. Additionally, we will explore the use of other advanced computer vision techniques such as convolutional neural networks to improve prediction accuracy to enable even wider application of these methods in other countries. The features our team extracted features include: Lights at night (VIIRS: Visible Infrared Imaging Radiometer Suite) data, population density, measures of possible agricultural activity including NDVI (Normalized Difference Vegetation Index) and EVI (Enhanced Vegetation Index), known irrigation activity, and Human Built-up and Settlement Extent (HBASE) index. We used data on urban extent and irrigated regions to focus our feature extraction on those areas within each village. We trained a gradient boosted decision tree classifier using these features to predict whether 16,389 individual villages in Bihar were either electrified or un-electrified based on ground truth data from the Indian government’s GARV dataset. Our cross-validated results demonstrated through Receiver Operating Characteristic (ROC) performance curves show an area under the curve of 0.693, 0.73, and 0.799 respectively (higher is better). We then used this algorithm to predict electrification of villages in a neighboring state Uttar Pradesh. Our resulting accuracy is promising in its performance and our model can be scaled to identify electricity access in different parts of the world. Introduction & Overview Conclusions & Future Work Results Process Summary Government of India Ministry of Power, Rural Electrification Corporation Ltd. Saubhagya Dashboard, 2018, http://saubhagya.gov.in/ International Energy Agency (2011), World Energy Outlook 2011, OECD Publishing, Paris. http://dx.doi.org/10.1787/weo-2011-en Khandker, S.R., Samad, H.A., Ali, R., & Barnes, D.F. (2012). Who Benefits Most from Rural Electrification? Evidence in India. Policy Research Working Papers. doi:10.1596/1813-9450-6095 Min, B., Gaba, K. M., Sarr, O. F., & Agalassou, A. (2013). Detection of rural electrification in Africa using DMSP-OLS night lights imagery. International Journal of Remote Sensing, 34(22), 8118–8141. https://doi.org/10.1080/01431161.2013.833358 Min, B., & Gaba, K. M. (2014). Tracking Electrification in Vietnam Using Nighttime Lights. Remote Sensing, 6(10), 9511–9529. https://doi.org/10.3390/rs6109511 Shi, K., Yu, B., Huang, Y., Hu, Y., Yin, B., Chen, Z., … Wu, J. (2014). Evaluating the Ability of NPP-VIIRS Nighttime Light Data to Estimate the Gross Domestic Product and the Electric Power Consumption of China at Multiple Scales: A Comparison with DMSP-OLS Data. Remote Sensing, 6(2), 1705–1724. https://doi.org/10.3390/rs6021705 Todd Lindeman, 1.3 BILLION ARE LIVING IN THE DARK, Washington Post, Nov. 10 2015, https://www.washingtonpost.com/graphics/world/world-without-power/ Sebastian Brixey-Williams, Access to electricity is increasing fastest in these countries, World Bank, World Economic Forum, 2012 https://data.worldbank.org/indicator/EG.ELC.ACCS.ZS References Figure 5. ROC Curve demonstrating results of energy access projections separated by three models, one with all villages included, and two others including only those villages with at least 100 or 400 households, respectively, since villages with more households potentially present stronger visible signals in the satellite imagery. The confusion matrices to the right show the performance at three specific points along the ROC curves to the left. Figure 2. District level electrification data compared to higher granularity village level electrification data (Government of India Ministry of Power, 2018) Figure 3. Process of data collection, feature extraction, village electrification classification and output validation. Figure 4. Mean of the five most important features for classification of electrified vs unelectrified villages Figure 1: Global electricity access broken down into percentage of population and number of people in the millions without access to electricity (Lindeman 2015; Brixey-Williams, 2015). Basantpur (Unelectrified) Basauni (Electrified) Data Collection Curate a dataset of electricity access survey data and satellite imagery for all villages in Bihar, India. Feature Extraction Classifier Output Extract features from satellite bands for each village to be input into classifier. (e.g. median value of light at night within the urban extent) Create high-resolution electrification map for any state in India. Model is trained on Bihar. District-wide electrification rate Electrification Rate Prediction State: Uttar Pradesh No Ground Truth Data Available Training State: Bihar Ground Truth Data Available Lights at Night Vegetation Urban Extent Irrigated Area Lights at Night Distribution, Jan. 2016 Village-level electrification rate Basantpur (Unelectrified) Basauni (Electrified) Bihar Unelectrified Electrified Normalized Average Feature Value 0.87 0.62 0.33 0.33 0.19 0.19 0.15 0.15 1.13 0.86 0.0 0.5 1.0 1.5 2.0 Lights at Night Light Spectrum Enhanced Green Vegetation Green Vegetation Population Density 3 1 2 63% Electrification Rate Araria District, Bihar [ 409 ] [ 8654 ] [ 100 ] [ 1481 ] [ 282 ] [ 4366 ] NDVI Distribution, Jan. 2016 Electrified Unelectrified No Data BiharUttar Pradesh Border Correct Detection Rate False Alarm Rate Gradient Boosting Classification ROC Curve Unelectrified Electrified Prediction Electrified Unelectrified Truth Confusion Matrix of All Villages 1 Villages with Over 400 Households 3 Villages with Over 100 Households 2 Unelectrified Electrified Prediction Electrified Unelectrified Truth Unelectrified Electrified Prediction Electrified Unelectrified Truth Total

Automating Electricity Access Prediction Using Satellite Imagery · 2018-06-07 · Automating Electricity Access Prediction Using Satellite Imagery Shamikh Hossain 1, 2 , Shijia Hu

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Automating Electricity Access Prediction Using Satellite Imagery · 2018-06-07 · Automating Electricity Access Prediction Using Satellite Imagery Shamikh Hossain 1, 2 , Shijia Hu

An estimated 1.2 billion people around the world do not have electricity access, and far more have unreliable electricity access (World Energy Outlook, 2017). Energy access is correlated with improvements in health, economic prosperity, and gender equality outcomes. Particularly, access to electricity is linked to an increase in student enrollment in schools, time students spend studying, available business hours, agricultural productivity and labor supply, and a reduction of the poverty rate (Khandker et al., 2012). We present a technique to determine regional electricity access from satellite imagery to aid electrification efforts.

This project aims to fill a data gap by producing high resolution estimates of electrification rates through a case study in the Indian states Bihar and Uttar Pradesh. India has over 300 million people without access to electricity (Figure 1) and there were ground truth data available for Bihar to enable our analysis. Currently, however, electricity access estimates in India are generally available at a district level, which is still highly aggregated (Figure 2). The algorithm we developed through this work is able to classify electrification status at the village level, which is an order of magnitude improvement in spatial resolution.

Using the electrification data from Bihar, we developed a process for automating the classification of satellite imagery data from a region as electrified or unelectrified (Figure 3). We curated a dataset of satellite imagery from Bihar, India, and extracted features that from those data related to electricity access.

Automating Electricity Access Prediction Using Satellite ImageryShamikh Hossain1, 2, Shijia Hu1, 2, Prithvir Jhaveri1, Harshvardhan Sanghi3, Joe Squillace1, Brian Wong4, Xiaolan You1, 2

Faculty Advisors: Dr. Kyle Bradbury5, Dr. Leslie Collins6, Dr. T. Robert Fetter7, Dr. Marc Jeuland8, Dr. Timothy Johnson4

1Department of Computer Science, 2Department of Statistical Science, 3Department of Mechanical Engineering & Material Science, 4Nicholas School of the Environment, 5Energy Initiative, 6Pratt School of Engineering, 7Nicholas Institute for Environmental Policy Solutions,

8Sanford School of Public Policy

Our results present evidence that it may be feasible to automate electricity access assessment using satellite imagery. This approach provides higher resolution data than existing data sources and can be used to produce estimates in regions of India (or other countries) which have not been surveyed down to the village level to determine electrification status. In the future, our village level data could be combined with geospatial electricity grid data to identify the economically and environmentally optimal pathways to electrification for rural villages via grid extension, microgrid development, or off-grid systems such as solar photovoltaics. Additionally, we will explore the use of other advanced computer vision techniques such as convolutional neural networks to improve prediction accuracy to enable even wider application of these methods in other countries.

The features our team extracted features include: Lights at night (VIIRS: Visible Infrared Imaging Radiometer Suite) data, population density, measures of possible agricultural activity including NDVI (Normalized Difference Vegetation Index) and EVI (Enhanced Vegetation Index), known irrigation activity, and Human Built-up and Settlement Extent (HBASE) index. We used data on urban extent and irrigated regions to focus our feature extraction on those areas within each village. We trained a gradient boosted decision tree classifier using these features to predict whether 16,389 individual villages in Bihar were either electrified or un-electrified based on ground truth data from the Indian government’s GARV dataset. Our cross-validated results demonstrated through Receiver Operating Characteristic (ROC) performance curves show an area under the curve of 0.693, 0.73, and 0.799 respectively (higher is better). We then used this algorithm to predict electrification of villages in a neighboring state Uttar Pradesh. Our resulting accuracy is promising in its performance and our model can be scaled to identify electricity access in different parts of the world.

Introduction & Overview

Conclusions & Future Work

ResultsProcess Summary

Government of India Ministry of Power, Rural Electrification Corporation Ltd. Saubhagya Dashboard, 2018, http://saubhagya.gov.in/ International Energy Agency (2011), World Energy Outlook 2011, OECD Publishing, Paris. http://dx.doi.org/10.1787/weo-2011-enKhandker, S.R., Samad, H.A., Ali, R., & Barnes, D.F. (2012). Who Benefits Most from Rural Electrification? Evidence in India. Policy Research Working Papers. doi:10.1596/1813-9450-6095Min, B., Gaba, K. M., Sarr, O. F., & Agalassou, A. (2013). Detection of rural electrification in Africa using DMSP-OLS night lights imagery. International Journal of Remote Sensing, 34(22),

8118–8141. https://doi.org/10.1080/01431161.2013.833358 Min, B., & Gaba, K. M. (2014). Tracking Electrification in Vietnam Using Nighttime Lights. Remote Sensing, 6(10), 9511–9529. https://doi.org/10.3390/rs6109511 Shi, K., Yu, B., Huang, Y., Hu, Y., Yin, B., Chen, Z., … Wu, J. (2014). Evaluating the Ability of NPP-VIIRS Nighttime Light Data to Estimate the Gross Domestic Product and the Electric Power

Consumption of China at Multiple Scales: A Comparison with DMSP-OLS Data. Remote Sensing, 6(2), 1705–1724. https://doi.org/10.3390/rs6021705Todd Lindeman, 1.3 BILLION ARE LIVING IN THE DARK, Washington Post, Nov. 10 2015, https://www.washingtonpost.com/graphics/world/world-without-power/

Sebastian Brixey-Williams, Access to electricity is increasing fastest in these countries, World Bank, World Economic Forum, 2012 https://data.worldbank.org/indicator/EG.ELC.ACCS.ZS

References

Figure 5. ROC Curve demonstrating results of energy access projections separated by three models, one with all villages included, and two others including only those villages with at least 100 or 400 households, respectively, since villages with more households potentially present stronger visible signals in the satellite imagery. The confusion matrices to the right show the performance at three specific points along the ROC curves to the left.

Figure 2. District level electrification data compared to higher granularity village level electrification data (Government of India Ministry of Power, 2018)

Figure 3. Process of data collection, feature extraction, village electrification classification and output validation.

Figure 4. Mean of the five most important features for classification of electrified vs unelectrified villages

Figure 1: Global electricity access broken down into percentage of population and number of people in the millions without access to electricity (Lindeman 2015; Brixey-Williams, 2015).

Basantpur(Unelectrified)

Basauni (Electrified)Data Collection

Curate a dataset of electricity access survey data and satellite imagery for all villages in Bihar, India.

Feature Extraction

Classifier Output

Extract features from satellite bands for each village to be input into classifier. (e.g. median value of light at night within the urban extent)

Create high-resolution electrification map for any state in India. Model is trained on Bihar.

District-wide electrification rate

Electrification Rate

Prediction State: Uttar PradeshNo Ground Truth Data Available

Training State: BiharGround Truth Data Available

Lights at Night

Vegetation

Urban Extent

Irrigated Area

Lights at Night Distribution, Jan. 2016

Village-level electrification rate

Basantpur(Unelectrified)

Basauni(Electrified)

Bihar

UnelectrifiedElectrified

Nor

mal

ized

Ave

rage

Fea

ture

Val

ue

0.87

0.62

0.33 0.330.19 0.19

0.15 0.15

1.13

0.86

0.0

0.5

1.0

1.5

2.0

Lights at Night Light SpectrumEnhanced Green Vegetation

Green Vegetation Population Density

3 1

2

63% Electrification

Rate

Araria District, Bihar

[ 409 ]

[ 8654 ]

[ 100 ]

[ 1481 ]

[ 282 ]

[ 4366 ]

NDVI Distribution, Jan. 2016

Electrified

Unelectrified

No Data

Bihar–Uttar Pradesh Border

Cor

rect

Det

ectio

n R

ate

False Alarm Rate

Gradient Boosting Classification ROC Curve

Unelectrified ElectrifiedPrediction

Elec

trifi

edU

nele

ctrif

ied

Trut

h

Confusion Matrix of All Villages

1

Villages with Over 400 Households

3

Villages with Over 100 Households

2

Unelectrified ElectrifiedPrediction

Elec

trifi

edU

nele

ctrif

ied

Trut

h

Unelectrified ElectrifiedPrediction

Elec

trifi

edU

nele

ctrif

ied

Trut

h

Total