Electricity Access in Developing Countries

WHERE IS THE DATA

BEFORE EVERYTHING IS PUBLISHED ON FIGSHARE, PLEASE FIND THEM HERE:

US Power Plant Data

• VM (1 - raw data; 2 - processed dataset):
  1. Z:\data\energyaccess\US_Power_Plants_RAW_NAIP.tar
     Z:\data\energyaccess\US_Power_Plants_RAW_LS8.tar
  2. Z:\data\energyaccess\dataplus2017\USPowerPlantDataset\USPowerPlantDataset_DATA\
• GPU (dataset only): /home/hyperion/dataplus/dataplus2017/USPowerPlantDataset/USPowerPlantDataset_DATA/

Indian Villages Data

Either of the following holds the COMPLETE multi-band imagery & electrification map of Bihar, India.

• VM (1 - compressed; 2 - extracted for test and review):
  
  1. Z:\data\energyaccess\archive\IndianVillagesDataset_DATA.zip
     
  2. Z:\data\energyaccess\dataplus2017\IndianVillagesDataset\IndianVillagesDataset_DATA\
• GPU : NA

WHAT ARE THE SETS LIKE

This section introduces the organization of each set of products, including data and code.

US Power Plants* - A list of files

* More info: for data, please see the dataset documentation here, for code the creation demo here.

Data

• /USPowerPlantDataset_DATA
  • /uspp_naip - naip_ID_StateName_FuelCategory.tif
  • /uspp_landsat - ls8_ID_StateName_FuelCategory.tif
  • /exceptions // none of accepted annotations marks it as containing a power plants
  • /annotations // polygons in .txt, and rasterized annotations in binary and confidence maps .png
    • accepted_ann_json.txt // accepted annotations condensed
    • /binary - bilabels_ID.png
    • /confidence - conflabels_ID.png
  • uspp_metadata.geojson // power plants metadata
  • README.md // data explanations
• /USPowerPlantDataset_RAW
  • US_Power_Plants_RAW_NAIP.tar.gz
  • US_Power_Plants_RAW_LS8.tar.gz

Code

• /USPowerPlantDataset_CREATION
  • *A SUBSET OF USPowerPlantDataset_DATA* (ID=300~500)
  • egrid2014_data_v2_PLNT14.xlsx // a subset of the egrid document
  • P1DATAPREP_cropPowerPlants.py // prepares data - download
  • P1DATAPREP_fixLs.m // prepares data - preprocess
  • P2ANNOGEN_getAllAcceptedCondensed.py // fetches annotations
  • P3DATAPROC_make.py // constructs dataset
  • P3DATAPROC_report.py // displays data distribution
  • P4TESTCLSFR_classify_sample.py // tests classifiers
  • README.md // documentation

Indian Villages Data * - A list of files

* More info: for data, please see data description here, for code the creation summary here.

Data

• /IndianVillagesDataset_DATA // size: 45,220
  • imagery/ // 48-band imagery by village bounding boxes
    • Naming: StateName(type)-VillageName-6DigitCensusID.tif *
  • masks/ // binary masks of village bounding polygons
    • Naming: StateName(type)-VillageName-6DigitCensusID.tif *
  • ElectrificationMap_Bihar.geojson // electrification map (of Bihar); i.e. ground truth from garv & village boundaries

Code

• /creation
  • /india_geojsons // Indian administrative divisions .geojson
  • makeIrriElecMetrics.js // exports composite imagery from GEE
  • /Scrape_code_and_files // download village info from garv.gov.in
    • /csv_scrape // uses the download button
    • /id_scrape // uses the village IDs
  • /curr_data_files // current data
  • combine.py
  • combine_garv_csv.py
  • control.py
  • geojson2shp.py
  • visShapeFile.py
  • readme.txt // creation code documentation
• /processing
  • merge_crop.py // merges or crops given image(s)
  • getImgList.py // generates districts_img_list.txt
  • genSamples.m // generate sample images
  • readme.txt // documentation for merge_crop.py