Home

Unicef AI4D Poverty Mapping Wiki

working notes on AI4D Poverty Mapping project

Links

• DHS
• OSM
• Ookla

Scripts

• DHS Preprocessing - convert source dhs data in stata (.DTA) and shape files (for geotagging) into csv and geojson files

  • module: povertymapping.dhs_data_proc
  • notebooks:
    • test (uses test data)
    • ph (Philippines)
    • tl (Timor Leste)
    • kh (Cambodia)
    • mm (Myanmar)

• Ookla Preprocessing - filter and feature extraction from downloaded global OOkla to csv files per country

  • module: povertymapping.ookla_data_proc
  • notebooks:
    • test (use test data)
    • ph (Philippines)
    • tl (Timor Leste)
    • kh (Cambodia)
    • mm (Myanmar)

• OSM - feature extraction from downloaded from per country

  • module: povertymapping.osm_data_proc
  • notebooks:
    • test (using test data)
    • ph (Philippines)

• Nightlights - splitting into per country from downloaded global ntlights data and feature extraction from each country

  • notebooks:
    • ph (Philippines)

• Prepare Train/ Prepare Train test - merging, and filtering of predicted labels and features

  • module: poverty_mapping.process_train_test
  • notebooks:

    • prepare train (Philippines)

    • process train test (test data)

    • process train test (Philippines)

• Model Training/Model Evaluation

  • notebooks:
    • train (Philippines)
    • evaluate (Philippines)