Skip to content

Commit

Permalink
new population data (#47)
Browse files Browse the repository at this point in the history
  • Loading branch information
SahitiSarva authored Mar 7, 2024
1 parent 6e1b01e commit 70fd571
Showing 1 changed file with 22 additions and 9 deletions.
31 changes: 22 additions & 9 deletions notebooks/population/population.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -49,15 +49,23 @@
"* Youth (15-24)\n",
"* Senior\n",
"\n",
"#### Accessing the Data\n",
"\n",
"The High Resolution Population Density Layer can be accessed through two ways - either through Meta's [AWS Server](https://registry.opendata.aws/dataforgood-fb-hrsl/) or through [HdX](https://data.humdata.org/dataset/lebanon-high-resolution-population-density-maps-demographic-estimates). Both the links will provide additional instructions on how to access the data. Shapefiles are also obtained from [HdX website](https://data.humdata.org/dataset/cod-ab-lbn?).\n",
"\n",
"### Relative Wealth Index\n",
"\n",
"The Meta Relative Wealth Index predicts the relative standard of living within countries using privacy protecting connectivity data, satellite imagery, and other novel data sources. To calculate this index, Meta uses measurements of household wealth collected through *face-to-face surveys conducted by the United States Agency for International Development* with 1,457,315 unique households living in 66,819 villages in 56 different LMICs around the world. Following this, they use spatial markers to link villages to non-traditional data sources , including satellite imagery, cellular network data, topographic maps, and *privacy protecting connectivity data from Facebook*. They process the non-traditional data using deep learning and other computational algorithms, which convert the raw data to a set of quantitative features for each village. They use these features to train a supervised machine learning model that predicts the relative wealth of each populated 2.4km2 grid cell on the planet, even in regions where no ground truth data exists (Chi et. al., 2022).\n",
"\n",
"The Relative Wealth Index is a number that compared the wealth within the country where negative RWI implies poorer areas and positive RWI implies richer areas. \n",
"\n",
"#### Accessing the Data\n",
"\n",
"Relative Wealth Index dataset has been obtained through the Development Data Partnership. This raw data has been made accessible via [SharePoint](https://worldbankgroup.sharepoint.com.mcas.ms/teams/DevelopmentDataPartnershipCommunity-WBGroup/Shared%20Documents/Forms/AllItems.aspx?csf=1&web=1&e=Yvwh8r&cid=fccdf23e%2D94d5%2D48bf%2Db75d%2D0af291138bde&FolderCTID=0x012000CFAB9FF0F938A64EBB297E7E16BDFCFD&id=%2Fteams%2FDevelopmentDataPartnershipCommunity%2DWBGroup%2FShared%20Documents%2FProjects%2FData%20Lab%2FLebanon%20Economic%20Analytics%2FData%2Frelative%5Fwealth&viewid=80cdadb3%2D8bb3%2D47ae%2D8b18%2Dc1dd89c373c5).\n",
"\n",
"## Methodology and Implementation\n",
"\n",
"The data extracted from Meta was then aggregated to different admin levels using the shapefiles available on [HdX](https://data.humdata.org/dataset/cod-ab-lbn?). These datasets are made available on [SharePoint](https://worldbankgroup.sharepoint.com.mcas.ms/teams/DevelopmentDataPartnershipCommunity-WBGroup/Shared%20Documents/Forms/AllItems.aspx?csf=1&web=1&e=Yvwh8r&cid=fccdf23e%2D94d5%2D48bf%2Db75d%2D0af291138bde&FolderCTID=0x012000CFAB9FF0F938A64EBB297E7E16BDFCFD&id=%2Fteams%2FDevelopmentDataPartnershipCommunity%2DWBGroup%2FShared%20Documents%2FProjects%2FData%20Lab%2FLebanon%20Economic%20Analytics%2FData%2Fpopulation%2Fmeta%2Dhigh%2Dresolution%2Dpopulation%2Ddensity%2F2023&viewid=80cdadb3%2D8bb3%2D47ae%2D8b18%2Dc1dd89c373c5). "
"The data extracted from Meta was then aggregated to different admin levels using the shapefiles available on [HdX](https://data.humdata.org/dataset/cod-ab-lbn?). These datasets are made available on [SharePoint](https://worldbankgroup.sharepoint.com.mcas.ms/teams/DevelopmentDataPartnershipCommunity-WBGroup/Shared%20Documents/Forms/AllItems.aspx?csf=1&web=1&e=Yvwh8r&cid=fccdf23e%2D94d5%2D48bf%2Db75d%2D0af291138bde&FolderCTID=0x012000CFAB9FF0F938A64EBB297E7E16BDFCFD&id=%2Fteams%2FDevelopmentDataPartnershipCommunity%2DWBGroup%2FShared%20Documents%2FProjects%2FData%20Lab%2FLebanon%20Economic%20Analytics%2FData%2Fpopulation%2Fmeta%2Dhigh%2Dresolution%2Dpopulation%2Ddensity%2F2023&viewid=80cdadb3%2D8bb3%2D47ae%2D8b18%2Dc1dd89c373c5). Relative Wealth Index is accessible to the project team via the Development Data Partnership. "
]
},
{
Expand Down Expand Up @@ -89,6 +97,17 @@
"LEBANON_ADM2 = gpd.read_file('../../data/shapefiles/lbn_adm_cdr_20200810/lbn_admbnda_adm2_cdr_20200810.shp')"
]
},
{
"cell_type": "markdown",
"metadata": {
"tags": [
"remove-cell"
]
},
"source": [
"Use the below method to clip HRSL data for Lebanon if the data is obtained from the AWS server. If it is directly downloaded from HdX, just reading the file should suffice"
]
},
{
"cell_type": "code",
"execution_count": 6,
Expand Down Expand Up @@ -119,14 +138,15 @@
},
{
"cell_type": "code",
"execution_count": 17,
"execution_count": null,
"metadata": {
"tags": [
"remove-cell"
]
},
"outputs": [],
"source": [
"# aggregate HRSL to admin level 1 and 2\n",
"hrsl_lebanon0 = LEBANON_ADM0.sjoin(hrsl)\n",
"hrsl_lebanon1 = LEBANON_ADM1.sjoin(hrsl)"
]
Expand Down Expand Up @@ -314,13 +334,6 @@
"\n",
"Chi, Guanghua, Han Fang, Sourav Chatterjee, and Joshua E. Blumenstock. \"Microestimates of wealth for all low-and middle-income countries.\" Proceedings of the National Academy of Sciences 119, no. 3 (2022): e2113658119."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": []
}
],
"metadata": {
Expand Down

0 comments on commit 70fd571

Please sign in to comment.