This script compiles the data treatments performed by Cemal in his analysis notebook that generated many of the charts used in the paper.

The purpose of this script is to facilitate reproducibility of the results in our paper by taking in the raw set of trips in csv, and applying all data treatments, then saving the results to be loaded into the analysis notebooks

Note that I have not yet had a chance to be sure that this works on the data from TSDC, but it does yield the numbers we quote in terms of participants and trips on an aggregate and program level when run in the raw file Cemal gave me

keeping git up to date as I update the paper, changes are messy but need to be kept

loading from the database / showing participation rates

working on centralizing to as few scripts as possible

mine is not currently working for some reason, erroring out over "within" in one part of the code but not others

very close to the TSDC numbers

all but 8 of the charts are now in this Analysis file

working through the energy calculations, might still need some updates to the data used as input until the paper is matched exactly

figured out what the underlying function could have been - was able to use the seaborn library

move to only one scenario - reading in from a the csv file!

this chart was age distribution over modes, but this is the chart that's really in the paper so I switched them out

needed to treat data as categorical

needed to drop 0 mile days from e-bike ratio chart

working to make sure that paths are not hardcoded for my configuration (they were), now providing the paths as a variable at the top of each file

while updating this notebook to include paths as a variable, I encountered a bug

to resolve, needed to manually install libtiff5

note documenting the error I encountered and the method to resolve added

discovered some of the header code was no longer needed since we are working with csvs and not mongodump

factored repeated code into a function

these have been replaced by the notebooks in the Abby folder, and are no longer needed as the newer notebooks are compatible with the TSDC data

implemented function, removed unnecessary code, centralized import statements

needed for spatial analysis notebook functions

after refactoring, the outputs now reflect the refined notebooks

This reverts commit 05398e2.

this way expected outputs can be viewed, separate from the code itself