-
Notifications
You must be signed in to change notification settings - Fork 1
Sep 21, 2023
alejandropaz edited this page Sep 28, 2023
·
2 revisions
- forms
- new time
- email Nat about NPM error and also history issue with restarting crawl
- Aryan will work with Francisco to figure out what trouble-shooting needs to be done
- Gy will help Raazia learn how to set up an instance
- today running postprocessor on foxnews to see if it would work for large dataset
- still need to trouble-shoot accuracy
- worked on running the crawler
- reading on webcrawling in general and some resources
- reading the NYT crawl and the batch
- meeting with Nat tmrw
- Aryan and Francisco: still learning code base
- learning the dask dataframe with Nat in meeting first
- then turn to fixing accuracy of the postprocessor
- Francisco will send some resources for Aryan about Dask and Pandas
- Raazia: continue reading about webcrawling, meet with Nat and Gy, and look at web archive API