Releases: nansencenter/django-geo-spaas-harvesting
Releases · nansencenter/django-geo-spaas-harvesting
3.0.1
3.0.0
2.2.2
2.2.1
Various fixes:
- limit the number of concurrent database connections created when harvesting
- create a new database connection for each parallel harvester process to avoid "lost synchronization" errors
- for paginated APIs, sort by publishing date rather than content date
- add settings to control pythesint vocabularies updates
2.2.0
- CONN_MAX_AGE and DISABLE_SERVER_SIDE_CURSORS database settings are parameterized in settings.py
- The reliability of the FTP crawler has been improved
- A base crawler class for exploring paginated APIs has been added
- The base Ingester has been modified so that crawlers can provide more than a download URL
- The version of metanorm has been updated to 2.0.2
- Added a harvester for Creodias
- Added a local filesystem crawler