The aim of this project is to provide GIS files for each caving region which contain the entrances of every known cave programtically.
The aim is to provide:
- KML
- JSON
- GPX
For the following registrys:
- Derbyshire
- North Yorkshire
- Wales and related areas
- Gloucestershire and Wye Valley
- Devon and Cornwall
- Mendip
- Scotland
- Ireland
To download the output from this repository go to the releases page and download the file for the region you are interested in.
All efforts have been made to ensure accuracy of the output files but not every registry entry is acurate to begin with. Not every registry entry lists WGS84 or NGR which means it has to be derived from the other if availaible which can introduce an error. If you chose to use this data for navigation its not my fault if you end up wandering around on leck fell lost in the mist!
Pull requests welcome but please read the contribution guidelines first here
The tool is written in python 3.4 using scrapy the output is released by commits to master via travis CI Docker is used manage the python enviroment.
- First build the docker image
docker-compose build - Then run the spiders with
docker-compose up
To run scrapy commands run docker-compose run scrapy scrapy <command> such as docker-compose run scrapy scrapy crawl ` to crawl a single registry.
To have access to the containers shell run docker-compose run scrapy /bin/bash
You may need to reset the owner and permissions of files created by docker/scrapy using sudo chmod & sudo chown on linux.