Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Latest Europe continent database indexing taking too much time #719

Open
akki401 opened this issue Mar 29, 2024 · 2 comments
Open

Latest Europe continent database indexing taking too much time #719

akki401 opened this issue Mar 29, 2024 · 2 comments
Labels

Comments

@akki401
Copy link

akki401 commented Mar 29, 2024

Hello Team,
I am using overpass docker image(https://hub.docker.com/r/wiktorn/overpass-api) to launch the overpass docker service for Europe continent and the plant URL I am using is https://download.geofabrik.de/europe-latest.osm.bz2 which is latest up to date.
It took more than 48 hours to do indexing and still doing indexing. Find the below docker command to start the overpass docker and EC2 hardware config.
I have given diff url to update every 30 days in environment variables.
My question is when I am starting the docker image it will start with latest europe continent database but when I see the logs it is considering the updates also and start doing indexing( I see update 30 days interval). Screenshot of last few lines of latest logs
image

Docker command:
cmd = " ".join(
[
"docker",
"run",
"--restart=always", # starts docker after system reboot
"--log-driver json-file",
"--log-opt max-size=10m",
"--log-opt max-file=3",
"-e",
"OVERPASS_META=yes",
"-e",
"OVERPASS_MODE=init",
"-e",
f"OVERPASS_PLANET_URL=file:///db/{self.region}-latest.osm.bz2",
"-e",
"OVERPASS_RULES_LOAD=10", # infinite areas update process. Ex: 0-always run, 5-run 5% of the time...
"-e",
f"OVERPASS_DIFF_URL={self._updates_url}", # https://download.geofabrik.de/europe-updates
"-e",
f"OVERPASS_UPDATE_SLEEP={3600 * 24 * 30}", # update every 30 days
"-e",
"OVERPASS_STOP_AFTER_INIT=false",
"-v",
f"{self._dir_overpass}/:/db",
"-p",
f"{self._overpass_port}:80",
"-i",
"-t",
"-d",
"--name",
self._overpass_container_name,
"wiktorn/overpass-api",
]
)
EC2 config:
Instance Size: i4i.2xlarge
vCPU: 64
Instance Storage (GB): 1 x 1,875 AWS Nitro SSD
Network Bandwidth (Gbps): Up to 12
EBS Bandwidth (Gbps): Up to 10

@akki401
Copy link
Author

akki401 commented Mar 29, 2024

After very long time the status of docker is unhealth and the last log statements are
image

No idea why it got failed

@mmd-osm
Copy link
Contributor

mmd-osm commented Mar 30, 2024

Since this docker image is maintained by a third party, we cannot help you with any issues.
Please head over to https://github.com/wiktorn/Overpass-API instead.

@drolbr drolbr added the invalid label Apr 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants