Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Poll interval on worker manager is not working as intended #1021

Open
benoit74 opened this issue Oct 4, 2024 · 0 comments
Open

Poll interval on worker manager is not working as intended #1021

benoit74 opened this issue Oct 4, 2024 · 0 comments

Comments

@benoit74
Copy link
Collaborator

benoit74 commented Oct 4, 2024

See logs below. Polling interval is supposed to be 180secs, i.e. every 3 minutes, but this is not what happens, interval is significantly bigger.

[2024-10-04 09:24:54,922: INFO] starting zimfarm worker-manager.
[2024-10-04 09:24:54,923: INFO] configuration:
	username=sisyphus
	webapi_uris=['https://api.farm.zimit.kiwix.org/v1', 'https://api.farm.openzim.org/v1']
	workdir=/data
	worker_name=sisyphus
	poll_interval=180
	sleep_interval=5
	selfish=True
	OFFLINERS=['mwoffliner', 'youtube', 'phet', 'gutenberg', 'sotoki', 'nautilus', 'ted', 'openedx', 'zimit', 'kolibri', 'wikihow', 'ifixit', 'freecodecamp', 'devdocs']
	PLATFORMS_TASKS={}
[2024-10-04 09:24:54,923: INFO] testing workdir at /data…
[2024-10-04 09:24:54,923: INFO] 	workdir is available and writable
[2024-10-04 09:24:54,923: INFO] testing private key at /etc/ssh/keys/zimfarm…
[2024-10-04 09:24:55,201: INFO] 	private key is available and readable (0b553ecbd4c69aa84f8322d7f5633030)
[2024-10-04 09:24:55,201: INFO] testing authentication with https://api.farm.zimit.kiwix.org/v1…
[2024-10-04 09:24:55,508: INFO] 	authentication successful
[2024-10-04 09:24:55,509: INFO] testing authentication with https://api.farm.openzim.org/v1…
[2024-10-04 09:24:55,790: INFO] 	authentication successful
[2024-10-04 09:24:55,791: INFO] testing docker API on /var/run/docker.sock…
[2024-10-04 09:24:55,815: INFO] 	docker API access successful
[2024-10-04 09:24:55,823: INFO] Host hardware resources:
	CPU : 4 (total) ;  4 (avail)
	RAM : 15 GiB (total) ;  15 GiB (avail)
	Disk: 200 GiB (configured) ; 217.78 GiB (avail) ; 0 bytes (reserved) ; 200 GiB (remain)
[2024-10-04 09:24:55,823: INFO] checking-in with the API at api.farm.zimit.kiwix.org…
[2024-10-04 09:24:55,960: INFO] 	checked-in!
[2024-10-04 09:24:55,960: INFO] checking-in with the API at api.farm.openzim.org…
[2024-10-04 09:24:56,081: INFO] 	checked-in!
[2024-10-04 09:24:56,082: INFO] registering exit signals
[2024-10-04 09:24:56,096: DEBUG] polling api.farm.zimit.kiwix.org…
[2024-10-04 09:24:56,302: INFO] API is offering 1 task(s): ['9ac13cff-76b1-48ab-a79e-7b2f84248dd6']
[2024-10-04 09:24:56,302: DEBUG] start_task: [email protected]
[2024-10-04 09:24:56,444: DEBUG] update_task_data: [email protected]
[2024-10-04 09:24:56,556: DEBUG] start_task_worker: 9ac13cff-76b1-48ab-a79e-7b2f84248dd6
[2024-10-04 09:24:56,561: DEBUG] getting image ghcr.io/openzim/zimfarm-task-worker:latest
[2024-10-04 09:25:07,495: DEBUG] running ['task-worker', '--task-id', '9ac13cff-76b1-48ab-a79e-7b2f84248dd6', '--webapi-uri', 'https://api.farm.zimit.kiwix.org/v1']
[2024-10-04 09:29:38,253: DEBUG] update_task_data: [email protected]
[2024-10-04 09:29:38,397: DEBUG] polling api.farm.openzim.org…
[2024-10-04 09:29:38,647: DEBUG] polling api.farm.zimit.kiwix.org…
[2024-10-04 09:29:38,803: INFO] API is offering 1 task(s): ['6267c175-41bd-4b20-b782-9cff71a39b29']
[2024-10-04 09:29:38,804: DEBUG] start_task: [email protected]
[2024-10-04 09:29:38,928: DEBUG] update_task_data: [email protected]
[2024-10-04 09:29:39,044: DEBUG] start_task_worker: 6267c175-41bd-4b20-b782-9cff71a39b29
[2024-10-04 09:29:39,048: DEBUG] getting image ghcr.io/openzim/zimfarm-task-worker:latest
[2024-10-04 09:29:39,592: DEBUG] running ['task-worker', '--task-id', '6267c175-41bd-4b20-b782-9cff71a39b29', '--webapi-uri', 'https://api.farm.zimit.kiwix.org/v1']
[2024-10-04 09:34:10,070: DEBUG] update_task_data: [email protected]
[2024-10-04 09:34:10,215: DEBUG] update_task_data: [email protected]
[2024-10-04 09:34:10,336: DEBUG] polling api.farm.openzim.org…
[2024-10-04 09:34:10,573: DEBUG] polling api.farm.zimit.kiwix.org…
[2024-10-04 09:34:10,778: INFO] API is offering 1 task(s): ['8304178b-706e-4d0e-aa7e-2aee3d50e7a8']
[2024-10-04 09:34:10,779: DEBUG] start_task: [email protected]
[2024-10-04 09:34:10,923: DEBUG] update_task_data: [email protected]
[2024-10-04 09:34:11,039: DEBUG] start_task_worker: 8304178b-706e-4d0e-aa7e-2aee3d50e7a8
[2024-10-04 09:34:11,044: DEBUG] getting image ghcr.io/openzim/zimfarm-task-worker:latest
[2024-10-04 09:34:11,587: DEBUG] running ['task-worker', '--task-id', '8304178b-706e-4d0e-aa7e-2aee3d50e7a8', '--webapi-uri', 'https://api.farm.zimit.kiwix.org/v1']
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant