Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failed to upload crash dump: couldn't connect to host (7) #18

Open
SefoNotasi opened this issue Sep 3, 2024 · 6 comments
Open

Failed to upload crash dump: couldn't connect to host (7) #18

SefoNotasi opened this issue Sep 3, 2024 · 6 comments

Comments

@SefoNotasi
Copy link

Last time I created issues - crash logs are not uploading:
#17

Now I have a new error:

accelerator.log

Presubmit failed: couldn't connect to host (7)
Failed to upload crash dump: couldn't connect to host (7)

errors_20240903.log

L 09/03/2024 - 20:33:49: Started session with SourceMod error
L 09/03/2024 - 20:33:49: Information (map “c13m2_southpinestream”) (file “/game/left4dead2/addons/sourcemod/logs/errors_2024090903.log”)
L 09/03/2024 - 20:33:49: [CRASH] Accelerator failed to load crash dump: failed to connect to host (7)

Dedicated server on linux, latest version of Accelerator, IP: 46.174.50.10:27268
@SefoNotasi
Copy link
Author

I ran some tests and this is what I found out:

If I run a dedicated server with my build and Accelerator on a local Windows machine and crash it, the crash report is immediately uploaded to crash.limetech.org (I have a static IP: 95.143.216.252).

If I run the same build (of course with Linux versions of the same extensions and mods) of the dedicated server on a Linux machine on hosting and crash it there, then the crash report is not uploaded to crash.limetech.org
Hosted server IP: 46.174.50.10:27268

I tried : -condebug, -debug, cURL Extension (1.3.0.0), nothing helps.

After the crash and rebooting the dedicated server on hosting I see only one message from Accelerator in the console:

Network: IP 46.174.50.10, mode MP, dedicated Yes, ports 27268 SV / 0 CL
---- Host_NewGame ----
Host_NewGame on map c10m1_caves
Accelerator upload thread started.

SourceMod errors_20240905.log:

L 09/05/2024 - 22:33:20: SourceMod error session started
L 09/05/2024 - 22:33:20: Info (map "c1m2_streets") (file "/game/left4dead2/addons/sourcemod/logs/errors_20240905.log")
L 09/05/2024 - 22:33:20: [CRASH] Accelerator failed to upload crash dump: couldn't connect to host (7)
L 09/05/2024 - 22:37:42: [CRASH] Accelerator failed to upload crash dump: couldn't connect to host (7)
L 09/05/2024 - 22:42:04: [CRASH] Accelerator failed to upload crash dump: couldn't connect to host (7)
L 09/05/2024 - 23:18:51: Error log file session closed.
L 09/05/2024 - 23:59:39: SourceMod error session started
L 09/05/2024 - 23:59:39: Info (map "c1m2_streets") (file "/game/left4dead2/addons/sourcemod/logs/errors_20240905.log")
L 09/05/2024 - 23:59:39: [CRASH] Accelerator failed to upload crash dump: couldn't connect to host (7)
L 09/06/2024 - 07:16:20: Error log file session closed.

accelerator.log:

Presubmit failed: couldn't connect to host (7)
Failed to upload crash dump: couldn't connect to host (7)
Presubmit failed: couldn't connect to host (7)
Failed to upload crash dump: couldn't connect to host (7)
Presubmit failed: couldn't connect to host (7)
Failed to upload crash dump: couldn't connect to host (7)
Presubmit failed: couldn't connect to host (7)
Failed to upload crash dump: couldn't connect to host (7)
Presubmit failed: couldn't connect to host (7)
Failed to upload crash dump: couldn't connect to host (7)
Presubmit failed: couldn't connect to host (7)
Failed to upload crash dump: couldn't connect to host (7)
Presubmit failed: couldn't connect to host (7)
Failed to upload crash dump: couldn't connect to host (7)
Presubmit failed: couldn't connect to host (7)
Failed to upload crash dump: couldn't connect to host (7)

Is the problem on my hosting side?
What should I write to my hosting support to fix this problem so that the logs will upload?

@SefoNotasi
Copy link
Author

SefoNotasi commented Sep 8, 2024 •
edited
Loading

I contacted the technical support of my hosting, and they told me that connections from their side are ignored by the crash.limetech.org service and I should address this problem to the Accelerator developer.

They claim that the problem is not on their side and everything worked stably before.

crash.limetech.org ignores connection from IP 46.174.50.10 of my server:

L 09/05/2024 - 22:33:20: [CRASH] Accelerator failed to upload crash dump: couldn't connect to host (7)
L 09/05/2024 - 22:37:42: [CRASH] Accelerator failed to upload crash dump: couldn't connect to host (7)
L 09/05/2024 - 22:42:04: [CRASH] Accelerator failed to upload crash dump: couldn't connect to host (7)

Is it possible to fix this please?

@asherkin
Copy link
Owner

There are no network-level restrictions on access to crash.limetech.org, unfortunately this problem is with your hosting provider or their ISP.

They'll need to do some basic network diagnostics to narrow down the problem, if you'd like my help then I would like at minimum the output of traceroute -I 109.74.205.75 and curl -v -XPOST http://crash.limetech.org/submit from the host - hopefully that should tell us what system is blocking the traffic.

@F1F88
Copy link

F1F88 commented Sep 13, 2024 •
edited
Loading

I'm also experiencing this problem, and a look at sourcemod/logs/error.log shows that the server has been crashing and rebooting repeatedly from 19:00 on the 12th until 18:00 on the 13th.

But I don't get an error message after logging on to https://crash.limetech.org

So I looked at sourcemod/logs/error.log and found a lot of duplicate error messages:

L 09/12/2024 - 19:56:32: SourceMod error session started
L 09/12/2024 - 19:56:32: Info (map "nmo_chinatown") (file "/home/steam/serverfiles4/nmrih/addons/sourcemod/logs/errors_20240912.log")
L 09/12/2024 - 19:56:32: [CRASH] Accelerator uploaded crash dump: Sorry, presubmit is required - you may need to upgrade accelerator or adjust your config
L 09/12/2024 - 19:59:00: SourceMod error session started
L 09/12/2024 - 19:59:00: Info (map "nmo_chinatown") (file "/home/steam/serverfiles4/nmrih/addons/sourcemod/logs/errors_20240912.log")
L 09/12/2024 - 19:59:00: [CRASH] Accelerator uploaded crash dump: Sorry, presubmit is required - you may need to upgrade accelerator or adjust your config
L 09/12/2024 - 20:03:36: SourceMod error session started
L 09/12/2024 - 20:03:36: Info (map "nmo_chinatown") (file "/home/steam/serverfiles4/nmrih/addons/sourcemod/logs/errors_20240912.log")
L 09/12/2024 - 20:03:36: [CRASH] Accelerator failed to upload crash dump: couldn't connect to host (7)

There are also a lot of duplicate error messages in sourcemod/logs/accelerator.log:

Presubmit failed: couldn't connect to host (7)
Uploaded crash dump: Sorry, presubmit is required - you may need to upgrade accelerator or adjust your config
Presubmit failed: couldn't connect to host (7)
Uploaded crash dump: Sorry, presubmit is required - you may need to upgrade accelerator or adjust your config
Presubmit failed: couldn't connect to host (7)
Failed to upload crash dump: couldn't connect to host (7)

This is the result of my test traceroute -I 109.74.205.75

[steam@VM-12-14-centos ~]$ traceroute -I 109.74.205.75
traceroute to 109.74.205.75 (109.74.205.75), 30 hops max, 60 byte packets
 1  * * *
 2  * * *
 3  * * *
 4  10.196.0.49 (10.196.0.49)  0.957 ms  1.040 ms  1.058 ms
 5  10.196.2.101 (10.196.2.101)  1.163 ms  1.225 ms  1.259 ms
 6  * * *
 7  113.108.209.37 (113.108.209.37)  5.092 ms  5.002 ms  4.957 ms
 8  113.96.5.65 (113.96.5.65)  3.212 ms  2.968 ms  3.048 ms
 9  202.97.82.62 (202.97.82.62)  3.580 ms * *
10  202.97.12.29 (202.97.12.29)  4.417 ms  4.655 ms *
11  * 202.97.91.86 (202.97.91.86)  158.596 ms *
12  218.30.53.51 (218.30.53.51)  147.293 ms  147.290 ms  147.296 ms
13  * * *
14  * * ae-2.r24.asbnva02.us.bb.gin.ntt.net (129.250.6.238)  210.709 ms
15  ae-3.r23.parsfr04.fr.bb.gin.ntt.net (129.250.6.5)  246.732 ms  246.728 ms  246.723 ms
16  ae-8.a01.parsfr04.fr.bb.gin.ntt.net (129.250.4.94)  242.903 ms  242.856 ms  242.836 ms
17  ae-1.akamai.parsfr04.fr.bb.gin.ntt.net (168.143.105.115)  242.317 ms  241.694 ms  241.720 ms
18  ae4.r02.par01.icn.netarch.akamai.com (23.210.51.40)  241.808 ms  241.631 ms  241.610 ms
19  ae6.r02.lon03.icn.netarch.akamai.com (95.100.192.111)  241.836 ms  242.844 ms  242.354 ms
20  ae11.r01.lon01.icn.netarch.akamai.com (95.100.192.240)  254.658 ms  254.943 ms  250.620 ms
21  ae5.r21.lon01.icn.netarch.akamai.com (23.210.48.105)  251.086 ms  251.256 ms  251.009 ms
22  ae1.r21.lon01.mag.netarch.akamai.com (23.197.64.96)  250.840 ms  250.971 ms  250.865 ms
23  ae1.r21.lon01.ien.netarch.akamai.com (23.197.64.65)  241.888 ms  241.871 ms  241.391 ms
24  a23-210-48-107.deploy.static.akamaitechnologies.com (23.210.48.107)  251.961 ms  251.812 ms  251.789 ms
25  * * *
26  * * *
27  * * *
28  limetech.io (109.74.205.75)  252.036 ms  251.807 ms  251.955 ms
[steam@VM-12-14-centos ~]$

This is the result of my test curl -v -XPOST http://crash.limetech.org/submit

[steam@VM-12-14-centos ~]$ curl -v -XPOST http://crash.limetech.org/submit
*   Trying 109.74.205.75:80...
* Connected to crash.limetech.org (109.74.205.75) port 80 (#0)
> POST /submit HTTP/1.1
> Host: crash.limetech.org
> User-Agent: curl/7.76.1
> Accept: */*
> 
* Mark bundle as not supporting multiuse
< HTTP/1.1 200 OK
< Server: nginx/1.22.1
< Content-Type: text/plain; charset=UTF-8
< Transfer-Encoding: chunked
< Connection: keep-alive
< Vary: Accept-Encoding
< X-Powered-By: PHP/8.1.25
< Set-Cookie: PHPSESSID=5i8l7vheg3ruhbn2jb8vuve6k5; path=/
< Cache-Control: no-cache
< Date: Fri, 13 Sep 2024 11:40:36 GMT
< 
* Connection #0 to host crash.limetech.org left intact
Sorry, presubmit is required - you may need to upgrade accelerator or adjust your config[steam@VM-12-14-centos ~]$ 
[steam@VM-12-14-centos ~]$

Does this have anything to do with the sourcemod version? I'm using sm-1.12 version, not sm-1.11.

sm version
 SourceMod Version Information:
    SourceMod Version: 1.12.0.7106
    SourcePawn Engine: 1.12.0.7106, jit-x86 (build 1.12.0.7106)
    SourcePawn API: v1 = 5, v2 = 16
    Compiled on: Feb  1 2024 01:38:13
    Built from: https://github.com/alliedmodders/sourcemod/commit/7bb9da2a
    Build ID: 7106:7bb9da2a
    http://www.sourcemod.net/

@SefoNotasi
Copy link
Author

They'll need to do some basic network diagnostics to narrow down the problem, if you'd like my help then I would like at minimum the output of traceroute -I 109.74.205.75 and curl -v -XPOST http://crash.limetech.org/submit from the host - hopefully that should tell us what system is blocking the traffic.

Thank you for your reply and help.

I asked the hosting tech support to run this network diagnostic, they replied that the result is as follows:

traceroute -I 109.74.205.75
traceroute to 109.74.205.75 (109.74.205.75), 30 hops max, 60 byte packets
1 * * *
2 169.254.33.1 (169.254.33.1) 0.643 ms 0.720 ms 0.724 ms
3 * * *
4 m9-cr04-be31.msk.mts-internet.net (212.188.33.208) 0.891 ms 0.905 ms 0.986 ms
5 * * *
6 anc-cr03-ae3.77.ff.mts-internet.net (195.34.59.50) 34.140 ms 34.194 ms 34.247 ms
7 mil-cr01-be6.119.lnd.mts-internet.net (195.34.53.250) 47.444 ms 47.357 ms 47.455 ms
8 195.66.225.73 (195.66.225.73) 47.622 ms 47.735 ms 47.733 ms
9 * * *
10 * * *
11 * * *
12 limetech.io (109.74.205.75) 47.844 ms 47.778 ms 47.961 ms


curl -v -XPOST http://crash.limetech.org/submit
* Trying 109.74.205.75...
* TCP_NODELAY set
* connect to 109.74.205.75 port 80 failed: Connection timed out
* Failed to connect to crash.limetech.org port 80: Connection timed out
* Closing connection 0
curl: (7) Failed to connect to crash.limetech.org port 80: Connection timed out

Hope this helps to find the problem.

@asherkin
Copy link
Owner

Both your cases look like some sort of intercepting proxy on the outbound connection (which isn't particularly surprising given your hosting locations), could you please both also try traceroute -T 109.74.205.75? The next best diagnostic step would be a packet capture with tcpdump while attempting to submit a crash dump with Accelerator.

Having checked the logs, Throttle isn't seeing the requests that are failing at all, and I've verified there's no firewall configuration on my end that could cause this - the timeouts mean that something is completely dropping packets, but the traceroutes show that ICMP traffic is making it without issue.

@SefoNotasi your host's ISP appears to completely block all HTTP traffic to Throttle.

@F1F88 your host's ISP appears to only block the presubmit request, which may be something specific to the way it is encoded.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@asherkin @SefoNotasi @F1F88