Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Since upgrading icinga-powershell-framework to 1.12.3, timeouts occur more often #765

Open
TheCry opened this issue Dec 4, 2024 · 6 comments

Comments

@TheCry
Copy link

TheCry commented Dec 4, 2024

We With CVE-2024-49369, we have updated all window servers to the latest icinga-powershell-framework (1.12.3) and Icinga Client (2.14.3). Now we notice that different servers get a timeout every now and then during the simple check "Invoke-IcingaCheckTimeSync".
We tested 2 different servers (Windows 2019 with the same function).
For one of them, the check runs through within 2-3 seconds and for the other, the check takes at least 20 seconds until the timeouts (30 seconds).
This is what the event log says:
warning/Process: Killing process group 6444 ('C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NoLogo -ExecutionPolicy ByPass -C "try { Use-Icinga -Minimal; } catch { Write-Output 'The Icinga PowerShell Framework is either not installed on the system or not configured properly. Please check https://icinga.com/docs/windows for further details'; Write-Output 'Error:' $($_.Exception.Message)Components:rn$( Get-Module -ListAvailable 'icinga-powershell-*' )rn'Module-Path:'rn$($Env:PSModulePath); exit 3; }; Exit-IcingaExecutePlugin -Command 'Invoke-IcingaCheckTimeSync' " -Server '***.***.***.***' -Warning -1s:1s -Critical -2s:2s -Verbosity 2') after timeout of 30 seconds
Before the update, these problems never existed. Now I hope that you can find something, because we don't have a approach.
Thank you
Greeting
Sascha

@bfenda
Copy link

bfenda commented Dec 11, 2024

Hi together,

I would also add to it. Since updating to 2.14.3 especially we see various checks on Icinga Agents, frequently run into timeouts. The Timeout is set to 60 seconds. Normally the checks takes about 10s, but as said, the check runs into a timeout very often leading to the service being in a flapping state:

image

I maybe found a related message to it in the windows Eventlog.
image

Thank you,

Best regards,
Brian

@BTT-Monitoring
Copy link

We're encountering this issue across multiple production environments affecting several of our customers since upgrading IFW.
Given the widespread impact on our production systems, we would greatly appreciate any insights or potential solutions. We're happy to provide additional details or assist with debugging if needed.
Thank you for looking into this!

@Raupueppi
Copy link

Since the update of icinga-powershell-framework to 1.12.3 we observe the same problem! The checks run into timeouts.
Can you please take a look at this?

@bieberjz
Copy link

Ever since updating the Icinga PowerShell Framework to version 1.12.3, we've been encountering the same issue—our checks are timing out

@BTMichel
Copy link

We are also encountering this issue, lots of timeouts since we updated the icinga powershell framework.
The only viable fix/workaround currently is a rollback to the previous version, which we definitely would like to avoid.
@LordHepipud are there any potential other fixes or workarounds which we could at least manually apply?

@dbecker1234
Copy link

Same here!
Might be coincidentally, but at least in our environment only two machines are affected, both running Server 2019 with domain controller services (one host physical and the other virtual on vSphere).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants