Your message dated Tue, 12 Mar 2024 16:32:55 +0000
with message-id <[email protected]>
and subject line Re: Bug#1059483: r-b CI: oom killer must not kill certain 
processes
has caused the Debian Bug report #1059483,
regarding r-b CI: oom killer must not kill certain processes
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact [email protected]
immediately.)


-- 
1059483: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1059483
Debian Bug Tracking System
Contact [email protected] with problems
--- Begin Message ---
package: jenkins.debian.org

Up until this week, we could see several cases of the oom killer
gone wild frequently:

- postgresql killed and stopped on jenkins
- squid being killed and stopped on codethink04
- jenkins, the service, restarted on jenkins

This week I've increased swap from 10g to 24g on the codethink nodes
and from 8g to 40g on jenkins.d.n, which helped and at least makes
the squid killings on codethink04 much rarer.

However, it's still happening and it should not happen.


-- 
cheers,
        Holger

 ⢀⣴⠾⠻⢶⣦⠀
 ⣾⠁⢠⠒⠀⣿⡁  holger@(debian|reproducible-builds|layer-acht).org
 ⢿⡄⠘⠷⠚⠋⠀  OpenPGP: B8BF54137B09D35CF026FE9D 091AB856069AAA1C
 ⠈⠳⣄

„Never argue with an idiot. They will drag you down to their level and beat
 you with experience.“ (Mark Twain)

Attachment: signature.asc
Description: PGP signature


--- End Message ---
--- Begin Message ---
On Tue, Dec 26, 2023 at 06:05:56PM +0000, Holger Levsen wrote:
> Up until this week, we could see several cases of the oom killer
> gone wild frequently:
> 
> - postgresql killed and stopped on jenkins
> - squid being killed and stopped on codethink04
> - jenkins, the service, restarted on jenkins

node_health_check.sh now sets /proc/$pid/oom_score_adj of the first
two to -1000. if we ever see jenkins killed we could add it, however
it's more complicated because the binary running is called java, 
so we'd need some extra code to find the java process actually running
jenkins.war...


-- 
cheers,
        Holger

 ⢀⣴⠾⠻⢶⣦⠀
 ⣾⠁⢠⠒⠀⣿⡁  holger@(debian|reproducible-builds|layer-acht).org
 ⢿⡄⠘⠷⠚⠋⠀  OpenPGP: B8BF54137B09D35CF026FE9D 091AB856069AAA1C
 ⠈⠳⣄

Make facts great again.

Attachment: signature.asc
Description: PGP signature


--- End Message ---

Reply via email to