[
https://issues.apache.org/jira/browse/YETUS-597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296264#comment-16296264
]
Allen Wittenauer edited comment on YETUS-597 at 12/19/17 6:01 AM:
------------------------------------------------------------------
UserTasksMax is set for some ridiculously low level by default because
desktops. As a result, on many servers it still set to 12288 (or smaller!).
Thus setting a ulimit of 5k but only hit 4k before crashing is very likely
because the cgroup Yetus processes are running in is hitting the systemd limit.
cgget is the easiest way to get this number. But it might not be installed.
Next best bet is to:
{code}
$ cat /proc/$$/cgroup | grep pid
9:pids:/user.slice/user-501.slice
$ lssubsys -m pids
pids /sys/fs/cgroup/pids
{code}
then parry the two:
{code}
$ cat /sys/fs/cgroup/pids/user.slice/user-501.slice/pids.max
12288
{code}
That's the actual upper limit *ACROSS ALL SESSIONS*.
In the case of the ASF, it's pretty easy to see now why some unit tests are
problematic given that there are two executors running as the same user on the
same node + all of the Jenkins support processes......
was (Author: aw):
UserTasksMax is set for some ridiculously low level by default because
desktops. As a result, on many servers it still set to 12288 (or smaller!).
Thus setting a ulimit of 5k but only hit 4k before crashing is very likely
because the cgroup Yetus processes are running in is hitting the systemd limit.
cgget is the easiest way to get this number. But it might not be installed.
Next best bet is to:
{code}
$ cat /proc/$$/cgroup | grep pid
9:pids:/user.slice/user-501.slice
$ lssubsys -m pids
pids /sys/fs/cgroup/pids
{code}
then parry the two:
{code}
$ cat /sys/fs/cgroup/pids/user.slice/user-501.slice/pids.max
12288
{code}
That's the actual upper limit, regardless of what ulimit says or sets.
In the case of the ASF, it's pretty easy to see now why some unit tests are
problematic given that there are two executors running as the same user on the
same node + all of the Jenkins support processes......
> Add support for systemd's UserTasksMax
> --------------------------------------
>
> Key: YETUS-597
> URL: https://issues.apache.org/jira/browse/YETUS-597
> Project: Yetus
> Issue Type: Improvement
> Components: Test Patch
> Affects Versions: 0.7.0
> Reporter: Allen Wittenauer
> Assignee: Allen Wittenauer
>
> systemd introduced a new level of fun on process limits with UserTasksMax.
> We should attempt to figure out what systemd is set to and warn appropriately
> since a lot of users don't know about it.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
