This is an automated email from the ASF dual-hosted git repository.
stoty pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/phoenix.git
The following commit(s) were added to refs/heads/master by this push:
new 10738f9 PHOENIX-5032 add Apache Yetus to Phoenix (addendum: increase
process limit)
10738f9 is described below
commit 10738f9507029866dd4fd7f1ad35ff28a7bd6558
Author: Istvan Toth <[email protected]>
AuthorDate: Tue Sep 22 16:32:57 2020 +0200
PHOENIX-5032 add Apache Yetus to Phoenix (addendum: increase process limit)
---
dev/phoenix-personality.sh | 11 ++++++++---
1 file changed, 8 insertions(+), 3 deletions(-)
diff --git a/dev/phoenix-personality.sh b/dev/phoenix-personality.sh
index b3b7791..ae5806f 100755
--- a/dev/phoenix-personality.sh
+++ b/dev/phoenix-personality.sh
@@ -75,10 +75,15 @@ function personality_globals
# TODO use PATCH_BRANCH to select jdk versions to use.
- # Yetus 0.7.0 enforces limits. Default proclimit is 1000.
- # Up it. See HBASE-19902 for how we arrived at this number.
+ # ASF Jenkins workers run up to two jobs per Agent. Docker doesn't do
anything with nproc,
+ # any setting is simply set on the docker daemon user, and shared between
containers.
+ # Thus, there is no way to protect containers from fork-bombing each other.
+ # Set nprocs higher than than the combined process count of two jobs.
+ # see
https://docs.docker.com/engine/reference/commandline/run/#set-ulimits-in-container-ulimit
+ # Note that this won't stop a container started after us from resetting the
limit to a
+ # lower value, but should help if we are started later.
#shellcheck disable=SC2034
- PROC_LIMIT=12500
+ PROC_LIMIT=30000
# Set docker container to run with 20g. Default is 4g in yetus.
# See HBASE-19902 for how we arrived at 20g.
