[
https://issues.apache.org/jira/browse/HBASE-19901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349857#comment-16349857
]
stack commented on HBASE-19901:
-------------------------------
I reverted all changes made against this issue, then put back the originals.
With DEBUG I see that the hbase_nightly is not picking up defines in
hbase-personality... So nightly was failing because docker mem set to ... ?
Ditto on proclimit. So hardcoded values in hbase_nightly. Not nice. Nightly
seems to be working now though. To be revisited. Here is what is committed
currently...
commit b2fe241089dddaf65253ad882fbbff36225dafd2
Author: Michael Stack <[email protected]>
Date: Thu Feb 1 20:54:13 2018 -0800
HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies; AMENDMENT hardcode
proclimit and docker memlimit in nightly script...
diff --git a/dev-support/hbase_nightly_yetus.sh
b/dev-support/hbase_nightly_yetus.sh
index 651a2e22d7..27d11c8beb 100755
--- a/dev-support/hbase_nightly_yetus.sh
+++ b/dev-support/hbase_nightly_yetus.sh
@@ -67,8 +67,9 @@
YETUS_ARGS=("--whitespace-tabs-ignore-list=${WHITESPACE_IGNORE_LIST}" "${YETUS_A
YETUS_ARGS=("--sentinel" "${YETUS_ARGS[@]}")
YETUS_ARGS=("--branch=${BRANCH_NAME}" "${YETUS_ARGS[@]}")
YETUS_ARGS=("--tests-filter=${TESTS_FILTER}" "${YETUS_ARGS[@]}")
-YETUS_ARGS=("--proclimit=${PROCLIMIT}" "${YETUS_ARGS[@]}")
-YETUS_ARGS=("--dockermemlimit=${DOCKERMEMLIMIT}" "${YETUS_ARGS[@]}")
+# Why are these not being picked up from hbase-personality?
+YETUS_ARGS=("--proclimit=10000" "${YETUS_ARGS[@]}")
+YETUS_ARGS=("--dockermemlimit=20g" "${YETUS_ARGS[@]}")
# Currently, flaky list is calculated only for master branch.
UNDERSCORED_BRANCH_NAME=$(echo ${BRANCH_NAME} | tr '.-' '_')
The defines in hbase-personality:
# Yetus 0.7.0 enforces limits. Default proclimit is 1000.
# Up it. See HBASE-19902 for how we arrived at this number.
PROCLIMIT=10000
# Set docker container to run with 20g. Default is 4g in yetus.
# See HBASE-19902 for how we arrived at 20g.
DOCKERMEMLIMIT=20g
... are what are not being picked up. I traced download of hbase-personality as
personality.sh... but don't see how it picked up (though yetus describes
picking up these globals...) TODO.
> Up yetus proclimit on nightlies
> -------------------------------
>
> Key: HBASE-19901
> URL: https://issues.apache.org/jira/browse/HBASE-19901
> Project: HBase
> Issue Type: Bug
> Reporter: stack
> Assignee: stack
> Priority: Major
> Attachments: HBASE-19901.master.001.patch,
> HBASE-19901.master.002.patch
>
>
> We're on 0.7.0 now which enforces limits meant to protect against runaway
> processes. Default is 1000 procs. HBase test runs seem to consume almost 4k.
> Up our proclimit.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
