Joe McDonnell has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/20801


Change subject: IMPALA-11909: Use absolute path when calling 
resolve_minidumps.py
......................................................................

IMPALA-11909: Use absolute path when calling resolve_minidumps.py

If the bin/jenkins/finalize.sh script is called from a directory
other than $IMPALA_HOME, it's call to resolve_minidumps.py will
fail due to the relative path. This changes the call to use
the absolute path so that finalize.sh works in this case.

On some platforms (Centos 7), resolve_minidump.py's call to
minidump_stackwalk goes haywire and uses all the system memory
until it gets OOM killed. Some library must have corrupt
symbols, etc. As a workaround, this detects whether the
prlimit utility is present and uses this to run minidump_stackwalk
with a 4GB limit on virtual memory. This kills the process
earlier and avoids using all system memory.

Testing:
 - Verified that bin/jenkins/finalize.sh uses resolve_minidumps.py
   on a Redhat 8 Jenkins job (and it works)
 - Verified that bin/jenkins/finalize.sh works properly on
   my Ubuntu 20 box
 - Ran a Jenkins job on Centos 7 and verified that the prlimit
   code kills minidump_stackwalk when it uses 4GB of memory.

Change-Id: I063843554b52d3e8ed79ee32d9fd4c90d059c482
---
M bin/jenkins/finalize.sh
M bin/resolve_minidumps.py
2 files changed, 15 insertions(+), 2 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/01/20801/1
--
To view, visit http://gerrit.cloudera.org:8080/20801
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I063843554b52d3e8ed79ee32d9fd4c90d059c482
Gerrit-Change-Number: 20801
Gerrit-PatchSet: 1
Gerrit-Owner: Joe McDonnell <[email protected]>

Reply via email to