Hello Impala Public Jenkins,

I'd like you to reexamine a change. Please visit

    http://gerrit.cloudera.org:8080/23638

to look at the new patch set (#2).

Change subject: IMPALA-14530: Limit link concurrency with flock
......................................................................

IMPALA-14530: Limit link concurrency with flock

Adds a wrapper around 'gold' that limits concurrency using 'flock'.
Concurrency is limited to IMPALA_LINK_THREADS by using a pool of link
files and randomly selecting from them.

Uses 'ld.gold' to select the version in binutils, and '--threads' to use
more cores while still limiting memory from multiple links.

New link option is selected by setting IMPALA_LINKER=fold, which is now
set as the default. Performance does not appear to be significantly
worse than before, and link actually succeeds on rebuild dominated by
linking test binaries.

Adds MOLD_JOBS=1 to avoid overloading the system when trying 'mold' and
linking test binaries. However 'mold' is not selected as the default
due to test failures around SASL/GSSAPI.

Removes the guard in bootstrap_development.sh limiting
IMPALA_BUILD_THREADS as it's no longer needed with default config.

Change-Id: I9b1be517bbc439a17932cc16c8a203e3bc4e5e04
---
M .gitignore
M README-build.md
M be/CMakeLists.txt
M bin/bootstrap_development.sh
A bin/fold/ld
M bin/impala-config.sh
6 files changed, 56 insertions(+), 16 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/38/23638/2
--
To view, visit http://gerrit.cloudera.org:8080/23638
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I9b1be517bbc439a17932cc16c8a203e3bc4e5e04
Gerrit-Change-Number: 23638
Gerrit-PatchSet: 2
Gerrit-Owner: Michael Smith <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>

Reply via email to