Tim Armstrong has uploaded a new patch set (#4). ( http://gerrit.cloudera.org:8080/12133 )
Change subject: IMPALA-7446: enable buffer pool GC when near process mem limit ...................................................................... IMPALA-7446: enable buffer pool GC when near process mem limit GC is performed when: * The amount of memory allocated from the system for the buffer pool exceeds the reservation (i.e. free buffers and clean pages are not offset by unused reservation). * The soft or hard process memory limit would otherwise cause an allocation to fail. Testing: Looped the old version of the semi_joins_exhaustive test, which reliably reproduced the issue. I confirmed that the buffer pool GC was running and that it preventing the query failures. Added a backend test that reproed the issue. A large chunk of the code change is to add infrastructure to use TCMalloc memory metrics for the process memory tracker in backend tests. Ran exhaustive tests. Change-Id: I81e8e29f1ba319f1b499032f9518d32c511b4b21 --- M be/src/runtime/bufferpool/buffer-allocator.cc M be/src/runtime/bufferpool/buffer-pool-test.cc M be/src/runtime/exec-env.cc M be/src/runtime/exec-env.h M be/src/runtime/mem-tracker.h M be/src/runtime/test-env.cc M be/src/runtime/test-env.h M testdata/workloads/functional-query/queries/QueryTest/semi-joins-exhaustive.test M tests/query_test/test_join_queries.py 9 files changed, 122 insertions(+), 38 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/33/12133/4 -- To view, visit http://gerrit.cloudera.org:8080/12133 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I81e8e29f1ba319f1b499032f9518d32c511b4b21 Gerrit-Change-Number: 12133 Gerrit-PatchSet: 4 Gerrit-Owner: Tim Armstrong <tarmstr...@cloudera.com>
