Tim Armstrong has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/16848


Change subject: IMPALA-10343: increase control_service_queue_mem_limit
......................................................................

IMPALA-10343: increase control_service_queue_mem_limit

--control_service_queue_mem_limit is set to 1% by default
to increase the maximum size of the queue in typical
production deployments.  E.g. an Impala daemon with
a 50GB memory limit will have a limit of 512MB on
the control service queue.

Add --control_service_queue_mem_limit_floor_bytes so
that this does not have the unintended effect of
reducing the memory given to the queue.

If the impala daemon has a mem limit of <= 5000MB, this
patch has no effect to default behaviour.

Testing:
This had been previously problematic on a 64 node TPC-DS
workload with mt_dop=12 where impalads had ~100GB of memory.
Status report RPCs would fail and have to be retried.
We tested this new value on the same workload and the retries
were avoided.

Change-Id: Ic7fe93b5ce7eb6b63e48293ac287d98cc1d9e3fa
---
M be/src/service/control-service.cc
M tests/custom_cluster/test_rpc_timeout.py
2 files changed, 9 insertions(+), 2 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/48/16848/1
--
To view, visit http://gerrit.cloudera.org:8080/16848
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: Ic7fe93b5ce7eb6b63e48293ac287d98cc1d9e3fa
Gerrit-Change-Number: 16848
Gerrit-PatchSet: 1
Gerrit-Owner: Tim Armstrong <[email protected]>

Reply via email to