Matthew Jacobs has uploaded a new change for review.

  http://gerrit.cloudera.org:8080/7678

Change subject: IMPALA-5644: Reject queries if min reservation is too large
......................................................................

IMPALA-5644: Reject queries if min reservation is too large

Rejects queries during admission control if:
* the largest (across all backends) min buffer reservation is
  greater than the query mem_limit
* the sum of the min buffer reservations across the cluster
  is larger than the pool max mem resources

There are some other interesting cases to consider later:
* every per-backend min buffer reservation is less than the
  associated backend's process mem_limit; the current
  admission control code doesn't know about other backend's
  proc mem_limits.

Some minor code refactoring in admission-controller and
query-state.

Testing:
* Added new test cases in test_admission_controller.py

Change-Id: Iabe87ce8f460356cfe4d1be4d7092c5900f9d79b
TODO: Consider more help text.
---
M be/src/runtime/bufferpool/CMakeLists.txt
A be/src/runtime/bufferpool/reservation-util.cc
A be/src/runtime/bufferpool/reservation-util.h
M be/src/runtime/query-state.cc
M be/src/scheduling/admission-controller.cc
M be/src/scheduling/admission-controller.h
M be/src/scheduling/scheduler.h
M common/thrift/generate_error_codes.py
M tests/custom_cluster/test_admission_controller.py
9 files changed, 213 insertions(+), 55 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/78/7678/1
-- 
To view, visit http://gerrit.cloudera.org:8080/7678
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: newchange
Gerrit-Change-Id: Iabe87ce8f460356cfe4d1be4d7092c5900f9d79b
Gerrit-PatchSet: 1
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-Owner: Matthew Jacobs <[email protected]>

Reply via email to