Thomas Tauber-Marshall has uploaded this change for review. ( http://gerrit.cloudera.org:8080/16891
Change subject: IMPALA-9975 (part 2): Introduce new admission control daemon ...................................................................... IMPALA-9975 (part 2): Introduce new admission control daemon A recent patch (IMPALA-9930) introduces a new admission control rpc service, which can be configured to perform admission control for coordinators. In that patch, the admission service runs in an impalad. This patch separates the service out to run in a new daemon, called the admissiond. Some notable changes: - Adds a new class, AdmissiondEnv, which performs the same function for the admissiond as ExecEnv does for impalads. - The '/admission' http endpoint is exposed on the admissiond's webui if the admission control service is in use, otherwise it is exposed on coordinator impalad's webuis. - Executors now never create an AdmissionController, and coordinators do not create one if configured to use an admissiond. This requires removing admission related info on the '/backends' endpoint and completely removing the '/admission' endpoint for these daemons. - start-impala-cluster.py takes a new flag --enable_admission_service which configures the minicluster to have an admissiond with all coordinators using it for admisison control. TODO: integrate this with the Docker infrastructure Testing: - Existing tests for the admission control serivce are modified to run with an admissiond. Change-Id: Id677814b31e9193035e8cf0d08aba0ce388a0ad9 --- M CMakeLists.txt M be/src/runtime/exec-env.cc M be/src/runtime/exec-env.h M be/src/scheduling/CMakeLists.txt M be/src/scheduling/admission-control-client.cc M be/src/scheduling/admission-control-service.cc M be/src/scheduling/admission-control-service.h A be/src/scheduling/admissiond-env.cc A be/src/scheduling/admissiond-env.h A be/src/scheduling/admissiond-main.cc M be/src/service/CMakeLists.txt M be/src/service/daemon-main.cc M be/src/service/impala-http-handler.cc M be/src/service/impala-http-handler.h M be/src/service/impala-server.cc M be/src/util/mem-info.cc M be/src/util/mem-info.h M bin/start-impala-cluster.py M common/thrift/metrics.json M tests/common/custom_cluster_test_suite.py M tests/common/impala_cluster.py M tests/common/impala_service.py M tests/custom_cluster/test_admission_controller.py M www/backends.tmpl 24 files changed, 574 insertions(+), 185 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/91/16891/1 -- To view, visit http://gerrit.cloudera.org:8080/16891 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: Id677814b31e9193035e8cf0d08aba0ce388a0ad9 Gerrit-Change-Number: 16891 Gerrit-PatchSet: 1 Gerrit-Owner: Thomas Tauber-Marshall <[email protected]>
