Zhou Xu has uploaded a new patch set (#15). ( http://gerrit.cloudera.org:8080/14846 )
Change subject: IMPALA-9195: Using multithreaded execution to accelerate 'show tables/databases' ...................................................................... IMPALA-9195: Using multithreaded execution to accelerate 'show tables/databases' If Sentry authorization is enabled, users with multi group-policies will take time to get the result of 'show tables/databases'. It seems that ResourceAuthorizationProvider.hasAccess performs bad for users with complex group-policies, IMPALA-9242 will target to address this problem. This patch provides a config option 'num_check_authorization_threads' to accelerate 'show tables/databases' by using multithreading. This configuration is applicable only when authorization is enabled. A value of 1 disables multi-threaded execution for checking access. However, a small value of larger than 1 may limit the parallism of FE requests when checking authorization with a high concurrency. The value must be in the range of 1 to 128. The default value of 'num_check_access_threads' is 1. Change-Id: I860e0d18afa0421665f8b3b1c5561d6bdacc5e96 --- M be/src/common/global-flags.cc M be/src/util/backend-gflag-util.cc M common/thrift/BackendGflags.thrift M fe/src/main/java/org/apache/impala/service/BackendConfig.java M fe/src/main/java/org/apache/impala/service/Frontend.java M tests/authorization/test_authorization.py 6 files changed, 144 insertions(+), 20 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/46/14846/15 -- To view, visit http://gerrit.cloudera.org:8080/14846 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I860e0d18afa0421665f8b3b1c5561d6bdacc5e96 Gerrit-Change-Number: 14846 Gerrit-PatchSet: 15 Gerrit-Owner: Zhou Xu <[email protected]> Gerrit-Reviewer: Csaba Ringhofer <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Tim Armstrong <[email protected]> Gerrit-Reviewer: Vihang Karajgaonkar <[email protected]> Gerrit-Reviewer: Zhou Xu <[email protected]>
