Zhou Xu has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/14846


Change subject: IMPALA-9195: Using multithreaded execution to accelerate 'show 
tables/databases'
......................................................................

IMPALA-9195: Using multithreaded execution to accelerate 'show tables/databases'

If Sentry authorization is enabled, users with multi group-policies
will take time to get the result of 'show tables/databases'. It seems
that ResourceAuthorizationProvider.hasAccess performs bad for users
with complex group-policies.

This patch enables MT_DOP query option to accelerate 'show tables/databases'
with multithreaded execution. The time cost for users with complex 
group-policies
can be reduced from 65.886 seconds to 4.752 seconds when getting 160 avaliable
tables from 910 tables with MT_DOP=16.

Change-Id: I860e0d18afa0421665f8b3b1c5561d6bdacc5e96
---
M be/src/service/client-request-state.cc
M be/src/service/frontend.cc
M be/src/service/frontend.h
M be/src/service/impala-http-handler.cc
M common/thrift/Frontend.thrift
M fe/src/main/java/org/apache/impala/service/Frontend.java
M fe/src/main/java/org/apache/impala/service/JniFrontend.java
M fe/src/main/java/org/apache/impala/service/MetadataOp.java
M fe/src/test/java/org/apache/impala/authorization/AuthorizationTest.java
9 files changed, 160 insertions(+), 63 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/46/14846/1
--
To view, visit http://gerrit.cloudera.org:8080/14846
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I860e0d18afa0421665f8b3b1c5561d6bdacc5e96
Gerrit-Change-Number: 14846
Gerrit-PatchSet: 1
Gerrit-Owner: Zhou Xu <[email protected]>

Reply via email to