Fredy Wijaya has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/11250


Change subject: IMPALA-7343: Update SentryProxy to use Sentry bulk API
......................................................................

IMPALA-7343: Update SentryProxy to use Sentry bulk API

Prior to this patch, every Sentry policy update required a Thrift call
to Sentry to get the role privileges per role. This is not inefficient.
This patch updates the way Impala update its Sentry policy by using the
new Sentry APIs for getting all all roles/users and their associated
privileges in a single Thrift call to Sentry. This patch also updates
SentryProxy to get user privileges.

Before:
- Refreshing 100 roles: 493ms
- Refreshing 1000 roles: 4668ms
- Refreshing 10000 roles: 45636ms

After:
- Refreshing 100 roles: 114ms
- Refreshing 1000 roles: 1021ms
- Refreshing 10000 roles: 10076ms

Testing:
- Ran all FE tests
- Ran all E2E authorization tests

Change-Id: I3ab215f2a5c5111bf1d25eec7fac90506d2f6304
---
M bin/impala-config.sh
M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java
M fe/src/main/java/org/apache/impala/util/SentryPolicyService.java
M fe/src/main/java/org/apache/impala/util/SentryProxy.java
4 files changed, 197 insertions(+), 74 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/50/11250/3
--
To view, visit http://gerrit.cloudera.org:8080/11250
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I3ab215f2a5c5111bf1d25eec7fac90506d2f6304
Gerrit-Change-Number: 11250
Gerrit-PatchSet: 3
Gerrit-Owner: Fredy Wijaya <fwij...@cloudera.com>

Reply via email to