Alexander Kolbasov created SENTRY-1912:
------------------------------------------
Summary: Directly construct Thrift message from DB when full
update is sent to NN
Key: SENTRY-1912
URL: https://issues.apache.org/jira/browse/SENTRY-1912
Project: Sentry
Issue Type: Bug
Components: Sentry
Affects Versions: 2.0.0
Reporter: Alexander Kolbasov
Currently when we send full update to the NameNode we do the following:
1. Read full snapshot from DB into Map<String, Set<String>> structure
2. Convert it to Thrift structure which uses list of strings.
We should be able to directly construct Thrift version without going to the
intermediate representation. This should save significant amount of memory
since we don't have to maintain two copies of the same data in memory and we
don't need to use inefficient Set data structures for huge objects.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)