Alexander Kolbasov created SENTRY-1912:
------------------------------------------

             Summary: Directly construct Thrift message from DB when full 
update is sent to NN
                 Key: SENTRY-1912
                 URL: https://issues.apache.org/jira/browse/SENTRY-1912
             Project: Sentry
          Issue Type: Bug
          Components: Sentry
    Affects Versions: 2.0.0
            Reporter: Alexander Kolbasov


Currently when we send full update to the NameNode we do the following:

1. Read full snapshot from DB into Map<String, Set<String>> structure
2. Convert it to Thrift structure which uses list of strings.

We should be able to directly construct Thrift version without going to the 
intermediate representation. This should save significant amount of memory 
since we don't have to maintain two copies of the same data in memory and we 
don't need to use inefficient Set data structures for huge objects.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to