[ 
https://issues.apache.org/jira/browse/SENTRY-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149758#comment-16149758
 ] 

Alexander Kolbasov commented on SENTRY-1912:
--------------------------------------------

[[email protected]] [[email protected]] [~btowles] FYI

> Directly construct Thrift message from DB when full update is sent to NN
> ------------------------------------------------------------------------
>
>                 Key: SENTRY-1912
>                 URL: https://issues.apache.org/jira/browse/SENTRY-1912
>             Project: Sentry
>          Issue Type: Bug
>          Components: Sentry
>    Affects Versions: 2.0.0
>            Reporter: Alexander Kolbasov
>
> Currently when we send full update to the NameNode we do the following:
> 1. Read full snapshot from DB into Map<String, Set<String>> structure
> 2. Convert it to Thrift structure which uses list of strings.
> We should be able to directly construct Thrift version without going to the 
> intermediate representation. This should save significant amount of memory 
> since we don't have to maintain two copies of the same data in memory and we 
> don't need to use inefficient Set data structures for huge objects.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to