[
https://issues.apache.org/jira/browse/SENTRY-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149758#comment-16149758
]
Alexander Kolbasov commented on SENTRY-1912:
--------------------------------------------
[[email protected]] [[email protected]] [~btowles] FYI
> Directly construct Thrift message from DB when full update is sent to NN
> ------------------------------------------------------------------------
>
> Key: SENTRY-1912
> URL: https://issues.apache.org/jira/browse/SENTRY-1912
> Project: Sentry
> Issue Type: Bug
> Components: Sentry
> Affects Versions: 2.0.0
> Reporter: Alexander Kolbasov
>
> Currently when we send full update to the NameNode we do the following:
> 1. Read full snapshot from DB into Map<String, Set<String>> structure
> 2. Convert it to Thrift structure which uses list of strings.
> We should be able to directly construct Thrift version without going to the
> intermediate representation. This should save significant amount of memory
> since we don't have to maintain two copies of the same data in memory and we
> don't need to use inefficient Set data structures for huge objects.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)