[
https://issues.apache.org/jira/browse/SENTRY-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16155876#comment-16155876
]
Hadoop QA commented on SENTRY-1915:
-----------------------------------
Here are the results of testing the latest attachment
https://issues.apache.org/jira/secure/attachment/12885649/SENTRY-1915.02.patch
against master.
{color:red}Overall:{color} -1 due to an error
{color:red}ERROR:{color} failed to build with patch (exit code 1)
Console output:
https://builds.apache.org/job/PreCommit-SENTRY-Build/3251/console
This message is automatically generated.
> Sentry is doing a lot of work to convert list of paths to HMSPaths structure
> ----------------------------------------------------------------------------
>
> Key: SENTRY-1915
> URL: https://issues.apache.org/jira/browse/SENTRY-1915
> Project: Sentry
> Issue Type: Bug
> Components: Sentry
> Affects Versions: 2.0.0
> Reporter: Alexander Kolbasov
> Assignee: Alexander Kolbasov
> Attachments: SENTRY-1915.01.patch, SENTRY-1915.02.patch
>
>
> It turns out that in 2.0 we changed the way full snapshots are sent from
> Sentry to HDFS. Before they were using {{HMSPaths}} which used tree structure
> and eliminated some duplication. Also SENTRY-1827 helped to compressed this
> on the serialization side.
> Now we are using {{TPathChanges}} structure that is not tree-based and
> contains very non-efficient way of representing paths: {{required
> list<list<string>> addPaths;}} so we split each paths on slashes and store
> list of elements instead of storing a tree. As a result we may use much more
> memory.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
