[ 
https://issues.apache.org/jira/browse/SENTRY-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154151#comment-16154151
 ] 

Vamsee Yarlagadda commented on SENTRY-1916:
-------------------------------------------

Gave a cursory look at the patch. One thing that i noticed is that 
SentryHMSClient seems to accept the PathValidator instance. Not sure whether we 
are doing any initial filtering at the HMSFollower level itself (for the data 
received from HMS) but ideally we are supposed to save the complete data from 
HMS and then do any filtering possible at the time of HDFS sync response.

> Sentry should not store paths outside of the prefix
> ---------------------------------------------------
>
>                 Key: SENTRY-1916
>                 URL: https://issues.apache.org/jira/browse/SENTRY-1916
>             Project: Sentry
>          Issue Type: Bug
>          Components: Sentry
>    Affects Versions: 2.0.0
>            Reporter: Alexander Kolbasov
>            Assignee: Alexander Kolbasov
>         Attachments: SENTRY-1916.01.patch
>
>
> Before Sentry 2.0 we were only sending paths which were inside Hive prefix to 
> HDFS. With Sentry HA we changed that and store all paths. This significantly 
> increases the amount of memory when there are many external tables.
> [~vamsee] [~spena] [[email protected]] [~hahao] [[email protected]] 
> [~mcrocker] FYI



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to