----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/62096/#review184587 -----------------------------------------------------------
LGTM Otherwise sentry-hdfs/sentry-hdfs-service/src/main/java/org/apache/sentry/hdfs/SentryHDFSServiceProcessor.java Lines 103 (patched) <https://reviews.apache.org/r/62096/#comment260753> At this point, we doubled the memory requirement as permUpdates and retPermUpdates are both in memory. Is there anything we can do to reduce this footprint?e.g: Use an iterator to traverse and proactively call remove() for every next() so that we only use permUpdates.size() units of memory? sentry-hdfs/sentry-hdfs-service/src/main/java/org/apache/sentry/hdfs/SentryHDFSServiceProcessor.java Lines 70-77 (original), 134-139 (patched) <https://reviews.apache.org/r/62096/#comment260754> Same comment as above. - Vamsee Yarlagadda On Sept. 5, 2017, 9:11 p.m., Sergio Pena wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/62096/ > ----------------------------------------------------------- > > (Updated Sept. 5, 2017, 9:11 p.m.) > > > Review request for sentry, Alexander Kolbasov, Brian Towles, Na Li, and > Vamsee Yarlagadda. > > > Bugs: sentry-1919 > https://issues.apache.org/jira/browse/sentry-1919 > > > Repository: sentry > > > Description > ------- > > The patch uses an atomic boolean flag that prevents multiple HDFS requests to > get the paths updates (either deltas or full images) by returning an empty > paths updates list if the flag is set as not available. > > The reason to prevent for deltas as well is because the code change was much > easier to do in once place (SentryHDFSServiceProcessor). We shouldn't get any > issues if we do it this way (unless the reviewer thinks otherwise). > > > Diffs > ----- > > > sentry-hdfs/sentry-hdfs-service/src/main/java/org/apache/sentry/hdfs/SentryHDFSServiceProcessor.java > 6221f3d01b2d86ec257bcec290c9b3b0527a6e34 > > > Diff: https://reviews.apache.org/r/62096/diff/1/ > > > Testing > ------- > > > Thanks, > > Sergio Pena > >
