[jira] [Commented] (RANGER-3043) Policy export is too slow, because method ensureAdminAndAuditAccess was call for every policies
[ https://issues.apache.org/jira/browse/RANGER-3043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412573#comment-17412573 ] Pradeep Agrawal commented on RANGER-3043: - I tried with large set of policies(around 50k), seems i have difference of around 500ms. Please retry when you have time and provide more details. > Policy export is too slow, because method ensureAdminAndAuditAccess was call > for every policies > > > Key: RANGER-3043 > URL: https://issues.apache.org/jira/browse/RANGER-3043 > Project: Ranger > Issue Type: Improvement > Components: Ranger >Affects Versions: 2.0.0, 2.1.0 >Reporter: fengxianjing >Assignee: fengxianjing >Priority: Major > Attachments: 0001-RANGER-3043-Policy-export-is-too-slow.patch, > image-2020-10-16-17-21-12-163.png > > > !image-2020-10-16-17-21-12-163.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3043) Policy export is too slow, because method ensureAdminAndAuditAccess was call for every policies
[ https://issues.apache.org/jira/browse/RANGER-3043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17402208#comment-17402208 ] fengxianjing commented on RANGER-3043: -- Sorry, I forgot how much performance is improved. I only remember we have about 30,000 policies, and this part of the code executes a lot of repeated statement. This is what happened last year. > Policy export is too slow, because method ensureAdminAndAuditAccess was call > for every policies > > > Key: RANGER-3043 > URL: https://issues.apache.org/jira/browse/RANGER-3043 > Project: Ranger > Issue Type: Improvement > Components: Ranger >Affects Versions: 2.0.0, 2.1.0 >Reporter: fengxianjing >Assignee: fengxianjing >Priority: Major > Attachments: 0001-RANGER-3043-Policy-export-is-too-slow.patch, > image-2020-10-16-17-21-12-163.png > > > !image-2020-10-16-17-21-12-163.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3043) Policy export is too slow, because method ensureAdminAndAuditAccess was call for every policies
[ https://issues.apache.org/jira/browse/RANGER-3043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17402022#comment-17402022 ] Pradeep Agrawal commented on RANGER-3043: - [~fengxianjing] : Can you provide few details on how much performance is improved after this patch. It will be good if you have time consumed with and without your changes for N number of policies export then it will be helpful to validate. I will also try at my end. > Policy export is too slow, because method ensureAdminAndAuditAccess was call > for every policies > > > Key: RANGER-3043 > URL: https://issues.apache.org/jira/browse/RANGER-3043 > Project: Ranger > Issue Type: Improvement > Components: Ranger >Affects Versions: 2.0.0, 2.1.0 >Reporter: fengxianjing >Assignee: fengxianjing >Priority: Major > Attachments: 0001-RANGER-3043-Policy-export-is-too-slow.patch, > image-2020-10-16-17-21-12-163.png > > > !image-2020-10-16-17-21-12-163.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3043) Policy export is too slow, because method ensureAdminAndAuditAccess was call for every policies
[ https://issues.apache.org/jira/browse/RANGER-3043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17399287#comment-17399287 ] fengxianjing commented on RANGER-3043: -- [~rmani] It is open now. > Policy export is too slow, because method ensureAdminAndAuditAccess was call > for every policies > > > Key: RANGER-3043 > URL: https://issues.apache.org/jira/browse/RANGER-3043 > Project: Ranger > Issue Type: Improvement > Components: Ranger >Affects Versions: 2.0.0, 2.1.0 >Reporter: fengxianjing >Assignee: fengxianjing >Priority: Major > Attachments: > 0001-RANGER-3043-method-ensureAdminAndAuditAccess-is-exec.patch, > image-2020-10-16-17-21-12-163.png > > > !image-2020-10-16-17-21-12-163.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3043) Policy export is too slow, because method ensureAdminAndAuditAccess was call for every policies
[ https://issues.apache.org/jira/browse/RANGER-3043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17399255#comment-17399255 ] Ramesh Mani commented on RANGER-3043: - [~fengxianjing] could you please reopen the review request. Thanks. > Policy export is too slow, because method ensureAdminAndAuditAccess was call > for every policies > > > Key: RANGER-3043 > URL: https://issues.apache.org/jira/browse/RANGER-3043 > Project: Ranger > Issue Type: Improvement > Components: Ranger >Affects Versions: 2.0.0, 2.1.0 >Reporter: fengxianjing >Assignee: fengxianjing >Priority: Major > Attachments: > 0001-RANGER-3043-method-ensureAdminAndAuditAccess-is-exec.patch, > image-2020-10-16-17-21-12-163.png > > > !image-2020-10-16-17-21-12-163.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3043) Policy export is too slow, because method ensureAdminAndAuditAccess was call for every policies
[ https://issues.apache.org/jira/browse/RANGER-3043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17399205#comment-17399205 ] fengxianjing commented on RANGER-3043: -- review request: https://reviews.apache.org/r/73516/ > Policy export is too slow, because method ensureAdminAndAuditAccess was call > for every policies > > > Key: RANGER-3043 > URL: https://issues.apache.org/jira/browse/RANGER-3043 > Project: Ranger > Issue Type: Improvement > Components: Ranger >Affects Versions: 2.0.0, 2.1.0 >Reporter: fengxianjing >Assignee: fengxianjing >Priority: Major > Attachments: > 0001-RANGER-3043-method-ensureAdminAndAuditAccess-is-exec.patch, > image-2020-10-16-17-21-12-163.png > > > !image-2020-10-16-17-21-12-163.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
