[jira] [Created] (RANGER-3493) Add unique index on service and resource_signature column of x_policy table

2021-10-20 Thread Pradeep Agrawal (Jira) 
Pradeep Agrawal created RANGER-3493:
---

 Summary: Add unique index on service and resource_signature column 
of x_policy table
 Key: RANGER-3493
 URL: https://issues.apache.org/jira/browse/RANGER-3493
 Project: Ranger
  Issue Type: Sub-task
  Components: Ranger
Affects Versions: 3.0.0
Reporter: Pradeep Agrawal
Assignee: Pradeep Agrawal
 Fix For: 3.0.0






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (RANGER-3491) Not find TAG serviceDef when update tag serviceDef for loading service-defs json file

2021-10-20 Thread Hervor (Jira) 


 [ 
https://issues.apache.org/jira/browse/RANGER-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hervor updated RANGER-3491:
---
External issue URL: https://reviews.apache.org/r/73661/

> Not find TAG serviceDef when update tag serviceDef for loading service-defs 
> json file
> -
>
> Key: RANGER-3491
> URL: https://issues.apache.org/jira/browse/RANGER-3491
> Project: Ranger
>  Issue Type: Bug
>  Components: plugins
>Affects Versions: 2.1.0
>Reporter: Hervor
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: 
> 0001-RANGER-3491-fix-not-find-TAG-serviceDef-when-loading.patch
>
>
> EmbeddedServiceDefsUtil.init() 
>  
>  not find TAG serviceDef when update tag serviceDef for loading service-defs 
> json file



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (RANGER-3492) Support update when loading serviceDef json file during initialization

2021-10-20 Thread Hervor (Jira) 


 [ 
https://issues.apache.org/jira/browse/RANGER-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hervor updated RANGER-3492:
---
External issue URL: https://reviews.apache.org/r/73662/

> Support update when loading serviceDef  json file during initialization
> ---
>
> Key: RANGER-3492
> URL: https://issues.apache.org/jira/browse/RANGER-3492
> Project: Ranger
>  Issue Type: Improvement
>  Components: plugins
>Affects Versions: 2.1.0
>Reporter: Hervor
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: 
> 0001-RANGER-3492-Support-update-when-loading-serviceDef-j.patch
>
>
> Support update when loading serviceDef  json file during initialization
> improve getOrCreateServiceDef()  to support update serviceDef json file



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: Review Request 73662: RANGER-3492: Support update when loading serviceDef json file during initialization

2021-10-20 Thread hervor tao 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73662/
---

(Updated 十月 21, 2021, 5:13 a.m.)


Review request for ranger.


Bugs: RANGER-3492
https://issues.apache.org/jira/browse/RANGER-3492


Repository: ranger


Description
---

Support update when loading serviceDef json file during initialization
improve getOrCreateServiceDef() to support update serviceDef json file


Diffs
-

  0001-RANGER-3491-fix-not-find-TAG-serviceDef-when-loading.patch PRE-CREATION 
  
agents-common/src/main/java/org/apache/ranger/plugin/store/EmbeddedServiceDefsUtil.java
 7775b0871 


Diff: https://reviews.apache.org/r/73662/diff/1/


Testing
---

Vertify update when loading serviceDef json file during initialization 
successfully


Thanks,

hervor tao

Review Request 73662: RANGER-3492: Support update when loading serviceDef json file during initialization

2021-10-20 Thread hervor tao 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73662/
---

Review request for ranger.


Bugs: RANGER-3492
https://issues.apache.org/jira/browse/RANGER-3492


Repository: ranger


Description
---

Support update when loading serviceDef json file during initialization
improve getOrCreateServiceDef() to support update serviceDef json file


Diffs
-

  0001-RANGER-3491-fix-not-find-TAG-serviceDef-when-loading.patch PRE-CREATION 
  
agents-common/src/main/java/org/apache/ranger/plugin/store/EmbeddedServiceDefsUtil.java
 7775b0871 


Diff: https://reviews.apache.org/r/73662/diff/1/


Testing
---

Vertify update when loading serviceDef json file during initialization 
successfully


Thanks,

hervor tao

[jira] [Updated] (RANGER-3492) Support update when loading serviceDef json file during initialization

2021-10-20 Thread Hervor (Jira) 


 [ 
https://issues.apache.org/jira/browse/RANGER-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hervor updated RANGER-3492:
---
Attachment: 0001-RANGER-3492-Support-update-when-loading-serviceDef-j.patch

> Support update when loading serviceDef  json file during initialization
> ---
>
> Key: RANGER-3492
> URL: https://issues.apache.org/jira/browse/RANGER-3492
> Project: Ranger
>  Issue Type: Improvement
>  Components: plugins
>Affects Versions: 2.1.0
>Reporter: Hervor
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: 
> 0001-RANGER-3492-Support-update-when-loading-serviceDef-j.patch
>
>
> Support update when loading serviceDef  json file during initialization
> improve getOrCreateServiceDef()  to support update serviceDef json file



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Assigned] (RANGER-3430) Null Dereference in RangerDefaultAuditHandler.java

2021-10-20 Thread Mehul Parikh (Jira) 


 [ 
https://issues.apache.org/jira/browse/RANGER-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mehul Parikh reassigned RANGER-3430:


Assignee: Mehul Parikh

> Null Dereference in RangerDefaultAuditHandler.java
> --
>
> Key: RANGER-3430
> URL: https://issues.apache.org/jira/browse/RANGER-3430
> Project: Ranger
>  Issue Type: Bug
>  Components: Ranger
>Reporter: Abhishek Kumar
>Assignee: Mehul Parikh
>Priority: Minor
>
> Null dereference in RangerDefaultAuditHandler.java at line numbers : 150 and 
> 181.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (RANGER-3492) Support update when loading serviceDef json file during initialization

2021-10-20 Thread Hervor (Jira) 
Hervor created RANGER-3492:
--

 Summary: Support update when loading serviceDef  json file during 
initialization
 Key: RANGER-3492
 URL: https://issues.apache.org/jira/browse/RANGER-3492
 Project: Ranger
  Issue Type: Improvement
  Components: plugins
Affects Versions: 2.1.0
Reporter: Hervor
 Fix For: 2.1.0


Support update when loading serviceDef  json file during initialization

improve getOrCreateServiceDef()  to support update serviceDef json file



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Review Request 73661: RANGER-3491 Not find TAG serviceDef when update tag serviceDef for loading service-defs json file

2021-10-20 Thread hervor tao 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73661/
---

Review request for ranger.


Bugs: RANGER-3491
https://issues.apache.org/jira/browse/RANGER-3491


Repository: ranger


Description
---

EmbeddedServiceDefsUtil.init() 
 
not find TAG serviceDef when update tag serviceDef for loading service-defs 
json file


Diffs
-

  0001-RANGER-3486-fix-RangerPolicy-Data-Not-Found-for-give.patch PRE-CREATION 
  
agents-common/src/main/java/org/apache/ranger/plugin/store/EmbeddedServiceDefsUtil.java
 7775b0871 


Diff: https://reviews.apache.org/r/73661/diff/1/


Testing
---

vertify loading service-defs json file successfully


Thanks,

hervor tao

[jira] [Updated] (RANGER-3491) Not find TAG serviceDef when update tag serviceDef for loading service-defs json file

2021-10-20 Thread Hervor (Jira) 


 [ 
https://issues.apache.org/jira/browse/RANGER-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hervor updated RANGER-3491:
---
Attachment: 0001-RANGER-3491-fix-not-find-TAG-serviceDef-when-loading.patch

> Not find TAG serviceDef when update tag serviceDef for loading service-defs 
> json file
> -
>
> Key: RANGER-3491
> URL: https://issues.apache.org/jira/browse/RANGER-3491
> Project: Ranger
>  Issue Type: Bug
>  Components: plugins
>Affects Versions: 2.1.0
>Reporter: Hervor
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: 
> 0001-RANGER-3491-fix-not-find-TAG-serviceDef-when-loading.patch
>
>
> EmbeddedServiceDefsUtil.init() 
>  
>  not find TAG serviceDef when update tag serviceDef for loading service-defs 
> json file



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (RANGER-3491) Not find TAG serviceDef when update tag serviceDef for loading service-defs json file

2021-10-20 Thread Hervor (Jira) 
Hervor created RANGER-3491:
--

 Summary: Not find TAG serviceDef when update tag serviceDef for 
loading service-defs json file
 Key: RANGER-3491
 URL: https://issues.apache.org/jira/browse/RANGER-3491
 Project: Ranger
  Issue Type: Bug
  Components: plugins
Affects Versions: 2.1.0
Reporter: Hervor
 Fix For: 2.1.0


EmbeddedServiceDefsUtil.init() 

 

 not find TAG serviceDef when update tag serviceDef for loading service-defs 
json file



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (RANGER-3390) improve plugin performance for yarn and es by replacing getAsString

2021-10-20 Thread caozhiqiang (Jira) 


[ 
https://issues.apache.org/jira/browse/RANGER-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17432176#comment-17432176
 ] 

caozhiqiang commented on RANGER-3390:
-

[~bpatel], could you give me some suggestion and help review this Jira coninue?

> improve plugin performance for yarn and es by replacing getAsString
> ---
>
> Key: RANGER-3390
> URL: https://issues.apache.org/jira/browse/RANGER-3390
> Project: Ranger
>  Issue Type: Improvement
>  Components: plugins
>Affects Versions: 2.0.1
>Reporter: caozhiqiang
>Assignee: caozhiqiang
>Priority: Major
> Attachments: RANGER-3390-branch-2.0.1.001.patch
>
>
> The 
> org/apache/ranger/plugin/policyengine/RangerAccessResourceImpl.getAsString 
> function take too much time. We should replace it to improve performance for 
> Yarn and ES.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Assigned] (RANGER-3478) Remove INFO level auditing logs in the Ranger audit frame to reduce verbosity

2021-10-20 Thread Ramesh Mani (Jira) 


 [ 
https://issues.apache.org/jira/browse/RANGER-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ramesh Mani reassigned RANGER-3478:
---

Assignee: Ramesh Mani

>  Remove INFO level auditing logs in the Ranger audit frame to reduce 
> verbosity 
> ---
>
> Key: RANGER-3478
> URL: https://issues.apache.org/jira/browse/RANGER-3478
> Project: Ranger
>  Issue Type: Bug
>  Components: Ranger
>Affects Versions: 3.0.0
>Reporter: Ramesh Mani
>Assignee: Ramesh Mani
>Priority: Minor
> Fix For: 3.0.0
>
> Attachments: 
> 0001-RANGER-3478-Remove-INFO-level-auditing-logs-in-the-R.patch
>
>
> There are logs which are created as part of audit framework which are in INFO 
> level. These  are generate at a quick pace resulting in huge service logs 
> files. By converting them to debug level, Service log will be much cleaner. 
> To get ranger plugin logs we can always put Ranger Package / classes in debug 
> in log4j properties for each of services.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Review Request 73660: RANGER-3489:Add htrace-core.jar as dependency for various Ranger Plugins

2021-10-20 Thread Ramesh Mani 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73660/
---

Review request for ranger, Don Bosco Durai, Abhay Kulkarni, Madhan Neethiraj, 
Mehul Parikh, Pradeep Agrawal, Selvamohan Neethiraj, Sailaja Polavarapu, and 
Velmurugan Periasamy.


Bugs: RANGER-3489
https://issues.apache.org/jira/browse/RANGER-3489


Repository: ranger


Description
---

RANGER-3489:Add htrace-core.jar as dependency for various Ranger Plugins


Diffs
-

  distro/src/main/assembly/knox-agent.xml c1f16d62f 
  distro/src/main/assembly/plugin-atlas.xml 365d62b70 
  distro/src/main/assembly/plugin-kylin.xml 4924134fb 
  distro/src/main/assembly/plugin-ozone.xml 1fed6c407 
  distro/src/main/assembly/plugin-presto.xml 804b40869 
  distro/src/main/assembly/plugin-solr.xml 3dbaa9cff 
  distro/src/main/assembly/plugin-sqoop.xml c8fcab5c2 


Diff: https://reviews.apache.org/r/73660/diff/1/


Testing
---

- Verified in local build the plugins tar file has the htrace jar added as 
dependency.


Thanks,

Ramesh Mani

[jira] [Assigned] (RANGER-3489) Add htrace-core.jar as dependency for various Ranger Plugins

2021-10-20 Thread Ramesh Mani (Jira) 


 [ 
https://issues.apache.org/jira/browse/RANGER-3489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ramesh Mani reassigned RANGER-3489:
---

Assignee: Ramesh Mani

> Add  htrace-core.jar as dependency for various Ranger Plugins
> -
>
> Key: RANGER-3489
> URL: https://issues.apache.org/jira/browse/RANGER-3489
> Project: Ranger
>  Issue Type: Bug
>  Components: Ranger
>Affects Versions: 3.0.0, 2.2.0
>Reporter: Ramesh Mani
>Assignee: Ramesh Mani
>Priority: Major
>
> We need to add back htrace-core.jar as dependency for various Ranger Plugins 
> which include  SOLR/KNOX/ATLAS/OZONE/PRESTO/SCOOP/KYLIN
> htrace-core.jar was removed as part of RANGER-3340 due to the jar's EOL, but 
> the hadoop version we use needs this. Without this jar Ranger plugins are 
> failing



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: Review Request 73659: RANGER-3490:Make policy resource signature is unique in a service

2021-10-20 Thread Madhan Neethiraj 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73659/#review223642
---


Ship it!




In addition to the changes in this patch, DB scripts need to be updated to 
setup unique-key constraint for {service, zone, resource-signature}.

Also, resource signature of existing disabled policies should be updated using 
a Java patch.

- Madhan Neethiraj


On Oct. 20, 2021, 7:28 p.m., Abhay Kulkarni wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73659/
> ---
> 
> (Updated Oct. 20, 2021, 7:28 p.m.)
> 
> 
> Review request for ranger, Dineshkumar Yadav, Madhan Neethiraj, Pradeep 
> Agrawal, Ramesh Mani, and Sailaja Polavarapu.
> 
> 
> Bugs: RANGER-3490
> https://issues.apache.org/jira/browse/RANGER-3490
> 
> 
> Repository: ranger
> 
> 
> Description
> ---
> 
> There may be multiple policies with the same resource signature within a 
> service (at most one enabled policy and potentially any number of disabled 
> policies).  Therefore, the resource-signature uniqueness within a service 
> cannot be enforced at the database level.
> 
> The proposal is to encode GUID of a disabled policy within the resource 
> signature, thus making the resource signature unique within a service.
> 
> 
> Diffs
> -
> 
>   
> agents-common/src/main/java/org/apache/ranger/plugin/model/RangerPolicyResourceSignature.java
>  312005e0f 
>   
> agents-common/src/test/java/org/apache/ranger/plugin/model/TestRangerPolicyResourceSignature.java
>  bc9df31cc 
>   security-admin/src/main/java/org/apache/ranger/biz/ServiceDBStore.java 
> f13cef71d 
>   security-admin/src/test/java/org/apache/ranger/biz/TestServiceDBStore.java 
> ef0d3b4eb 
> 
> 
> Diff: https://reviews.apache.org/r/73659/diff/1/
> 
> 
> Testing
> ---
> 
> Compiled and ran all unit tests successfully.
> 
> 
> Thanks,
> 
> Abhay Kulkarni
> 
>

[jira] [Commented] (RANGER-2847) Add support/Fix Test connection with Ozone service

2021-10-20 Thread Abhishek Kumar (Jira) 


[ 
https://issues.apache.org/jira/browse/RANGER-2847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17432102#comment-17432102
 ] 

Abhishek Kumar commented on RANGER-2847:


[Commit|https://github.com/apache/ranger/commit/27c32c4235df81c73e626de2940d4103c381]

> Add support/Fix Test connection with Ozone service
> --
>
> Key: RANGER-2847
> URL: https://issues.apache.org/jira/browse/RANGER-2847
> Project: Ranger
>  Issue Type: Bug
>  Components: plugins
>Affects Versions: 2.1.0
>Reporter: Abhishek Shukla
>Assignee: Abhishek Kumar
>Priority: Major
>  Labels: ozone
>
> Currently, Test Connection with Ozone Service is failing with this error.
> {noformat}
> java.lang.NoClassDefFoundError: 
> org/apache/hadoop/ozone/client/OzoneClientFactory.{noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (RANGER-2847) Add support/Fix Test connection with Ozone service

2021-10-20 Thread Abhishek Kumar (Jira) 


 [ 
https://issues.apache.org/jira/browse/RANGER-2847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Abhishek Kumar resolved RANGER-2847.

Resolution: Fixed

> Add support/Fix Test connection with Ozone service
> --
>
> Key: RANGER-2847
> URL: https://issues.apache.org/jira/browse/RANGER-2847
> Project: Ranger
>  Issue Type: Bug
>  Components: plugins
>Affects Versions: 2.1.0
>Reporter: Abhishek Shukla
>Assignee: Abhishek Kumar
>Priority: Major
>  Labels: ozone
>
> Currently, Test Connection with Ozone Service is failing with this error.
> {noformat}
> java.lang.NoClassDefFoundError: 
> org/apache/hadoop/ozone/client/OzoneClientFactory.{noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (RANGER-2846) Add support for resource[volume, bucket, key] look up in ozone plugin

2021-10-20 Thread Abhishek Kumar (Jira) 


[ 
https://issues.apache.org/jira/browse/RANGER-2846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17432101#comment-17432101
 ] 

Abhishek Kumar commented on RANGER-2846:


[Commit|https://github.com/apache/ranger/commit/27c32c4235df81c73e626de2940d4103c381]

> Add support for resource[volume, bucket, key] look up in ozone plugin
> -
>
> Key: RANGER-2846
> URL: https://issues.apache.org/jira/browse/RANGER-2846
> Project: Ranger
>  Issue Type: Task
>  Components: plugins
>Affects Versions: 2.1.0
>Reporter: Abhishek Shukla
>Assignee: Abhishek Kumar
>Priority: Major
>  Labels: ozone
>
> The task to add support for resource [volume, bucket, key] lookup while 
> creating ozone policy in ranger.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (RANGER-2846) Add support for resource[volume, bucket, key] look up in ozone plugin

2021-10-20 Thread Abhishek Kumar (Jira) 


 [ 
https://issues.apache.org/jira/browse/RANGER-2846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Abhishek Kumar resolved RANGER-2846.

Resolution: Fixed

> Add support for resource[volume, bucket, key] look up in ozone plugin
> -
>
> Key: RANGER-2846
> URL: https://issues.apache.org/jira/browse/RANGER-2846
> Project: Ranger
>  Issue Type: Task
>  Components: plugins
>Affects Versions: 2.1.0
>Reporter: Abhishek Shukla
>Assignee: Abhishek Kumar
>Priority: Major
>  Labels: ozone
>
> The task to add support for resource [volume, bucket, key] lookup while 
> creating ozone policy in ranger.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (RANGER-3452) Other attributes and sync source are not shown when user is converted from internal to external

2021-10-20 Thread Abhishek Kumar (Jira) 


 [ 
https://issues.apache.org/jira/browse/RANGER-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Abhishek Kumar resolved RANGER-3452.

Resolution: Fixed

[Commit|https://github.com/apache/ranger/commit/4ea9ef6d3f459583985c1a3b79abf164170155b9]

> Other attributes and sync source are not shown when user is converted from 
> internal to external
> ---
>
> Key: RANGER-3452
> URL: https://issues.apache.org/jira/browse/RANGER-3452
> Project: Ranger
>  Issue Type: Bug
>  Components: usersync
>Reporter: Abhishek Kumar
>Assignee: Abhishek Kumar
>Priority: Major
>
> Other attributes and sync source are not shown when user is converted from 
> internal to external user



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Review Request 73659: RANGER-3490:Make policy resource signature is unique in a service

2021-10-20 Thread Abhay Kulkarni 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73659/
---

Review request for ranger, Dineshkumar Yadav, Madhan Neethiraj, Pradeep 
Agrawal, Ramesh Mani, and Sailaja Polavarapu.


Bugs: RANGER-3490
https://issues.apache.org/jira/browse/RANGER-3490


Repository: ranger


Description
---

There may be multiple policies with the same resource signature within a 
service (at most one enabled policy and potentially any number of disabled 
policies).  Therefore, the resource-signature uniqueness within a service 
cannot be enforced at the database level.

The proposal is to encode GUID of a disabled policy within the resource 
signature, thus making the resource signature unique within a service.


Diffs
-

  
agents-common/src/main/java/org/apache/ranger/plugin/model/RangerPolicyResourceSignature.java
 312005e0f 
  
agents-common/src/test/java/org/apache/ranger/plugin/model/TestRangerPolicyResourceSignature.java
 bc9df31cc 
  security-admin/src/main/java/org/apache/ranger/biz/ServiceDBStore.java 
f13cef71d 
  security-admin/src/test/java/org/apache/ranger/biz/TestServiceDBStore.java 
ef0d3b4eb 


Diff: https://reviews.apache.org/r/73659/diff/1/


Testing
---

Compiled and ran all unit tests successfully.


Thanks,

Abhay Kulkarni

[jira] [Created] (RANGER-3490) Make policy resource signature is unique in a service

2021-10-20 Thread Abhay Kulkarni (Jira) 
Abhay Kulkarni created RANGER-3490:
--

 Summary: Make policy resource signature is unique in a service
 Key: RANGER-3490
 URL: https://issues.apache.org/jira/browse/RANGER-3490
 Project: Ranger
  Issue Type: Bug
  Components: Ranger
Reporter: Abhay Kulkarni
Assignee: Abhay Kulkarni


There may be multiple policies with the same resource signature within a 
service (at most one enabled policy and potentially any number of disabled 
policies).  Therefore, the resource-signature uniqueness within a service 
cannot be enforced at the database level.

The proposal is to encode GUID of a disabled policy within the resource 
signature, thus making the resource signature unique within a service.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: Review Request 73612: RANGER-3452: Other attributes and sync source are not shown in audits during updates to users/groups.

2021-10-20 Thread Abhay Kulkarni 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73612/#review223641
---


Ship it!




Ship It!

- Abhay Kulkarni


On Sept. 27, 2021, 7:19 p.m., Abhishek  Kumar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73612/
> ---
> 
> (Updated Sept. 27, 2021, 7:19 p.m.)
> 
> 
> Review request for ranger, Abhay Kulkarni, Madhan Neethiraj, Ramesh Mani, 
> Sailaja Polavarapu, and Velmurugan Periasamy.
> 
> 
> Bugs: RANGER-3452
> https://issues.apache.org/jira/browse/RANGER-3452
> 
> 
> Repository: ranger
> 
> 
> Description
> ---
> 
> The two fields will now be shown in audits whenever updates are made to users 
> and groups. Previously updates to users/groups would not show any diff in the 
> 2 fields.
> 
> 
> Diffs
> -
> 
>   security-admin/src/main/java/org/apache/ranger/service/XGroupService.java 
> c39796806 
>   security-admin/src/main/java/org/apache/ranger/service/XUserService.java 
> eff1718b3 
> 
> 
> Diff: https://reviews.apache.org/r/73612/diff/1/
> 
> 
> Testing
> ---
> 
> New fields are now shown on the UI after updates to users/groups in the audit 
> tab.
> 
> 
> Thanks,
> 
> Abhishek  Kumar
> 
>

Re: Review Request 73629: RANGER-2846 RANGER-2847: Fix TestConnection and Resource Lookup(Bucket) for Ozone Plugin

2021-10-20 Thread Sailaja Polavarapu 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73629/#review223640
---


Ship it!




Ship It!

- Sailaja Polavarapu


On Oct. 20, 2021, 6:45 p.m., Abhishek  Kumar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73629/
> ---
> 
> (Updated Oct. 20, 2021, 6:45 p.m.)
> 
> 
> Review request for ranger, Abhay Kulkarni, Madhan Neethiraj, Ramesh Mani, 
> Sailaja Polavarapu, and Velmurugan Periasamy.
> 
> 
> Bugs: RANGER-2846 and RANGER-2847
> https://issues.apache.org/jira/browse/RANGER-2846
> https://issues.apache.org/jira/browse/RANGER-2847
> 
> 
> Repository: ranger
> 
> 
> Description
> ---
> 
> Test connection for ozone service now works on the Ranger UI.
> Also, fixes ozone bucket lookup while trying to create a new ozone policy in 
> Ranger.
> 
> 
> Diffs
> -
> 
>   distro/src/main/assembly/admin-web.xml 3fc054d7c 
>   distro/src/main/assembly/plugin-ozone.xml 734bf1970 
>   
> plugin-ozone/src/main/java/org/apache/ranger/services/ozone/client/OzoneClient.java
>  695510f47 
>   
> plugin-ozone/src/main/java/org/apache/ranger/services/ozone/client/OzoneConnectionMgr.java
>  5b18ee356 
>   pom.xml 626591d60 
> 
> 
> Diff: https://reviews.apache.org/r/73629/diff/2/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Abhishek  Kumar
> 
>

Re: Review Request 73629: RANGER-2846 RANGER-2847: Fix TestConnection and Resource Lookup(Bucket) for Ozone Plugin

2021-10-20 Thread Abhishek Kumar 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73629/
---

(Updated Oct. 20, 2021, 6:45 p.m.)


Review request for ranger, Abhay Kulkarni, Madhan Neethiraj, Ramesh Mani, 
Sailaja Polavarapu, and Velmurugan Periasamy.


Bugs: RANGER-2846 and RANGER-2847
https://issues.apache.org/jira/browse/RANGER-2846
https://issues.apache.org/jira/browse/RANGER-2847


Repository: ranger


Description
---

Test connection for ozone service now works on the Ranger UI.
Also, fixes ozone bucket lookup while trying to create a new ozone policy in 
Ranger.


Diffs (updated)
-

  distro/src/main/assembly/admin-web.xml 3fc054d7c 
  distro/src/main/assembly/plugin-ozone.xml 734bf1970 
  
plugin-ozone/src/main/java/org/apache/ranger/services/ozone/client/OzoneClient.java
 695510f47 
  
plugin-ozone/src/main/java/org/apache/ranger/services/ozone/client/OzoneConnectionMgr.java
 5b18ee356 
  pom.xml 626591d60 


Diff: https://reviews.apache.org/r/73629/diff/2/

Changes: https://reviews.apache.org/r/73629/diff/1-2/


Testing
---


Thanks,

Abhishek  Kumar

Re: Review Request 73612: RANGER-3452: Other attributes and sync source are not shown in audits during updates to users/groups.

2021-10-20 Thread Sailaja Polavarapu 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73612/#review223639
---


Ship it!




Ship It!

- Sailaja Polavarapu


On Sept. 27, 2021, 7:19 p.m., Abhishek  Kumar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73612/
> ---
> 
> (Updated Sept. 27, 2021, 7:19 p.m.)
> 
> 
> Review request for ranger, Abhay Kulkarni, Madhan Neethiraj, Ramesh Mani, 
> Sailaja Polavarapu, and Velmurugan Periasamy.
> 
> 
> Bugs: RANGER-3452
> https://issues.apache.org/jira/browse/RANGER-3452
> 
> 
> Repository: ranger
> 
> 
> Description
> ---
> 
> The two fields will now be shown in audits whenever updates are made to users 
> and groups. Previously updates to users/groups would not show any diff in the 
> 2 fields.
> 
> 
> Diffs
> -
> 
>   security-admin/src/main/java/org/apache/ranger/service/XGroupService.java 
> c39796806 
>   security-admin/src/main/java/org/apache/ranger/service/XUserService.java 
> eff1718b3 
> 
> 
> Diff: https://reviews.apache.org/r/73612/diff/1/
> 
> 
> Testing
> ---
> 
> New fields are now shown on the UI after updates to users/groups in the audit 
> tab.
> 
> 
> Thanks,
> 
> Abhishek  Kumar
> 
>

[jira] [Created] (RANGER-3489) Add htrace-core.jar as dependency for various Ranger Plugins

2021-10-20 Thread Ramesh Mani (Jira) 
Ramesh Mani created RANGER-3489:
---

 Summary: Add  htrace-core.jar as dependency for various Ranger 
Plugins
 Key: RANGER-3489
 URL: https://issues.apache.org/jira/browse/RANGER-3489
 Project: Ranger
  Issue Type: Bug
  Components: Ranger
Affects Versions: 3.0.0, 2.2.0
Reporter: Ramesh Mani


We need to add back htrace-core.jar as dependency for various Ranger Plugins 
which include  SOLR/KNOX/ATLAS/OZONE/PRESTO/SCOOP/KYLIN

htrace-core.jar was removed as part of RANGER-3340 due to the jar's EOL, but 
the hadoop version we use needs this. Without this jar Ranger plugins are 
failing



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: Review Request 73629: RANGER-2846 RANGER-2847: Fix TestConnection and Resource Lookup(Bucket) for Ozone Plugin

2021-10-20 Thread Sailaja Polavarapu 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73629/#review223638
---




plugin-ozone/src/main/java/org/apache/ranger/services/ozone/client/OzoneConnectionMgr.java
Line 53 (original), 53 (patched)


Minor one - Please rename the variable "connectHive" to "connectOzone"


- Sailaja Polavarapu


On Oct. 5, 2021, 7:52 p.m., Abhishek  Kumar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73629/
> ---
> 
> (Updated Oct. 5, 2021, 7:52 p.m.)
> 
> 
> Review request for ranger, Abhay Kulkarni, Madhan Neethiraj, Ramesh Mani, 
> Sailaja Polavarapu, and Velmurugan Periasamy.
> 
> 
> Bugs: RANGER-2846 and RANGER-2847
> https://issues.apache.org/jira/browse/RANGER-2846
> https://issues.apache.org/jira/browse/RANGER-2847
> 
> 
> Repository: ranger
> 
> 
> Description
> ---
> 
> Test connection for ozone service now works on the Ranger UI.
> Also, fixes ozone bucket lookup while trying to create a new ozone policy in 
> Ranger.
> 
> 
> Diffs
> -
> 
>   distro/src/main/assembly/admin-web.xml 3fc054d7c 
>   distro/src/main/assembly/plugin-ozone.xml 734bf1970 
>   
> plugin-ozone/src/main/java/org/apache/ranger/services/ozone/client/OzoneClient.java
>  695510f47 
>   
> plugin-ozone/src/main/java/org/apache/ranger/services/ozone/client/OzoneConnectionMgr.java
>  5b18ee356 
>   pom.xml 626591d60 
> 
> 
> Diff: https://reviews.apache.org/r/73629/diff/1/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Abhishek  Kumar
> 
>

[jira] [Created] (RANGER-3488) Docker setup for Apache Ranger Knox plugin

2021-10-20 Thread Ramesh Mani (Jira) 
Ramesh Mani created RANGER-3488:
---

 Summary: Docker setup for Apache Ranger Knox plugin
 Key: RANGER-3488
 URL: https://issues.apache.org/jira/browse/RANGER-3488
 Project: Ranger
  Issue Type: Bug
  Components: Ranger
Affects Versions: 3.0.0
Reporter: Ramesh Mani
Assignee: Ramesh Mani


This is to extended the current docker setup to Apache Ranger Knox  plugin so 
we could utilize it to verify the Apache Knox plugin more easily by using 
docker.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (RANGER-3487) Update underscorejs with latest version.

2021-10-20 Thread Nitin Galave (Jira) 
Nitin Galave created RANGER-3487:


 Summary: Update underscorejs with latest version.
 Key: RANGER-3487
 URL: https://issues.apache.org/jira/browse/RANGER-3487
 Project: Ranger
  Issue Type: Improvement
  Components: Ranger
Reporter: Nitin Galave
Assignee: Nitin Galave


For more functionality update underscorejs with the latest version is 1.13.1.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (RANGER-3471) Upgrade Jetty-client, commons-compress, poi-ooxml jar.

2021-10-20 Thread Mateen N Mansoori (Jira) 


 [ 
https://issues.apache.org/jira/browse/RANGER-3471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mateen N Mansoori resolved RANGER-3471.
---
Fix Version/s: 3.0.0
   Resolution: Fixed

Merged in apache master : 
https://github.com/apache/ranger/commit/efe1bcd5a350ecf32b855a86d6c4e1e60677b2d3

> Upgrade Jetty-client, commons-compress, poi-ooxml jar.
> --
>
> Key: RANGER-3471
> URL: https://issues.apache.org/jira/browse/RANGER-3471
> Project: Ranger
>  Issue Type: Task
>  Components: Ranger
>Reporter: Mateen N Mansoori
>Assignee: Mateen Mansoori
>Priority: Major
> Fix For: 3.0.0
>
>
> Currently ranger pulling jetty-client : 9.4.31.v20200723, commons-compress : 
> 1.8.1 and poi-ooxml : 4.1.2, Upgrading these libs to 9.4.44.v20210927, 1.21 
> and 5.0.0 respectively. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: Review Request 73658: RANGER-3486: RangerPolicy Data Not Found for given id when grantAccess and revokeAccess

2021-10-20 Thread hervor tao 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73658/
---

(Updated 十月 20, 2021, 8:40 a.m.)


Review request for ranger.


Bugs: RANGER-3486
https://issues.apache.org/jira/browse/RANGER-3486


Repository: ranger


Description
---

/plugins/services/revoke/{serviceName} 
 
When get match's Policies from access resource, policy evaluators  maintained 
in memory
is not updated, result in an error matching policy data deleted in ranger 
database  
Finally, return  "org.apache.ranger.plugin.model.RangerPolicy :Data Not Found 
for given Id"


Diffs
-

  
agents-common/src/main/java/org/apache/ranger/plugin/policyengine/RangerPolicyRepository.java
 008ee7719 
  security-admin/src/main/java/org/apache/ranger/biz/RangerPolicyAdminImpl.java 
5311a54a2 


Diff: https://reviews.apache.org/r/73658/diff/1/


Testing
---

verified that revoke and grant aceess successfully


File Attachments (updated)


patch
  
https://reviews.apache.org/media/uploaded/files/2021/10/20/2552945a-7a7c-49d9-9572-461ab05eef48__0001-RANGER-3486-fix-RangerPolicy-Data-Not-Found-for-give.patch


Thanks,

hervor tao

[jira] [Updated] (RANGER-3486) RangerPolicy Data Not Found for given id when grantAccess and revokeAccess

2021-10-20 Thread Hervor (Jira) 


 [ 
https://issues.apache.org/jira/browse/RANGER-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hervor updated RANGER-3486:
---
External issue URL: https://reviews.apache.org/r/73658/
 Flags: Patch,Important  (was: Important)

> RangerPolicy Data Not Found for given id when grantAccess and revokeAccess 
> ---
>
> Key: RANGER-3486
> URL: https://issues.apache.org/jira/browse/RANGER-3486
> Project: Ranger
>  Issue Type: Bug
>  Components: admin, Ranger
>Affects Versions: 2.1.0
>Reporter: Hervor
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: 
> 0001-RANGER-3486-fix-RangerPolicy-Data-Not-Found-for-give.patch
>
>
> /plugins/services/revoke/\{serviceName} 
>  
> When get match's Policies from access resource, policy evaluators  maintained 
> in memory
> is not updated, result in an error matching policy data deleted in ranger 
> database  
> Finally, return  "org.apache.ranger.plugin.model.RangerPolicy :Data Not Found 
> for given Id"
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: Review Request 73658: RANGER-3486: RangerPolicy Data Not Found for given id when grantAccess and revokeAccess

2021-10-20 Thread hervor tao 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73658/
---

(Updated 十月 20, 2021, 8:28 a.m.)


Review request for ranger.


Bugs: RANGER-3486
https://issues.apache.org/jira/browse/RANGER-3486


Repository: ranger


Description
---

/plugins/services/revoke/{serviceName} 
 
When get match's Policies from access resource, policy evaluators  maintained 
in memory
is not updated, result in an error matching policy data deleted in ranger 
database  
Finally, return  "org.apache.ranger.plugin.model.RangerPolicy :Data Not Found 
for given Id"


Diffs
-

  
agents-common/src/main/java/org/apache/ranger/plugin/policyengine/RangerPolicyRepository.java
 008ee7719 
  security-admin/src/main/java/org/apache/ranger/biz/RangerPolicyAdminImpl.java 
5311a54a2 


Diff: https://reviews.apache.org/r/73658/diff/1/


Testing (updated)
---

verified that revoke and grant aceess successfully


Thanks,

hervor tao

Re: Review Request 73658: RANGER-3486: RangerPolicy Data Not Found for given id when grantAccess and revokeAccess

2021-10-20 Thread hervor tao 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73658/
---

(Updated 十月 20, 2021, 8:27 a.m.)


Review request for ranger.


Bugs: RANGER-3486
https://issues.apache.org/jira/browse/RANGER-3486


Repository: ranger


Description
---

/plugins/services/revoke/{serviceName} 
 
When get match's Policies from access resource, policy evaluators  maintained 
in memory
is not updated, result in an error matching policy data deleted in ranger 
database  
Finally, return  "org.apache.ranger.plugin.model.RangerPolicy :Data Not Found 
for given Id"


Diffs
-

  
agents-common/src/main/java/org/apache/ranger/plugin/policyengine/RangerPolicyRepository.java
 008ee7719 
  security-admin/src/main/java/org/apache/ranger/biz/RangerPolicyAdminImpl.java 
5311a54a2 


Diff: https://reviews.apache.org/r/73658/diff/1/


Testing
---


Thanks,

hervor tao

Review Request 73658: RANGER-3486: RangerPolicy Data Not Found for given id when grantAccess and revokeAccess

2021-10-20 Thread hervor tao 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73658/
---

Review request for ranger.


Bugs: RANGER-3486
https://issues.apache.org/jira/browse/RANGER-3486


Repository: ranger


Description
---

/plugins/services/revoke/{serviceName} 
 
When get match's Policies from access resource, policy evaluators  maintained 
in memory
is not updated, result in an error matching policy data deleted in ranger 
database  
Finally, return  "org.apache.ranger.plugin.model.RangerPolicy :Data Not Found 
for given Id"


Diffs
-

  
agents-common/src/main/java/org/apache/ranger/plugin/policyengine/RangerPolicyRepository.java
 008ee7719 
  security-admin/src/main/java/org/apache/ranger/biz/RangerPolicyAdminImpl.java 
5311a54a2 


Diff: https://reviews.apache.org/r/73658/diff/1/


Testing
---


Thanks,

hervor tao

[jira] [Updated] (RANGER-3486) RangerPolicy Data Not Found for given id when grantAccess and revokeAccess

2021-10-20 Thread Hervor (Jira) 


 [ 
https://issues.apache.org/jira/browse/RANGER-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hervor updated RANGER-3486:
---
Attachment: 0001-RANGER-3486-fix-RangerPolicy-Data-Not-Found-for-give.patch

> RangerPolicy Data Not Found for given id when grantAccess and revokeAccess 
> ---
>
> Key: RANGER-3486
> URL: https://issues.apache.org/jira/browse/RANGER-3486
> Project: Ranger
>  Issue Type: Bug
>  Components: admin, Ranger
>Affects Versions: 2.1.0
>Reporter: Hervor
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: 
> 0001-RANGER-3486-fix-RangerPolicy-Data-Not-Found-for-give.patch
>
>
> /plugins/services/revoke/\{serviceName} 
>  
> When get match's Policies from access resource, policy evaluators  maintained 
> in memory
> is not updated, result in an error matching policy data deleted in ranger 
> database  
> Finally, return  "org.apache.ranger.plugin.model.RangerPolicy :Data Not Found 
> for given Id"
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (RANGER-3486) RangerPolicy Data Not Found for given id when grantAccess and revokeAccess

2021-10-20 Thread Hervor (Jira) 
Hervor created RANGER-3486:
--

 Summary: RangerPolicy Data Not Found for given id when grantAccess 
and revokeAccess 
 Key: RANGER-3486
 URL: https://issues.apache.org/jira/browse/RANGER-3486
 Project: Ranger
  Issue Type: Bug
  Components: admin, Ranger
Affects Versions: 2.1.0
Reporter: Hervor
 Fix For: 2.1.0


/plugins/services/revoke/\{serviceName} 

 

When get match's Policies from access resource, policy evaluators  maintained 
in memory

is not updated, result in an error matching policy data deleted in ranger 
database  

Finally, return  "org.apache.ranger.plugin.model.RangerPolicy :Data Not Found 
for given Id"

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: Review Request 73657: RANGER-3433: Null Dereference in ServiceREST getPolicyByName method

2021-10-20 Thread Madhan Neethiraj 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73657/#review223637
---


Ship it!




Ship It!

- Madhan Neethiraj


On Oct. 20, 2021, 5:13 a.m., Kishor Gollapalliwar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73657/
> ---
> 
> (Updated Oct. 20, 2021, 5:13 a.m.)
> 
> 
> Review request for ranger, Abhishek  Kumar, Dineshkumar Yadav, Abhay 
> Kulkarni, Madhan Neethiraj, Mehul Parikh, and Velmurugan Periasamy.
> 
> 
> Bugs: RANGER-3433
> https://issues.apache.org/jira/browse/RANGER-3433
> 
> 
> Repository: ranger
> 
> 
> Description
> ---
> 
> Null Dereference in ServiceREST getPolicyByName method
> 
> 
> Diffs
> -
> 
>   security-admin/src/main/java/org/apache/ranger/rest/ServiceREST.java 
> 01e952a23 
> 
> 
> Diff: https://reviews.apache.org/r/73657/diff/2/
> 
> 
> Testing
> ---
> 
> 1. Maven build
> 2. Setup Ranger Admin
> 2. Create, Update & Delete policy
> 
> 
> Thanks,
> 
> Kishor Gollapalliwar
> 
>