[jira] [Updated] (ATLAS-3477) Introduce purging of entity in Atlas

2019-11-07 Thread Sarath Subramanian (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-3477:
--
Component/s:  atlas-core

> Introduce purging of entity in Atlas
> 
>
> Key: ATLAS-3477
> URL: https://issues.apache.org/jira/browse/ATLAS-3477
> Project: Atlas
>  Issue Type: New Feature
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Sidharth Kumar Mishra
>Assignee: Sidharth Kumar Mishra
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: ATLAS-3477.patch
>
>
> In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there 
> is no way to do cleanup if user wants to delete those permanently. Right now 
> we can change the configuration 
> atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1.
> HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as 
> desired. But what happens to existing soft deleted Entities. There is no way 
> in that case.
> As part of this issue solution we should be able to purge the entities which 
> are already soft deleted. This will be useful to users who is interested to 
> purge some list of soft deleted entities from Atlas. Due to governance 
> compliances, only admin can perform purge of entities.
> Purge should have separate Audit similar to delete entity.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3477) Introduce purging of entity in Atlas

2019-11-07 Thread Sidharth Kumar Mishra (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sidharth Kumar Mishra updated ATLAS-3477:
-
Attachment: (was: ATLAS-3477.patch)

> Introduce purging of entity in Atlas
> 
>
> Key: ATLAS-3477
> URL: https://issues.apache.org/jira/browse/ATLAS-3477
> Project: Atlas
>  Issue Type: New Feature
>Affects Versions: 2.0.0
>Reporter: Sidharth Kumar Mishra
>Assignee: Sidharth Kumar Mishra
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: ATLAS-3477.patch
>
>
> In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there 
> is no way to do cleanup if user wants to delete those permanently. Right now 
> we can change the configuration 
> atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1.
> HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as 
> desired. But what happens to existing soft deleted Entities. There is no way 
> in that case.
> As part of this issue solution we should be able to purge the entities which 
> are already soft deleted. This will be useful to users who is interested to 
> purge some list of soft deleted entities from Atlas. Due to governance 
> compliances, only admin can perform purge of entities.
> Purge should have separate Audit similar to delete entity.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3477) Introduce purging of entity in Atlas

2019-11-07 Thread Sidharth Kumar Mishra (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sidharth Kumar Mishra updated ATLAS-3477:
-
Attachment: ATLAS-3477.patch

> Introduce purging of entity in Atlas
> 
>
> Key: ATLAS-3477
> URL: https://issues.apache.org/jira/browse/ATLAS-3477
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Sidharth Kumar Mishra
>Assignee: Sidharth Kumar Mishra
>Priority: Major
> Attachments: ATLAS-3477.patch
>
>
> In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there 
> is no way to do cleanup if user wants to delete those permanently. Right now 
> we can change the configuration 
> atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1.
> HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as 
> desired. But what happens to existing soft deleted Entities. There is no way 
> in that case.
> As part of this issue solution we should be able to purge the entities which 
> are already soft deleted. This will be useful to users who is interested to 
> purge some list of soft deleted entities from Atlas. Due to governance 
> compliances, only admin can perform purge of entities.
> Purge should have separate Audit similar to delete entity.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3477) Introduce purging of entity in Atlas

2019-11-07 Thread Sidharth Kumar Mishra (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sidharth Kumar Mishra updated ATLAS-3477:
-
Description: 
In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there is 
no way to do cleanup if user wants to delete those permanently. Right now we 
can change the configuration 

atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1.

HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as 
desired. But what happens to existing soft deleted Entities. There is no way in 
that case.

As part of this issue solution we should be able to purge the entities which 
are already soft deleted. This will be useful to users who is interested to 
purge some list of soft deleted entities from Atlas. Due to governance 
compliances, only admin can perform purge of entities.

Purge should have separate Audit similar to delete entity.

  was:
In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there is 
no way to do cleanup if user wants to delete those permanently. Right now we 
can change the configuration 

atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1.

HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as 
desired. But what happens to existing soft deleted Entities. There is no way in 
that case.

There are two cases which needs to be addressed as part of this problem.
 # There is an active entity which has to be purged in case the entity is 
dropped.
 # There might be existing soft deleted entities and which has to be purge 
deleted if user desires

In both the above cases we also need to think about the auditing and its impact.


> Introduce purging of entity in Atlas
> 
>
> Key: ATLAS-3477
> URL: https://issues.apache.org/jira/browse/ATLAS-3477
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Sidharth Kumar Mishra
>Assignee: Sidharth Kumar Mishra
>Priority: Major
>
> In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there 
> is no way to do cleanup if user wants to delete those permanently. Right now 
> we can change the configuration 
> atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1.
> HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as 
> desired. But what happens to existing soft deleted Entities. There is no way 
> in that case.
> As part of this issue solution we should be able to purge the entities which 
> are already soft deleted. This will be useful to users who is interested to 
> purge some list of soft deleted entities from Atlas. Due to governance 
> compliances, only admin can perform purge of entities.
> Purge should have separate Audit similar to delete entity.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3477) Introduce purging of entity in Atlas

2019-10-17 Thread Sidharth Kumar Mishra (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sidharth Kumar Mishra updated ATLAS-3477:
-
Description: 
In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there is 
no way to do cleanup if user wants to delete those permanently. Right now we 
can change the configuration 

atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1.

HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as 
desired. But what happens to existing soft deleted Entities. There is no way in 
that case.

There are two cases which needs to be addressed as part of this problem.
 # There is an active entity which has to be purged in case the entity is 
dropped.
 # There might be existing soft deleted entities and which has to be purge 
deleted if user desires

In both the above cases we also need to think about the auditing and its impact.

  was:
In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there is 
no way to do cleanup if user wants to delete those permanently. Right now we 
can change the configuration 

atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1.

HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as 
desired. But what happens to existing soft deleted Entities. There is no way in 
that case.

There are two cases which needs to be addressed as part of this problem.
 # There are active entity which has to be purged in case the entity is dropped.
 # There might be existing soft deleted entities and which has to be purge 
deleted

In both the above cases we also need to think about the auditing and its impact.


> Introduce purging of entity in Atlas
> 
>
> Key: ATLAS-3477
> URL: https://issues.apache.org/jira/browse/ATLAS-3477
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Sidharth Kumar Mishra
>Assignee: Sidharth Kumar Mishra
>Priority: Major
>
> In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there 
> is no way to do cleanup if user wants to delete those permanently. Right now 
> we can change the configuration 
> atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1.
> HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as 
> desired. But what happens to existing soft deleted Entities. There is no way 
> in that case.
> There are two cases which needs to be addressed as part of this problem.
>  # There is an active entity which has to be purged in case the entity is 
> dropped.
>  # There might be existing soft deleted entities and which has to be purge 
> deleted if user desires
> In both the above cases we also need to think about the auditing and its 
> impact.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3477) Introduce purging of entity in Atlas

2019-10-17 Thread Sidharth Kumar Mishra (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sidharth Kumar Mishra updated ATLAS-3477:
-
Description: 
In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there is 
no way to do cleanup if user wants to delete those permanently. Right now we 
can change the configuration 

atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1.

HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as 
desired. But what happens to existing soft deleted Entities. There is no way in 
that case.

There are two cases which needs to be addressed as part of this problem.
 # There are active entity which has to be purged in case the entity is dropped.
 # There might be existing soft deleted entities and which has to be purge 
deleted

In both the above cases we also need to think about the auditing and its impact.

  was:
In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there is 
no way to do cleanup if user wants to delete those permanently. Right now we 
can change the configuration 

atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1.

HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as 
desired. But what happens to existing soft deleted Entities. There is no way in 
that case.


> Introduce purging of entity in Atlas
> 
>
> Key: ATLAS-3477
> URL: https://issues.apache.org/jira/browse/ATLAS-3477
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Sidharth Kumar Mishra
>Assignee: Sidharth Kumar Mishra
>Priority: Major
>
> In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there 
> is no way to do cleanup if user wants to delete those permanently. Right now 
> we can change the configuration 
> atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1.
> HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as 
> desired. But what happens to existing soft deleted Entities. There is no way 
> in that case.
> There are two cases which needs to be addressed as part of this problem.
>  # There are active entity which has to be purged in case the entity is 
> dropped.
>  # There might be existing soft deleted entities and which has to be purge 
> deleted
> In both the above cases we also need to think about the auditing and its 
> impact.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3477) Introduce purging of entity in Atlas

2019-10-17 Thread Sidharth Kumar Mishra (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sidharth Kumar Mishra updated ATLAS-3477:
-
Summary: Introduce purging of entity in Atlas  (was: No way to purge the 
soft deleted entity from Atlas)

> Introduce purging of entity in Atlas
> 
>
> Key: ATLAS-3477
> URL: https://issues.apache.org/jira/browse/ATLAS-3477
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Sidharth Kumar Mishra
>Assignee: Sidharth Kumar Mishra
>Priority: Major
>
> In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there 
> is no way to do cleanup if user wants to delete those permanently. Right now 
> we can change the configuration 
> atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1.
> HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as 
> desired. But what happens to existing soft deleted Entities. There is no way 
> in that case.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)