[jira] [Updated] (ATLAS-3477) Introduce purging of entity in Atlas
[ https://issues.apache.org/jira/browse/ATLAS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sarath Subramanian updated ATLAS-3477: -- Component/s: atlas-core > Introduce purging of entity in Atlas > > > Key: ATLAS-3477 > URL: https://issues.apache.org/jira/browse/ATLAS-3477 > Project: Atlas > Issue Type: New Feature > Components: atlas-core >Affects Versions: 2.0.0 >Reporter: Sidharth Kumar Mishra >Assignee: Sidharth Kumar Mishra >Priority: Major > Fix For: 2.1.0 > > Attachments: ATLAS-3477.patch > > > In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there > is no way to do cleanup if user wants to delete those permanently. Right now > we can change the configuration > atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1. > HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as > desired. But what happens to existing soft deleted Entities. There is no way > in that case. > As part of this issue solution we should be able to purge the entities which > are already soft deleted. This will be useful to users who is interested to > purge some list of soft deleted entities from Atlas. Due to governance > compliances, only admin can perform purge of entities. > Purge should have separate Audit similar to delete entity. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3477) Introduce purging of entity in Atlas
[ https://issues.apache.org/jira/browse/ATLAS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharth Kumar Mishra updated ATLAS-3477: - Attachment: (was: ATLAS-3477.patch) > Introduce purging of entity in Atlas > > > Key: ATLAS-3477 > URL: https://issues.apache.org/jira/browse/ATLAS-3477 > Project: Atlas > Issue Type: New Feature >Affects Versions: 2.0.0 >Reporter: Sidharth Kumar Mishra >Assignee: Sidharth Kumar Mishra >Priority: Major > Fix For: 2.1.0 > > Attachments: ATLAS-3477.patch > > > In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there > is no way to do cleanup if user wants to delete those permanently. Right now > we can change the configuration > atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1. > HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as > desired. But what happens to existing soft deleted Entities. There is no way > in that case. > As part of this issue solution we should be able to purge the entities which > are already soft deleted. This will be useful to users who is interested to > purge some list of soft deleted entities from Atlas. Due to governance > compliances, only admin can perform purge of entities. > Purge should have separate Audit similar to delete entity. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3477) Introduce purging of entity in Atlas
[ https://issues.apache.org/jira/browse/ATLAS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharth Kumar Mishra updated ATLAS-3477: - Attachment: ATLAS-3477.patch > Introduce purging of entity in Atlas > > > Key: ATLAS-3477 > URL: https://issues.apache.org/jira/browse/ATLAS-3477 > Project: Atlas > Issue Type: New Feature >Reporter: Sidharth Kumar Mishra >Assignee: Sidharth Kumar Mishra >Priority: Major > Attachments: ATLAS-3477.patch > > > In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there > is no way to do cleanup if user wants to delete those permanently. Right now > we can change the configuration > atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1. > HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as > desired. But what happens to existing soft deleted Entities. There is no way > in that case. > As part of this issue solution we should be able to purge the entities which > are already soft deleted. This will be useful to users who is interested to > purge some list of soft deleted entities from Atlas. Due to governance > compliances, only admin can perform purge of entities. > Purge should have separate Audit similar to delete entity. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3477) Introduce purging of entity in Atlas
[ https://issues.apache.org/jira/browse/ATLAS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharth Kumar Mishra updated ATLAS-3477: - Description: In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there is no way to do cleanup if user wants to delete those permanently. Right now we can change the configuration atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1. HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as desired. But what happens to existing soft deleted Entities. There is no way in that case. As part of this issue solution we should be able to purge the entities which are already soft deleted. This will be useful to users who is interested to purge some list of soft deleted entities from Atlas. Due to governance compliances, only admin can perform purge of entities. Purge should have separate Audit similar to delete entity. was: In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there is no way to do cleanup if user wants to delete those permanently. Right now we can change the configuration atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1. HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as desired. But what happens to existing soft deleted Entities. There is no way in that case. There are two cases which needs to be addressed as part of this problem. # There is an active entity which has to be purged in case the entity is dropped. # There might be existing soft deleted entities and which has to be purge deleted if user desires In both the above cases we also need to think about the auditing and its impact. > Introduce purging of entity in Atlas > > > Key: ATLAS-3477 > URL: https://issues.apache.org/jira/browse/ATLAS-3477 > Project: Atlas > Issue Type: New Feature >Reporter: Sidharth Kumar Mishra >Assignee: Sidharth Kumar Mishra >Priority: Major > > In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there > is no way to do cleanup if user wants to delete those permanently. Right now > we can change the configuration > atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1. > HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as > desired. But what happens to existing soft deleted Entities. There is no way > in that case. > As part of this issue solution we should be able to purge the entities which > are already soft deleted. This will be useful to users who is interested to > purge some list of soft deleted entities from Atlas. Due to governance > compliances, only admin can perform purge of entities. > Purge should have separate Audit similar to delete entity. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3477) Introduce purging of entity in Atlas
[ https://issues.apache.org/jira/browse/ATLAS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharth Kumar Mishra updated ATLAS-3477: - Description: In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there is no way to do cleanup if user wants to delete those permanently. Right now we can change the configuration atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1. HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as desired. But what happens to existing soft deleted Entities. There is no way in that case. There are two cases which needs to be addressed as part of this problem. # There is an active entity which has to be purged in case the entity is dropped. # There might be existing soft deleted entities and which has to be purge deleted if user desires In both the above cases we also need to think about the auditing and its impact. was: In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there is no way to do cleanup if user wants to delete those permanently. Right now we can change the configuration atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1. HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as desired. But what happens to existing soft deleted Entities. There is no way in that case. There are two cases which needs to be addressed as part of this problem. # There are active entity which has to be purged in case the entity is dropped. # There might be existing soft deleted entities and which has to be purge deleted In both the above cases we also need to think about the auditing and its impact. > Introduce purging of entity in Atlas > > > Key: ATLAS-3477 > URL: https://issues.apache.org/jira/browse/ATLAS-3477 > Project: Atlas > Issue Type: New Feature >Reporter: Sidharth Kumar Mishra >Assignee: Sidharth Kumar Mishra >Priority: Major > > In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there > is no way to do cleanup if user wants to delete those permanently. Right now > we can change the configuration > atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1. > HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as > desired. But what happens to existing soft deleted Entities. There is no way > in that case. > There are two cases which needs to be addressed as part of this problem. > # There is an active entity which has to be purged in case the entity is > dropped. > # There might be existing soft deleted entities and which has to be purge > deleted if user desires > In both the above cases we also need to think about the auditing and its > impact. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3477) Introduce purging of entity in Atlas
[ https://issues.apache.org/jira/browse/ATLAS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharth Kumar Mishra updated ATLAS-3477: - Description: In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there is no way to do cleanup if user wants to delete those permanently. Right now we can change the configuration atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1. HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as desired. But what happens to existing soft deleted Entities. There is no way in that case. There are two cases which needs to be addressed as part of this problem. # There are active entity which has to be purged in case the entity is dropped. # There might be existing soft deleted entities and which has to be purge deleted In both the above cases we also need to think about the auditing and its impact. was: In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there is no way to do cleanup if user wants to delete those permanently. Right now we can change the configuration atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1. HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as desired. But what happens to existing soft deleted Entities. There is no way in that case. > Introduce purging of entity in Atlas > > > Key: ATLAS-3477 > URL: https://issues.apache.org/jira/browse/ATLAS-3477 > Project: Atlas > Issue Type: New Feature >Reporter: Sidharth Kumar Mishra >Assignee: Sidharth Kumar Mishra >Priority: Major > > In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there > is no way to do cleanup if user wants to delete those permanently. Right now > we can change the configuration > atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1. > HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as > desired. But what happens to existing soft deleted Entities. There is no way > in that case. > There are two cases which needs to be addressed as part of this problem. > # There are active entity which has to be purged in case the entity is > dropped. > # There might be existing soft deleted entities and which has to be purge > deleted > In both the above cases we also need to think about the auditing and its > impact. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3477) Introduce purging of entity in Atlas
[ https://issues.apache.org/jira/browse/ATLAS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharth Kumar Mishra updated ATLAS-3477: - Summary: Introduce purging of entity in Atlas (was: No way to purge the soft deleted entity from Atlas) > Introduce purging of entity in Atlas > > > Key: ATLAS-3477 > URL: https://issues.apache.org/jira/browse/ATLAS-3477 > Project: Atlas > Issue Type: New Feature >Reporter: Sidharth Kumar Mishra >Assignee: Sidharth Kumar Mishra >Priority: Major > > In case of soft delete at Atlas i.e. the entities marked as 'DELETED' there > is no way to do cleanup if user wants to delete those permanently. Right now > we can change the configuration > atlas.DeleteHandlerV1.impl=org.apache.atlas.repository.store.graph.v1. > HardDeleteHandlerV1 and make the new delete of entity to be cleaned up as > desired. But what happens to existing soft deleted Entities. There is no way > in that case. -- This message was sent by Atlassian Jira (v8.3.4#803005)