[ https://issues.apache.org/jira/browse/ATLAS-2916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jiaqi Shan updated ATLAS-2916: ------------------------------ Description: {{ When creating a Hive process, columnEntity wil update with the value of table's AtlasObjectId. There is an example to show the differences bwtween CurrentEntity and EntityInStore.}} {panel:title=CurrentEntity} AtlasEntity{AtlasStruct{typeName='hive_column', attributes=[owner:bi_sh, qualifiedName:bi.yingbang.t@bdyf, name:t, comment:t, position:1, type:int, table:{color:#d04437}AtlasObjectId\{guid='-17020754238878791', typeName='hive_table', uniqueAttributes={qualifiedName:b.yingbang@bdyf}}{color}]}guid='431c8847-8fd2-454d-b77a-19aeef0d6b9b', status=null, createdBy='null', updatedBy='null', createTime=null, updateTime=null, version=0, relationshipAttributes=[], classifications=[], meanings=[]} {panel} {panel:title=EntityInStore} AtlasEntity{AtlasStruct{typeName='hive_column', attributes=[owner:bi_sh, qualifiedName:bi.yingbang.t@bdyf, name:t, description:null, comment:t, position:1, type:int, {color:#d04437}table:AtlasObjectId\{guid='da35aff2-9851-499d-99cf-f1fbafb6e92b', typeName='hive_table', uniqueAttributes={}}{color}]}guid='431c8847-8fd2-454d-b77a-19aeef0d6b9b', status=ACTIVE, createdBy='bi_sh', updatedBy='bi_sh', createTime=2018-10-09T11:26:51.685Z, updateTime=2018-10-09T11:26:51.685Z, version=0, relationshipAttributes=[], classifications=[], meanings=[]} {panel} {{ Actually there is no metedata changed in columnEntity, so I think maybe it's unnecessary to update columnEntity if only need to update the AtlasObJectId.}} {{ We propose to add a LRU cache to skip updating the same entitiy which was sent in an earlier notification and it works.}}{{Is there any other good solution to aviod this problem?}} was: {{ When creating a Hive process, columnEntity wil update with the value of table's AtlasObjectId. There is an example to show the differences bwtween CurrentEntity and EntityInStore.}} {panel:title=CurrentEntity} AtlasEntity{AtlasStruct{typeName='hive_column', attributes=[owner:bi_sh, qualifiedName:bi.yingbang.t@bdyf, name:t, comment:t, position:1, type:int, table:{color:#d04437}AtlasObjectId\{guid='-17020754238878791', typeName='hive_table', uniqueAttributes={qualifiedName:b.yingbang@bdyf}}{color}]}guid='431c8847-8fd2-454d-b77a-19aeef0d6b9b', status=null, createdBy='null', updatedBy='null', createTime=null, updateTime=null, version=0, relationshipAttributes=[], classifications=[], meanings=[]} {panel} {panel:title=EntityInStore} AtlasEntity{AtlasStruct{typeName='hive_column', attributes=[owner:bi_sh, qualifiedName:bi.yingbang.t@bdyf, name:t, description:null, comment:t, position:1, type:int, {color:#d04437}table:AtlasObjectId\{guid='da35aff2-9851-499d-99cf-f1fbafb6e92b', typeName='hive_table', uniqueAttributes={}}{color}]}guid='431c8847-8fd2-454d-b77a-19aeef0d6b9b', status=ACTIVE, createdBy='bi_sh', updatedBy='bi_sh', createTime=2018-10-09T11:26:51.685Z, updateTime=2018-10-09T11:26:51.685Z, version=0, relationshipAttributes=[], classifications=[], meanings=[]} {panel} {{ Actually there is no metedata changed in columnEntity, so I think maybe it's unnecessary to update columnEntity if only need to update the AtlasObJectId.}} {{ We propose to add a LRU cache to skip updating the same entitiy which was sent in an earlier notification and it works.}}{{Is there any other good solution to aviod this problem?}} > Unnecessary entity update causes by different AtlasObjectId > ----------------------------------------------------------- > > Key: ATLAS-2916 > URL: https://issues.apache.org/jira/browse/ATLAS-2916 > Project: Atlas > Issue Type: Improvement > Components: atlas-core > Affects Versions: 1.0.0 > Reporter: Jiaqi Shan > Priority: Minor > > {{ When creating a Hive process, columnEntity wil update with the value of > table's AtlasObjectId. There is an example to show the differences bwtween > CurrentEntity and EntityInStore.}} > {panel:title=CurrentEntity} > AtlasEntity{AtlasStruct{typeName='hive_column', attributes=[owner:bi_sh, > qualifiedName:bi.yingbang.t@bdyf, name:t, comment:t, position:1, type:int, > table:{color:#d04437}AtlasObjectId\{guid='-17020754238878791', > typeName='hive_table', > uniqueAttributes={qualifiedName:b.yingbang@bdyf}}{color}]}guid='431c8847-8fd2-454d-b77a-19aeef0d6b9b', > status=null, createdBy='null', updatedBy='null', createTime=null, > updateTime=null, version=0, relationshipAttributes=[], classifications=[], > meanings=[]} > {panel} > {panel:title=EntityInStore} > AtlasEntity{AtlasStruct{typeName='hive_column', attributes=[owner:bi_sh, > qualifiedName:bi.yingbang.t@bdyf, name:t, description:null, comment:t, > position:1, type:int, > {color:#d04437}table:AtlasObjectId\{guid='da35aff2-9851-499d-99cf-f1fbafb6e92b', > typeName='hive_table', > uniqueAttributes={}}{color}]}guid='431c8847-8fd2-454d-b77a-19aeef0d6b9b', > status=ACTIVE, createdBy='bi_sh', updatedBy='bi_sh', > createTime=2018-10-09T11:26:51.685Z, updateTime=2018-10-09T11:26:51.685Z, > version=0, relationshipAttributes=[], classifications=[], meanings=[]} > {panel} > {{ Actually there is no metedata changed in columnEntity, so I think maybe > it's unnecessary to update columnEntity if only need to update the > AtlasObJectId.}} > {{ We propose to add a LRU cache to skip updating the same entitiy which was > sent in an earlier notification and it works.}}{{Is there any other good > solution to aviod this problem?}} > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)