[jira] [Commented] (ATLAS-3515) Migration: New Types Referenced within Existing Types

2019-11-08 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970426#comment-16970426
 ] 

ASF subversion and git services commented on ATLAS-3515:


Commit 77dbea47bf42daceefea6bd03b81116aefa2f755 in atlas's branch 
refs/heads/branch-2.0 from Ashutosh Mestry
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=77dbea4 ]

ATLAS-3515: Migration import now creates new types and then updates existing 
types.


> Migration: New Types Referenced within Existing Types
> -
>
> Key: ATLAS-3515
> URL: https://issues.apache.org/jira/browse/ATLAS-3515
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0, trunk
>Reporter: Ashutosh Mestry
>Assignee: Ashutosh Mestry
>Priority: Major
> Fix For: trunk, 2.1.0
>
> Attachments: ATLAS-3515-Migration-import-type-definition.patch
>
>
> *Background*
> During migration import (and regular Import) types coming in are processed in 
> the following way:
>  * New types are determined.
>  * Modification to existing types are determined.
> *Steps to Duplicate*
> _Pre-requisites:_
>  * Create type definition with new _structDef_.
>  * Modify _hive_table_ (existing) such a new attribute references the 
> _structDef_.
> _Steps_
>  * Initiate migration import.
> _Expected outcome_
>  * New types should be part of the types definition (using REST APIs and 
> property pages).
>  * Data should get migrated.
> _Actual outcome_
>  * Type definition import fails.
> _Additional information_
> Stack trace:
> {code:java}
> org.apache.atlas.exception.AtlasBaseException: Given typename 
> hive_table_profile_data was invalid
> at 
> org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStore.tryUpdateByName(AtlasTypeDefGraphStore.java:1025)
> 
> at 
> org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStore.updateEntityDefByName(AtlasTypeDefGraphStore.java:285)
> 
> at 
> org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStore$$FastClassBySprin
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3515) Migration: New Types Referenced within Existing Types

2019-11-07 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969863#comment-16969863
 ] 

ASF subversion and git services commented on ATLAS-3515:


Commit 98163440590852fa9d142c23e596e8975a322349 in atlas's branch 
refs/heads/master from Ashutosh Mestry
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=9816344 ]

ATLAS-3515: Migration import now creates new types and then updates existing 
types.


> Migration: New Types Referenced within Existing Types
> -
>
> Key: ATLAS-3515
> URL: https://issues.apache.org/jira/browse/ATLAS-3515
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0, trunk
>Reporter: Ashutosh Mestry
>Assignee: Ashutosh Mestry
>Priority: Major
> Fix For: trunk, 2.1.0
>
> Attachments: ATLAS-3515-Migration-import-type-definition.patch
>
>
> *Background*
> During migration import (and regular Import) types coming in are processed in 
> the following way:
>  * New types are determined.
>  * Modification to existing types are determined.
> *Steps to Duplicate*
> _Pre-requisites:_
>  * Create type definition with new _structDef_.
>  * Modify _hive_table_ (existing) such a new attribute references the 
> _structDef_.
> _Steps_
>  * Initiate migration import.
> _Expected outcome_
>  * New types should be part of the types definition (using REST APIs and 
> property pages).
>  * Data should get migrated.
> _Actual outcome_
>  * Type definition import fails.
> _Additional information_
> Stack trace:
> {code:java}
> org.apache.atlas.exception.AtlasBaseException: Given typename 
> hive_table_profile_data was invalid
> at 
> org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStore.tryUpdateByName(AtlasTypeDefGraphStore.java:1025)
> 
> at 
> org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStore.updateEntityDefByName(AtlasTypeDefGraphStore.java:285)
> 
> at 
> org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStore$$FastClassBySprin
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3515) Migration: New Types Referenced within Existing Types

2019-11-07 Thread Sarath Subramanian (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969644#comment-16969644
 ] 

Sarath Subramanian commented on ATLAS-3515:
---

+1 for the patch. Thanks [~amestry]

> Migration: New Types Referenced within Existing Types
> -
>
> Key: ATLAS-3515
> URL: https://issues.apache.org/jira/browse/ATLAS-3515
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0, trunk
>Reporter: Ashutosh Mestry
>Assignee: Ashutosh Mestry
>Priority: Major
> Fix For: trunk, 2.1.0
>
> Attachments: ATLAS-3515-Migration-import-type-definition.patch
>
>
> *Background*
> During migration import (and regular Import) types coming in are processed in 
> the following way:
>  * New types are determined.
>  * Modification to existing types are determined.
> *Steps to Duplicate*
> _Pre-requisites:_
>  * Create type definition with new _structDef_.
>  * Modify _hive_table_ (existing) such a new attribute references the 
> _structDef_.
> _Steps_
>  * Initiate migration import.
> _Expected outcome_
>  * New types should be part of the types definition (using REST APIs and 
> property pages).
>  * Data should get migrated.
> _Actual outcome_
>  * Type definition import fails.
> _Additional information_
> Stack trace:
> {code:java}
> org.apache.atlas.exception.AtlasBaseException: Given typename 
> hive_table_profile_data was invalid
> at 
> org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStore.tryUpdateByName(AtlasTypeDefGraphStore.java:1025)
> 
> at 
> org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStore.updateEntityDefByName(AtlasTypeDefGraphStore.java:285)
> 
> at 
> org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStore$$FastClassBySprin
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3515) Migration: New Types Referenced within Existing Types

2019-11-07 Thread Ashutosh Mestry (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969592#comment-16969592
 ] 

Ashutosh Mestry commented on ATLAS-3515:


PC build: 
[https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1533/]

> Migration: New Types Referenced within Existing Types
> -
>
> Key: ATLAS-3515
> URL: https://issues.apache.org/jira/browse/ATLAS-3515
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0, trunk
>Reporter: Ashutosh Mestry
>Assignee: Ashutosh Mestry
>Priority: Major
> Fix For: trunk, 2.1.0
>
> Attachments: ATLAS-3515-Migration-import-type-definition.patch
>
>
> *Background*
> During migration import (and regular Import) types coming in are processed in 
> the following way:
>  * New types are determined.
>  * Modification to existing types are determined.
> *Steps to Duplicate*
> _Pre-requisites:_
>  * Create type definition with new _structDef_.
>  * Modify _hive_table_ (existing) such a new attribute references the 
> _structDef_.
> _Steps_
>  * Initiate migration import.
> _Expected outcome_
>  * New types should be part of the types definition (using REST APIs and 
> property pages).
>  * Data should get migrated.
> _Actual outcome_
>  * Type definition import fails.
> _Additional information_
> Stack trace:
> {code:java}
> org.apache.atlas.exception.AtlasBaseException: Given typename 
> hive_table_profile_data was invalid
> at 
> org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStore.tryUpdateByName(AtlasTypeDefGraphStore.java:1025)
> 
> at 
> org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStore.updateEntityDefByName(AtlasTypeDefGraphStore.java:285)
> 
> at 
> org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStore$$FastClassBySprin
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)