[jira] [Commented] (ATLAS-3844) Ignore relationship attributes while fetching entities in Import Hive bridge.

2020-08-27 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186138#comment-17186138
 ] 

ASF subversion and git services commented on ATLAS-3844:


Commit 260f06645d95474209d433c78086c07e25c20dc2 in atlas's branch 
refs/heads/branch-2.0 from Nixon Rodrigues
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=260f066 ]

ATLAS-3844 - Ignore relationship attributes while fetching entities in Import 
Hive bridge.

Change-Id: I1d0eeb478286e896af733b51fe4f7fc62c594899
(cherry picked from commit cea851c5513cede054bc7704ac24c04cc498cd32)


> Ignore relationship attributes while fetching entities in Import Hive bridge.
> -
>
> Key: ATLAS-3844
> URL: https://issues.apache.org/jira/browse/ATLAS-3844
> Project: Atlas
>  Issue Type: Improvement
>  Components: hive-integration
>Reporter: Nixon Rodrigues
>Assignee: Nixon Rodrigues
>Priority: Major
> Fix For: 3.0.0
>
>     Attachments: 
> 0001-ATLAS-3844-Ignore-relationship-attributes-while-fetc.patch, 
> ATLAS-3844-Testcase-Fix-Ignore-relationship-attributes-while-fetc.patch
>
>
> Currently in Import Hive bridge, the hive_db and hive_table entities are 
> fetched along relationshipAttributes and related Attributes and this 
> attributes are cleared thereafter.
> Instead fetching relationshipAttributes and related Attributes in response, 
> it is will good to ignoreRelationship to reduce the size of response payload.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3844) Ignore relationship attributes while fetching entities in Import Hive bridge.

2020-08-27 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186139#comment-17186139
 ] 

ASF subversion and git services commented on ATLAS-3844:


Commit af8bd8a76e0f366f8fda2f46ab9a6257013fad06 in atlas's branch 
refs/heads/branch-2.0 from Nixon Rodrigues
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=af8bd8a ]

ATLAS-3844 - Ignore relationship attributes while fetching entities in Import 
Hive bridge. (UT fix) #2

(cherry picked from commit 682d16dd19cb72d36af9798811ed701ecdc0dacf)


> Ignore relationship attributes while fetching entities in Import Hive bridge.
> -
>
> Key: ATLAS-3844
> URL: https://issues.apache.org/jira/browse/ATLAS-3844
> Project: Atlas
>  Issue Type: Improvement
>  Components: hive-integration
>Reporter: Nixon Rodrigues
>Assignee: Nixon Rodrigues
>Priority: Major
> Fix For: 3.0.0
>
>     Attachments: 
> 0001-ATLAS-3844-Ignore-relationship-attributes-while-fetc.patch, 
> ATLAS-3844-Testcase-Fix-Ignore-relationship-attributes-while-fetc.patch
>
>
> Currently in Import Hive bridge, the hive_db and hive_table entities are 
> fetched along relationshipAttributes and related Attributes and this 
> attributes are cleared thereafter.
> Instead fetching relationshipAttributes and related Attributes in response, 
> it is will good to ignoreRelationship to reduce the size of response payload.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3844) Ignore relationship attributes while fetching entities in Import Hive bridge.

2020-07-08 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153735#comment-17153735
 ] 

ASF subversion and git services commented on ATLAS-3844:


Commit 682d16dd19cb72d36af9798811ed701ecdc0dacf in atlas's branch 
refs/heads/master from Nixon Rodrigues
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=682d16d ]

ATLAS-3844 - Ignore relationship attributes while fetching entities in Import 
Hive bridge. (UT fix) #2


> Ignore relationship attributes while fetching entities in Import Hive bridge.
> -
>
> Key: ATLAS-3844
> URL: https://issues.apache.org/jira/browse/ATLAS-3844
> Project: Atlas
>  Issue Type: Improvement
>  Components: hive-integration
>Reporter: Nixon Rodrigues
>Assignee: Nixon Rodrigues
>Priority: Major
> Fix For: 3.0.0
>
>     Attachments: 
> 0001-ATLAS-3844-Ignore-relationship-attributes-while-fetc.patch, 
> ATLAS-3844-Testcase-Fix-Ignore-relationship-attributes-while-fetc.patch
>
>
> Currently in Import Hive bridge, the hive_db and hive_table entities are 
> fetched along relationshipAttributes and related Attributes and this 
> attributes are cleared thereafter.
> Instead fetching relationshipAttributes and related Attributes in response, 
> it is will good to ignoreRelationship to reduce the size of response payload.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3844) Ignore relationship attributes while fetching entities in Import Hive bridge.

2020-07-08 Thread Pinal (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153731#comment-17153731
 ] 

Pinal commented on ATLAS-3844:
--

patch looks good, +1 for the patch.

> Ignore relationship attributes while fetching entities in Import Hive bridge.
> -
>
> Key: ATLAS-3844
> URL: https://issues.apache.org/jira/browse/ATLAS-3844
> Project: Atlas
>  Issue Type: Improvement
>  Components: hive-integration
>Reporter: Nixon Rodrigues
>Assignee: Nixon Rodrigues
>Priority: Major
> Fix For: 3.0.0
>
>     Attachments: 
> 0001-ATLAS-3844-Ignore-relationship-attributes-while-fetc.patch, 
> ATLAS-3844-Testcase-Fix-Ignore-relationship-attributes-while-fetc.patch
>
>
> Currently in Import Hive bridge, the hive_db and hive_table entities are 
> fetched along relationshipAttributes and related Attributes and this 
> attributes are cleared thereafter.
> Instead fetching relationshipAttributes and related Attributes in response, 
> it is will good to ignoreRelationship to reduce the size of response payload.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3844) Ignore relationship attributes while fetching entities in Import Hive bridge.

2020-07-08 Thread Nixon Rodrigues (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153718#comment-17153718
 ] 

Nixon Rodrigues commented on ATLAS-3844:


patch for testcase failure in hive-brigde

[^ATLAS-3844-Testcase-Fix-Ignore-relationship-attributes-while-fetc.patch] 

> Ignore relationship attributes while fetching entities in Import Hive bridge.
> -
>
> Key: ATLAS-3844
> URL: https://issues.apache.org/jira/browse/ATLAS-3844
> Project: Atlas
>  Issue Type: Improvement
>  Components: hive-integration
>Reporter: Nixon Rodrigues
>Assignee: Nixon Rodrigues
>Priority: Major
> Fix For: 3.0.0
>
>     Attachments: 
> 0001-ATLAS-3844-Ignore-relationship-attributes-while-fetc.patch, 
> ATLAS-3844-Testcase-Fix-Ignore-relationship-attributes-while-fetc.patch
>
>
> Currently in Import Hive bridge, the hive_db and hive_table entities are 
> fetched along relationshipAttributes and related Attributes and this 
> attributes are cleared thereafter.
> Instead fetching relationshipAttributes and related Attributes in response, 
> it is will good to ignoreRelationship to reduce the size of response payload.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3844) Ignore relationship attributes while fetching entities in Import Hive bridge.

2020-07-08 Thread Nixon Rodrigues (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nixon Rodrigues updated ATLAS-3844:
---
Attachment: 
ATLAS-3844-Testcase-Fix-Ignore-relationship-attributes-while-fetc.patch

> Ignore relationship attributes while fetching entities in Import Hive bridge.
> -
>
> Key: ATLAS-3844
> URL: https://issues.apache.org/jira/browse/ATLAS-3844
> Project: Atlas
>  Issue Type: Improvement
>  Components: hive-integration
>Reporter: Nixon Rodrigues
>Assignee: Nixon Rodrigues
>Priority: Major
> Fix For: 3.0.0
>
>     Attachments: 
> 0001-ATLAS-3844-Ignore-relationship-attributes-while-fetc.patch, 
> ATLAS-3844-Testcase-Fix-Ignore-relationship-attributes-while-fetc.patch
>
>
> Currently in Import Hive bridge, the hive_db and hive_table entities are 
> fetched along relationshipAttributes and related Attributes and this 
> attributes are cleared thereafter.
> Instead fetching relationshipAttributes and related Attributes in response, 
> it is will good to ignoreRelationship to reduce the size of response payload.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (ATLAS-3844) Ignore relationship attributes while fetching entities in Import Hive bridge.

2020-07-06 Thread Nixon Rodrigues (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nixon Rodrigues resolved ATLAS-3844.

Resolution: Fixed

> Ignore relationship attributes while fetching entities in Import Hive bridge.
> -
>
> Key: ATLAS-3844
> URL: https://issues.apache.org/jira/browse/ATLAS-3844
> Project: Atlas
>  Issue Type: Improvement
>  Components: hive-integration
>Reporter: Nixon Rodrigues
>Assignee: Nixon Rodrigues
>Priority: Major
> Fix For: 3.0.0
>
>     Attachments: 
> 0001-ATLAS-3844-Ignore-relationship-attributes-while-fetc.patch
>
>
> Currently in Import Hive bridge, the hive_db and hive_table entities are 
> fetched along relationshipAttributes and related Attributes and this 
> attributes are cleared thereafter.
> Instead fetching relationshipAttributes and related Attributes in response, 
> it is will good to ignoreRelationship to reduce the size of response payload.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3844) Ignore relationship attributes while fetching entities in Import Hive bridge.

2020-07-06 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17152022#comment-17152022
 ] 

ASF subversion and git services commented on ATLAS-3844:


Commit cea851c5513cede054bc7704ac24c04cc498cd32 in atlas's branch 
refs/heads/master from Nixon Rodrigues
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=cea851c ]

ATLAS-3844 - Ignore relationship attributes while fetching entities in Import 
Hive bridge.

Change-Id: I1d0eeb478286e896af733b51fe4f7fc62c594899


> Ignore relationship attributes while fetching entities in Import Hive bridge.
> -
>
> Key: ATLAS-3844
> URL: https://issues.apache.org/jira/browse/ATLAS-3844
> Project: Atlas
>  Issue Type: Improvement
>  Components: hive-integration
>Reporter: Nixon Rodrigues
>Assignee: Nixon Rodrigues
>Priority: Major
> Fix For: 3.0.0
>
>     Attachments: 
> 0001-ATLAS-3844-Ignore-relationship-attributes-while-fetc.patch
>
>
> Currently in Import Hive bridge, the hive_db and hive_table entities are 
> fetched along relationshipAttributes and related Attributes and this 
> attributes are cleared thereafter.
> Instead fetching relationshipAttributes and related Attributes in response, 
> it is will good to ignoreRelationship to reduce the size of response payload.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3844) Ignore relationship attributes while fetching entities in Import Hive bridge.

2020-06-17 Thread Nixon Rodrigues (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nixon Rodrigues updated ATLAS-3844:
---
Attachment: 0001-ATLAS-3844-Ignore-relationship-attributes-while-fetc.patch

> Ignore relationship attributes while fetching entities in Import Hive bridge.
> -
>
> Key: ATLAS-3844
> URL: https://issues.apache.org/jira/browse/ATLAS-3844
> Project: Atlas
>  Issue Type: Improvement
>  Components: hive-integration
>Reporter: Nixon Rodrigues
>Assignee: Nixon Rodrigues
>Priority: Major
> Fix For: 3.0.0
>
>     Attachments: 
> 0001-ATLAS-3844-Ignore-relationship-attributes-while-fetc.patch
>
>
> Currently in Import Hive bridge, the hive_db and hive_table entities are 
> fetched along relationshipAttributes and related Attributes and this 
> attributes are cleared thereafter.
> Instead fetching relationshipAttributes and related Attributes in response, 
> it is will good to ignoreRelationship to reduce the size of response payload.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3844) Ignore relationship attributes while fetching entities in Import Hive bridge.

2020-06-17 Thread Nixon Rodrigues (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nixon Rodrigues updated ATLAS-3844:
---
Summary: Ignore relationship attributes while fetching entities in Import 
Hive bridge.  (was: Ignore relationship attributea while fetching entities in 
Import Hive bridge.)

> Ignore relationship attributes while fetching entities in Import Hive bridge.
> -
>
> Key: ATLAS-3844
> URL: https://issues.apache.org/jira/browse/ATLAS-3844
> Project: Atlas
>  Issue Type: Improvement
>  Components: hive-integration
>Reporter: Nixon Rodrigues
>Assignee: Nixon Rodrigues
>Priority: Major
> Fix For: 3.0.0
>
>
> Currently in Import Hive bridge, the hive_db and hive_table entities are 
> fetched along relationshipAttributes and related Attributes and this 
> attributes are cleared thereafter.
> Instead fetching relationshipAttributes and related Attributes in response, 
> it is will good to ignoreRelationship to reduce the size of response payload.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3511) Relationship attributes not forming while creating entities using a bulk entity API request

2019-11-12 Thread Rahul Kurup (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973030#comment-16973030
 ] 

Rahul Kurup commented on ATLAS-3511:


Hi, I've used the corrected json file and it seems to be working now. I'll 
close the issue.

> Relationship attributes not forming while creating entities using a bulk 
> entity API request
> ---
>
> Key: ATLAS-3511
> URL: https://issues.apache.org/jira/browse/ATLAS-3511
> Project: Atlas
>  Issue Type: Bug
>Reporter: Rahul Kurup
>Assignee: chaitali borole
>Priority: Major
> Attachments: entity_instance, entity_instancecorrected, 
> entity_typedef_1, entity_typedef_2, relationship_typedef
>
>
> Steps:
> 1.Create 2 entity types based on the JSON structure (see attached file 
> [^entity_typedef_1] and [^entity_typedef_2])  with relationship attributes as 
> described in attached file [^relationship_typedef]  through a POST request on 
> the typedef API ({color:#505050}api/atlas/v2/types/typedefs{color}).
> 2. Create entities with relationship attributes for each of the entity types 
> (as described in step 1) through a POST request on the bulk API (see attached 
> file [^entity_instance] for reference) ([^relationship_typedef])
> You will observe that the definition of the attributes and the number of 
> attributes varies for each of the entities. Hence we are not able to create 
> relationship instances using bulk REST API call.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (ATLAS-3511) Relationship attributes not forming while creating entities using a bulk entity API request

2019-11-12 Thread Rahul Kurup (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rahul Kurup resolved ATLAS-3511.

Resolution: Not A Bug

> Relationship attributes not forming while creating entities using a bulk 
> entity API request
> ---
>
> Key: ATLAS-3511
> URL: https://issues.apache.org/jira/browse/ATLAS-3511
> Project: Atlas
>  Issue Type: Bug
>Reporter: Rahul Kurup
>Assignee: chaitali borole
>Priority: Major
> Attachments: entity_instance, entity_instancecorrected, 
> entity_typedef_1, entity_typedef_2, relationship_typedef
>
>
> Steps:
> 1.Create 2 entity types based on the JSON structure (see attached file 
> [^entity_typedef_1] and [^entity_typedef_2])  with relationship attributes as 
> described in attached file [^relationship_typedef]  through a POST request on 
> the typedef API ({color:#505050}api/atlas/v2/types/typedefs{color}).
> 2. Create entities with relationship attributes for each of the entity types 
> (as described in step 1) through a POST request on the bulk API (see attached 
> file [^entity_instance] for reference) ([^relationship_typedef])
> You will observe that the definition of the attributes and the number of 
> attributes varies for each of the entities. Hence we are not able to create 
> relationship instances using bulk REST API call.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3511) Relationship attributes not forming while creating entities using a bulk entity API request

2019-11-08 Thread chaitali borole (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970044#comment-16970044
 ] 

chaitali borole commented on ATLAS-3511:


Hi,

I have attached the corrected entity instance JSON for bulk api call where 
multiple relationshipattributes  can be created.

Can you please verify from your side.

 

> Relationship attributes not forming while creating entities using a bulk 
> entity API request
> ---
>
> Key: ATLAS-3511
> URL: https://issues.apache.org/jira/browse/ATLAS-3511
> Project: Atlas
>  Issue Type: Bug
>Reporter: Rahul Kurup
>Assignee: Mayank Jain
>Priority: Major
> Attachments: entity_instance, entity_instancecorrected, 
> entity_typedef_1, entity_typedef_2, relationship_typedef
>
>
> Steps:
> 1.Create 2 entity types based on the JSON structure (see attached file 
> [^entity_typedef_1] and [^entity_typedef_2])  with relationship attributes as 
> described in attached file [^relationship_typedef]  through a POST request on 
> the typedef API ({color:#505050}api/atlas/v2/types/typedefs{color}).
> 2. Create entities with relationship attributes for each of the entity types 
> (as described in step 1) through a POST request on the bulk API (see attached 
> file [^entity_instance] for reference) ([^relationship_typedef])
> You will observe that the definition of the attributes and the number of 
> attributes varies for each of the entities. Hence we are not able to create 
> relationship instances using bulk REST API call.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Assigned] (ATLAS-3511) Relationship attributes not forming while creating entities using a bulk entity API request

2019-11-08 Thread chaitali borole (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

chaitali borole reassigned ATLAS-3511:
--

Assignee: chaitali borole  (was: Mayank Jain)

> Relationship attributes not forming while creating entities using a bulk 
> entity API request
> ---
>
> Key: ATLAS-3511
> URL: https://issues.apache.org/jira/browse/ATLAS-3511
> Project: Atlas
>  Issue Type: Bug
>Reporter: Rahul Kurup
>Assignee: chaitali borole
>Priority: Major
> Attachments: entity_instance, entity_instancecorrected, 
> entity_typedef_1, entity_typedef_2, relationship_typedef
>
>
> Steps:
> 1.Create 2 entity types based on the JSON structure (see attached file 
> [^entity_typedef_1] and [^entity_typedef_2])  with relationship attributes as 
> described in attached file [^relationship_typedef]  through a POST request on 
> the typedef API ({color:#505050}api/atlas/v2/types/typedefs{color}).
> 2. Create entities with relationship attributes for each of the entity types 
> (as described in step 1) through a POST request on the bulk API (see attached 
> file [^entity_instance] for reference) ([^relationship_typedef])
> You will observe that the definition of the attributes and the number of 
> attributes varies for each of the entities. Hence we are not able to create 
> relationship instances using bulk REST API call.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3511) Relationship attributes not forming while creating entities using a bulk entity API request

2019-11-08 Thread chaitali borole (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

chaitali borole updated ATLAS-3511:
---
Attachment: entity_instancecorrected

> Relationship attributes not forming while creating entities using a bulk 
> entity API request
> ---
>
> Key: ATLAS-3511
> URL: https://issues.apache.org/jira/browse/ATLAS-3511
> Project: Atlas
>  Issue Type: Bug
>Reporter: Rahul Kurup
>Assignee: Mayank Jain
>Priority: Major
> Attachments: entity_instance, entity_instancecorrected, 
> entity_typedef_1, entity_typedef_2, relationship_typedef
>
>
> Steps:
> 1.Create 2 entity types based on the JSON structure (see attached file 
> [^entity_typedef_1] and [^entity_typedef_2])  with relationship attributes as 
> described in attached file [^relationship_typedef]  through a POST request on 
> the typedef API ({color:#505050}api/atlas/v2/types/typedefs{color}).
> 2. Create entities with relationship attributes for each of the entity types 
> (as described in step 1) through a POST request on the bulk API (see attached 
> file [^entity_instance] for reference) ([^relationship_typedef])
> You will observe that the definition of the attributes and the number of 
> attributes varies for each of the entities. Hence we are not able to create 
> relationship instances using bulk REST API call.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Assigned] (ATLAS-3511) Relationship attributes not forming while creating entities using a bulk entity API request

2019-11-06 Thread Mayank Jain (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mayank Jain reassigned ATLAS-3511:
--

Assignee: Mayank Jain

> Relationship attributes not forming while creating entities using a bulk 
> entity API request
> ---
>
> Key: ATLAS-3511
> URL: https://issues.apache.org/jira/browse/ATLAS-3511
> Project: Atlas
>  Issue Type: Bug
>Reporter: Rahul Kurup
>Assignee: Mayank Jain
>Priority: Major
> Attachments: entity_instance, entity_typedef_1, entity_typedef_2, 
> relationship_typedef
>
>
> Steps:
> 1.Create 2 entity types based on the JSON structure (see attached file 
> [^entity_typedef_1] and [^entity_typedef_2])  with relationship attributes as 
> described in attached file [^relationship_typedef]  through a POST request on 
> the typedef API ({color:#505050}api/atlas/v2/types/typedefs{color}).
> 2. Create entities with relationship attributes for each of the entity types 
> (as described in step 1) through a POST request on the bulk API (see attached 
> file [^entity_instance] for reference) ([^relationship_typedef])
> You will observe that the definition of the attributes and the number of 
> attributes varies for each of the entities. Hence we are not able to create 
> relationship instances using bulk REST API call.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (ATLAS-3511) Relationship attributes not forming while creating entities using a bulk entity API request

2019-11-06 Thread Rahul Kurup (Jira)
Rahul Kurup created ATLAS-3511:
--

 Summary: Relationship attributes not forming while creating 
entities using a bulk entity API request
 Key: ATLAS-3511
 URL: https://issues.apache.org/jira/browse/ATLAS-3511
 Project: Atlas
  Issue Type: Bug
Reporter: Rahul Kurup
 Attachments: entity_instance, entity_typedef_1, entity_typedef_2, 
relationship_typedef

Steps:

1.Create 2 entity types based on the JSON structure (see attached file 
[^entity_typedef_1] and [^entity_typedef_2])  with relationship attributes as 
described in attached file [^relationship_typedef]  through a POST request on 
the typedef API ({color:#505050}api/atlas/v2/types/typedefs{color}).

2. Create entities with relationship attributes for each of the entity types 
(as described in step 1) through a POST request on the bulk API (see attached 
file [^entity_instance] for reference) ([^relationship_typedef])

You will observe that the definition of the attributes and the number of 
attributes varies for each of the entities. Hence we are not able to create 
relationship instances using bulk REST API call.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3492) Audit log has incorrect guid for relationship attributes

2019-10-28 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961281#comment-16961281
 ] 

ASF subversion and git services commented on ATLAS-3492:


Commit f8cb6f76cc8851848225ea35417bebdbc85ad6f7 in atlas's branch 
refs/heads/master from Madhan Neethiraj
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=f8cb6f7 ]

ATLAS-3492: updated object-id attributes in audit logs to replace 
unassigned-guids with assigned-guids (#2)


> Audit log has incorrect guid for relationship attributes
> 
>
> Key: ATLAS-3492
> URL: https://issues.apache.org/jira/browse/ATLAS-3492
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Sharmadha S
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 2.1.0, 3.0.0
>
> Attachments: ATLAS-3492.patch
>
>
> Audit log generated during entity create/update includes the entity 
> state/changes at the end of the operation. When Atlas UI renders the details 
> of an audit log, it fetches the referenced entities by their guid stored in 
> relationship attributes. This fails when these guid are unassigned ones (i.e. 
> starting with "-"). Unassigned guids should be replaced with corresponding 
> assigned guid of the entities.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3492) Audit log has incorrect guid for relationship attributes

2019-10-28 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961282#comment-16961282
 ] 

ASF subversion and git services commented on ATLAS-3492:


Commit 9659dc3c03fc65e001189ca317fe97342b0630f5 in atlas's branch 
refs/heads/branch-2.0 from Madhan Neethiraj
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=9659dc3 ]

ATLAS-3492: updated object-id attributes in audit logs to replace 
unassigned-guids with assigned-guids (#2)

(cherry picked from commit f8cb6f76cc8851848225ea35417bebdbc85ad6f7)


> Audit log has incorrect guid for relationship attributes
> 
>
> Key: ATLAS-3492
> URL: https://issues.apache.org/jira/browse/ATLAS-3492
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Sharmadha S
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 2.1.0, 3.0.0
>
> Attachments: ATLAS-3492.patch
>
>
> Audit log generated during entity create/update includes the entity 
> state/changes at the end of the operation. When Atlas UI renders the details 
> of an audit log, it fetches the referenced entities by their guid stored in 
> relationship attributes. This fails when these guid are unassigned ones (i.e. 
> starting with "-"). Unassigned guids should be replaced with corresponding 
> assigned guid of the entities.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3492) Audit log has incorrect guid for relationship attributes

2019-10-25 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959831#comment-16959831
 ] 

ASF subversion and git services commented on ATLAS-3492:


Commit e0fad53203896024ca722e67b21d2bd737de9705 in atlas's branch 
refs/heads/branch-2.0 from Madhan Neethiraj
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=e0fad53 ]

ATLAS-3492: updated object-id attributes in audit logs to replace 
unassigned-guids with assigned-guids

(cherry picked from commit f687fb7d12d5ed752b85f813fbd550e26105daeb)


> Audit log has incorrect guid for relationship attributes
> 
>
> Key: ATLAS-3492
> URL: https://issues.apache.org/jira/browse/ATLAS-3492
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Sharmadha S
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 2.1.0, 3.0.0
>
> Attachments: ATLAS-3492.patch
>
>
> Audit log generated during entity create/update includes the entity 
> state/changes at the end of the operation. When Atlas UI renders the details 
> of an audit log, it fetches the referenced entities by their guid stored in 
> relationship attributes. This fails when these guid are unassigned ones (i.e. 
> starting with "-"). Unassigned guids should be replaced with corresponding 
> assigned guid of the entities.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3492) Audit log has incorrect guid for relationship attributes

2019-10-25 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959793#comment-16959793
 ] 

ASF subversion and git services commented on ATLAS-3492:


Commit f687fb7d12d5ed752b85f813fbd550e26105daeb in atlas's branch 
refs/heads/master from Madhan Neethiraj
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=f687fb7 ]

ATLAS-3492: updated object-id attributes in audit logs to replace 
unassigned-guids with assigned-guids


> Audit log has incorrect guid for relationship attributes
> 
>
> Key: ATLAS-3492
> URL: https://issues.apache.org/jira/browse/ATLAS-3492
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Sharmadha S
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 2.1.0, 3.0.0
>
> Attachments: ATLAS-3492.patch
>
>
> Audit log generated during entity create/update includes the entity 
> state/changes at the end of the operation. When Atlas UI renders the details 
> of an audit log, it fetches the referenced entities by their guid stored in 
> relationship attributes. This fails when these guid are unassigned ones (i.e. 
> starting with "-"). Unassigned guids should be replaced with corresponding 
> assigned guid of the entities.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3492) Audit log has incorrect guid for relationship attributes

2019-10-24 Thread Madhan Neethiraj (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Madhan Neethiraj updated ATLAS-3492:

Attachment: (was: ATLAS-3492.patch)

> Audit log has incorrect guid for relationship attributes
> 
>
> Key: ATLAS-3492
> URL: https://issues.apache.org/jira/browse/ATLAS-3492
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Sharmadha S
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 2.1.0, 3.0.0
>
> Attachments: ATLAS-3492.patch
>
>
> Audit log generated during entity create/update includes the entity 
> state/changes at the end of the operation. When Atlas UI renders the details 
> of an audit log, it fetches the referenced entities by their guid stored in 
> relationship attributes. This fails when these guid are unassigned ones (i.e. 
> starting with "-"). Unassigned guids should be replaced with corresponding 
> assigned guid of the entities.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3492) Audit log has incorrect guid for relationship attributes

2019-10-24 Thread Madhan Neethiraj (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Madhan Neethiraj updated ATLAS-3492:

Attachment: ATLAS-3492.patch

> Audit log has incorrect guid for relationship attributes
> 
>
> Key: ATLAS-3492
> URL: https://issues.apache.org/jira/browse/ATLAS-3492
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Sharmadha S
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 2.1.0, 3.0.0
>
> Attachments: ATLAS-3492.patch
>
>
> Audit log generated during entity create/update includes the entity 
> state/changes at the end of the operation. When Atlas UI renders the details 
> of an audit log, it fetches the referenced entities by their guid stored in 
> relationship attributes. This fails when these guid are unassigned ones (i.e. 
> starting with "-"). Unassigned guids should be replaced with corresponding 
> assigned guid of the entities.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (ATLAS-3492) Audit log has incorrect guid for relationship attributes

2019-10-24 Thread Madhan Neethiraj (Jira)
Madhan Neethiraj created ATLAS-3492:
---

 Summary: Audit log has incorrect guid for relationship attributes
 Key: ATLAS-3492
 URL: https://issues.apache.org/jira/browse/ATLAS-3492
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Affects Versions: 2.0.0
Reporter: Madhan Neethiraj
Assignee: Madhan Neethiraj


Audit log generated during entity create/update includes the entity 
state/changes at the end of the operation. When Atlas UI renders the details of 
an audit log, it fetches the referenced entities by their guid stored in 
relationship attributes. This fails when these guid are unassigned ones (i.e. 
starting with "-"). Unassigned guids should be replaced with corresponding 
assigned guid of the entities.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3492) Audit log has incorrect guid for relationship attributes

2019-10-24 Thread Madhan Neethiraj (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Madhan Neethiraj updated ATLAS-3492:

Reporter: Sharmadha S  (was: Madhan Neethiraj)

> Audit log has incorrect guid for relationship attributes
> 
>
> Key: ATLAS-3492
> URL: https://issues.apache.org/jira/browse/ATLAS-3492
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Sharmadha S
>Assignee: Madhan Neethiraj
>Priority: Major
>
> Audit log generated during entity create/update includes the entity 
> state/changes at the end of the operation. When Atlas UI renders the details 
> of an audit log, it fetches the referenced entities by their guid stored in 
> relationship attributes. This fails when these guid are unassigned ones (i.e. 
> starting with "-"). Unassigned guids should be replaced with corresponding 
> assigned guid of the entities.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: Review Request 71632: ATLAS-3471 : Regression : UI - Relationship attributes are not displayed in Audit Details Table

2019-10-17 Thread Sarath Subramanian

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71632/#review218263
---


Ship it!




Ship It!

- Sarath Subramanian


On Oct. 17, 2019, 5:23 a.m., keval bhatt wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71632/
> ---
> 
> (Updated Oct. 17, 2019, 5:23 a.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Nixon Rodrigues, and Sarath 
> Subramanian.
> 
> 
> Bugs: ATLAS-3471
> https://issues.apache.org/jira/browse/ATLAS-3471
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Relationship attributes with legacyAttribute=True were displayed in the Audit 
> Details Table but it is not shown anymore. Example: columns, DB for an 
> hive_table entity.
> 
> 
> Diffs
> -
> 
>   dashboardv2/public/css/scss/common.scss 84afbc87a 
>   dashboardv2/public/js/templates/audit/CreateAuditTableLayoutView_tmpl.html 
> 88808d13f 
>   dashboardv2/public/js/views/audit/CreateAuditTableLayoutView.js a35eacbc1 
>   dashboardv3/public/css/scss/common.scss 00c67ea6e 
>   dashboardv3/public/css/scss/theme.scss 344e73f80 
>   dashboardv3/public/js/templates/audit/CreateAuditTableLayoutView_tmpl.html 
> 88808d13f 
>   dashboardv3/public/js/views/audit/CreateAuditTableLayoutView.js a35eacbc1 
> 
> 
> Diff: https://reviews.apache.org/r/71632/diff/1/
> 
> 
> Testing
> ---
> 
> Done one rounf of sanity test
> 
> 
> Thanks,
> 
> keval bhatt
> 
>



[jira] [Commented] (ATLAS-3471) Regression : UI - Relationship attributes are not displayed in Audit Details Table

2019-10-17 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953720#comment-16953720
 ] 

ASF subversion and git services commented on ATLAS-3471:


Commit 8654188f233e5f3acef982c52b6221b5331f6370 in atlas's branch 
refs/heads/branch-2.0 from Keval Bhatt
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=8654188 ]

ATLAS-3471: Regression : UI - Relationship attributes are not displayed in 
Audit Details Table

Signed-off-by: Sarath Subramanian 
(cherry picked from commit e04acda4868a8db9b41f6b55d33b25c66bccebe3)


> Regression : UI - Relationship attributes are not displayed in Audit Details 
> Table
> --
>
> Key: ATLAS-3471
> URL: https://issues.apache.org/jira/browse/ATLAS-3471
> Project: Atlas
>  Issue Type: Bug
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 2.1.0, 3.0.0
>
>     Attachments: ATLAS-3471.patch
>
>
> Relationship attributes with legacyAttribute=True were displayed in the Audit 
> Details Table but it is not shown anymore. Example: columns, DB for an 
> hive_table entity.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3471) Regression : UI - Relationship attributes are not displayed in Audit Details Table

2019-10-17 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953717#comment-16953717
 ] 

ASF subversion and git services commented on ATLAS-3471:


Commit e04acda4868a8db9b41f6b55d33b25c66bccebe3 in atlas's branch 
refs/heads/master from Keval Bhatt
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=e04acda ]

ATLAS-3471: Regression : UI - Relationship attributes are not displayed in 
Audit Details Table

Signed-off-by: Sarath Subramanian 


> Regression : UI - Relationship attributes are not displayed in Audit Details 
> Table
> --
>
> Key: ATLAS-3471
> URL: https://issues.apache.org/jira/browse/ATLAS-3471
> Project: Atlas
>  Issue Type: Bug
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 2.1.0, 3.0.0
>
>     Attachments: ATLAS-3471.patch
>
>
> Relationship attributes with legacyAttribute=True were displayed in the Audit 
> Details Table but it is not shown anymore. Example: columns, DB for an 
> hive_table entity.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Review Request 71632: ATLAS-3471 : Regression : UI - Relationship attributes are not displayed in Audit Details Table

2019-10-17 Thread keval bhatt

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71632/
---

Review request for atlas, Ashutosh Mestry, Nixon Rodrigues, and Sarath 
Subramanian.


Bugs: ATLAS-3471
https://issues.apache.org/jira/browse/ATLAS-3471


Repository: atlas


Description
---

Relationship attributes with legacyAttribute=True were displayed in the Audit 
Details Table but it is not shown anymore. Example: columns, DB for an 
hive_table entity.


Diffs
-

  dashboardv2/public/css/scss/common.scss 84afbc87a 
  dashboardv2/public/js/templates/audit/CreateAuditTableLayoutView_tmpl.html 
88808d13f 
  dashboardv2/public/js/views/audit/CreateAuditTableLayoutView.js a35eacbc1 
  dashboardv3/public/css/scss/common.scss 00c67ea6e 
  dashboardv3/public/css/scss/theme.scss 344e73f80 
  dashboardv3/public/js/templates/audit/CreateAuditTableLayoutView_tmpl.html 
88808d13f 
  dashboardv3/public/js/views/audit/CreateAuditTableLayoutView.js a35eacbc1 


Diff: https://reviews.apache.org/r/71632/diff/1/


Testing
---

Done one rounf of sanity test


Thanks,

keval bhatt



[jira] [Updated] (ATLAS-3471) Regression : UI - Relationship attributes are not displayed in Audit Details Table

2019-10-17 Thread Keval Bhatt (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-3471:
---
Attachment: ATLAS-3471.patch

> Regression : UI - Relationship attributes are not displayed in Audit Details 
> Table
> --
>
> Key: ATLAS-3471
> URL: https://issues.apache.org/jira/browse/ATLAS-3471
> Project: Atlas
>  Issue Type: Bug
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 2.1.0, 3.0.0
>
>     Attachments: ATLAS-3471.patch
>
>
> Relationship attributes with legacyAttribute=True were displayed in the Audit 
> Details Table but it is not shown anymore. Example: columns, DB for an 
> hive_table entity.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3471) Regression : UI - Relationship attributes are not displayed in Audit Details Table

2019-10-16 Thread Keval Bhatt (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-3471:
---
Fix Version/s: 3.0.0
   2.1.0

> Regression : UI - Relationship attributes are not displayed in Audit Details 
> Table
> --
>
> Key: ATLAS-3471
> URL: https://issues.apache.org/jira/browse/ATLAS-3471
> Project: Atlas
>  Issue Type: Bug
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 2.1.0, 3.0.0
>
>
> Relationship attributes with legacyAttribute=True were displayed in the Audit 
> Details Table but it is not shown anymore. Example: columns, DB for an 
> hive_table entity.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3471) Regression : UI - Relationship attributes are not displayed in Audit Details Table

2019-10-16 Thread Keval Bhatt (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-3471:
---
Description: Relationship attributes with legacyAttribute=True were 
displayed in the Audit Details Table but it is not shown anymore. Example: 
columns, DB for an hive_table entity.  (was: Relationship attributes  with 
legacyAttribute=True were displayed in the Audit Details Table but it is not 
shown anymore. Example : columns , db for an hive_table entity.)

> Regression : UI - Relationship attributes are not displayed in Audit Details 
> Table
> --
>
> Key: ATLAS-3471
> URL: https://issues.apache.org/jira/browse/ATLAS-3471
> Project: Atlas
>  Issue Type: Bug
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>    Priority: Major
>
> Relationship attributes with legacyAttribute=True were displayed in the Audit 
> Details Table but it is not shown anymore. Example: columns, DB for an 
> hive_table entity.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (ATLAS-3471) Regression : UI - Relationship attributes are not displayed in Audit Details Table

2019-10-16 Thread Keval Bhatt (Jira)
Keval Bhatt created ATLAS-3471:
--

 Summary: Regression : UI - Relationship attributes are not 
displayed in Audit Details Table
 Key: ATLAS-3471
 URL: https://issues.apache.org/jira/browse/ATLAS-3471
 Project: Atlas
  Issue Type: Bug
Reporter: Keval Bhatt
Assignee: Keval Bhatt


Relationship attributes  with legacyAttribute=True were displayed in the Audit 
Details Table but it is not shown anymore. Example : columns , db for an 
hive_table entity.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3139) basic search enhancement to include relationship attributes as well in the result

2019-09-25 Thread Carol Drummond (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Carol Drummond updated ATLAS-3139:
--
Labels:   (was: release-notes)

> basic search enhancement to include relationship attributes as well in the 
> result
> -
>
> Key: ATLAS-3139
> URL: https://issues.apache.org/jira/browse/ATLAS-3139
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Madhan Neethiraj
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 1.2.0, 2.0.0
>
> Attachments: ATLAS-3139.patch
>
>
> Basic-search results should include list of attributes specified in the 
> search-request. This works for attributes that are directly defined in the 
> given entity-type; if an attribute is a relationship attribute (for example: 
> attribute 'table' in type 'hive_column'), its value is not included in the 
> result.
> Request:
> {noformat}
> POST api/atlas/v2/search/basic
> { "typeName":"hive_column", "limit":2, "attributes":[ "table", "position" ]}
> {noformat}
> Response:
> {noformat}
> {
>   "queryType": "BASIC",
>   "searchParameters": {
> "typeName":   "hive_column",
> "limit":  2,
> "attributes": [ "position", "table" ]
>   }
>   "entities": [
> {
>   "guid":"464d3a2b-b1e0-4731-a924-4286b9e578ba",
>   "typeName":"hive_column",
>   "displayText": "dob",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "dob",
> "owner": "madhan",
> "position":  2,
> "qualifiedName": "testdb.testtable.dob@cl1"
>   }
> },
> {
>   "guid":"1684e785-9200-41d0-843e-e79167a4a6e0",
>   "typeName":"hive_column",
>   "displayText": "name",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "name",
> "owner": "madhan",
> "position":  1,
> "qualifiedName": "testdb.testtable.name@cl1"
>   }
> }
>   ]
> }
> {noformat}
> Expected Response:
> {noformat}
> {
>   "queryType": "BASIC",
>   "searchParameters": {
> "typeName":   "hive_column",
> "limit":  2,
> "attributes": [ "position", "table" ]
>   },
>   "entities": [
> {
>   "guid":"464d3a2b-b1e0-4731-a924-4286b9e578ba",
>   "typeName":"hive_column",
>   "displayText": "dob",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "dob",
> "owner": "madhan",
> "position":  2,
> "qualifiedName": "testdb.testtable.dob@cl1",
> "table": {
>   "guid": "3b29c9ae-d765-485d-bdba-bde1f9cc6794",
>   "typeName": "hive_table",
>   "uniqueAttributes": {
> "qualifiedName": "testdb.testtable@cl1"
>   }
> }
>   }
> },
> {
>   "guid":"1684e785-9200-41d0-843e-e79167a4a6e0",
>   "typeName":"hive_column",
>   "displayText": "name",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "name",
> "owner": "madhan",
> "position":  1,
> "qualifiedName": "testdb.testtable.name@cl1",
> "table": {
>   "guid": "3b29c9ae-d765-485d-bdba-bde1f9cc6794",
>   "typeName": "hive_table",
>   "uniqueAttributes": {
> "qualifiedName": "testdb.testtable@cl1"
>   }
> }
>   }
> }
>   ],
>   "referredEntities": {
> "3b29c9ae-d765-485d-bdba-bde1f9cc6794": {
>   "guid":"3b29c9ae-d765-485d-bdba-bde1f9cc6794",
>   "typeName":"hive_table",
>   "status":  "ACTIVE",
>   "displayText": "testtable",
>   "attributes": {
> "createTime":155523129,
> "name":  "testtable",
> "owner": "madhan",
> "qualifiedName": "testdb.testtable@cl1"
>   }
> }
>   }
> }
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3055) fix entity create/update to handle relationship attributes consistently

2019-09-25 Thread Carol Drummond (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Carol Drummond updated ATLAS-3055:
--
Labels:   (was: release-notes)

> fix entity create/update to handle relationship attributes consistently
> ---
>
> Key: ATLAS-3055
> URL: https://issues.apache.org/jira/browse/ATLAS-3055
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0, 1.1.0
>Reporter: Madhan Neethiraj
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 1.2.0, 2.0.0
>
> Attachments: ATLAS-3055.patch
>
>
> Currently an AtlasEntity can have relationship-attributes either in 
> 'attributes' or 'relationshipAttribute'. When a relationship attribute is 
> present in both, Atlas removes the attribute from 'attributes' and continues 
> processing the value in relationshipAttribute. However, if the attribute is  
> present only in 'attributes', Atlas doesn't move this value to 
> 'relationshipAttribute' - which can result in the attribute to be ignored if 
> no first-class attribute with the same name is present in the entity-def.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3103) UI : Render Schema Table from relationship attributes node in the entity API

2019-09-25 Thread Carol Drummond (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Carol Drummond updated ATLAS-3103:
--
Labels:   (was: release-notes)

> UI : Render Schema Table from relationship attributes node in the entity API
> 
>
> Key: ATLAS-3103
> URL: https://issues.apache.org/jira/browse/ATLAS-3103
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Binit Gutka
>Assignee: Binit Gutka
>Priority: Major
> Fix For: 2.0.0, trunk
>
> Attachments: ATLAS-3103.patch
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3055) fix entity create/update to handle relationship attributes consistently

2019-09-25 Thread Carol Drummond (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Carol Drummond updated ATLAS-3055:
--
Labels: release  (was: )

> fix entity create/update to handle relationship attributes consistently
> ---
>
> Key: ATLAS-3055
> URL: https://issues.apache.org/jira/browse/ATLAS-3055
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0, 1.1.0
>Reporter: Madhan Neethiraj
>Assignee: Madhan Neethiraj
>Priority: Major
>  Labels: release
> Fix For: 1.2.0, 2.0.0
>
> Attachments: ATLAS-3055.patch
>
>
> Currently an AtlasEntity can have relationship-attributes either in 
> 'attributes' or 'relationshipAttribute'. When a relationship attribute is 
> present in both, Atlas removes the attribute from 'attributes' and continues 
> processing the value in relationshipAttribute. However, if the attribute is  
> present only in 'attributes', Atlas doesn't move this value to 
> 'relationshipAttribute' - which can result in the attribute to be ignored if 
> no first-class attribute with the same name is present in the entity-def.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3055) fix entity create/update to handle relationship attributes consistently

2019-09-25 Thread Carol Drummond (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Carol Drummond updated ATLAS-3055:
--
Labels: release-notes  (was: release)

> fix entity create/update to handle relationship attributes consistently
> ---
>
> Key: ATLAS-3055
> URL: https://issues.apache.org/jira/browse/ATLAS-3055
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0, 1.1.0
>Reporter: Madhan Neethiraj
>Assignee: Madhan Neethiraj
>Priority: Major
>  Labels: release-notes
> Fix For: 1.2.0, 2.0.0
>
> Attachments: ATLAS-3055.patch
>
>
> Currently an AtlasEntity can have relationship-attributes either in 
> 'attributes' or 'relationshipAttribute'. When a relationship attribute is 
> present in both, Atlas removes the attribute from 'attributes' and continues 
> processing the value in relationshipAttribute. However, if the attribute is  
> present only in 'attributes', Atlas doesn't move this value to 
> 'relationshipAttribute' - which can result in the attribute to be ignored if 
> no first-class attribute with the same name is present in the entity-def.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3103) UI : Render Schema Table from relationship attributes node in the entity API

2019-09-25 Thread Carol Drummond (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Carol Drummond updated ATLAS-3103:
--
Labels: release-notes  (was: )

> UI : Render Schema Table from relationship attributes node in the entity API
> 
>
> Key: ATLAS-3103
> URL: https://issues.apache.org/jira/browse/ATLAS-3103
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Binit Gutka
>Assignee: Binit Gutka
>Priority: Major
>  Labels: release-notes
> Fix For: 2.0.0, trunk
>
> Attachments: ATLAS-3103.patch
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3139) basic search enhancement to include relationship attributes as well in the result

2019-09-25 Thread Carol Drummond (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Carol Drummond updated ATLAS-3139:
--
Labels: release-notes  (was: )

> basic search enhancement to include relationship attributes as well in the 
> result
> -
>
> Key: ATLAS-3139
> URL: https://issues.apache.org/jira/browse/ATLAS-3139
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Madhan Neethiraj
>Assignee: Madhan Neethiraj
>Priority: Major
>  Labels: release-notes
> Fix For: 1.2.0, 2.0.0
>
> Attachments: ATLAS-3139.patch
>
>
> Basic-search results should include list of attributes specified in the 
> search-request. This works for attributes that are directly defined in the 
> given entity-type; if an attribute is a relationship attribute (for example: 
> attribute 'table' in type 'hive_column'), its value is not included in the 
> result.
> Request:
> {noformat}
> POST api/atlas/v2/search/basic
> { "typeName":"hive_column", "limit":2, "attributes":[ "table", "position" ]}
> {noformat}
> Response:
> {noformat}
> {
>   "queryType": "BASIC",
>   "searchParameters": {
> "typeName":   "hive_column",
> "limit":  2,
> "attributes": [ "position", "table" ]
>   }
>   "entities": [
> {
>   "guid":"464d3a2b-b1e0-4731-a924-4286b9e578ba",
>   "typeName":"hive_column",
>   "displayText": "dob",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "dob",
> "owner": "madhan",
> "position":  2,
> "qualifiedName": "testdb.testtable.dob@cl1"
>   }
> },
> {
>   "guid":"1684e785-9200-41d0-843e-e79167a4a6e0",
>   "typeName":"hive_column",
>   "displayText": "name",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "name",
> "owner": "madhan",
> "position":  1,
> "qualifiedName": "testdb.testtable.name@cl1"
>   }
> }
>   ]
> }
> {noformat}
> Expected Response:
> {noformat}
> {
>   "queryType": "BASIC",
>   "searchParameters": {
> "typeName":   "hive_column",
> "limit":  2,
> "attributes": [ "position", "table" ]
>   },
>   "entities": [
> {
>   "guid":"464d3a2b-b1e0-4731-a924-4286b9e578ba",
>   "typeName":"hive_column",
>   "displayText": "dob",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "dob",
> "owner": "madhan",
> "position":  2,
> "qualifiedName": "testdb.testtable.dob@cl1",
> "table": {
>   "guid": "3b29c9ae-d765-485d-bdba-bde1f9cc6794",
>   "typeName": "hive_table",
>   "uniqueAttributes": {
> "qualifiedName": "testdb.testtable@cl1"
>   }
> }
>   }
> },
> {
>   "guid":"1684e785-9200-41d0-843e-e79167a4a6e0",
>   "typeName":"hive_column",
>   "displayText": "name",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "name",
> "owner": "madhan",
> "position":  1,
> "qualifiedName": "testdb.testtable.name@cl1",
> "table": {
>   "guid": "3b29c9ae-d765-485d-bdba-bde1f9cc6794",
>   "typeName": "hive_table",
>   "uniqueAttributes": {
> "qualifiedName": "testdb.testtable@cl1"
>   }
> }
>   }
> }
>   ],
>   "referredEntities": {
> "3b29c9ae-d765-485d-bdba-bde1f9cc6794": {
>   "guid":"3b29c9ae-d765-485d-bdba-bde1f9cc6794",
>   "typeName":"hive_table",
>   "status":  "ACTIVE",
>   "displayText": "testtable",
>   "attributes": {
> "createTime":155523129,
> "name":  "testtable",
> "owner": "madhan",
> "qualifiedName": "testdb.testtable@cl1"
>   }
> }
>   }
> }
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: Indexes for relationship attributes

2019-08-26 Thread Verdan Mahmood
Thanks Mayank,

That's really helpful. Hope to have the patch soon :)

Best,
*Verdan Mahmood*


On Mon, Aug 26, 2019 at 7:56 AM mayank jain <
mayank.j...@freestoneinfotech.com> wrote:

> Hi Verdan,
>
>
> Yes the isIndexable when set to "true" currently is not creating any
> indexes in case of relationship and currently i am working on the same and
> will let you know as soon as the patch is ready.
>
>
> Thanks and Regards,
> Mayank Jain
>
> On Fri, Aug 23, 2019 at 5:28 AM Verdan Mahmood 
> wrote:
>
> > Hello Guys,
> >
> > I can see there is a property available even for relationship attributes
> > "isIndexable", but not sure if the we are respecting that. I tried to
> make
> > it true in my entity definitions, but apparently it does not make indexes
> > on those relationships attributes.
> >
> > Do you guys have any idea what am I missing, or if that's not an option,
> is
> > there a way to create indexes on relationship attributes?
> >
> > Thanks!
> >
> > Best,
> > *Verdan Mahmood*
> >
>


Re: Indexes for relationship attributes

2019-08-25 Thread mayank jain
Hi Verdan,


Yes the isIndexable when set to "true" currently is not creating any
indexes in case of relationship and currently i am working on the same and
will let you know as soon as the patch is ready.


Thanks and Regards,
Mayank Jain

On Fri, Aug 23, 2019 at 5:28 AM Verdan Mahmood 
wrote:

> Hello Guys,
>
> I can see there is a property available even for relationship attributes
> "isIndexable", but not sure if the we are respecting that. I tried to make
> it true in my entity definitions, but apparently it does not make indexes
> on those relationships attributes.
>
> Do you guys have any idea what am I missing, or if that's not an option, is
> there a way to create indexes on relationship attributes?
>
> Thanks!
>
> Best,
> *Verdan Mahmood*
>


Indexes for relationship attributes

2019-08-22 Thread Verdan Mahmood
Hello Guys,

I can see there is a property available even for relationship attributes
"isIndexable", but not sure if the we are respecting that. I tried to make
it true in my entity definitions, but apparently it does not make indexes
on those relationships attributes.

Do you guys have any idea what am I missing, or if that's not an option, is
there a way to create indexes on relationship attributes?

Thanks!

Best,
*Verdan Mahmood*


[jira] [Created] (ATLAS-3383) Relationships : Atlas allows Relationship attributes of Atlas types.

2019-08-21 Thread Mayank Jain (Jira)
Mayank Jain created ATLAS-3383:
--

 Summary: Relationships : Atlas allows Relationship attributes of 
Atlas types.
 Key: ATLAS-3383
 URL: https://issues.apache.org/jira/browse/ATLAS-3383
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Reporter: Mayank Jain
Assignee: Mayank Jain


Creation of Relationship typedef with an attribute of type hive_table passes.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (ATLAS-3335) Update Sqoop/Storm hook to use relationship attributes

2019-07-19 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889094#comment-16889094
 ] 

ASF subversion and git services commented on ATLAS-3335:


Commit 845a2a8b5561e964bb2c24df61aa6f553969b493 in atlas's branch 
refs/heads/branch-2.0 from Mandar Ambawane
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=845a2a8 ]

ATLAS-3335 Update Sqoop/Storm hook to use relationship attributes

Signed-off-by: Sarath Subramanian 
(cherry picked from commit 74bfe9478ed26d917d5da77e02309d8b7b4299f9)


> Update Sqoop/Storm hook to use relationship attributes
> --
>
> Key: ATLAS-3335
> URL: https://issues.apache.org/jira/browse/ATLAS-3335
> Project: Atlas
>  Issue Type: Bug
>Reporter: Nixon Rodrigues
>Assignee: Mandar Ambawane
>Priority: Major
>
> Currently in Sqoop Hook object the reference attributes are added as part of 
> "attributes" and we don't leverage relationshipAttributes. This JIRA will 
> update Sqoop hook to assign all object if references using relationship 
> attributes.  



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Resolved] (ATLAS-3335) Update Sqoop/Storm hook to use relationship attributes

2019-07-19 Thread Sarath Subramanian (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian resolved ATLAS-3335.
---
Resolution: Fixed

> Update Sqoop/Storm hook to use relationship attributes
> --
>
> Key: ATLAS-3335
> URL: https://issues.apache.org/jira/browse/ATLAS-3335
> Project: Atlas
>  Issue Type: Bug
>Reporter: Nixon Rodrigues
>Assignee: Mandar Ambawane
>Priority: Major
>
> Currently in Sqoop Hook object the reference attributes are added as part of 
> "attributes" and we don't leverage relationshipAttributes. This JIRA will 
> update Sqoop hook to assign all object if references using relationship 
> attributes.  



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ATLAS-3335) Update Sqoop/Storm hook to use relationship attributes

2019-07-19 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889082#comment-16889082
 ] 

ASF subversion and git services commented on ATLAS-3335:


Commit 74bfe9478ed26d917d5da77e02309d8b7b4299f9 in atlas's branch 
refs/heads/master from Mandar Ambawane
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=74bfe94 ]

ATLAS-3335 Update Sqoop/Storm hook to use relationship attributes

Signed-off-by: Sarath Subramanian 


> Update Sqoop/Storm hook to use relationship attributes
> --
>
> Key: ATLAS-3335
> URL: https://issues.apache.org/jira/browse/ATLAS-3335
> Project: Atlas
>  Issue Type: Bug
>Reporter: Nixon Rodrigues
>Assignee: Mandar Ambawane
>Priority: Major
>
> Currently in Sqoop Hook object the reference attributes are added as part of 
> "attributes" and we don't leverage relationshipAttributes. This JIRA will 
> update Sqoop hook to assign all object if references using relationship 
> attributes.  



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


Re: Review Request 71115: ATLAS-3335 Update Sqoop/Storm hook to use relationship attributes

2019-07-19 Thread Sarath Subramanian

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71115/#review216767
---


Ship it!




Ship It!

- Sarath Subramanian


On July 18, 2019, 6:50 a.m., Mandar Ambawane wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71115/
> ---
> 
> (Updated July 18, 2019, 6:50 a.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3335
> https://issues.apache.org/jira/browse/ATLAS-3335
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> ATLAS-3335 Update Sqoop/Storm hook to use relationship attributes
> 
> 
> Diffs
> -
> 
>   
> addons/sqoop-bridge/src/main/java/org/apache/atlas/sqoop/hook/SqoopHook.java 
> 3ccd426 
>   
> addons/storm-bridge/src/main/java/org/apache/atlas/storm/hook/StormAtlasHook.java
>  517a3c3 
> 
> 
> Diff: https://reviews.apache.org/r/71115/diff/1/
> 
> 
> Testing
> ---
> 
> Executed sqoop import with mysql to hive.
> 
> pre-commit 
> https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1285/console
> 
> 
> Thanks,
> 
> Mandar Ambawane
> 
>



Re: Review Request 71115: ATLAS-3335 Update Sqoop/Storm hook to use relationship attributes

2019-07-18 Thread Nixon Rodrigues

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71115/#review216757
---


Ship it!




Precommit passed
https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1285/console

- Nixon Rodrigues


On July 18, 2019, 1:50 p.m., Mandar Ambawane wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71115/
> ---
> 
> (Updated July 18, 2019, 1:50 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3335
> https://issues.apache.org/jira/browse/ATLAS-3335
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> ATLAS-3335 Update Sqoop/Storm hook to use relationship attributes
> 
> 
> Diffs
> -
> 
>   
> addons/sqoop-bridge/src/main/java/org/apache/atlas/sqoop/hook/SqoopHook.java 
> 3ccd426 
>   
> addons/storm-bridge/src/main/java/org/apache/atlas/storm/hook/StormAtlasHook.java
>  517a3c3 
> 
> 
> Diff: https://reviews.apache.org/r/71115/diff/1/
> 
> 
> Testing
> ---
> 
> Executed sqoop import with mysql to hive.
> 
> pre-commit 
> https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1285/console
> 
> 
> Thanks,
> 
> Mandar Ambawane
> 
>



Re: Review Request 71115: ATLAS-3335 Update Sqoop/Storm hook to use relationship attributes

2019-07-18 Thread Nixon Rodrigues

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71115/#review216756
---


Ship it!




Ship It!

- Nixon Rodrigues


On July 18, 2019, 1:50 p.m., Mandar Ambawane wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71115/
> ---
> 
> (Updated July 18, 2019, 1:50 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3335
> https://issues.apache.org/jira/browse/ATLAS-3335
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> ATLAS-3335 Update Sqoop/Storm hook to use relationship attributes
> 
> 
> Diffs
> -
> 
>   
> addons/sqoop-bridge/src/main/java/org/apache/atlas/sqoop/hook/SqoopHook.java 
> 3ccd426 
>   
> addons/storm-bridge/src/main/java/org/apache/atlas/storm/hook/StormAtlasHook.java
>  517a3c3 
> 
> 
> Diff: https://reviews.apache.org/r/71115/diff/1/
> 
> 
> Testing
> ---
> 
> Executed sqoop import with mysql to hive.
> 
> pre-commit 
> https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1285/console
> 
> 
> Thanks,
> 
> Mandar Ambawane
> 
>



Review Request 71115: ATLAS-3335 Update Sqoop/Storm hook to use relationship attributes

2019-07-18 Thread Mandar Ambawane

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71115/
---

Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
and Sarath Subramanian.


Bugs: ATLAS-3335
https://issues.apache.org/jira/browse/ATLAS-3335


Repository: atlas


Description
---

ATLAS-3335 Update Sqoop/Storm hook to use relationship attributes


Diffs
-

  addons/sqoop-bridge/src/main/java/org/apache/atlas/sqoop/hook/SqoopHook.java 
3ccd426 
  
addons/storm-bridge/src/main/java/org/apache/atlas/storm/hook/StormAtlasHook.java
 517a3c3 


Diff: https://reviews.apache.org/r/71115/diff/1/


Testing
---

Executed sqoop import with mysql to hive.

pre-commit https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1285/console


Thanks,

Mandar Ambawane



[jira] [Updated] (ATLAS-3335) Update Sqoop/Storm hook to use relationship attributes

2019-07-15 Thread Mandar Ambawane (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mandar Ambawane updated ATLAS-3335:
---
Summary: Update Sqoop/Storm hook to use relationship attributes  (was: 
Update Sqoop hook to use relationship attributes)

> Update Sqoop/Storm hook to use relationship attributes
> --
>
> Key: ATLAS-3335
> URL: https://issues.apache.org/jira/browse/ATLAS-3335
> Project: Atlas
>  Issue Type: Bug
>Reporter: Nixon Rodrigues
>Assignee: Mandar Ambawane
>Priority: Major
>
> Currently in Sqoop Hook object the reference attributes are added as part of 
> "attributes" and we don't leverage relationshipAttributes. This JIRA will 
> update Sqoop hook to assign all object if references using relationship 
> attributes.  



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Created] (ATLAS-3335) Update Sqoop hook to use relationship attributes

2019-07-15 Thread Nixon Rodrigues (JIRA)
Nixon Rodrigues created ATLAS-3335:
--

 Summary: Update Sqoop hook to use relationship attributes
 Key: ATLAS-3335
 URL: https://issues.apache.org/jira/browse/ATLAS-3335
 Project: Atlas
  Issue Type: Bug
Reporter: Nixon Rodrigues
Assignee: Mandar Ambawane


Currently in Sqoop Hook object the reference attributes are added as part of 
"attributes" and we don't leverage relationshipAttributes. This JIRA will 
update Sqoop hook to assign all object if references using relationship 
attributes.  



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Resolved] (ATLAS-3325) Update hive-bridge to use relationship attributes

2019-07-13 Thread Madhan Neethiraj (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Madhan Neethiraj resolved ATLAS-3325.
-
   Resolution: Fixed
Fix Version/s: 3.0.0
   2.1.0

> Update hive-bridge to use relationship attributes
> -
>
> Key: ATLAS-3325
> URL: https://issues.apache.org/jira/browse/ATLAS-3325
> Project: Atlas
>  Issue Type: Bug
>Reporter: Nixon Rodrigues
>Assignee: Mandar Ambawane
>Priority: Major
> Fix For: 2.1.0, 3.0.0
>
> Attachments: ATLAS-3325.patch
>
>
> Update hive bridge code to use relationship attributes instead normal 
> attribute which defined in entity type 



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ATLAS-3325) Update hive-bridge to use relationship attributes

2019-07-13 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884423#comment-16884423
 ] 

ASF subversion and git services commented on ATLAS-3325:


Commit 549dee6b6a488da4e5aa75b0927855889e1eb59f in atlas's branch 
refs/heads/master from Mandar Ambawane
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=549dee6 ]

ATLAS-3325: update hive-bridge to use relationship attributes

Signed-off-by: Madhan Neethiraj 


> Update hive-bridge to use relationship attributes
> -
>
> Key: ATLAS-3325
> URL: https://issues.apache.org/jira/browse/ATLAS-3325
> Project: Atlas
>  Issue Type: Bug
>Reporter: Nixon Rodrigues
>Assignee: Mandar Ambawane
>Priority: Major
> Attachments: ATLAS-3325.patch
>
>
> Update hive bridge code to use relationship attributes instead normal 
> attribute which defined in entity type 



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (ATLAS-3325) Update hive-bridge to use relationship attributes

2019-07-13 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884424#comment-16884424
 ] 

ASF subversion and git services commented on ATLAS-3325:


Commit 6ae4d8f6cd5b3cb28b11378cafb6a7ec1243ce5d in atlas's branch 
refs/heads/branch-2.0 from Mandar Ambawane
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=6ae4d8f ]

ATLAS-3325: update hive-bridge to use relationship attributes

Signed-off-by: Madhan Neethiraj 
(cherry picked from commit 549dee6b6a488da4e5aa75b0927855889e1eb59f)


> Update hive-bridge to use relationship attributes
> -
>
> Key: ATLAS-3325
> URL: https://issues.apache.org/jira/browse/ATLAS-3325
> Project: Atlas
>  Issue Type: Bug
>Reporter: Nixon Rodrigues
>Assignee: Mandar Ambawane
>Priority: Major
> Attachments: ATLAS-3325.patch
>
>
> Update hive bridge code to use relationship attributes instead normal 
> attribute which defined in entity type 



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


Re: Review Request 71056: ATLAS-3325 Update hive-bridge to use relationship attributes

2019-07-13 Thread Madhan Neethiraj

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71056/#review216595
---


Ship it!




Ship It!

- Madhan Neethiraj


On July 13, 2019, 9:32 a.m., Mandar Ambawane wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71056/
> ---
> 
> (Updated July 13, 2019, 9:32 a.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3325
> https://issues.apache.org/jira/browse/ATLAS-3325
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> ATLAS-3325 Update hive-bridge to use relationship attributes
> 
> 
> Diffs
> -
> 
>   
> addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
>  049112b 
>   
> addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java
>  98b4d4f 
>   
> addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateHiveProcess.java
>  91e063e 
> 
> 
> Diff: https://reviews.apache.org/r/71056/diff/4/
> 
> 
> Testing
> ---
> 
> Steps done for updating 
> 1. Disable hive-hook from Ambari.
> 2. Create table in hive.
> 3. Check whether table entity is created in Atlas side or not.(It should not 
> be created) 
> 4. Run script import-hive.sh
> 5. Check again in Atlas side, hive table and DB entities are created with 
> relationship. 
> 
> https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1255/console
> 
> 
> Thanks,
> 
> Mandar Ambawane
> 
>



Re: Review Request 71056: ATLAS-3325 Update hive-bridge to use relationship attributes

2019-07-13 Thread Mandar Ambawane

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71056/
---

(Updated July 13, 2019, 9:32 a.m.)


Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
and Sarath Subramanian.


Changes
---

renamed method toStroageDescEntity => toStorageDescEntity


Bugs: ATLAS-3325
https://issues.apache.org/jira/browse/ATLAS-3325


Repository: atlas


Description
---

ATLAS-3325 Update hive-bridge to use relationship attributes


Diffs (updated)
-

  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
 049112b 
  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java
 98b4d4f 
  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateHiveProcess.java
 91e063e 


Diff: https://reviews.apache.org/r/71056/diff/4/

Changes: https://reviews.apache.org/r/71056/diff/3-4/


Testing
---

Steps done for updating 
1. Disable hive-hook from Ambari.
2. Create table in hive.
3. Check whether table entity is created in Atlas side or not.(It should not be 
created) 
4. Run script import-hive.sh
5. Check again in Atlas side, hive table and DB entities are created with 
relationship. 

https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1255/console


Thanks,

Mandar Ambawane



Re: Review Request 71056: ATLAS-3325 Update hive-bridge to use relationship attributes

2019-07-13 Thread Mandar Ambawane

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71056/
---

(Updated July 13, 2019, 6:16 a.m.)


Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
and Sarath Subramanian.


Changes
---

Rebase the patch and did changes as per review comments


Bugs: ATLAS-3325
https://issues.apache.org/jira/browse/ATLAS-3325


Repository: atlas


Description
---

ATLAS-3325 Update hive-bridge to use relationship attributes


Diffs (updated)
-

  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
 049112b 
  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java
 98b4d4f 
  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateHiveProcess.java
 91e063e 


Diff: https://reviews.apache.org/r/71056/diff/3/

Changes: https://reviews.apache.org/r/71056/diff/2-3/


Testing
---

Steps done for updating 
1. Disable hive-hook from Ambari.
2. Create table in hive.
3. Check whether table entity is created in Atlas side or not.(It should not be 
created) 
4. Run script import-hive.sh
5. Check again in Atlas side, hive table and DB entities are created with 
relationship. 

https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1255/console


Thanks,

Mandar Ambawane



Re: Review Request 71056: ATLAS-3325 Update hive-bridge to use relationship attributes

2019-07-12 Thread Sarath Subramanian


> On July 12, 2019, 4:49 p.m., Sarath Subramanian wrote:
> >

rebase the patch, it doesn't apply cleanly.


- Sarath


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71056/#review216576
---


On July 12, 2019, 3:55 a.m., Mandar Ambawane wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71056/
> ---
> 
> (Updated July 12, 2019, 3:55 a.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3325
> https://issues.apache.org/jira/browse/ATLAS-3325
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> ATLAS-3325 Update hive-bridge to use relationship attributes
> 
> 
> Diffs
> -
> 
>   
> addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
>  5f8f846 
>   
> addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java
>  b3663da 
> 
> 
> Diff: https://reviews.apache.org/r/71056/diff/2/
> 
> 
> Testing
> ---
> 
> Steps done for updating 
> 1. Disable hive-hook from Ambari.
> 2. Create table in hive.
> 3. Check whether table entity is created in Atlas side or not.(It should not 
> be created) 
> 4. Run script import-hive.sh
> 5. Check again in Atlas side, hive table and DB entities are created with 
> relationship. 
> 
> https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1255/console
> 
> 
> Thanks,
> 
> Mandar Ambawane
> 
>



Re: Review Request 71056: ATLAS-3325 Update hive-bridge to use relationship attributes

2019-07-12 Thread Sarath Subramanian

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71056/#review216576
---


Fix it, then Ship it!





addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
Lines 41 (patched)
<https://reviews.apache.org/r/71056/#comment303784>

nit: unused import; consider removing it.



addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
Line 630 (original), 631 (patched)
<https://reviews.apache.org/r/71056/#comment303786>

toStroageDescEntity => toStorageDescEntity



addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java
Line 211 (original), 211 (patched)
<https://reviews.apache.org/r/71056/#comment303783>

refactor this method to:

return getObjectIdWithRelationshipType(getObjectId(entity), 
relationshipType);



addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java
Lines 214 (patched)
<https://reviews.apache.org/r/71056/#comment303781>

getObjectIdWithRelationshipType => getAtlasRelatedObjectId; same for line 
209

relationShipType => relationshipType; same for line# 209


- Sarath Subramanian


On July 12, 2019, 3:55 a.m., Mandar Ambawane wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71056/
> ---
> 
> (Updated July 12, 2019, 3:55 a.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3325
> https://issues.apache.org/jira/browse/ATLAS-3325
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> ATLAS-3325 Update hive-bridge to use relationship attributes
> 
> 
> Diffs
> -
> 
>   
> addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
>  5f8f846 
>   
> addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java
>  b3663da 
> 
> 
> Diff: https://reviews.apache.org/r/71056/diff/2/
> 
> 
> Testing
> ---
> 
> Steps done for updating 
> 1. Disable hive-hook from Ambari.
> 2. Create table in hive.
> 3. Check whether table entity is created in Atlas side or not.(It should not 
> be created) 
> 4. Run script import-hive.sh
> 5. Check again in Atlas side, hive table and DB entities are created with 
> relationship. 
> 
> https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1255/console
> 
> 
> Thanks,
> 
> Mandar Ambawane
> 
>



Re: Review Request 71056: ATLAS-3325 Update hive-bridge to use relationship attributes

2019-07-12 Thread Mandar Ambawane

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71056/
---

(Updated July 12, 2019, 10:55 a.m.)


Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
and Sarath Subramanian.


Changes
---

Changes done according to review comments


Bugs: ATLAS-3325
https://issues.apache.org/jira/browse/ATLAS-3325


Repository: atlas


Description
---

ATLAS-3325 Update hive-bridge to use relationship attributes


Diffs (updated)
-

  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
 5f8f846 
  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java
 b3663da 


Diff: https://reviews.apache.org/r/71056/diff/2/

Changes: https://reviews.apache.org/r/71056/diff/1-2/


Testing
---

Steps done for updating 
1. Disable hive-hook from Ambari.
2. Create table in hive.
3. Check whether table entity is created in Atlas side or not.(It should not be 
created) 
4. Run script import-hive.sh
5. Check again in Atlas side, hive table and DB entities are created with 
relationship. 

https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1255/console


Thanks,

Mandar Ambawane



Re: Review Request 71056: ATLAS-3325 Update hive-bridge to use relationship attributes

2019-07-11 Thread Madhan Neethiraj

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71056/#review216542
---




addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
Lines 357 (patched)
<https://reviews.apache.org/r/71056/#comment303753>

Instead of using pathInstList and tableInstList, consider rewriting #355 - 
#360 as below:

 processInst.setRelationshipAttribute(ATTRIBUTE_INPUTS, 
Collections.singletonList(getObjectIdWithRelationshipType(pathInst, 
RELATIONSHIP_DATASET_PROCESS_INPUTS)));
 processInst.setRelationshipAttribute(ATTRIBUTE_OUTPUTS, 
Collections.singletonList(getObjectIdWithRelationshipType(tableInst, 
RELATIONSHIP_PROCESS_DATASET_OUTPUTS)));



addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
Lines 587 (patched)
<https://reviews.apache.org/r/71056/#comment303754>

for simpler reading, consider replacing #586, #587 with:
  tableEntity.setRelationshipAttribute(ATTRIBUTE_DB, 
getObjectIdWithRelationshipType(database, RELATIONSHIP_HIVE_TABLE_DB));
  
Same for #639 and #697


- Madhan Neethiraj


On July 11, 2019, 1:24 p.m., Mandar Ambawane wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71056/
> ---
> 
> (Updated July 11, 2019, 1:24 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3325
> https://issues.apache.org/jira/browse/ATLAS-3325
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> ATLAS-3325 Update hive-bridge to use relationship attributes
> 
> 
> Diffs
> -
> 
>   
> addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
>  5f8f846 
> 
> 
> Diff: https://reviews.apache.org/r/71056/diff/1/
> 
> 
> Testing
> ---
> 
> Steps done for updating 
> 1. Disable hive-hook from Ambari.
> 2. Create table in hive.
> 3. Check whether table entity is created in Atlas side or not.(It should not 
> be created) 
> 4. Run script import-hive.sh
> 5. Check again in Atlas side, hive table and DB entities are created with 
> relationship. 
> 
> https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1255/console
> 
> 
> Thanks,
> 
> Mandar Ambawane
> 
>



Re: Review Request 71056: ATLAS-3325 Update hive-bridge to use relationship attributes

2019-07-11 Thread Mandar Ambawane

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71056/
---

(Updated July 11, 2019, 1:24 p.m.)


Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, 
and Sarath Subramanian.


Bugs: ATLAS-3325
https://issues.apache.org/jira/browse/ATLAS-3325


Repository: atlas


Description
---

ATLAS-3325 Update hive-bridge to use relationship attributes


Diffs
-

  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
 5f8f846 


Diff: https://reviews.apache.org/r/71056/diff/1/


Testing (updated)
---

Steps done for updating 
1. Disable hive-hook from Ambari.
2. Create table in hive.
3. Check whether table entity is created in Atlas side or not.(It should not be 
created) 
4. Run script import-hbase.sh
5. Check again in Atlas side, hive table and DB entities are created with 
relationship. 

https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1255/console


Thanks,

Mandar Ambawane



[jira] [Updated] (ATLAS-3325) Update hive-bridge to use relationship attributes

2019-07-10 Thread Mandar Ambawane (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mandar Ambawane updated ATLAS-3325:
---
Attachment: ATLAS-3325.patch

> Update hive-bridge to use relationship attributes
> -
>
> Key: ATLAS-3325
> URL: https://issues.apache.org/jira/browse/ATLAS-3325
> Project: Atlas
>  Issue Type: Bug
>Reporter: Nixon Rodrigues
>Assignee: Mandar Ambawane
>Priority: Major
> Attachments: ATLAS-3325.patch
>
>
> Update hive bridge code to use relationship attributes instead normal 
> attribute which defined in entity type 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ATLAS-3325) Update hive-bridge to use relationship attributes

2019-07-10 Thread Nixon Rodrigues (JIRA)
Nixon Rodrigues created ATLAS-3325:
--

 Summary: Update hive-bridge to use relationship attributes
 Key: ATLAS-3325
 URL: https://issues.apache.org/jira/browse/ATLAS-3325
 Project: Atlas
  Issue Type: Bug
Reporter: Nixon Rodrigues
Assignee: Mandar Ambawane


Update hive bridge code to use relationship attributes instead normal attribute 
which defined in entity type 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Optional Relationship Attributes

2019-07-03 Thread Verdan Mahmood
A quick question, does any one know if and how can I add OPTIONAL custom
relationshipAttributes? Apparently "isOptional" flag is not doing anything.

Thanks!

Best,
*Verdan Mahmood*
(+31) 655 576 560


[jira] [Assigned] (ATLAS-3287) Populate Dynamic Relationship Attributes

2019-06-17 Thread Merryle Wang (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Merryle Wang reassigned ATLAS-3287:
---

Assignee: Merryle Wang

> Populate Dynamic Relationship Attributes
> 
>
> Key: ATLAS-3287
> URL: https://issues.apache.org/jira/browse/ATLAS-3287
> Project: Atlas
>  Issue Type: Sub-task
>Reporter: Aadarsh Jajodia
>Assignee: Merryle Wang
>Priority: Major
>   Original Estimate: 336h
>  Remaining Estimate: 336h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-3287) Populate Dynamic Relationship Attributes

2019-06-17 Thread Merryle Wang (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Merryle Wang updated ATLAS-3287:

Remaining Estimate: 336h
 Original Estimate: 336h

> Populate Dynamic Relationship Attributes
> 
>
> Key: ATLAS-3287
> URL: https://issues.apache.org/jira/browse/ATLAS-3287
> Project: Atlas
>  Issue Type: Sub-task
>Reporter: Aadarsh Jajodia
>Priority: Major
>   Original Estimate: 336h
>  Remaining Estimate: 336h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ATLAS-3287) Populate Dynamic Relationship Attributes

2019-06-17 Thread Aadarsh Jajodia (JIRA)
Aadarsh Jajodia created ATLAS-3287:
--

 Summary: Populate Dynamic Relationship Attributes
 Key: ATLAS-3287
 URL: https://issues.apache.org/jira/browse/ATLAS-3287
 Project: Atlas
  Issue Type: Sub-task
Reporter: Aadarsh Jajodia






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Re: Relationship Attributes linked with qualifiedName

2019-06-14 Thread Verdan Mahmood
Does anyone has experience with this, or any workaround? Or how can this be
solved in Atlas?

Best,
*Verdan Mahmood*
(+31) 655 576 560

On Wed, Jun 12, 2019 at 11:35 AM Verdan Mahmood 
wrote:

> Hello guys,
>
> As it is really common to delete and re-create hive tables, this removes
> the entity in atlas and creates a new one. This results in all custom
> attributes to be removed also, along with all custom (manually added)
> relationshipAttributes to be lost as well.
>
> Was just wondering, if we do have a workaround for this? Can we make
> relations in an entity based on their qualifiedName instead of GUIDs?
>
> Best,
> *Verdan Mahmood*
> (+31) 655 576 560
>


Relationship Attributes linked with qualifiedName

2019-06-12 Thread Verdan Mahmood
Hello guys,

As it is really common to delete and re-create hive tables, this removes
the entity in atlas and creates a new one. This results in all custom
attributes to be removed also, along with all custom (manually added)
relationshipAttributes to be lost as well.

Was just wondering, if we do have a workaround for this? Can we make
relations in an entity based on their qualifiedName instead of GUIDs?

Best,
*Verdan Mahmood*
(+31) 655 576 560


[jira] [Updated] (ATLAS-3103) UI : Render Schema Table from relationship attributes node in the entity API

2019-04-19 Thread Sarath Subramanian (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-3103:
--
Fix Version/s: trunk
   2.0.0

> UI : Render Schema Table from relationship attributes node in the entity API
> 
>
> Key: ATLAS-3103
> URL: https://issues.apache.org/jira/browse/ATLAS-3103
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Binit Gutka
>Assignee: Binit Gutka
>Priority: Major
> Fix For: 2.0.0, trunk
>
> Attachments: ATLAS-3103.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (ATLAS-3139) basic search enhancement to include relationship attributes as well in the result

2019-04-15 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818309#comment-16818309
 ] 

ASF subversion and git services commented on ATLAS-3139:


Commit 2caf30ae21556bd0ae3ea0b791344f50defe460d in atlas's branch 
refs/heads/branch-1.0 from Madhan Neethiraj
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=2caf30a ]

ATLAS-3139: updated basic search to include relationship attributes as well in 
the result

(cherry picked from commit 9c9eed274532391ceb57a0e17d0b2f8611530f8a)


> basic search enhancement to include relationship attributes as well in the 
> result
> -
>
> Key: ATLAS-3139
> URL: https://issues.apache.org/jira/browse/ATLAS-3139
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Madhan Neethiraj
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 1.2.0, 2.0.0
>
> Attachments: ATLAS-3139.patch
>
>
> Basic-search results should include list of attributes specified in the 
> search-request. This works for attributes that are directly defined in the 
> given entity-type; if an attribute is a relationship attribute (for example: 
> attribute 'table' in type 'hive_column'), its value is not included in the 
> result.
> Request:
> {noformat}
> POST api/atlas/v2/search/basic
> { "typeName":"hive_column", "limit":2, "attributes":[ "table", "position" ]}
> {noformat}
> Response:
> {noformat}
> {
>   "queryType": "BASIC",
>   "searchParameters": {
> "typeName":   "hive_column",
> "limit":  2,
> "attributes": [ "position", "table" ]
>   }
>   "entities": [
> {
>   "guid":"464d3a2b-b1e0-4731-a924-4286b9e578ba",
>   "typeName":"hive_column",
>   "displayText": "dob",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "dob",
> "owner": "madhan",
> "position":  2,
> "qualifiedName": "testdb.testtable.dob@cl1"
>   }
> },
> {
>   "guid":"1684e785-9200-41d0-843e-e79167a4a6e0",
>   "typeName":"hive_column",
>   "displayText": "name",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "name",
> "owner": "madhan",
> "position":  1,
> "qualifiedName": "testdb.testtable.name@cl1"
>   }
> }
>   ]
> }
> {noformat}
> Expected Response:
> {noformat}
> {
>   "queryType": "BASIC",
>   "searchParameters": {
> "typeName":   "hive_column",
> "limit":  2,
> "attributes": [ "position", "table" ]
>   },
>   "entities": [
> {
>   "guid":"464d3a2b-b1e0-4731-a924-4286b9e578ba",
>   "typeName":"hive_column",
>   "displayText": "dob",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "dob",
> "owner": "madhan",
> "position":  2,
> "qualifiedName": "testdb.testtable.dob@cl1",
> "table": {
>   "guid": "3b29c9ae-d765-485d-bdba-bde1f9cc6794",
>   "typeName": "hive_table",
>   "uniqueAttributes": {
> "qualifiedName": "testdb.testtable@cl1"
>   }
> }
>   }
> },
> {
>   "guid":"1684e785-9200-41d0-843e-e79167a4a6e0",
>   "typeName":"hive_column",
>   "displayText": "name",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "name",
> "owner": "madhan",
> "position":  1,
> "qualifiedName": "testdb.testtable.name@cl1",
> "table": {
>   "guid": "3b29c9ae-d765-485d-bdba-bde1f9cc6794",
>   "typeName": "hive_table",
>   "uniqueAttributes": {
> "qualifiedName": "testdb.testtable@cl1"
>   }
> }
>   }
> }
>   ],
>   "referredEntities": {
> "3b29c9ae-d765-485d-bdba-bde1f9cc6794": {
>   "guid":"3b29c9ae-d765-485d-bdba-bde1f9cc6794",
>   "typeName":"hive_table",
>   "status":  "ACTIVE",
>   "displayText": "testtable",
>   "attributes": {
> "createTime":155523129,
> "name":  "testtable",
> "owner": "madhan",
> "qualifiedName": "testdb.testtable@cl1"
>   }
> }
>   }
> }
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (ATLAS-3139) basic search enhancement to include relationship attributes as well in the result

2019-04-15 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818293#comment-16818293
 ] 

ASF subversion and git services commented on ATLAS-3139:


Commit 02b2b02822da5e5b342d9c181eebb09e407cba50 in atlas's branch 
refs/heads/branch-2.0 from Madhan Neethiraj
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=02b2b02 ]

ATLAS-3139: updated basic search to include relationship attributes as well in 
the result

(cherry picked from commit 9c9eed274532391ceb57a0e17d0b2f8611530f8a)


> basic search enhancement to include relationship attributes as well in the 
> result
> -
>
> Key: ATLAS-3139
> URL: https://issues.apache.org/jira/browse/ATLAS-3139
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Madhan Neethiraj
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 1.2.0, 2.0.0
>
> Attachments: ATLAS-3139.patch
>
>
> Basic-search results should include list of attributes specified in the 
> search-request. This works for attributes that are directly defined in the 
> given entity-type; if an attribute is a relationship attribute (for example: 
> attribute 'table' in type 'hive_column'), its value is not included in the 
> result.
> Request:
> {noformat}
> POST api/atlas/v2/search/basic
> { "typeName":"hive_column", "limit":2, "attributes":[ "table", "position" ]}
> {noformat}
> Response:
> {noformat}
> {
>   "queryType": "BASIC",
>   "searchParameters": {
> "typeName":   "hive_column",
> "limit":  2,
> "attributes": [ "position", "table" ]
>   }
>   "entities": [
> {
>   "guid":"464d3a2b-b1e0-4731-a924-4286b9e578ba",
>   "typeName":"hive_column",
>   "displayText": "dob",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "dob",
> "owner": "madhan",
> "position":  2,
> "qualifiedName": "testdb.testtable.dob@cl1"
>   }
> },
> {
>   "guid":"1684e785-9200-41d0-843e-e79167a4a6e0",
>   "typeName":"hive_column",
>   "displayText": "name",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "name",
> "owner": "madhan",
> "position":  1,
> "qualifiedName": "testdb.testtable.name@cl1"
>   }
> }
>   ]
> }
> {noformat}
> Expected Response:
> {noformat}
> {
>   "queryType": "BASIC",
>   "searchParameters": {
> "typeName":   "hive_column",
> "limit":  2,
> "attributes": [ "position", "table" ]
>   },
>   "entities": [
> {
>   "guid":"464d3a2b-b1e0-4731-a924-4286b9e578ba",
>   "typeName":"hive_column",
>   "displayText": "dob",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "dob",
> "owner": "madhan",
> "position":  2,
> "qualifiedName": "testdb.testtable.dob@cl1",
> "table": {
>   "guid": "3b29c9ae-d765-485d-bdba-bde1f9cc6794",
>   "typeName": "hive_table",
>   "uniqueAttributes": {
> "qualifiedName": "testdb.testtable@cl1"
>   }
> }
>   }
> },
> {
>   "guid":"1684e785-9200-41d0-843e-e79167a4a6e0",
>   "typeName":"hive_column",
>   "displayText": "name",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "name",
> "owner": "madhan",
> "position":  1,
> "qualifiedName": "testdb.testtable.name@cl1",
> "table": {
>   "guid": "3b29c9ae-d765-485d-bdba-bde1f9cc6794",
>   "typeName": "hive_table",
>   "uniqueAttributes": {
> "qualifiedName": "testdb.testtable@cl1"
>   }
> }
>   }
> }
>   ],
>   "referredEntities": {
> "3b29c9ae-d765-485d-bdba-bde1f9cc6794": {
>   "guid":"3b29c9ae-d765-485d-bdba-bde1f9cc6794",
>   "typeName":"hive_table",
>   "status":  "ACTIVE",
>   "displayText": "testtable",
>   "attributes": {
> "createTime":155523129,
> "name":  "testtable",
> "owner": "madhan",
> "qualifiedName": "testdb.testtable@cl1"
>   }
> }
>   }
> }
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (ATLAS-3139) basic search enhancement to include relationship attributes as well in the result

2019-04-15 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818274#comment-16818274
 ] 

ASF subversion and git services commented on ATLAS-3139:


Commit 9c9eed274532391ceb57a0e17d0b2f8611530f8a in atlas's branch 
refs/heads/master from Madhan Neethiraj
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=9c9eed2 ]

ATLAS-3139: updated basic search to include relationship attributes as well in 
the result


> basic search enhancement to include relationship attributes as well in the 
> result
> -
>
> Key: ATLAS-3139
> URL: https://issues.apache.org/jira/browse/ATLAS-3139
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Madhan Neethiraj
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 1.2.0, 2.0.0
>
> Attachments: ATLAS-3139.patch
>
>
> Basic-search results should include list of attributes specified in the 
> search-request. This works for attributes that are directly defined in the 
> given entity-type; if an attribute is a relationship attribute (for example: 
> attribute 'table' in type 'hive_column'), its value is not included in the 
> result.
> Request:
> {noformat}
> POST api/atlas/v2/search/basic
> { "typeName":"hive_column", "limit":2, "attributes":[ "table", "position" ]}
> {noformat}
> Response:
> {noformat}
> {
>   "queryType": "BASIC",
>   "searchParameters": {
> "typeName":   "hive_column",
> "limit":  2,
> "attributes": [ "position", "table" ]
>   }
>   "entities": [
> {
>   "guid":"464d3a2b-b1e0-4731-a924-4286b9e578ba",
>   "typeName":"hive_column",
>   "displayText": "dob",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "dob",
> "owner": "madhan",
> "position":  2,
> "qualifiedName": "testdb.testtable.dob@cl1"
>   }
> },
> {
>   "guid":"1684e785-9200-41d0-843e-e79167a4a6e0",
>   "typeName":"hive_column",
>   "displayText": "name",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "name",
> "owner": "madhan",
> "position":  1,
> "qualifiedName": "testdb.testtable.name@cl1"
>   }
> }
>   ]
> }
> {noformat}
> Expected Response:
> {noformat}
> {
>   "queryType": "BASIC",
>   "searchParameters": {
> "typeName":   "hive_column",
> "limit":  2,
> "attributes": [ "position", "table" ]
>   },
>   "entities": [
> {
>   "guid":"464d3a2b-b1e0-4731-a924-4286b9e578ba",
>   "typeName":"hive_column",
>   "displayText": "dob",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "dob",
> "owner": "madhan",
> "position":  2,
> "qualifiedName": "testdb.testtable.dob@cl1",
> "table": {
>   "guid": "3b29c9ae-d765-485d-bdba-bde1f9cc6794",
>   "typeName": "hive_table",
>   "uniqueAttributes": {
> "qualifiedName": "testdb.testtable@cl1"
>   }
> }
>   }
> },
> {
>   "guid":"1684e785-9200-41d0-843e-e79167a4a6e0",
>   "typeName":"hive_column",
>   "displayText": "name",
>   "status":  "ACTIVE",
>   "attributes": {
> "name":  "name",
> "owner": "madhan",
> "position":  1,
> "qualifiedName": "testdb.testtable.name@cl1",
> "table": {
>   "guid": "3b29c9ae-d765-485d-bdba-bde1f9cc6794",
>   "typeName": "hive_table",
>   "uniqueAttributes": {
> "qualifiedName": "testdb.testtable@cl1"
>   }
> }
>   }
> }
>   ],
>   "referredEntities": {
> "3b29c9ae-d765-485d-bdba-bde1f9cc6794": {
>   "guid":"3b29c9ae-d765-485d-bdba-bde1f9cc6794",
>   "typeName":"hive_table",
>   "status":  "ACTIVE",
>   "displayText": "testtable",
>   "attributes": {
> "createTime":155523129,
> "name":  "testtable",
> "owner": "madhan",
> "qualifiedName": "testdb.testtable@cl1"
>   }
> }
>   }
> }
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Re: Review Request 70475: ATLAS-3139: updated basic search to include relationship attributes as well in the result

2019-04-15 Thread keval bhatt

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/70475/#review214665
---


Ship it!




Ship It!

- keval bhatt


On April 15, 2019, 7:01 a.m., Madhan Neethiraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/70475/
> ---
> 
> (Updated April 15, 2019, 7:01 a.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, keval bhatt, Kapildeo Nayak, Mehul 
> Parikh, Nikhil Bonte, Nixon Rodrigues, and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3139
> https://issues.apache.org/jira/browse/ATLAS-3139
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> updated basic-search implementation to look for relationship-attributes when 
> a specified attribute is not directly defined in the entity-type being 
> searched
> 
> 
> Diffs
> -
> 
>   intg/src/main/java/org/apache/atlas/type/AtlasStructType.java 31953bdd1 
>   
> repository/src/main/java/org/apache/atlas/discovery/EntityDiscoveryService.java
>  19f81d357 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphRetriever.java
>  5aa6c8f0e 
> 
> 
> Diff: https://reviews.apache.org/r/70475/diff/1/
> 
> 
> Testing
> ---
> 
> - verified that basic-search results include specified attributes, both 
> directly defined and relationship-attributes.
> - pre-commit tests run 
> https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1033/
> 
> 
> Thanks,
> 
> Madhan Neethiraj
> 
>



Review Request 70475: ATLAS-3139: updated basic search to include relationship attributes as well in the result

2019-04-15 Thread Madhan Neethiraj

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/70475/
---

Review request for atlas, Ashutosh Mestry, keval bhatt, Kapildeo Nayak, Mehul 
Parikh, Nikhil Bonte, Nixon Rodrigues, and Sarath Subramanian.


Bugs: ATLAS-3139
https://issues.apache.org/jira/browse/ATLAS-3139


Repository: atlas


Description
---

updated basic-search implementation to look for relationship-attributes when a 
specified attribute is not directly defined in the entity-type being searched


Diffs
-

  intg/src/main/java/org/apache/atlas/type/AtlasStructType.java 31953bdd1 
  
repository/src/main/java/org/apache/atlas/discovery/EntityDiscoveryService.java 
19f81d357 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphRetriever.java
 5aa6c8f0e 


Diff: https://reviews.apache.org/r/70475/diff/1/


Testing
---

- verified that basic-search results include specified attributes, both 
directly defined and relationship-attributes.
- pre-commit tests run 
https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1033/


Thanks,

Madhan Neethiraj



[jira] [Created] (ATLAS-3139) basic search enhancement to include relationship attributes as well in the result

2019-04-15 Thread Madhan Neethiraj (JIRA)
Madhan Neethiraj created ATLAS-3139:
---

 Summary: basic search enhancement to include relationship 
attributes as well in the result
 Key: ATLAS-3139
 URL: https://issues.apache.org/jira/browse/ATLAS-3139
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Affects Versions: 2.0.0
Reporter: Madhan Neethiraj
Assignee: Madhan Neethiraj


Basic-search results should include list of attributes specified in the 
search-request. This works for attributes that are directly defined in the 
given entity-type; if an attribute is a relationship attribute (for example: 
attribute 'table' in type 'hive_column'), its value is not included in the 
result.

Request:
{noformat}
POST api/atlas/v2/search/basic
{ "typeName":"hive_column", "limit":2, "attributes":[ "table", "position" ]}
{noformat}
Response:
{noformat}
{
  "queryType": "BASIC",
  "searchParameters": {
"typeName":   "hive_column",
"limit":  2,
"attributes": [ "position", "table" ]
  }
  "entities": [
{
  "guid":"464d3a2b-b1e0-4731-a924-4286b9e578ba",
  "typeName":"hive_column",
  "displayText": "dob",
  "status":  "ACTIVE",
  "attributes": {
"name":  "dob",
"owner": "madhan",
"position":  2,
"qualifiedName": "testdb.testtable.dob@cl1"
  }
},
{
  "guid":"1684e785-9200-41d0-843e-e79167a4a6e0",
  "typeName":"hive_column",
  "displayText": "name",
  "status":  "ACTIVE",
  "attributes": {
"name":  "name",
"owner": "madhan",
"position":  1,
"qualifiedName": "testdb.testtable.name@cl1"
  }
}
  ]
}
{noformat}
Expected Response:
{noformat}
{
  "queryType": "BASIC",
  "searchParameters": {
"typeName":   "hive_column",
"limit":  2,
"attributes": [ "position", "table" ]
  },
  "entities": [
{
  "guid":"464d3a2b-b1e0-4731-a924-4286b9e578ba",
  "typeName":"hive_column",
  "displayText": "dob",
  "status":  "ACTIVE",
  "attributes": {
"name":  "dob",
"owner": "madhan",
"position":  2,
"qualifiedName": "testdb.testtable.dob@cl1",
"table": {
  "guid": "3b29c9ae-d765-485d-bdba-bde1f9cc6794",
  "typeName": "hive_table",
  "uniqueAttributes": {
"qualifiedName": "testdb.testtable@cl1"
  }
}
  }
},
{
  "guid":"1684e785-9200-41d0-843e-e79167a4a6e0",
  "typeName":"hive_column",
  "displayText": "name",
  "status":  "ACTIVE",
  "attributes": {
"name":  "name",
"owner": "madhan",
"position":  1,
"qualifiedName": "testdb.testtable.name@cl1",
"table": {
  "guid": "3b29c9ae-d765-485d-bdba-bde1f9cc6794",
  "typeName": "hive_table",
  "uniqueAttributes": {
"qualifiedName": "testdb.testtable@cl1"
  }
}
  }
}
  ],
  "referredEntities": {
"3b29c9ae-d765-485d-bdba-bde1f9cc6794": {
  "guid":"3b29c9ae-d765-485d-bdba-bde1f9cc6794",
  "typeName":"hive_table",
  "status":  "ACTIVE",
  "displayText": "testtable",
  "attributes": {
"createTime":155523129,
"name":  "testtable",
"owner": "madhan",
"qualifiedName": "testdb.testtable@cl1"
  }
}
  }
}
{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (ATLAS-3103) UI : Render Schema Table from relationship attributes node in the entity API

2019-03-28 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803887#comment-16803887
 ] 

ASF subversion and git services commented on ATLAS-3103:


Commit 3fb19af8012f6591f888ea500bf620f3494d663f in atlas's branch 
refs/heads/branch-1.0 from gutkaBinit
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=3fb19af ]

ATLAS-3103 UI : Render schema table from relationshipattributes node in the 
entity API

Signed-off-by: kevalbhatt 
(cherry picked from commit 4551dcd7af36662c4df8a83af9f599ed1a3a39d4)


> UI : Render Schema Table from relationship attributes node in the entity API
> 
>
> Key: ATLAS-3103
> URL: https://issues.apache.org/jira/browse/ATLAS-3103
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Binit Gutka
>Assignee: Binit Gutka
>Priority: Major
> Attachments: ATLAS-3103.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (ATLAS-3103) UI : Render Schema Table from relationship attributes node in the entity API

2019-03-28 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803874#comment-16803874
 ] 

ASF subversion and git services commented on ATLAS-3103:


Commit 4551dcd7af36662c4df8a83af9f599ed1a3a39d4 in atlas's branch 
refs/heads/master from gutkaBinit
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=4551dcd ]

ATLAS-3103 UI : Render schema table from relationshipattributes node in the 
entity API

Signed-off-by: kevalbhatt 


> UI : Render Schema Table from relationship attributes node in the entity API
> 
>
> Key: ATLAS-3103
> URL: https://issues.apache.org/jira/browse/ATLAS-3103
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Binit Gutka
>Assignee: Binit Gutka
>Priority: Major
> Attachments: ATLAS-3103.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-3103) UI : Render Schema Table from relationship attributes node in the entity API

2019-03-28 Thread Binit Gutka (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Binit Gutka updated ATLAS-3103:
---
Summary: UI : Render Schema Table from relationship attributes node in the 
entity API  (was: UI : Render Table from relationship attributes node in the 
entity API)

> UI : Render Schema Table from relationship attributes node in the entity API
> 
>
> Key: ATLAS-3103
> URL: https://issues.apache.org/jira/browse/ATLAS-3103
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Binit Gutka
>Assignee: Binit Gutka
>Priority: Major
> Attachments: ATLAS-3103.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-3103) UI : Render Table from relationship attributes node in the entity API

2019-03-28 Thread Binit Gutka (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Binit Gutka updated ATLAS-3103:
---
Summary: UI : Render Table from relationship attributes node in the entity 
API  (was: UI : Render Table from relationshipattributes node in the entity API)

> UI : Render Table from relationship attributes node in the entity API
> -
>
> Key: ATLAS-3103
> URL: https://issues.apache.org/jira/browse/ATLAS-3103
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Binit Gutka
>Assignee: Binit Gutka
>Priority: Major
> Attachments: ATLAS-3103.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Re: Review Request 70106: updated entity create/update to enable relationship-type to be specified for relationship attributes

2019-03-04 Thread Sarath Subramanian

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/70106/#review213424
---


Ship it!




Ship It!

- Sarath Subramanian


On March 3, 2019, 11:04 p.m., madhan wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/70106/
> ---
> 
> (Updated March 3, 2019, 11:04 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, keval bhatt, Kapildeo Nayak, Mehul 
> Parikh, Nikhil Bonte, Nixon Rodrigues, and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3063
> https://issues.apache.org/jira/browse/ATLAS-3063
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> - added field AtlasRelatedObjectId.relationshipType, to enable 
> relationship-type to be provided during entity create/update
> - added field AtlasRelationshipDef.relationshipLabel to specify the label to 
> be used for graph-edge that represents a relationship
> - updated AtlasEntityType to account for cases where an attribute can be part 
> of more than one relationship-type
> - updated entity normalization/validation to use 
> AtlasRelatedObjectId.relationshipType, if specified
> 
> 
> Diffs
> -
> 
>   common/src/main/java/org/apache/atlas/repository/Constants.java d677814d6 
>   
> intg/src/main/java/org/apache/atlas/model/instance/AtlasRelatedObjectId.java 
> fde2629b9 
>   intg/src/main/java/org/apache/atlas/model/typedef/AtlasRelationshipDef.java 
> d76f7fad1 
>   intg/src/main/java/org/apache/atlas/type/AtlasEntityType.java 8960703e0 
>   intg/src/main/java/org/apache/atlas/type/AtlasRelationshipType.java 
> 36e459a44 
>   intg/src/main/java/org/apache/atlas/type/AtlasStructType.java 644ed79d6 
>   intg/src/main/java/org/apache/atlas/utils/AtlasEntityUtil.java 2e7453673 
>   intg/src/test/java/org/apache/atlas/type/TestAtlasRelationshipType.java 
> 819dfe57f 
>   
> repository/src/main/java/org/apache/atlas/discovery/EntityDiscoveryService.java
>  2378d6bb3 
>   repository/src/main/java/org/apache/atlas/discovery/SearchContext.java 
> b4542b711 
>   repository/src/main/java/org/apache/atlas/repository/graph/GraphHelper.java 
> 97e3e2557 
>   
> repository/src/main/java/org/apache/atlas/repository/impexp/ExportService.java
>  5632520f7 
>   
> repository/src/main/java/org/apache/atlas/repository/impexp/ExportTypeProcessor.java
>  f528b1715 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasEntityGraphDiscoveryV2.java
>  23dc83a88 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasEntityStoreV2.java
>  18eb337ab 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasGraphUtilsV2.java
>  798b3621e 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasRelationshipDefStoreV2.java
>  3602c80bd 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasRelationshipStoreV2.java
>  47a7546e7 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphMapper.java
>  baaca0b05 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphRetriever.java
>  e2b74338e 
> 
> 
> Diff: https://reviews.apache.org/r/70106/diff/1/
> 
> 
> Testing
> ---
> 
> - verified that 'relationshipType' specified for relationship attributes 
> results in expected entity association
> - pre-commit tests run: 
> https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/938/
> 
> 
> Thanks,
> 
> madhan
> 
>



Review Request 70106: updated entity create/update to enable relationship-type to be specified for relationship attributes

2019-03-03 Thread madhan

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/70106/
---

Review request for atlas, Ashutosh Mestry, Nixon Rodrigues, and Sarath 
Subramanian.


Bugs: ATLAS-3063
https://issues.apache.org/jira/browse/ATLAS-3063


Repository: atlas


Description
---

- added field AtlasRelatedObjectId.relationshipType, to enable 
relationship-type to be provided during entity create/update
- added field AtlasRelationshipDef.relationshipLabel to specify the label to be 
used for graph-edge that represents a relationship
- updated AtlasEntityType to account for cases where an attribute can be part 
of more than one relationship-type
- updated entity normalization/validation to use 
AtlasRelatedObjectId.relationshipType, if specified


Diffs
-

  common/src/main/java/org/apache/atlas/repository/Constants.java d677814d6 
  intg/src/main/java/org/apache/atlas/model/instance/AtlasRelatedObjectId.java 
fde2629b9 
  intg/src/main/java/org/apache/atlas/model/typedef/AtlasRelationshipDef.java 
d76f7fad1 
  intg/src/main/java/org/apache/atlas/type/AtlasEntityType.java 8960703e0 
  intg/src/main/java/org/apache/atlas/type/AtlasRelationshipType.java 36e459a44 
  intg/src/main/java/org/apache/atlas/type/AtlasStructType.java 644ed79d6 
  intg/src/main/java/org/apache/atlas/utils/AtlasEntityUtil.java 2e7453673 
  intg/src/test/java/org/apache/atlas/type/TestAtlasRelationshipType.java 
819dfe57f 
  
repository/src/main/java/org/apache/atlas/discovery/EntityDiscoveryService.java 
2378d6bb3 
  repository/src/main/java/org/apache/atlas/discovery/SearchContext.java 
b4542b711 
  repository/src/main/java/org/apache/atlas/repository/graph/GraphHelper.java 
97e3e2557 
  
repository/src/main/java/org/apache/atlas/repository/impexp/ExportService.java 
5632520f7 
  
repository/src/main/java/org/apache/atlas/repository/impexp/ExportTypeProcessor.java
 f528b1715 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasEntityGraphDiscoveryV2.java
 23dc83a88 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasEntityStoreV2.java
 18eb337ab 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasGraphUtilsV2.java
 798b3621e 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasRelationshipDefStoreV2.java
 3602c80bd 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasRelationshipStoreV2.java
 47a7546e7 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphMapper.java
 baaca0b05 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphRetriever.java
 e2b74338e 


Diff: https://reviews.apache.org/r/70106/diff/1/


Testing
---

- verified that 'relationshipType' specified for relationship attributes 
results in expected entity association
- pre-commit tests run: 
https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/938/


Thanks,

madhan



Re: Review Request 70039: ATLAS-3055: updated entity create/update to handle relationship attributes consistently

2019-02-21 Thread Ashutosh Mestry

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/70039/#review213068
---


Ship it!




Ship It!

- Ashutosh Mestry


On Feb. 21, 2019, 9:01 p.m., madhan wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/70039/
> ---
> 
> (Updated Feb. 21, 2019, 9:01 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, keval bhatt, Nikhil Bonte, Nixon 
> Rodrigues, and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3055
> https://issues.apache.org/jira/browse/ATLAS-3055
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> - updated graph-mapper to move relationship attributes present in 
> 'attributes' to 'relationshipAttributes'
> - updated entity-walk through look for relationship attribute in 'attributes' 
> when its not present in 'relationshipAttributes', since this run before 
> graph-mapper gets to moving attributes around
> - fixed GlossaryUtils.createRelationship() to call getOrCreateRelationship(), 
> instead of ignoring RELATIONSHIP_ALREADY_EXISTS exception
> - added gui->vertex mapping at the graph-transaction level to optmize (by 
> avoiding graph query)
> 
> 
> Diffs
> -
> 
>   intg/src/main/java/org/apache/atlas/type/AtlasEntityType.java 7166caa8d 
>   repository/src/main/java/org/apache/atlas/GraphTransactionInterceptor.java 
> cbd2226b2 
>   repository/src/main/java/org/apache/atlas/glossary/GlossaryUtils.java 
> cec4c2303 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasEntityGraphDiscoveryV2.java
>  ddab2bf0e 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasEntityStoreV2.java
>  f610f6f06 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasGraphUtilsV2.java
>  254853726 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphMapper.java
>  173fe02ff 
> 
> 
> Diff: https://reviews.apache.org/r/70039/diff/1/
> 
> 
> Testing
> ---
> 
> Pre-commit tests run: 
> https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/931/
> 
> 
> Thanks,
> 
> madhan
> 
>



[jira] [Commented] (ATLAS-3055) fix entity create/update to handle relationship attributes consistently

2019-02-21 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774678#comment-16774678
 ] 

ASF subversion and git services commented on ATLAS-3055:


Commit 18019733f28448458e2cad94f5e67aabd18316be in atlas's branch 
refs/heads/master from Madhan Neethiraj
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=1801973 ]

ATLAS-3055: updated entity create/update to handle relationship attributes 
consistently


> fix entity create/update to handle relationship attributes consistently
> ---
>
> Key: ATLAS-3055
> URL: https://issues.apache.org/jira/browse/ATLAS-3055
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0, 1.1.0
>Reporter: Madhan Neethiraj
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 2.0.0
>
> Attachments: ATLAS-3055.patch
>
>
> Currently an AtlasEntity can have relationship-attributes either in 
> 'attributes' or 'relationshipAttribute'. When a relationship attribute is 
> present in both, Atlas removes the attribute from 'attributes' and continues 
> processing the value in relationshipAttribute. However, if the attribute is  
> present only in 'attributes', Atlas doesn't move this value to 
> 'relationshipAttribute' - which can result in the attribute to be ignored if 
> no first-class attribute with the same name is present in the entity-def.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Review Request 70039: ATLAS-3055: updated entity create/update to handle relationship attributes consistently

2019-02-21 Thread madhan

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/70039/
---

Review request for atlas, Ashutosh Mestry, keval bhatt, Nikhil Bonte, Nixon 
Rodrigues, and Sarath Subramanian.


Bugs: ATLAS-3055
https://issues.apache.org/jira/browse/ATLAS-3055


Repository: atlas


Description
---

- updated graph-mapper to move relationship attributes present in 'attributes' 
to 'relationshipAttributes'
- updated entity-walk through look for relationship attribute in 'attributes' 
when its not present in 'relationshipAttributes', since this run before 
graph-mapper gets to moving attributes around
- fixed GlossaryUtils.createRelationship() to call getOrCreateRelationship(), 
instead of ignoring RELATIONSHIP_ALREADY_EXISTS exception
- added gui->vertex mapping at the graph-transaction level to optmize (by 
avoiding graph query)


Diffs
-

  intg/src/main/java/org/apache/atlas/type/AtlasEntityType.java 7166caa8d 
  repository/src/main/java/org/apache/atlas/GraphTransactionInterceptor.java 
cbd2226b2 
  repository/src/main/java/org/apache/atlas/glossary/GlossaryUtils.java 
cec4c2303 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasEntityGraphDiscoveryV2.java
 ddab2bf0e 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasEntityStoreV2.java
 f610f6f06 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasGraphUtilsV2.java
 254853726 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphMapper.java
 173fe02ff 


Diff: https://reviews.apache.org/r/70039/diff/1/


Testing
---

Pre-commit tests run: 
https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/931/


Thanks,

madhan



[jira] [Created] (ATLAS-3055) fix entity create/update to handle relationship attributes consistently

2019-02-21 Thread Madhan Neethiraj (JIRA)
Madhan Neethiraj created ATLAS-3055:
---

 Summary: fix entity create/update to handle relationship 
attributes consistently
 Key: ATLAS-3055
 URL: https://issues.apache.org/jira/browse/ATLAS-3055
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Affects Versions: 1.1.0, 1.0.0
Reporter: Madhan Neethiraj
Assignee: Madhan Neethiraj


Currently an AtlasEntity can have relationship-attributes either in 
'attributes' or 'relationshipAttribute'. When a relationship attribute is 
present in both, Atlas removes the attribute from 'attributes' and continues 
processing the value in relationshipAttribute. However, if the attribute is  
present only in 'attributes', Atlas doesn't move this value to 
'relationshipAttribute' - which can result in the attribute to be ignored if no 
first-class attribute with the same name is present in the entity-def.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-1892) Implement logic to create relationship attributes in AtlasEntityType

2018-05-16 Thread Madhan Neethiraj (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Madhan Neethiraj updated ATLAS-1892:

Affects Version/s: (was: trunk)

> Implement logic to create relationship attributes in AtlasEntityType
> 
>
> Key: ATLAS-1892
> URL: https://issues.apache.org/jira/browse/ATLAS-1892
> Project: Atlas
>  Issue Type: New Feature
>  Components:  atlas-core
>Affects Versions: 1.0.0
>Reporter: Sarath Subramanian
>Assignee: Sarath Subramanian
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-1856.4.patch
>
>
> When a new relationshipDef is created, relation attributes needs to be 
> populated in AtlasEntityType during resolveReference stage.
> This JIRA also adds UT and IT and addresses review comments in 
> https://reviews.apache.org/r/59769/



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-1892) Implement logic to create relationship attributes in AtlasEntityType

2018-05-16 Thread Madhan Neethiraj (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Madhan Neethiraj updated ATLAS-1892:

Fix Version/s: 1.0.0

> Implement logic to create relationship attributes in AtlasEntityType
> 
>
> Key: ATLAS-1892
> URL: https://issues.apache.org/jira/browse/ATLAS-1892
> Project: Atlas
>  Issue Type: New Feature
>  Components:  atlas-core
>Affects Versions: trunk, 1.0.0
>Reporter: Sarath Subramanian
>Assignee: Sarath Subramanian
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-1856.4.patch
>
>
> When a new relationshipDef is created, relation attributes needs to be 
> populated in AtlasEntityType during resolveReference stage.
> This JIRA also adds UT and IT and addresses review comments in 
> https://reviews.apache.org/r/59769/



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-1984) Use AtlasRelatedObjectId to refer to relationship attributes during entity create/update

2018-05-16 Thread Madhan Neethiraj (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Madhan Neethiraj updated ATLAS-1984:

Affects Version/s: (was: trunk)
Fix Version/s: 1.0.0

> Use AtlasRelatedObjectId to refer to relationship attributes during entity 
> create/update
> 
>
> Key: ATLAS-1984
> URL: https://issues.apache.org/jira/browse/ATLAS-1984
> Project: Atlas
>  Issue Type: Improvement
>  Components:  atlas-core
>Affects Versions: 1.0.0
>Reporter: Sarath Subramanian
>Assignee: Sarath Subramanian
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-1984.1.patch
>
>
> AtlasObjectId is used to refer to entity attributes referring to another 
> entity.
> hive_table.columns => List
> hive_table.db => AtlasObjectId
> Change this to use AtlasRelatedObjectId with the following structure:
> class AtlasRelatedObjectId  {
>String relationshipGuid;
>String displayText;
>AtlasStruct relationshipAttributes; 
> }



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-1959) Enhance relationship attributes to support different cardinality mappings

2018-05-16 Thread Madhan Neethiraj (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-1959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Madhan Neethiraj updated ATLAS-1959:

Fix Version/s: 1.0.0

> Enhance relationship attributes to support different cardinality mappings
> -
>
> Key: ATLAS-1959
> URL: https://issues.apache.org/jira/browse/ATLAS-1959
> Project: Atlas
>  Issue Type: New Feature
>  Components:  atlas-core
>Affects Versions: trunk, 1.0.0
>Reporter: Sarath Subramanian
>Assignee: Sarath Subramanian
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-1959.1.patch
>
>
> 1. Improve relationship model to support create/update operations and the 
> following cardinalities (previously supported using inverseReference):
> * 1 to 1
> * 1 to many
> * many to 1
> * many to many
> 2. Change legacyLabel flag in AtlasRelationshipEndDef to boolean flag.
> 3. Add unit tests for the above cases.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-2372) Export-Import: Support for Relationship Attributes Missing

2018-05-16 Thread Madhan Neethiraj (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Madhan Neethiraj updated ATLAS-2372:

Affects Version/s: 1.0.0
Fix Version/s: 1.0.0

> Export-Import: Support for Relationship Attributes Missing
> --
>
> Key: ATLAS-2372
> URL: https://issues.apache.org/jira/browse/ATLAS-2372
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0
>Reporter: Ashutosh Mestry
>Assignee: Ashutosh Mestry
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-2372-Export-No-Relationship.patch, 
> ATLAS-2372-Support-Replationships-No-Resource.patch
>
>
> *Background*
> _Relationship_ attributes are supported first class within Atlas. However, 
> the implementation is not supported correctly by the _Export & Import_ 
> ++functionality.
> _Export_ operation works well with _Relationship_ attributes. Each exported 
> entity has correct information present in the _relationshipAttributes_ node.
> _Import_ operation, however, fails during the attribute creation phase of 
> entity creation. This needs to be addressed.
> Export and Import functionality should be functional with entities having 
> _relationshipAttritute_.
> *Short-term Solution*
> During _Export_ process, do not emit the _relationshipAttributes_. _Import_ 
> operation will be functional with low effort.
> Rationale: Existing hive model uses _relationshipAttributes_ but functions 
> well without it. This is compatible with earlier release.
> *Solution*
>  * Process import of entities like before. This will create vertices with 
> correct attributes.
>  * Process relationship attributes for each entity that is part of import 
> process. Edges with correct attributes will get created thus creating 
> _relationshipAttribute._
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ATLAS-2420) Create indexes for relationship attributes

2018-05-16 Thread Madhan Neethiraj (JIRA)

 [ 
https://issues.apache.org/jira/browse/ATLAS-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Madhan Neethiraj updated ATLAS-2420:

Fix Version/s: 1.0.0

> Create indexes for relationship attributes 
> ---
>
> Key: ATLAS-2420
> URL: https://issues.apache.org/jira/browse/ATLAS-2420
> Project: Atlas
>  Issue Type: Improvement
>  Components:  atlas-core
>Affects Versions: 1.0.0
>Reporter: Sarath Subramanian
>Assignee: Sarath Subramanian
>Priority: Major
>  Labels: 1.0.0
> Fix For: 1.0.0
>
> Attachments: ATLAS-2420.1.patch
>
>
> Currently attributes and system attributes (guid)  of relationship is not 
> indexed. This Jira enables adding indexing for relationship attributes. It 
> makes use of edge_index in solr.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Re: Review Request 65329: [ATLAS-2420]: Create indexes for relationship attributes

2018-01-28 Thread Madhan Neethiraj

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65329/#review196396
---


Ship it!




Ship It!

- Madhan Neethiraj


On Jan. 25, 2018, 12:56 a.m., Sarath Subramanian wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/65329/
> ---
> 
> (Updated Jan. 25, 2018, 12:56 a.m.)
> 
> 
> Review request for atlas and Madhan Neethiraj.
> 
> 
> Bugs: ATLAS-2420
> https://issues.apache.org/jira/browse/ATLAS-2420
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Currently attributes and system attributes (guid)  of relationship is not 
> indexed. This Jira enables adding indexing for relationship attributes. It 
> makes use of edge_index in solr.
> 
> 
> Diffs
> -
> 
>   common/src/main/java/org/apache/atlas/repository/Constants.java d63f361b 
>   
> graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasGraphManagement.java
>  620ba101 
>   
> graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusGraphManagement.java
>  036c566f 
>   
> graphdb/janus/src/test/java/org/apache/atlas/repository/graphdb/janus/AbstractGraphDatabaseTest.java
>  43b95cae 
>   
> graphdb/janus/src/test/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusDatabaseTest.java
>  ed4099b8 
>   
> graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/Titan0GraphManagement.java
>  5b9c9330 
>   
> graphdb/titan0/src/test/java/org/apache/atlas/repository/graphdb/titan0/AbstractGraphDatabaseTest.java
>  fbbfdef4 
>   
> graphdb/titan0/src/test/java/org/apache/atlas/repository/graphdb/titan0/Titan0DatabaseTest.java
>  3756382f 
>   
> repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
>  9f1206ca 
>   repository/src/main/java/org/apache/atlas/repository/graph/GraphHelper.java 
> 8c886100 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasRelationshipStoreV1.java
>  cf414bf4 
> 
> 
> Diff: https://reviews.apache.org/r/65329/diff/3/
> 
> 
> Testing
> ---
> 
> Verified in indexing backend (solr), indexes were created for relationship 
> attributes.
> 
> 
> Thanks,
> 
> Sarath Subramanian
> 
>



Re: Review Request 65329: [ATLAS-2420]: Create indexes for relationship attributes

2018-01-28 Thread Sarath Subramanian


> On Jan. 27, 2018, 10:43 a.m., Madhan Neethiraj wrote:
> > repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
> > Lines 347 (patched)
> > <https://reviews.apache.org/r/65329/diff/2/?file=1946844#file1946844line401>
> >
> > line #347 should be removed - as this shouldn't be executed for 
> > relationship-type and it is already executed in line #344 for other types.

good catch! missed to remove it.


- Sarath


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65329/#review196388
---


On Jan. 24, 2018, 4:56 p.m., Sarath Subramanian wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/65329/
> ---
> 
> (Updated Jan. 24, 2018, 4:56 p.m.)
> 
> 
> Review request for atlas and Madhan Neethiraj.
> 
> 
> Bugs: ATLAS-2420
> https://issues.apache.org/jira/browse/ATLAS-2420
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Currently attributes and system attributes (guid)  of relationship is not 
> indexed. This Jira enables adding indexing for relationship attributes. It 
> makes use of edge_index in solr.
> 
> 
> Diffs
> -
> 
>   common/src/main/java/org/apache/atlas/repository/Constants.java d63f361b 
>   
> graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasGraphManagement.java
>  620ba101 
>   
> graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusGraphManagement.java
>  036c566f 
>   
> graphdb/janus/src/test/java/org/apache/atlas/repository/graphdb/janus/AbstractGraphDatabaseTest.java
>  43b95cae 
>   
> graphdb/janus/src/test/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusDatabaseTest.java
>  ed4099b8 
>   
> graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/Titan0GraphManagement.java
>  5b9c9330 
>   
> graphdb/titan0/src/test/java/org/apache/atlas/repository/graphdb/titan0/AbstractGraphDatabaseTest.java
>  fbbfdef4 
>   
> graphdb/titan0/src/test/java/org/apache/atlas/repository/graphdb/titan0/Titan0DatabaseTest.java
>  3756382f 
>   
> repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
>  9f1206ca 
>   repository/src/main/java/org/apache/atlas/repository/graph/GraphHelper.java 
> 8c886100 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasRelationshipStoreV1.java
>  cf414bf4 
> 
> 
> Diff: https://reviews.apache.org/r/65329/diff/2/
> 
> 
> Testing
> ---
> 
> Verified in indexing backend (solr), indexes were created for relationship 
> attributes.
> 
> 
> Thanks,
> 
> Sarath Subramanian
> 
>



Re: Review Request 65329: [ATLAS-2420]: Create indexes for relationship attributes

2018-01-27 Thread Madhan Neethiraj

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65329/#review196388
---


Fix it, then Ship it!





repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
Lines 347 (patched)
<https://reviews.apache.org/r/65329/#comment276016>

line #347 should be removed - as this shouldn't be executed for 
relationship-type and it is already executed in line #344 for other types.


- Madhan Neethiraj


On Jan. 25, 2018, 12:56 a.m., Sarath Subramanian wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/65329/
> ---
> 
> (Updated Jan. 25, 2018, 12:56 a.m.)
> 
> 
> Review request for atlas and Madhan Neethiraj.
> 
> 
> Bugs: ATLAS-2420
> https://issues.apache.org/jira/browse/ATLAS-2420
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Currently attributes and system attributes (guid)  of relationship is not 
> indexed. This Jira enables adding indexing for relationship attributes. It 
> makes use of edge_index in solr.
> 
> 
> Diffs
> -
> 
>   common/src/main/java/org/apache/atlas/repository/Constants.java d63f361b 
>   
> graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasGraphManagement.java
>  620ba101 
>   
> graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusGraphManagement.java
>  036c566f 
>   
> graphdb/janus/src/test/java/org/apache/atlas/repository/graphdb/janus/AbstractGraphDatabaseTest.java
>  43b95cae 
>   
> graphdb/janus/src/test/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusDatabaseTest.java
>  ed4099b8 
>   
> graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/Titan0GraphManagement.java
>  5b9c9330 
>   
> graphdb/titan0/src/test/java/org/apache/atlas/repository/graphdb/titan0/AbstractGraphDatabaseTest.java
>  fbbfdef4 
>   
> graphdb/titan0/src/test/java/org/apache/atlas/repository/graphdb/titan0/Titan0DatabaseTest.java
>  3756382f 
>   
> repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
>  9f1206ca 
>   repository/src/main/java/org/apache/atlas/repository/graph/GraphHelper.java 
> 8c886100 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasRelationshipStoreV1.java
>  cf414bf4 
> 
> 
> Diff: https://reviews.apache.org/r/65329/diff/2/
> 
> 
> Testing
> ---
> 
> Verified in indexing backend (solr), indexes were created for relationship 
> attributes.
> 
> 
> Thanks,
> 
> Sarath Subramanian
> 
>



Review Request 65329: [ATLAS-2420]: Create indexes for relationship attributes

2018-01-24 Thread Sarath Subramanian

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65329/
---

Review request for atlas and Madhan Neethiraj.


Bugs: ATLAS-2420
https://issues.apache.org/jira/browse/ATLAS-2420


Repository: atlas


Description
---

Currently attributes and system attributes (guid)  of relationship is not 
indexed. This Jira enables adding indexing for relationship attributes. It 
makes use of edge_index in solr.


Diffs
-

  common/src/main/java/org/apache/atlas/repository/Constants.java d63f361b 
  
graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasGraphManagement.java
 620ba101 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusGraphManagement.java
 036c566f 
  
graphdb/janus/src/test/java/org/apache/atlas/repository/graphdb/janus/AbstractGraphDatabaseTest.java
 43b95cae 
  
graphdb/janus/src/test/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusDatabaseTest.java
 ed4099b8 
  
graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/Titan0GraphManagement.java
 5b9c9330 
  
graphdb/titan0/src/test/java/org/apache/atlas/repository/graphdb/titan0/AbstractGraphDatabaseTest.java
 fbbfdef4 
  
graphdb/titan0/src/test/java/org/apache/atlas/repository/graphdb/titan0/Titan0DatabaseTest.java
 3756382f 
  
repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
 9f1206ca 
  repository/src/main/java/org/apache/atlas/repository/graph/GraphHelper.java 
4da74b94 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasRelationshipStoreV1.java
 9301cfaa 


Diff: https://reviews.apache.org/r/65329/diff/1/


Testing
---

Verified in indexing backend (solr), indexes were created for relationship 
attributes.


Thanks,

Sarath Subramanian



Re: Review Request 65220: Import: Support for Types with Relationship Attributes

2018-01-19 Thread Ashutosh Mestry

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65220/
---

(Updated Jan. 19, 2018, 5:29 p.m.)


Review request for atlas, Madhan Neethiraj and Sarath Subramanian.


Changes
---

Updates include: Addressed review comments.


Bugs: ATLAS-2372
https://issues.apache.org/jira/browse/ATLAS-2372


Repository: atlas


Description
---

**Background**
After introduction of _relationshipAttributes_ the import of types with 
relationship attributes started failing.

**Analysis**
Root cause: The _AtlasEntityGraphDiscoveryV1_ started using 
_relationshipAttribute_ to discover entities. This caused more entities to be 
discovered than what was happening before. This caused the single stream entity 
not to lookup entities correctly. Failures started occuring when these 
additional entities started getting connected by edges.

Example: _hive_db_ has relationship attribute that now has relationship 
pointing to _hive_table_. This caused many more entities to be discovered. This 
also has a side effect of bringing-in way more entities than needed.

With relationshipAttributes, edges started receiving GUIDs. Import process did 
not handle creating of edges with incoming guids. 

**Approach**
- The new _AtlasEntityGraphDiscoveryV1_ entitiy discovery approach using 
relationships is not being used during import. Additional discussion are needed 
to guage validity of this approach.
- _EntityMutationContext_ now has additional getter to know of import is in 
progress.
- Edge creation (new method _AtlasRelationshipStoreV1.createEdgeWithGuid_) has 
been modified to support edge creation using specific guid.


Diffs (updated)
-

  
repository/src/main/java/org/apache/atlas/repository/impexp/ExportService.java 
c5e6534c 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasEntityGraphDiscoveryV1.java
 450fa875 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
 7474a8a4 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityMutationContext.java
 8a6a0e3f 
  
repository/src/test/java/org/apache/atlas/repository/impexp/ImportServiceTest.java
 ab25faaa 


Diff: https://reviews.apache.org/r/65220/diff/3/

Changes: https://reviews.apache.org/r/65220/diff/2-3/


Testing
---

**Unit tests**
- Additional tests for testing entities with relationships.
- (To execute tests locally, place the attached zip at: 
_./repository/src/test/resources_

**Functional tests**
- Suite of tests that verify export-import-export and diff comparision for 
accuracy testing.


File Attachments


Additional resource
  
https://reviews.apache.org/media/uploaded/files/2018/01/18/6edce43a-b1df-415a-98ea-1ab43359a9d7__stocks-rel-2.zip


Thanks,

Ashutosh Mestry



  1   2   >