[jira] [Updated] (ATLAS-4098) Add location relationship attribute for hive_db

2021-02-07 Thread Sarath Subramanian (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-4098:
--
Fix Version/s: 2.2.0

> Add location relationship attribute for hive_db
> ---
>
> Key: ATLAS-4098
> URL: https://issues.apache.org/jira/browse/ATLAS-4098
> Project: Atlas
>  Issue Type: New Feature
>Affects Versions: 2.1.0
>Reporter: Radhika Kundam
>Assignee: Radhika Kundam
>Priority: Major
> Fix For: 3.0.0, 2.2.0
>
>
> Requirement is to add "location" as one of the relationships to hive_db. With 
> this we can create a "location" entity based on the type of file storage and 
> assign it to hive_db relationship attributes.
> Since we are creating entities for location we can get more details about the 
> path. To support location entity with all types of file storage, need to 
> create a super type for all types of location entities.
> For that purpose, introduce new layer between DataSet and other location 
> entities which are derived from DataSet. Create "Path" entity which should be 
> derived from "DataSet" entity and "Path" should be a super type of all other 
> location entities. AWS s3 directory(aws_s3_v2_directory ), Azure ADLS 
> storage(adls_gen2_directory), HDFS(hdfs_path ) are the few location entities 
> which will be subtypes of "Path" entity.
> This location relationship attribute should be created with endDef1 as 
> "hive_db" and endDef2 as "Path".



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-4098) Add location relationship attribute for hive_db

2021-02-07 Thread Sarath Subramanian (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-4098:
--
Component/s:  atlas-core

> Add location relationship attribute for hive_db
> ---
>
> Key: ATLAS-4098
> URL: https://issues.apache.org/jira/browse/ATLAS-4098
> Project: Atlas
>  Issue Type: New Feature
>  Components:  atlas-core
>Affects Versions: 2.1.0
>Reporter: Radhika Kundam
>Assignee: Radhika Kundam
>Priority: Major
> Fix For: 3.0.0, 2.2.0
>
>
> Requirement is to add "location" as one of the relationships to hive_db. With 
> this we can create a "location" entity based on the type of file storage and 
> assign it to hive_db relationship attributes.
> Since we are creating entities for location we can get more details about the 
> path. To support location entity with all types of file storage, need to 
> create a super type for all types of location entities.
> For that purpose, introduce new layer between DataSet and other location 
> entities which are derived from DataSet. Create "Path" entity which should be 
> derived from "DataSet" entity and "Path" should be a super type of all other 
> location entities. AWS s3 directory(aws_s3_v2_directory ), Azure ADLS 
> storage(adls_gen2_directory), HDFS(hdfs_path ) are the few location entities 
> which will be subtypes of "Path" entity.
> This location relationship attribute should be created with endDef1 as 
> "hive_db" and endDef2 as "Path".



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-4098) Add location relationship attribute for hive_db

2021-02-07 Thread Sarath Subramanian (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-4098:
--
Labels: hive-hooks model  (was: )

> Add location relationship attribute for hive_db
> ---
>
> Key: ATLAS-4098
> URL: https://issues.apache.org/jira/browse/ATLAS-4098
> Project: Atlas
>  Issue Type: New Feature
>  Components:  atlas-core
>Affects Versions: 2.1.0
>Reporter: Radhika Kundam
>Assignee: Radhika Kundam
>Priority: Major
>  Labels: hive-hooks, model
> Fix For: 3.0.0, 2.2.0
>
>
> Requirement is to add "location" as one of the relationships to hive_db. With 
> this we can create a "location" entity based on the type of file storage and 
> assign it to hive_db relationship attributes.
> Since we are creating entities for location we can get more details about the 
> path. To support location entity with all types of file storage, need to 
> create a super type for all types of location entities.
> For that purpose, introduce new layer between DataSet and other location 
> entities which are derived from DataSet. Create "Path" entity which should be 
> derived from "DataSet" entity and "Path" should be a super type of all other 
> location entities. AWS s3 directory(aws_s3_v2_directory ), Azure ADLS 
> storage(adls_gen2_directory), HDFS(hdfs_path ) are the few location entities 
> which will be subtypes of "Path" entity.
> This location relationship attribute should be created with endDef1 as 
> "hive_db" and endDef2 as "Path".



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-4098) Add location relationship attribute for hive_db

2021-02-07 Thread Sarath Subramanian (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-4098:
--
Fix Version/s: 3.0.0

> Add location relationship attribute for hive_db
> ---
>
> Key: ATLAS-4098
> URL: https://issues.apache.org/jira/browse/ATLAS-4098
> Project: Atlas
>  Issue Type: New Feature
>Affects Versions: 2.1.0
>Reporter: Radhika Kundam
>Assignee: Radhika Kundam
>Priority: Major
> Fix For: 3.0.0
>
>
> Requirement is to add "location" as one of the relationships to hive_db. With 
> this we can create a "location" entity based on the type of file storage and 
> assign it to hive_db relationship attributes.
> Since we are creating entities for location we can get more details about the 
> path. To support location entity with all types of file storage, need to 
> create a super type for all types of location entities.
> For that purpose, introduce new layer between DataSet and other location 
> entities which are derived from DataSet. Create "Path" entity which should be 
> derived from "DataSet" entity and "Path" should be a super type of all other 
> location entities. AWS s3 directory(aws_s3_v2_directory ), Azure ADLS 
> storage(adls_gen2_directory), HDFS(hdfs_path ) are the few location entities 
> which will be subtypes of "Path" entity.
> This location relationship attribute should be created with endDef1 as 
> "hive_db" and endDef2 as "Path".



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-4098) Add location relationship attribute for hive_db

2021-02-07 Thread Sarath Subramanian (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-4098:
--
Affects Version/s: 2.1.0

> Add location relationship attribute for hive_db
> ---
>
> Key: ATLAS-4098
> URL: https://issues.apache.org/jira/browse/ATLAS-4098
> Project: Atlas
>  Issue Type: New Feature
>Affects Versions: 2.1.0
>Reporter: Radhika Kundam
>Assignee: Radhika Kundam
>Priority: Major
>
> Requirement is to add "location" as one of the relationships to hive_db. With 
> this we can create a "location" entity based on the type of file storage and 
> assign it to hive_db relationship attributes.
> Since we are creating entities for location we can get more details about the 
> path. To support location entity with all types of file storage, need to 
> create a super type for all types of location entities.
> For that purpose, introduce new layer between DataSet and other location 
> entities which are derived from DataSet. Create "Path" entity which should be 
> derived from "DataSet" entity and "Path" should be a super type of all other 
> location entities. AWS s3 directory(aws_s3_v2_directory ), Azure ADLS 
> storage(adls_gen2_directory), HDFS(hdfs_path ) are the few location entities 
> which will be subtypes of "Path" entity.
> This location relationship attribute should be created with endDef1 as 
> "hive_db" and endDef2 as "Path".



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-4098) Add location relationship attribute for hive_db

2021-01-11 Thread Radhika Kundam (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Radhika Kundam updated ATLAS-4098:
--
Issue Type: New Feature  (was: Task)

> Add location relationship attribute for hive_db
> ---
>
> Key: ATLAS-4098
> URL: https://issues.apache.org/jira/browse/ATLAS-4098
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Radhika Kundam
>Assignee: Radhika Kundam
>Priority: Major
>
> Requirement is to add "location" as one of the relationships to hive_db. With 
> this we can create a "location" entity based on the type of file storage and 
> assign it to hive_db relationship attributes.
> Since we are creating entities for location we can get more details about the 
> path. To support location entity with all types of file storage, need to 
> create a super type for all types of location entities.
> For that purpose, introduce new layer between DataSet and other location 
> entities which are derived from DataSet. Create "Path" entity which should be 
> derived from "DataSet" entity and "Path" should be a super type of all other 
> location entities. AWS s3 directory(aws_s3_v2_directory ), Azure ADLS 
> storage(adls_gen2_directory), HDFS(hdfs_path ) are the few location entities 
> which will be subtypes of "Path" entity.
> This location relationship attribute should be created with endDef1 as 
> "hive_db" and endDef2 as "Path".



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-4098) Add location relationship attribute for hive_db

2021-01-11 Thread Radhika Kundam (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Radhika Kundam updated ATLAS-4098:
--
Description: 
Requirement is to add "location" as one of the relationships to hive_db. With 
this we can create a "location" entity based on the type of file storage and 
assign it to hive_db relationship attributes.

Since we are creating entities for location we can get more details about the 
path. To support location entity with all types of file storage, need to create 
a super type for all types of location entities.

For that purpose, introduce new layer between DataSet and other location 
entities which are derived from DataSet. Create "Path" entity which should be 
derived from "DataSet" entity and "Path" should be a super type of all other 
location entities. AWS s3 directory(aws_s3_v2_directory ), Azure ADLS 
storage(adls_gen2_directory), HDFS(hdfs_path ) are the few location entities 
which will be subtypes of "Path" entity.

This location relationship attribute should be created with endDef1 as 
"hive_db" and endDef2 as "Path".

  was:
Add new relationship attribute "location" for hive_db entity. This location 
attribute holds the details about the path of the hive_db create script file. 

"Path" is superType of location entity which can be used for any type of file 
storage like AWS s3 directory, Azure ADLS storage, HDFS  etc.

This location relationship attribute should be created with endDef1 as 
"hive_db" and endDef2 as "Path".


> Add location relationship attribute for hive_db
> ---
>
> Key: ATLAS-4098
> URL: https://issues.apache.org/jira/browse/ATLAS-4098
> Project: Atlas
>  Issue Type: Task
>Reporter: Radhika Kundam
>Assignee: Radhika Kundam
>Priority: Major
>
> Requirement is to add "location" as one of the relationships to hive_db. With 
> this we can create a "location" entity based on the type of file storage and 
> assign it to hive_db relationship attributes.
> Since we are creating entities for location we can get more details about the 
> path. To support location entity with all types of file storage, need to 
> create a super type for all types of location entities.
> For that purpose, introduce new layer between DataSet and other location 
> entities which are derived from DataSet. Create "Path" entity which should be 
> derived from "DataSet" entity and "Path" should be a super type of all other 
> location entities. AWS s3 directory(aws_s3_v2_directory ), Azure ADLS 
> storage(adls_gen2_directory), HDFS(hdfs_path ) are the few location entities 
> which will be subtypes of "Path" entity.
> This location relationship attribute should be created with endDef1 as 
> "hive_db" and endDef2 as "Path".



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-4098) Add location relationship attribute for hive_db

2021-01-11 Thread Radhika Kundam (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Radhika Kundam updated ATLAS-4098:
--
Description: 
Add new relationship attribute "location" for hive_db entity. This location 
attribute holds the details about the path of the hive_db create script file. 

"Path" is superType of location entity which can be used for any type of file 
storage like AWS s3 directory, Azure ADLS storage, HDFS  etc.

This location relationship attribute should be created with endDef1 as 
"hive_db" and endDef2 as "Path".

  was:
Add new relationship attribute "location" for hive_db entity. This location 
attribute holds the path of the hive_db create script file.

This location relationship attribute should be created with endDef1 as 
"hive_db" and endDef2 as "Path".

"Path" is superType for path/location of any type of file storage like AWS s3 
directory path, Azure ADLS storage path, HDFS Path etc.


> Add location relationship attribute for hive_db
> ---
>
> Key: ATLAS-4098
> URL: https://issues.apache.org/jira/browse/ATLAS-4098
> Project: Atlas
>  Issue Type: Task
>Reporter: Radhika Kundam
>Assignee: Radhika Kundam
>Priority: Major
>
> Add new relationship attribute "location" for hive_db entity. This location 
> attribute holds the details about the path of the hive_db create script file. 
> "Path" is superType of location entity which can be used for any type of file 
> storage like AWS s3 directory, Azure ADLS storage, HDFS  etc.
> This location relationship attribute should be created with endDef1 as 
> "hive_db" and endDef2 as "Path".



--
This message was sent by Atlassian Jira
(v8.3.4#803005)