[
https://issues.apache.org/jira/browse/ATLAS-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Radhika Kundam updated ATLAS-4098:
----------------------------------
Description:
Requirement is to add "location" as one of the relationships to hive_db. With
this we can create a "location" entity based on the type of file storage and
assign it to hive_db relationship attributes.
Since we are creating entities for location we can get more details about the
path. To support location entity with all types of file storage, need to create
a super type for all types of location entities.
For that purpose, introduce new layer between DataSet and other location
entities which are derived from DataSet. Create "Path" entity which should be
derived from "DataSet" entity and "Path" should be a super type of all other
location entities. AWS s3 directory(aws_s3_v2_directory ), Azure ADLS
storage(adls_gen2_directory), HDFS(hdfs_path ) are the few location entities
which will be subtypes of "Path" entity.
This location relationship attribute should be created with endDef1 as
"hive_db" and endDef2 as "Path".
was:
Add new relationship attribute "location" for hive_db entity. This location
attribute holds the details about the path of the hive_db create script file.
"Path" is superType of location entity which can be used for any type of file
storage like AWS s3 directory, Azure ADLS storage, HDFS etc.
This location relationship attribute should be created with endDef1 as
"hive_db" and endDef2 as "Path".
> Add location relationship attribute for hive_db
> -----------------------------------------------
>
> Key: ATLAS-4098
> URL: https://issues.apache.org/jira/browse/ATLAS-4098
> Project: Atlas
> Issue Type: Task
> Reporter: Radhika Kundam
> Assignee: Radhika Kundam
> Priority: Major
>
> Requirement is to add "location" as one of the relationships to hive_db. With
> this we can create a "location" entity based on the type of file storage and
> assign it to hive_db relationship attributes.
> Since we are creating entities for location we can get more details about the
> path. To support location entity with all types of file storage, need to
> create a super type for all types of location entities.
> For that purpose, introduce new layer between DataSet and other location
> entities which are derived from DataSet. Create "Path" entity which should be
> derived from "DataSet" entity and "Path" should be a super type of all other
> location entities. AWS s3 directory(aws_s3_v2_directory ), Azure ADLS
> storage(adls_gen2_directory), HDFS(hdfs_path ) are the few location entities
> which will be subtypes of "Path" entity.
> This location relationship attribute should be created with endDef1 as
> "hive_db" and endDef2 as "Path".
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
