-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72652/
-----------------------------------------------------------
Review request for atlas, Ashutosh Mestry, Jayendra Parab, madhan, Nixon
Rodrigues, Sarath Subramanian, and Sidharth Mishra.
Repository: atlas
Description
-------
The support for Apache Ozone was added in ATLAS-3836. Currently, ozone_key
entity is getting created under ozone_bucket, but there is no support to create
a hierarchy of parent ozone_key and child ozone_key.
e.g.
-> CREATE EXTERNAL TABLE sales (id int) row format delimited fields terminated
by ' ' stored as textfile location
'o3fs://bucket1.volume1.ozone1/sale1/q1/sales';
This query will create only 1 ozone_key directly under bucket "bucket1".
Created entities :
o3fs://volume1@cm (ozone_key)
o3fs://volume1.bucket1@cm (ozone_bucket)
o3fs://bucket1.volume1.ozone1/sale1/q1/sales@cm (ozone_key)
This Jira will improve implementation to support creating the hierarchy of
ozone_keys.
With this, above query will result into following entites
o3fs://volume1@cm (ozone_key)
o3fs://volume1.bucket1@cm (ozone_bucket)
o3fs://bucket1.volume1.ozone1/sale1/@cm (ozone_key) child of ozone_bucket
o3fs://bucket1.volume1.ozone1/sale1/q1/@cm (ozone_key) child of ozone_key
o3fs://bucket1.volume1.ozone1/sale1/q1/sales/@cm (ozone_key) child of
ozone_key
Diffs
-----
addons/models/3000-Cloud/3050-ozone-typedefs.json 0f0a5c90f
common/src/main/java/org/apache/atlas/utils/AtlasPathExtractorUtil.java
c3276a891
common/src/test/java/org/apache/atlas/utils/AtlasPathExtractorUtilTest.java
4abdca498
Diff: https://reviews.apache.org/r/72652/diff/1/
Testing
-------
UTs updated & verified.
Manually verified.
PC build:
Thanks,
Nikhil Bonte
