-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72652/
-----------------------------------------------------------
(Updated July 7, 2020, 5:43 p.m.)
Review request for atlas, Ashutosh Mestry, Jayendra Parab, madhan, Nixon
Rodrigues, Sarath Subramanian, and Sidharth Mishra.
Changes
-------
Addressed review comment - Removed trailing "/" from ozone_key qualifiedName
Bugs: ATLAS-3879
https://issues.apache.org/jira/browse/ATLAS-3879
Repository: atlas
Description
-------
The support for Apache Ozone was added in ATLAS-3836. Currently, ozone_key
entity is getting created under ozone_bucket, but there is no support to create
a hierarchy of parent ozone_key and child ozone_key.
e.g.
-> CREATE EXTERNAL TABLE sales (id int) row format delimited fields terminated
by ' ' stored as textfile location
'o3fs://bucket1.volume1.ozone1/sale1/q1/sales';
This query will create only 1 ozone_key directly under bucket "bucket1".
Created entities :
o3fs://volume1@cm (ozone_key)
o3fs://volume1.bucket1@cm (ozone_bucket)
o3fs://bucket1.volume1.ozone1/sale1/q1/sales@cm (ozone_key)
This Jira will improve implementation to support creating the hierarchy of
ozone_keys.
With this, above query will result into following entites
o3fs://volume1@cm (ozone_key)
o3fs://volume1.bucket1@cm (ozone_bucket)
o3fs://bucket1.volume1.ozone1/sale1/@cm (ozone_key) child of ozone_bucket
o3fs://bucket1.volume1.ozone1/sale1/q1/@cm (ozone_key) child of ozone_key
o3fs://bucket1.volume1.ozone1/sale1/q1/sales/@cm (ozone_key) child of
ozone_key
Diffs (updated)
-----
addons/models/3000-Cloud/3050-ozone-typedefs.json 0f0a5c90f
common/src/main/java/org/apache/atlas/utils/AtlasPathExtractorUtil.java
c3276a891
common/src/test/java/org/apache/atlas/utils/AtlasPathExtractorUtilTest.java
4abdca498
Diff: https://reviews.apache.org/r/72652/diff/2/
Changes: https://reviews.apache.org/r/72652/diff/1-2/
Testing
-------
UTs updated & verified.
Manually verified.
PC build: https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/2026/console
(IN PROGRESS)
Thanks,
Nikhil Bonte
