Sidharth Kumar Mishra created ATLAS-4227:
--------------------------------------------
Summary: Remove aws_s3_v2_directory.objectPrefix uniqueness
Key: ATLAS-4227
URL: https://issues.apache.org/jira/browse/ATLAS-4227
Project: Atlas
Issue Type: Bug
Reporter: Sidharth Kumar Mishra
For aws_s3_v2_directory.objectPrefix, the isUnique property is true.
based on the test here: (see verifyS3V2PseudoDir)
[https://github.com/apache/atlas/blob/d27790dfdde09a58db15064bbdaf77d224f61ecc/common/src/test/java/org/apache/atlas/utils/AtlasPathExtractorUtilTest.java]
if we have 2 AWS S3 files from different buckets:
# s3://aws_my_bucket*1/1234567890/test.csv*
# s3://aws_my_bucket*2/1234567890/test.csv*
as you see there is 2 different directories from different buckets, but having
same objectPrefix, and different qualified name.
object 1:
aws_s3_v2_directory: qualifiedName: "s3://*aws_my_bucket1*/1234567890/"
objectPrefix: "/1234567890/"
object 2:
aws_s3_v2_directory:
qualifiedName: "s3://*aws_my_bucket2*/1234567890/"
objectPrefix: "/1234567890/"
So we should remove uniqueness
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
