steveloughran commented on issue #1810: HADOOP-16746 mkdirs and s3guard auth mode URL: https://github.com/apache/hadoop/pull/1810#issuecomment-576340720 latest PR is up; tested s3 ireland with and without ddb, at scale * Out of date entries only propagate from S3 to DDB *when there's a DDB entry*. This is the current policy; there's now a constant to change behaviour and more discussion about the details. So the next person maintaining it will understand what is going on better. (note, also change in ITestS3GuardWriteBack to disable the test when write back always happens) * Only writes the auth bit to an empty dir when the path is auth, rather than do it whenever an empty dir is recorded in S3Guard. ITestRestrictedReadAccess showed that problem; there's been a bit of tuning in that test to make it more robust to configs and previous test runs. Tune ITestDynamoDBMetadataStoreAuthoritativeMode * remove superfluous test case * more asserts about directory states during rename * enable another ignored test case
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
