[
https://issues.apache.org/jira/browse/HADOOP-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HADOOP-14323:
-----------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
I saw test failures:
{code}
$ mvn -Dit.test='ITestS3GuardListConsistency#testListStatusWriteBack'
-Dtest=none -Ds3guard -Ddynamo -q clean verify
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.441 sec - in
org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency
Results :
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0
$ mvn -Dit.test='ITestS3GuardListConsistency#testListStatusWriteBack'
-Dtest=none -Ds3guard -Ddynamodblocal -q verify
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.032 sec - in
org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency
Results :
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0
$ mvn -Dit.test='ITestS3GuardListConsistency#testListStatusWriteBack'
-Dtest=none -Ds3guard -Dlocal -q verify
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 3.273 sec <<<
FAILURE! - in org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency
testListStatusWriteBack(org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency)
Time elapsed: 3.179 sec <<< FAILURE!
java.lang.AssertionError: Metadata store without write back should still only
know about /OnS3AndMS, but it has:
DirListingMetadata{path=s3a://mliu-s3guard/test/ListStatusWriteBack,
listMap={s3a://mliu-s3guard/test/ListStatusWriteBack/OnS3AndMS=PathMetadata{fileStatus=S3AFileStatus{path=s3a://mliu-s3guard/test/ListStatusWriteBack/OnS3AndMS;
isDirectory=true; modification_time=0; access_time=0; owner=mliu; group=mliu;
permission=rwxrwxrwx; isSymlink=false; hasAcl=false; isEncrypted=false;
isErasureCoded=false} isEmptyDirectory=FALSE; isEmptyDirectory=UNKNOWN},
s3a://mliu-s3guard/test/ListStatusWriteBack/OnS3=PathMetadata{fileStatus=S3AFileStatus{path=s3a://mliu-s3guard/test/ListStatusWriteBack/OnS3;
isDirectory=true; modification_time=0; access_time=0; owner=mliu; group=mliu;
permission=rwxrwxrwx; isSymlink=false; hasAcl=false; isEncrypted=false;
isErasureCoded=false} isEmptyDirectory=FALSE; isEmptyDirectory=UNKNOWN}},
isAuthoritative=false} expected:<1> but was:<2>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at
org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency.testListStatusWriteBack(ITestS3GuardListConsistency.java:322)
{code}
If it's not failing before, is it because the recent change in listFiles()
(which I just committed)?
One nit {{asS3AFS()}} be static.
> ITestS3GuardListConsistency failure w/ Local, authoritative metadata store
> --------------------------------------------------------------------------
>
> Key: HADOOP-14323
> URL: https://issues.apache.org/jira/browse/HADOOP-14323
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: s3
> Affects Versions: HADOOP-13345
> Reporter: Aaron Fabbri
> Assignee: Aaron Fabbri
> Priority: Minor
> Fix For: HADOOP-13345
>
> Attachments: HADOOP-14323-HADOOP-13345.001.patch,
> HADOOP-14323-HADOOP-13345.002.patch
>
>
> When doing some testing for HADOOP-14266 I noticed this test failure:
> {noformat}
> java.lang.NullPointerException: null
> at
> org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency.testListStatusWriteBack(ITestS3GuardListConsistency.java:317)
> {noformat}
> I was running with LocalMetadataStore and
> {{fs.s3a.metadatastore.authoritative}} set to true. I haven't been testing
> this mode recently so not sure if this case ever worked. Lower priority but
> we should fix it.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
