[
https://issues.apache.org/jira/browse/HDDS-10615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Doroszlai updated HDDS-10615:
------------------------------------
Description:
{code}
Tests run: 11, Failures: 0, Errors: 3, Skipped: 1, Time elapsed: 2.998 s <<<
FAILURE! - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename
testRenamePopulatesFileAncestors2(org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename)
Time elapsed: 1.04 s <<< ERROR!
org.apache.hadoop.fs.s3a.RemoteFileChangedException: copy
`s3a://obs-bucket/test/testRenamePopulatesFileAncestors2/src/dir1/dir2/dir3/fileA':
ETag change detected on client during copy. Expected 2024-03-29T18:34:05.086Z
got f41ee8006d26bd7fc73828b0a0b350a8
at
org.apache.hadoop.fs.s3a.impl.ChangeDetectionPolicy.onChangeDetected(ChangeDetectionPolicy.java:317)
at
org.apache.hadoop.fs.s3a.impl.ChangeTracker.processNewRevision(ChangeTracker.java:288)
at
org.apache.hadoop.fs.s3a.impl.ChangeTracker.processMetadata(ChangeTracker.java:260)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$getObjectMetadata$11(S3AFileSystem.java:2667)
at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:468)
at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:431)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:2653)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$copyFile$29(S3AFileSystem.java:4271)
at org.apache.hadoop.fs.s3a.Invoker.once(Invoker.java:122)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.copyFile(S3AFileSystem.java:4269)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.access$1300(S3AFileSystem.java:266)
at
org.apache.hadoop.fs.s3a.S3AFileSystem$OperationCallbacksImpl.copyFile(S3AFileSystem.java:2285)
at
org.apache.hadoop.fs.s3a.impl.RenameOperation.copySource(RenameOperation.java:562)
testRenameWithNonEmptySubDir(org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename)
Time elapsed: 0.281 s <<< ERROR!
org.apache.hadoop.fs.s3a.RemoteFileChangedException: copy
`s3a://obs-bucket/test/testRenameWithNonEmptySubDir/src1/source.txt': ETag
change detected on client during copy. Expected 2024-03-29T18:34:05.352Z got
046d1988b7a01316bb47905ccf3b584a
testRenamePopulatesFileAncestors(org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename)
Time elapsed: 0.219 s <<< ERROR!
org.apache.hadoop.fs.s3a.RemoteFileChangedException: copy
`s3a://obs-bucket/test/testRenamePopulatesFileAncestors/source/dir1/dir2/dir3/file4':
ETag change detected on client during copy. Expected 2024-03-29T18:34:05.609Z
got 67e95334b751fbfc6570e8228183c074
Tests run: 4, Failures: 1, Errors: 0, Skipped: 1, Time elapsed: 1.314 s <<<
FAILURE! - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractEtag
testLocatedStatusAlsoHasEtag(org.apache.hadoop.fs.contract.s3a.ITestS3AContractEtag)
Time elapsed: 0.117 s <<< FAILURE!
org.junit.ComparisonFailure: [etag of listLocatedStatus
(S3ALocatedFileStatus{path=s3a://obs-bucket/test/testLocatedStatusAlsoHasEtag/src;
isDirectory=false; length=11; replication=1; blocksize=33554432;
modification_time=1711737272164; access_time=0; owner=...; group=...;
permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true;
isErasureCoded=false}[eTag='2024-03-29T18:34:32.164Z', versionId='']) compared
to HEAD value of
S3AFileStatus{path=s3a://obs-bucket/test/testLocatedStatusAlsoHasEtag/src;
isDirectory=false; length=11; replication=1; blocksize=33554432;
modification_time=1711737272000; access_time=0; owner=...; group=...;
permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true;
isErasureCoded=false} isEmptyDirectory=FALSE
eTag=26e078b87fdaa3206ab8bf63a6096c07 versionId=null]
expected:<"2[6e078b87fdaa3206ab8bf63a6096c07]"> but
was:<"2[024-03-29T18:34:32.164Z]">
...
at
org.apache.hadoop.fs.contract.AbstractContractEtagTest.testLocatedStatusAlsoHasEtag(AbstractContractEtagTest.java:186)
{code}
was:
{code}
Tests run: 11, Failures: 0, Errors: 3, Skipped: 1, Time elapsed: 2.998 s <<<
FAILURE! - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename
testRenamePopulatesFileAncestors2(org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename)
Time elapsed: 1.04 s <<< ERROR!
org.apache.hadoop.fs.s3a.RemoteFileChangedException: copy
`s3a://obs-bucket/test/testRenamePopulatesFileAncestors2/src/dir1/dir2/dir3/fileA':
ETag change detected on client during copy. Expected 2024-03-29T18:34:05.086Z
got f41ee8006d26bd7fc73828b0a0b350a8
at
org.apache.hadoop.fs.s3a.impl.ChangeDetectionPolicy.onChangeDetected(ChangeDetectionPolicy.java:317)
at
org.apache.hadoop.fs.s3a.impl.ChangeTracker.processNewRevision(ChangeTracker.java:288)
at
org.apache.hadoop.fs.s3a.impl.ChangeTracker.processMetadata(ChangeTracker.java:260)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$getObjectMetadata$11(S3AFileSystem.java:2667)
at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:468)
at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:431)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:2653)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$copyFile$29(S3AFileSystem.java:4271)
at org.apache.hadoop.fs.s3a.Invoker.once(Invoker.java:122)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.copyFile(S3AFileSystem.java:4269)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.access$1300(S3AFileSystem.java:266)
at
org.apache.hadoop.fs.s3a.S3AFileSystem$OperationCallbacksImpl.copyFile(S3AFileSystem.java:2285)
at
org.apache.hadoop.fs.s3a.impl.RenameOperation.copySource(RenameOperation.java:562)
testRenameWithNonEmptySubDir(org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename)
Time elapsed: 0.281 s <<< ERROR!
org.apache.hadoop.fs.s3a.RemoteFileChangedException: copy
`s3a://obs-bucket/test/testRenameWithNonEmptySubDir/src1/source.txt': ETag
change detected on client during copy. Expected 2024-03-29T18:34:05.352Z got
046d1988b7a01316bb47905ccf3b584a
testRenamePopulatesFileAncestors(org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename)
Time elapsed: 0.219 s <<< ERROR!
org.apache.hadoop.fs.s3a.RemoteFileChangedException: copy
`s3a://obs-bucket/test/testRenamePopulatesFileAncestors/source/dir1/dir2/dir3/file4':
ETag change detected on client during copy. Expected 2024-03-29T18:34:05.609Z
got 67e95334b751fbfc6570e8228183c074
19:34:32,231 [ERROR] Tests run: 4, Failures: 1, Errors: 0, Skipped: 1, Time
elapsed: 1.314 s <<< FAILURE! - in
org.apache.hadoop.fs.contract.s3a.ITestS3AContractEtag
19:34:32,231 [ERROR]
testLocatedStatusAlsoHasEtag(org.apache.hadoop.fs.contract.s3a.ITestS3AContractEtag)
Time elapsed: 0.117 s <<< FAILURE!
org.junit.ComparisonFailure: [etag of listLocatedStatus
(S3ALocatedFileStatus{path=s3a://obs-bucket/test/testLocatedStatusAlsoHasEtag/src;
isDirectory=false; length=11; replication=1; blocksize=33554432;
modification_time=1711737272164; access_time=0; owner=...; group=...;
permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true;
isErasureCoded=false}[eTag='2024-03-29T18:34:32.164Z', versionId='']) compared
to HEAD value of
S3AFileStatus{path=s3a://obs-bucket/test/testLocatedStatusAlsoHasEtag/src;
isDirectory=false; length=11; replication=1; blocksize=33554432;
modification_time=1711737272000; access_time=0; owner=...; group=...;
permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true;
isErasureCoded=false} isEmptyDirectory=FALSE
eTag=26e078b87fdaa3206ab8bf63a6096c07 versionId=null]
expected:<"2[6e078b87fdaa3206ab8bf63a6096c07]"> but
was:<"2[024-03-29T18:34:32.164Z]">
...
at
org.apache.hadoop.fs.contract.AbstractContractEtagTest.testLocatedStatusAlsoHasEtag(AbstractContractEtagTest.java:186)
{code}
> ETag change detected in S3A contract test
> -----------------------------------------
>
> Key: HDDS-10615
> URL: https://issues.apache.org/jira/browse/HDDS-10615
> Project: Apache Ozone
> Issue Type: Sub-task
> Components: S3
> Reporter: Attila Doroszlai
> Priority: Major
>
> {code}
> Tests run: 11, Failures: 0, Errors: 3, Skipped: 1, Time elapsed: 2.998 s <<<
> FAILURE! - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename
> testRenamePopulatesFileAncestors2(org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename)
> Time elapsed: 1.04 s <<< ERROR!
> org.apache.hadoop.fs.s3a.RemoteFileChangedException: copy
> `s3a://obs-bucket/test/testRenamePopulatesFileAncestors2/src/dir1/dir2/dir3/fileA':
> ETag change detected on client during copy. Expected
> 2024-03-29T18:34:05.086Z got f41ee8006d26bd7fc73828b0a0b350a8
> at
> org.apache.hadoop.fs.s3a.impl.ChangeDetectionPolicy.onChangeDetected(ChangeDetectionPolicy.java:317)
> at
> org.apache.hadoop.fs.s3a.impl.ChangeTracker.processNewRevision(ChangeTracker.java:288)
> at
> org.apache.hadoop.fs.s3a.impl.ChangeTracker.processMetadata(ChangeTracker.java:260)
> at
> org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$getObjectMetadata$11(S3AFileSystem.java:2667)
> at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:468)
> at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:431)
> at
> org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:2653)
> at
> org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$copyFile$29(S3AFileSystem.java:4271)
> at org.apache.hadoop.fs.s3a.Invoker.once(Invoker.java:122)
> at
> org.apache.hadoop.fs.s3a.S3AFileSystem.copyFile(S3AFileSystem.java:4269)
> at
> org.apache.hadoop.fs.s3a.S3AFileSystem.access$1300(S3AFileSystem.java:266)
> at
> org.apache.hadoop.fs.s3a.S3AFileSystem$OperationCallbacksImpl.copyFile(S3AFileSystem.java:2285)
> at
> org.apache.hadoop.fs.s3a.impl.RenameOperation.copySource(RenameOperation.java:562)
> testRenameWithNonEmptySubDir(org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename)
> Time elapsed: 0.281 s <<< ERROR!
> org.apache.hadoop.fs.s3a.RemoteFileChangedException: copy
> `s3a://obs-bucket/test/testRenameWithNonEmptySubDir/src1/source.txt': ETag
> change detected on client during copy. Expected 2024-03-29T18:34:05.352Z got
> 046d1988b7a01316bb47905ccf3b584a
> testRenamePopulatesFileAncestors(org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename)
> Time elapsed: 0.219 s <<< ERROR!
> org.apache.hadoop.fs.s3a.RemoteFileChangedException: copy
> `s3a://obs-bucket/test/testRenamePopulatesFileAncestors/source/dir1/dir2/dir3/file4':
> ETag change detected on client during copy. Expected
> 2024-03-29T18:34:05.609Z got 67e95334b751fbfc6570e8228183c074
> Tests run: 4, Failures: 1, Errors: 0, Skipped: 1, Time elapsed: 1.314 s <<<
> FAILURE! - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractEtag
> testLocatedStatusAlsoHasEtag(org.apache.hadoop.fs.contract.s3a.ITestS3AContractEtag)
> Time elapsed: 0.117 s <<< FAILURE!
> org.junit.ComparisonFailure: [etag of listLocatedStatus
> (S3ALocatedFileStatus{path=s3a://obs-bucket/test/testLocatedStatusAlsoHasEtag/src;
> isDirectory=false; length=11; replication=1; blocksize=33554432;
> modification_time=1711737272164; access_time=0; owner=...; group=...;
> permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true;
> isErasureCoded=false}[eTag='2024-03-29T18:34:32.164Z', versionId=''])
> compared to HEAD value of
> S3AFileStatus{path=s3a://obs-bucket/test/testLocatedStatusAlsoHasEtag/src;
> isDirectory=false; length=11; replication=1; blocksize=33554432;
> modification_time=1711737272000; access_time=0; owner=...; group=...;
> permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true;
> isErasureCoded=false} isEmptyDirectory=FALSE
> eTag=26e078b87fdaa3206ab8bf63a6096c07 versionId=null]
> expected:<"2[6e078b87fdaa3206ab8bf63a6096c07]"> but
> was:<"2[024-03-29T18:34:32.164Z]">
> ...
> at
> org.apache.hadoop.fs.contract.AbstractContractEtagTest.testLocatedStatusAlsoHasEtag(AbstractContractEtagTest.java:186)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
