shameersss1 commented on PR #6122:
URL: https://github.com/apache/hadoop/pull/6122#issuecomment-1780575205
> looks good and I'm not going to review backports except for backporting
issues.
>
> which s3 region did you test against, and with what parameters?
How was this patch tested?
1. Ran S3A Unit Tests
2. Ran S3A Integration test in us-west-1 region
[INFO] Running
org.apache.hadoop.fs.s3a.commit.staging.TestDirectoryCommitterScale [INFO]
Running org.apache.hadoop.fs.s3a.commit.staging.TestPaths [INFO] Running
org.apache.hadoop.fs.s3a.commit.TestMagicCommitPaths [INFO] Running
org.apache.hadoop.fs.s3a.commit.staging.TestStagingCommitter [INFO] Running
org.apache.hadoop.fs.s3a.commit.staging.TestStagingPartitionedFileListing
[INFO] Running
org.apache.hadoop.fs.s3a.commit.staging.TestStagingDirectoryOutputCommitter
[INFO] Running
org.apache.hadoop.fs.s3a.commit.staging.TestStagingPartitionedJobCommit [INFO]
Running
org.apache.hadoop.fs.s3a.commit.staging.TestStagingPartitionedTaskCommit [INFO]
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.473 s - in
org.apache.hadoop.fs.s3a.commit.TestMagicCommitPaths [INFO] Tests run: 14,
Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.611 s - in
org.apache.hadoop.fs.s3a.commit.staging.TestPaths [INFO] Tests run: 8,
Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.9
65 s - in
org.apache.hadoop.fs.s3a.commit.staging.TestStagingDirectoryOutputCommitter
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.474 s
- in org.apache.hadoop.fs.s3a.commit.staging.TestStagingPartitionedFileListing
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.627 s
- in org.apache.hadoop.fs.s3a.commit.staging.TestStagingPartitionedJobCommit
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.249 s
- in org.apache.hadoop.fs.s3a.commit.staging.TestStagingPartitionedTaskCommit
[INFO] Tests run: 63, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 61.11 s
- in org.apache.hadoop.fs.s3a.commit.staging.TestStagingCommitter [INFO] Tests
run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 84.193 s - in
org.apache.hadoop.fs.s3a.commit.staging.TestDirectoryCommitterScale [INFO]
Running
org.apache.hadoop.fs.s3a.commit.staging.integration.ITestStagingCommitProtocol
[INFO] Running org.apache.hadoop.fs.s3a.comm
it.staging.integration.ITestDirectoryCommitProtocol [INFO] Running
org.apache.hadoop.fs.s3a.commit.staging.integration.ITestPartitionedCommitProtocol
[INFO] Running
org.apache.hadoop.fs.s3a.commit.staging.integration.ITestStagingCommitProtocolFailure
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.901 s
- in
.hadoop.fs.s3a.commit.staging.integration.ITestStagingCommitProtocolFailure
[INFO] Running org.apache.hadoop.fs.s3a.commit.magic.ITestMagicCommitProtocol
[INFO] Running
org.apache.hadoop.fs.s3a.commit.magic.ITestMagicCommitProtocolFailure [INFO]
Running org.apache.hadoop.fs.s3a.commit.integration.ITestS3ACommitterMRJob
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.225 s
- in org.apache.hadoop.fs.s3a.commit.magic.ITestMagicCommitProtocolFailure
[INFO] Running org.apache.hadoop.fs.s3a.commit.ITestS3ACommitterFactory [INFO]
Running org.apache.hadoop.fs.s3a.commit.ITestCommitOperations [INFO] Running
org.apache.hadoop.fs.s3a.commi
t.ITestCommitOperationCost [INFO] Tests run: 1, Failures: 0, Errors: 0,
Skipped: 0, Time elapsed: 7.05 s - in
org.apache.hadoop.fs.s3a.commit.ITestS3ACommitterFactory [INFO] Tests run: 4,
Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.398 s - in
org.apache.hadoop.fs.s3a.commit.ITestCommitOperationCost [INFO] Tests run: 18,
Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 143.308 s - in
org.apache.hadoop.fs.s3a.commit.ITestCommitOperations [INFO] Running
org.apache.hadoop.fs.s3a.auth.ITestAssumedRoleCommitOperations [INFO] Tests
run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 218.466 s - in
org.apache.hadoop.fs.s3a.commit.integration.ITestS3ACommitterMRJob [WARNING]
Tests run: 18, Failures: 0, Errors: 0, Skipped: 18, Time elapsed: 62.036 s - in
org.apache.hadoop.fs.s3a.auth.ITestAssumedRoleCommitOperations [WARNING] Tests
run: 24, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 429.367 s - in
.hadoop.fs.s3a.commit.staging.integration.ITestPartitionedCommitProtoco
l [INFO] Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
472.06 s - in
.hadoop.fs.s3a.commit.staging.integration.ITestStagingCommitProtocol [INFO]
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 498.078 s - in
.hadoop.fs.s3a.commit.staging.integration.ITestDirectoryCommitProtocol [INFO]
Tests run: 23, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 861.607 s - in
org.apache.hadoop.fs.s3a.commit.magic.ITestMagicCommitProtocol [INFO] Running
org.apache.hadoop.fs.s3a.commit.magic.ITestS3AHugeMagicCommits [WARNING] Tests
run: 10, Failures: 0, Errors: 0, Skipped: 10, Time elapsed: 29.141 s - in
org.apache.hadoop.fs.s3a.commit.magic.ITestS3AHugeMagicCommits [INFO] Running
org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A [WARNING] Tests
run: 14, Failures: 0, Errors: 0, Skipped: 14, Time elapsed: 47.485 s - in
org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
