adoroszlai opened a new pull request, #7870: URL: https://github.com/apache/ozone/pull/7870
## What changes were proposed in this pull request? Speed up some Freon integration tests: - use single shared cluster (separate from other tests, because these Freon tests take a bit more time) - replace pair of `TestHadoopDirTreeGenerator`, `TestHadoopDirTreeGeneratorWithFSO` test with parameterized test - drop duplicate `TestRandomKeyGenerator` test case - reduce `TestRandomKeyGenerator` test size (number of buckets/keys) - increase chunk/block size for Freon test - reduce completion check interval (the time we notice Freon tasks are complete, so we can exit) Also: - reduce duplication between `TestOmBucketReadWriteFileOps` and `TestOmBucketReadWriteKeyOps` - close `FileSystem` instances properly https://issues.apache.org/jira/browse/HDDS-12315 ## How was this patch tested? Before: ``` Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 160.849 s - in org.apache.hadoop.ozone.freon.TestRandomKeyGenerator Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 85.673 s - in org.apache.hadoop.ozone.freon.TestOmBucketReadWriteKeyOps Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.322 s - in org.apache.hadoop.ozone.freon.TestOmBucketReadWriteFileOps Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.644 s - in org.apache.hadoop.ozone.freon.TestHsyncGenerator Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.916 s - in org.apache.hadoop.ozone.freon.TestHadoopNestedDirGenerator Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.021 s - in org.apache.hadoop.ozone.freon.TestHadoopDirTreeGeneratorWithFSO Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.901 s - in org.apache.hadoop.ozone.freon.TestHadoopDirTreeGenerator ``` After: ``` Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.565 s - in org.apache.ozone.test.FreonTests$RandomKeyGenerator Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.644 s - in org.apache.ozone.test.FreonTests$OmBucketReadWriteKeyOps Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.793 s - in org.apache.ozone.test.FreonTests$OmBucketReadWriteFileOps Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.088 s - in org.apache.ozone.test.FreonTests$HsyncGenerator Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.434 s - in org.apache.ozone.test.FreonTests$HadoopNestedDirGenerator Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.628 s - in org.apache.ozone.test.FreonTests$HadoopDirTreeGenerator Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.239 s - in org.apache.ozone.test.FreonTests$DNRPCLoadGenerator Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 123.236 s - in org.apache.ozone.test.TestFreon ``` (Total time is 123 seconds with the patch.) https://github.com/adoroszlai/ozone/actions/runs/13313983589 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
