adoroszlai opened a new pull request, #7793: URL: https://github.com/apache/ozone/pull/7793
## What changes were proposed in this pull request? Cluster startup/shutdown is the most time-consuming part of the test for several classes (30+ seconds for each of the following test classes). ``` [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.108 s - in org.apache.hadoop.fs.ozone.TestOzoneFsHAURLs [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.312 s - in org.apache.hadoop.hdds.scm.TestAllocateContainer [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.292 s - in org.apache.hadoop.hdds.scm.TestContainerReportWithKeys [INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.5 s - in org.apache.hadoop.hdds.scm.TestContainerSmallFile [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.365 s - in org.apache.hadoop.hdds.scm.TestGetCommittedBlockLengthAndPutKey [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.138 s - in org.apache.hadoop.hdds.scm.TestSCMNodeManagerMXBean [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.297 s - in org.apache.hadoop.hdds.scm.pipeline.TestPipelineManagerMXBean [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.23 s - in org.apache.hadoop.ozone.TestCpuMetrics [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.475 s - in org.apache.hadoop.ozone.TestGetClusterTreeInformation [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.577 s - in org.apache.hadoop.ozone.container.metrics.TestDatanodeQueueMetrics [INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.81 s - in org.apache.hadoop.ozone.freon.TestDNRPCLoadGenerator [INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.423 s - in org.apache.hadoop.ozone.om.TestObjectStore [INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.007 s - in org.apache.hadoop.ozone.om.TestObjectStoreWithFSO [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.304 s - in org.apache.hadoop.ozone.om.TestOmBlockVersioning [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.132 s - in org.apache.hadoop.ozone.om.TestOzoneManagerRestInterface [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.587 s - in org.apache.hadoop.ozone.shell.TestScmAdminHA ``` Safe integration tests (ones which do not stop / restart components) can be run on the same `MiniOzoneCluster` to save time. This PR creates two such test groups, one for HA and another for non-HA. Test implementations are kept in existing separate classes, but they no longer manage the lifecycle of the cluster. Further tests can be updated in follow-up, but wanted to keep the change relatively small here. https://issues.apache.org/jira/browse/HDDS-12183 ## How was this patch tested? Total time for these grouped tests is less than 2 minutes: ``` 2025-02-02T19:34:25.6207523Z [INFO] Running org.apache.ozone.test.TestOzoneIntegrationHA 2025-02-02T19:35:08.0532396Z [INFO] Running org.apache.ozone.test.HATests$ScmAdminHA 2025-02-02T19:35:08.3292991Z [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.264 s - in org.apache.ozone.test.HATests$ScmAdminHA 2025-02-02T19:35:08.3294514Z [INFO] Running org.apache.ozone.test.HATests$DatanodeQueueMetrics 2025-02-02T19:35:09.7697990Z [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.429 s - in org.apache.ozone.test.HATests$DatanodeQueueMetrics 2025-02-02T19:35:09.7788304Z [INFO] Running org.apache.ozone.test.HATests$GetClusterTreeInformation 2025-02-02T19:35:11.8574699Z [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.061 s - in org.apache.ozone.test.HATests$GetClusterTreeInformation 2025-02-02T19:35:11.8650174Z [INFO] Running org.apache.ozone.test.HATests$OzoneFsHAURLs 2025-02-02T19:35:13.6359721Z [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.757 s - in org.apache.ozone.test.HATests$OzoneFsHAURLs 2025-02-02T19:35:22.9608544Z [INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.336 s - in org.apache.ozone.test.TestOzoneIntegrationHA 2025-02-02T19:35:24.3609647Z [INFO] Running org.apache.ozone.test.TestOzoneIntegrationNonHA 2025-02-02T19:35:56.2101096Z [INFO] Running org.apache.ozone.test.NonHATests$OzoneManagerRestInterface 2025-02-02T19:35:56.4804421Z [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.265 s - in org.apache.ozone.test.NonHATests$OzoneManagerRestInterface 2025-02-02T19:35:56.4808719Z [INFO] Running org.apache.ozone.test.NonHATests$OmBlockVersioning 2025-02-02T19:35:57.7629080Z [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.276 s - in org.apache.ozone.test.NonHATests$OmBlockVersioning 2025-02-02T19:35:57.7656265Z [INFO] Running org.apache.ozone.test.NonHATests$ObjectStoreWithFSO 2025-02-02T19:35:59.6805203Z [INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.912 s - in org.apache.ozone.test.NonHATests$ObjectStoreWithFSO 2025-02-02T19:35:59.6824980Z [INFO] Running org.apache.ozone.test.NonHATests$ObjectStore 2025-02-02T19:35:59.7759688Z [INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.087 s - in org.apache.ozone.test.NonHATests$ObjectStore 2025-02-02T19:35:59.7780535Z [INFO] Running org.apache.ozone.test.NonHATests$DNRPCLoadGenerator 2025-02-02T19:36:04.4931112Z [INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.715 s - in org.apache.ozone.test.NonHATests$DNRPCLoadGenerator 2025-02-02T19:36:04.4932291Z [INFO] Running org.apache.ozone.test.NonHATests$CpuMetrics 2025-02-02T19:36:05.0518019Z [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.553 s - in org.apache.ozone.test.NonHATests$CpuMetrics 2025-02-02T19:36:05.0524175Z [INFO] Running org.apache.ozone.test.NonHATests$PipelineManagerMXBean 2025-02-02T19:36:05.0637681Z [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 s - in org.apache.ozone.test.NonHATests$PipelineManagerMXBean 2025-02-02T19:36:05.0643743Z [INFO] Running org.apache.ozone.test.NonHATests$SCMNodeManagerMXBean 2025-02-02T19:36:05.0823699Z [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 s - in org.apache.ozone.test.NonHATests$SCMNodeManagerMXBean 2025-02-02T19:36:05.0830009Z [INFO] Running org.apache.ozone.test.NonHATests$GetCommittedBlockLengthAndPutKey 2025-02-02T19:36:05.2385383Z [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.143 s - in org.apache.ozone.test.NonHATests$GetCommittedBlockLengthAndPutKey 2025-02-02T19:36:05.2386091Z [INFO] Running org.apache.ozone.test.NonHATests$ContainerSmallFile 2025-02-02T19:36:05.3736364Z [INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.135 s - in org.apache.ozone.test.NonHATests$ContainerSmallFile 2025-02-02T19:36:05.3742900Z [INFO] Running org.apache.ozone.test.NonHATests$ContainerReportWithKeys 2025-02-02T19:36:05.4369321Z [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.061 s - in org.apache.ozone.test.NonHATests$ContainerReportWithKeys 2025-02-02T19:36:05.4370413Z [INFO] Running org.apache.ozone.test.NonHATests$AllocateContainer 2025-02-02T19:36:05.4556415Z [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 s - in org.apache.ozone.test.NonHATests$AllocateContainer 2025-02-02T19:36:12.5130242Z [INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.148 s - in org.apache.ozone.test.TestOzoneIntegrationNonHA ``` https://github.com/adoroszlai/ozone/actions/runs/13101544695 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
