liyafan82 opened a new pull request #7271: URL: https://github.com/apache/arrow/pull/7271
In the past, we run integration tests from main methods, and recently, we have changed this to run them by the failsafe plugin. This is a good change, but it also leads to significant performance degradation. In the past, it took about 10s to run ITTestLargeVector#testLargeDecimalVector, now it takes more than half an hour. Our investigation shows that the problem was caused by calling HistoricalLog#recordEvent repeatedly. This method is called only when BaseAllocator#DEBUG is enabled. In a unit/integration test, the flag is enabled by default. We solve the problem with the following steps: 1. We set system property to disable the BaseAllocator#DEBUG flag. 2. We change the logic so that the system property takes precedence over the AssertionUtil#isAssertionsEnabled method. This makes the integration tests as fast as before. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
