MaxGekk opened a new pull request #27312: [SPARK-30599][CORE][SQL][TESTS] Increase the maximum number of log events in LogAppender URL: https://github.com/apache/spark/pull/27312 ### What changes were proposed in this pull request? Increased the limit for log events that could be stored in `SparkFunSuite.LogAppender` from 100 to 1000. ### Why are the changes needed? Sometimes (see traces in SPARK-30599) additional info is logged via log4j, and appended to `LogAppender`. For example, unusual log entries are: ``` [36] Removed broadcast_214_piece0 on 192.168.1.66:52354 in memory (size: 5.7 KiB, free: 2003.8 MiB) [37] Removed broadcast_204_piece0 on 192.168.1.66:52354 in memory (size: 5.7 KiB, free: 2003.9 MiB) [38] Removed broadcast_200_piece0 on 192.168.1.66:52354 in memory (size: 3.7 KiB, free: 2003.9 MiB) [39] Removed broadcast_207_piece0 on 192.168.1.66:52354 in memory (size: 24.2 KiB, free: 2003.9 MiB) [40] Removed broadcast_208_piece0 on 192.168.1.66:52354 in memory (size: 24.2 KiB, free: 2003.9 MiB) ``` ### Does this PR introduce any user-facing change? No ### How was this patch tested? By re-running `"SPARK-23786: warning should be printed if CSV header doesn't conform to schema"` in a loop.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
