dongjoon-hyun commented on PR #41507: URL: https://github.com/apache/spark/pull/41507#issuecomment-1582160844
The first commit passed all tests already (except pyspark-pandas-slow-connect). And, I verified the second commit manually. Merged to master. ``` [info] ParquetCodecSuite: 01:42:55.154 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable [info] - write and read - file source parquet - codec: none (10 seconds, 419 milliseconds) [info] - write and read - file source parquet - codec: uncompressed (1 second, 513 milliseconds) [info] - write and read - file source parquet - codec: snappy (1 second, 457 milliseconds) [info] - write and read - file source parquet - codec: gzip (1 second, 201 milliseconds) [info] - write and read - file source parquet - codec: zstd (1 second, 435 milliseconds) [info] - write and read - file source parquet - codec: lz4 (1 second, 163 milliseconds) [info] - write and read - file source parquet - codec: lz4raw (1 second, 282 milliseconds) 01:43:14.972 WARN org.apache.spark.sql.execution.datasources.ParquetCodecSuite: ===== POSSIBLE THREAD LEAK IN SUITE o.a.s.sql.execution.datasources.ParquetCodecSuite, threads: ForkJoinPool.commonPool-worker-6 (daemon=true), QueryStageCreator-0 (daemon=true), ForkJoinPool.commonPool-worker-4 (daemon=true), QueryStageCreator-5 (daemon=true), QueryStageCreator-4 (daemon=true), ForkJoinPool.commonPool-worker-7 (daemon=true), QueryStageCreator-1 (daemon=true), rpc-boss-3-1 (daemon=true), ForkJoinPool.commonPool-worker-5 (daemon=true), QueryStageCreator-6 (daemon=true), shuffle-boss-6-1 (daemon=true), ForkJoinPool.commonPool-worker-1 (daemon=true), ForkJoinPool.commonPool-worker-3 (daemon=true), QueryStageCreator-2 (daemon=true), QueryStageCreator-3 (daemon=true), ForkJoinPool.commonPool-worker-2 (daemon=true) ===== [info] Run completed in 22 seconds, 883 milliseconds. [info] Total number of tests run: 7 [info] Suites: completed 1, aborted 0 [info] Tests: succeeded 7, failed 0, canceled 0, ignored 0, pending 0 [info] All tests passed. [success] Total time: 487 s (08:07), completed Jun 8, 2023 1:43:15 AM ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
