dongjoon-hyun commented on code in PR #45654: URL: https://github.com/apache/spark/pull/45654#discussion_r1534988182
########## sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-jdk21-results.txt: ########## @@ -2,69 +2,69 @@ Parquet writer benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure +OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure AMD EPYC 7763 64-Core Processor Parquet(PARQUET_1_0) writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Output Single Int Column 1677 1729 73 9.4 106.6 1.0X -Output Single Double Column 1879 1895 22 8.4 119.4 0.9X -Output Int and String Column 4135 4144 13 3.8 262.9 0.4X -Output Partitions 3027 3042 21 5.2 192.4 0.6X -Output Buckets 4258 4265 11 3.7 270.7 0.4X +Output Single Int Column 1744 1797 75 9.0 110.9 1.0X +Output Single Double Column 1753 1775 31 9.0 111.4 1.0X +Output Int and String Column 4384 4389 8 3.6 278.7 0.4X +Output Partitions 2948 3021 103 5.3 187.4 0.6X +Output Buckets 4110 4219 154 3.8 261.3 0.4X -OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure +OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure AMD EPYC 7763 64-Core Processor Parquet(PARQUET_2_0) writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Output Single Int Column 1770 1797 38 8.9 112.5 1.0X -Output Single Double Column 1673 1703 43 9.4 106.3 1.1X -Output Int and String Column 4330 4337 10 3.6 275.3 0.4X -Output Partitions 3129 3133 6 5.0 198.9 0.6X -Output Buckets 4160 4192 46 3.8 264.5 0.4X +Output Single Int Column 1605 1640 50 9.8 102.0 1.0X +Output Single Double Column 1709 1726 25 9.2 108.6 0.9X +Output Int and String Column 4570 4587 24 3.4 290.5 0.4X +Output Partitions 2943 2960 23 5.3 187.1 0.5X +Output Buckets 3816 3851 50 4.1 242.6 0.4X ================================================================================================ ORC writer benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure +OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure AMD EPYC 7763 64-Core Processor ORC writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative Review Comment: ORC write is improved. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
