LuciferYang commented on code in PR #56072: URL: https://github.com/apache/spark/pull/56072#discussion_r3295835393
########## sql/core/benchmarks/VectorizedRleValuesReaderBenchmark-results.txt: ########## @@ -2,153 +2,153 @@ Boolean decode ================================================================================================ -OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure -AMD EPYC 7763 64-Core Processor +OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1013-azure +AMD EPYC 9V74 80-Core Processor RLE readBooleans decode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cold reader, trueRatio=0.0 0 0 0 66239.8 0.0 1.0X -reused reader, trueRatio=0.0 0 0 0 57887.6 0.0 0.9X -cold reader, trueRatio=0.1 1 1 0 893.5 1.1 0.0X -reused reader, trueRatio=0.1 1 1 0 895.6 1.1 0.0X -cold reader, trueRatio=0.5 1 1 0 1018.7 1.0 0.0X -reused reader, trueRatio=0.5 1 1 0 1029.4 1.0 0.0X -cold reader, trueRatio=0.9 1 1 0 891.9 1.1 0.0X -reused reader, trueRatio=0.9 1 1 0 894.8 1.1 0.0X -cold reader, trueRatio=1.0 0 0 0 67001.7 0.0 1.0X -reused reader, trueRatio=1.0 0 0 0 72380.5 0.0 1.1X +cold reader, trueRatio=0.0 0 0 0 72762.2 0.0 1.0X +reused reader, trueRatio=0.0 0 0 0 74151.5 0.0 1.0X +cold reader, trueRatio=0.1 1 1 0 891.7 1.1 0.0X +reused reader, trueRatio=0.1 1 1 0 894.1 1.1 0.0X +cold reader, trueRatio=0.5 1 1 0 1035.0 1.0 0.0X +reused reader, trueRatio=0.5 1 1 0 1031.8 1.0 0.0X +cold reader, trueRatio=0.9 1 1 0 881.6 1.1 0.0X +reused reader, trueRatio=0.9 1 1 0 889.2 1.1 0.0X +cold reader, trueRatio=1.0 0 0 0 69474.3 0.0 1.0X +reused reader, trueRatio=1.0 0 0 0 69942.4 0.0 1.0X ================================================================================================ Integer decode ================================================================================================ -OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure -AMD EPYC 7763 64-Core Processor +OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1013-azure +AMD EPYC 9V74 80-Core Processor RLE readIntegers dictionary-id decode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PACKED cold, bitWidth=4 2 2 0 505.6 2.0 1.0X -PACKED reused, bitWidth=4 2 2 0 504.6 2.0 1.0X -RLE, bitWidth=4 0 0 0 18249.1 0.1 36.1X -PACKED cold, bitWidth=8 2 2 0 497.6 2.0 1.0X -PACKED reused, bitWidth=8 2 2 0 496.2 2.0 1.0X -RLE, bitWidth=8 0 0 0 18123.0 0.1 35.8X -PACKED cold, bitWidth=12 3 3 0 370.2 2.7 0.7X -PACKED reused, bitWidth=12 3 3 0 369.6 2.7 0.7X -RLE, bitWidth=12 0 0 0 18573.3 0.1 36.7X -PACKED cold, bitWidth=20 3 3 0 315.1 3.2 0.6X -PACKED reused, bitWidth=20 3 3 0 316.2 3.2 0.6X -RLE, bitWidth=20 0 0 0 18570.0 0.1 36.7X +PACKED cold, bitWidth=4 2 2 0 473.3 2.1 1.0X +PACKED reused, bitWidth=4 2 2 0 467.4 2.1 1.0X +RLE, bitWidth=4 0 0 0 18167.5 0.1 38.4X +PACKED cold, bitWidth=8 2 2 0 471.0 2.1 1.0X +PACKED reused, bitWidth=8 2 2 0 464.9 2.2 1.0X +RLE, bitWidth=8 0 0 0 18195.9 0.1 38.4X +PACKED cold, bitWidth=12 3 3 0 338.6 3.0 0.7X +PACKED reused, bitWidth=12 3 3 0 336.6 3.0 0.7X +RLE, bitWidth=12 0 0 0 18214.9 0.1 38.5X +PACKED cold, bitWidth=20 4 4 0 284.2 3.5 0.6X +PACKED reused, bitWidth=20 4 4 0 285.1 3.5 0.6X +RLE, bitWidth=20 0 0 0 18158.1 0.1 38.4X ================================================================================================ Nullable batch decode with def-level materialization ================================================================================================ -OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure -AMD EPYC 7763 64-Core Processor +OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1013-azure +AMD EPYC 9V74 80-Core Processor Nullable batch with def-levels: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -nullRatio=0.0, n/a 0 0 0 6431.5 0.2 1.0X -nullRatio=0.1, random 9 9 0 114.6 8.7 0.0X -nullRatio=0.1, clustered 7 7 0 159.7 6.3 0.0X -nullRatio=0.3, random 13 13 0 80.1 12.5 0.0X -nullRatio=0.3, clustered 7 7 1 157.8 6.3 0.0X -nullRatio=0.5, random 14 15 0 72.7 13.7 0.0X -nullRatio=0.5, clustered 6 7 0 162.0 6.2 0.0X -nullRatio=0.9, random 8 8 0 126.4 7.9 0.0X -nullRatio=0.9, clustered 6 6 0 174.0 5.7 0.0X -nullRatio=1.0, random 0 0 0 8062.5 0.1 1.3X +nullRatio=0.0, n/a 0 0 0 5960.7 0.2 1.0X +nullRatio=0.1, random 11 11 0 98.8 10.1 0.0X +nullRatio=0.1, clustered 7 8 0 140.6 7.1 0.0X +nullRatio=0.3, random 16 16 1 67.4 14.8 0.0X +nullRatio=0.3, clustered 7 7 0 142.2 7.0 0.0X +nullRatio=0.5, random 17 17 0 60.5 16.5 0.0X +nullRatio=0.5, clustered 7 7 0 145.4 6.9 0.0X +nullRatio=0.9, random 9 9 0 112.1 8.9 0.0X +nullRatio=0.9, clustered 7 7 0 159.0 6.3 0.0X +nullRatio=1.0, random 0 0 0 2461.4 0.4 0.4X Review Comment: It seems the performance fails to meet expectations. Could this be related to the CPU model? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
