dongjoon-hyun commented on pull request #32826:
URL: https://github.com/apache/spark/pull/32826#issuecomment-857226630
BTW, @dchristle . I quickly ran the micro benchmark on master branch on my
Mac before and after. We also need to check the memory usage, too.
```
OpenJDK 64-Bit Server VM 1.8.0_292-b09 on Mac OS X 10.16
Intel(R) Core(TM) i7-9750H CPU @ 2.60GHz
Benchmark ZStandardCompressionCodec: Best Time(ms) Avg
Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
-Compression 10000 times at level 1 without buffer pool 173
348 161 0.1 17267.7 1.0X
-Compression 10000 times at level 2 without buffer pool 616
669 57 0.0 61574.1 0.3X
-Compression 10000 times at level 3 without buffer pool 1302
1327 35 0.0 130234.4 0.1X
-Compression 10000 times at level 1 with buffer pool 177
192 9 0.1 17709.8 1.0X
-Compression 10000 times at level 2 with buffer pool 670
709 36 0.0 66965.9 0.3X
-Compression 10000 times at level 3 with buffer pool 1201
1209 11 0.0 120144.2 0.1X
+Compression 10000 times at level 1 without buffer pool 271
348 75 0.0 27106.5 1.0X
+Compression 10000 times at level 2 without buffer pool 655
720 59 0.0 65510.4 0.4X
+Compression 10000 times at level 3 without buffer pool 908
963 73 0.0 90777.5 0.3X
+Compression 10000 times at level 1 with buffer pool 181
194 11 0.1 18089.8 1.5X
+Compression 10000 times at level 2 with buffer pool 489
531 48 0.0 48917.8 0.6X
+Compression 10000 times at level 3 with buffer pool 859
948 108 0.0 85869.0 0.3X
OpenJDK 64-Bit Server VM 1.8.0_292-b09 on Mac OS X 10.16
Intel(R) Core(TM) i7-9750H CPU @ 2.60GHz
Benchmark ZStandardCompressionCodec: Best Time(ms)
Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------------
-Decompression 10000 times from level 1 without buffer pool 422
441 12 0.0 42239.7 1.0X
-Decompression 10000 times from level 2 without buffer pool 433
460 19 0.0 43342.9 1.0X
-Decompression 10000 times from level 3 without buffer pool 1241
1306 93 0.0 124091.5 0.3X
-Decompression 10000 times from level 1 with buffer pool 373
387 12 0.0 37268.1 1.1X
-Decompression 10000 times from level 2 with buffer pool 383
387 3 0.0 38296.0 1.1X
-Decompression 10000 times from level 3 with buffer pool 1116
1168 73 0.0 111603.1 0.4X
+Decompression 10000 times from level 1 without buffer pool 464
487 21 0.0 46420.0 1.0X
+Decompression 10000 times from level 2 without buffer pool 436
452 11 0.0 43596.2 1.1X
+Decompression 10000 times from level 3 without buffer pool 1308
1345 53 0.0 130781.6 0.4X
+Decompression 10000 times from level 1 with buffer pool 379
392 11 0.0 37895.4 1.2X
+Decompression 10000 times from level 2 with buffer pool 380
396 12 0.0 38038.2 1.2X
+Decompression 10000 times from level 3 with buffer pool 909
1001 130 0.0 90861.3 0.5X
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
