LuciferYang commented on PR #37353:
URL: https://github.com/apache/spark/pull/37353#issuecomment-1200630766
Using Scala 2.13
**Before**
```
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Range iterator size 100: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 1 1
1 88.5 11.3 1.0X
Use Utils.getIteratorSize 12 12
0 8.4 119.4 0.1X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Range iterator size 1000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 1 1
1 88.6 11.3 1.0X
Use Utils.getIteratorSize 419 504
104 0.2 4187.4 0.0X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Range iterator size 10000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 2 3
2 50.1 19.9 1.0X
Use Utils.getIteratorSize 7666 8169
711 0.0 76659.3 0.0X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Range iterator size 30000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 1 2
1 87.0 11.5 1.0X
Use Utils.getIteratorSize 18400 18615
305 0.0 183999.1 0.0X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Seq iterator size 100: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 5 6
2 21.1 47.3 1.0X
Use Utils.getIteratorSize 38 39
1 2.6 382.4 0.1X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Seq iterator size 1000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 5 5
1 20.0 50.1 1.0X
Use Utils.getIteratorSize 941 968
46 0.1 9407.8 0.0X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Seq iterator size 10000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 9 14
2 11.3 88.6 1.0X
Use Utils.getIteratorSize 8646 8977
468 0.0 86457.7 0.0X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Seq iterator size 30000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 5 6
2 20.1 49.8 1.0X
Use Utils.getIteratorSize 28275 29490
1717 0.0 282753.1 0.0X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Array iterator size 100: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 1 2
1 77.8 12.8 1.0X
Use Utils.getIteratorSize 30 31
1 3.3 303.9 0.0X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Array iterator size 1000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 1 1
1 185.2 5.4 1.0X
Use Utils.getIteratorSize 388 414
27 0.3 3881.9 0.0X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Array iterator size 10000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 1 1
1 185.3 5.4 1.0X
Use Utils.getIteratorSize 4651 5066
586 0.0 46508.7 0.0X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Array iterator size 30000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 1 1
1 185.7 5.4 1.0X
Use Utils.getIteratorSize 14514 15972
2061 0.0 145144.5 0.0X
```
**After**
```
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Range iterator size 100: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 1 2
1 90.3 11.1 1.0X
Use Utils.getIteratorSize 1 2
2 82.7 12.1 0.9X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Range iterator size 1000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 1 2
1 90.9 11.0 1.0X
Use Utils.getIteratorSize 1 2
1 83.8 11.9 0.9X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Range iterator size 10000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 1 2
1 89.1 11.2 1.0X
Use Utils.getIteratorSize 1 1
1 83.1 12.0 0.9X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Range iterator size 30000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 1 1
1 89.6 11.2 1.0X
Use Utils.getIteratorSize 1 2
1 82.8 12.1 0.9X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Seq iterator size 100: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 4 6
3 28.4 35.2 1.0X
Use Utils.getIteratorSize 4 5
2 27.3 36.6 1.0X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Seq iterator size 1000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 5 7
3 20.4 49.1 1.0X
Use Utils.getIteratorSize 6 11
2 16.8 59.5 0.8X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Seq iterator size 10000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 5 9
5 19.9 50.3 1.0X
Use Utils.getIteratorSize 6 11
2 15.6 64.0 0.8X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Seq iterator size 30000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 8 14
2 12.5 80.3 1.0X
Use Utils.getIteratorSize 6 11
3 18.0 55.5 1.4X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Array iterator size 100: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 1 1
1 101.2 9.9 1.0X
Use Utils.getIteratorSize 1 1
1 80.0 12.5 0.8X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Array iterator size 1000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 1 1
0 185.3 5.4 1.0X
Use Utils.getIteratorSize 2 4
2 42.9 23.3 0.2X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Array iterator size 10000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 1 1
1 142.1 7.0 1.0X
Use Utils.getIteratorSize 1 2
1 83.7 11.9 0.6X
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 11.4
Apple M1
Test Array iterator size 30000: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Use Iterator.size 1 1
1 185.4 5.4 1.0X
Use Utils.getIteratorSize 1 1
1 118.8 8.4 0.6X
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
