[
https://issues.apache.org/jira/browse/SPARK-49491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878593#comment-17878593
]
Yuming Wang commented on SPARK-49491:
-------------------------------------
But there is a regression in Scala 2.13:
https://github.com/scala/bug/issues/13029
> Replace HashMap with LongMap or AnyRefMap
> -----------------------------------------
>
> Key: SPARK-49491
> URL: https://issues.apache.org/jira/browse/SPARK-49491
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 4.0.0
> Reporter: Yuming Wang
> Priority: Major
>
> JDK 1.8:
> {noformat}
> OpenJDK 64-Bit Server VM 1.8.0_382-b05 on Mac OS X 14.5
> Apple M2 Max
> Benchmark Map: Best Time(ms) Avg Time(ms)
> Stdev(ms) Rate(M/s) Per Row(ns) Relative
> ------------------------------------------------------------------------------------------------------------------------
> HashMap 2028 2063
> 98 0.0 506933.0 1.0X
> AnyRefMap 1901 1936
> 19 0.0 475346.3 1.1X
> {noformat}
> Java 17:
> {noformat}
> OpenJDK 64-Bit Server VM 17.0.7+7-LTS on Mac OS X 14.5
> Apple M2 Max
> Benchmark Map: Best Time(ms) Avg Time(ms)
> Stdev(ms) Rate(M/s) Per Row(ns) Relative
> ------------------------------------------------------------------------------------------------------------------------
> HashMap 1575 1615
> 47 0.0 393832.3 1.0X
> AnyRefMap 1495 1502
> 5 0.0 373664.5 1.1X
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
