Emil Ejbyfeldt created SPARK-40950:
--------------------------------------
Summary: On scala 2.13 isRemoteAddressMaxedOut performance overhead
Key: SPARK-40950
URL: https://issues.apache.org/jira/browse/SPARK-40950
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.3.1, 3.2.2
Reporter: Emil Ejbyfeldt
On scala 2.13 the blocks in FetchRequest is sometimes backed by a `List` while
in 2.12 it would be ArrayBuffer. This means that calculating the length of the
blocks which is done in isRemoteAddressMaxedOut and other places now much more
expensive. This is because in 2.13 `Seq` is can no longer be backed by a
mutable collection.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
