Xiangrui Meng created SPARK-4084:
------------------------------------
Summary: Reuse sort key in Sorter
Key: SPARK-4084
URL: https://issues.apache.org/jira/browse/SPARK-4084
Project: Spark
Issue Type: Improvement
Components: Spark Core
Reporter: Xiangrui Meng
Sorter uses generic-typed key for sorting. When data is large, it creates lots
of key objects, which is not efficient. We should reuse the key in Sorter for
memory efficiency. This change is part of the petabyte sort implementation from
[~rxin].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
