Xiangrui Meng created SPARK-4398:
------------------------------------
Summary: Specialize rdd.parallelize for xrange
Key: SPARK-4398
URL: https://issues.apache.org/jira/browse/SPARK-4398
Project: Spark
Issue Type: Improvement
Components: PySpark
Reporter: Xiangrui Meng
Assignee: Xiangrui Meng
sc.parallelize(range) is slow, which writes to disk. We should specialize
xrange for performance.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
