[
https://issues.apache.org/jira/browse/SPARK-10296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716556#comment-14716556
]
Sean Owen commented on SPARK-10296:
-----------------------------------
That's an interesting idea. As the comments allude to, I believe this parameter
really exists to support mapping key-value pairs when the key doesn't change,
and isn't applicable to general map operations. It exists on mapPartitions to
support the methods in PairRDDFunctions. So I think the intent is to not expose
this for map. You could say, well, it doesn't hurt to expose -- but I think at
this point it would change some of the binary API signatures, which could be a
blocker obstacle. Not 100% sure on that.
> add preservesParitioning parameter to RDD.map
> ---------------------------------------------
>
> Key: SPARK-10296
> URL: https://issues.apache.org/jira/browse/SPARK-10296
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Reporter: Esteban Donato
> Priority: Minor
>
> It would be nice to add the Boolean parameter preservesParitioning with
> default false to RDD.map method just as it is in RDD.mapPartitions method.
> If you agree I can submit a pull request with this enhancement.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
