[
https://issues.apache.org/jira/browse/SPARK-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051093#comment-15051093
]
Apache Spark commented on SPARK-1109:
-------------------------------------
User 'ScrapCodes' has created a pull request for this issue:
https://github.com/apache/spark/pull/73
> wrong API docs for pyspark map function
> ---------------------------------------
>
> Key: SPARK-1109
> URL: https://issues.apache.org/jira/browse/SPARK-1109
> Project: Spark
> Issue Type: Bug
> Components: PySpark
> Affects Versions: 0.9.0
> Reporter: Diana Carroll
> Assignee: prashant
> Fix For: 0.9.1, 1.0.0
>
>
> The source code/API docs for the pyspark RDD map function says:
> def map(self, f, preservesPartitioning=False):
> """
> Return a new RDD containing the distinct elements in this RDD.
> """
> def func(split, iterator): return imap(f, iterator)
> return PipelinedRDD(self, func, preservesPartitioning)
> I think that was incorrectly cut-and-pasted from the distinct() function, and
> should actually say "Return a new RDD by applying a function to each element
> of this RDD."
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
