[
https://issues.apache.org/jira/browse/SPARK-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14328766#comment-14328766
]
Michael Nitschinger commented on SPARK-5921:
--------------------------------------------
I've also attached some screenshots that show the difference in log/ui.
> Task/Stage always in pending on foreachPartition
> ------------------------------------------------
>
> Key: SPARK-5921
> URL: https://issues.apache.org/jira/browse/SPARK-5921
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, Web UI
> Affects Versions: 1.2.0, 1.2.1
> Environment: OS X, standalone cluster with 1 or more slaves.
> Reporter: Michael Nitschinger
> Attachments: Screen Shot 2015-02-20 at 10.59.26.png, Screen Shot
> 2015-02-20 at 11.00.34.png
>
>
> I've got some very simple code:
> sc
> .parallelize(Seq("foo", "bar), 1)
> .foreachPartition({ iter =>
> println(iter)
> })
> when I run this against a standalone cluster the application itself
> completes, but the job is always active (never completes),because the stage
> is always pending.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
