[
https://issues.apache.org/jira/browse/SPARK-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14328856#comment-14328856
]
Sean Owen commented on SPARK-5921:
----------------------------------
I wonder if it's related to https://issues.apache.org/jira/browse/SPARK-5259
which concerns a case where pending tasks may not be recognized. [~SuYan] do
you think it's related? do you want to try to get the PR submitted? it looks
like there are some outstanding comments.
> Task/Stage always in pending on foreachPartition in UI
> ------------------------------------------------------
>
> Key: SPARK-5921
> URL: https://issues.apache.org/jira/browse/SPARK-5921
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, Web UI
> Affects Versions: 1.2.0, 1.2.1
> Environment: OS X, standalone cluster with 1 or more slaves.
> Reporter: Michael Nitschinger
> Attachments: Screen Shot 2015-02-20 at 10.59.26.png, Screen Shot
> 2015-02-20 at 11.00.34.png
>
>
> I've got some very simple code:
> sc
> .parallelize(Seq("foo", "bar), 1)
> .foreachPartition({ iter =>
> println(iter)
> })
> when I run this against a standalone cluster the application itself
> completes, but the job is always active (never completes),because the stage
> is always pending.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
