[
https://issues.apache.org/jira/browse/SPARK-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14328833#comment-14328833
]
Michael Nitschinger commented on SPARK-5921:
--------------------------------------------
Hm, what makes me wonder is that the log shows it properly but the UI doesn't.
I poked around with different pieces of code and sometimes it did work,
sometimes it doesn't. I
I'll see if I can boil it down even further
> Task/Stage always in pending on foreachPartition in UI
> ------------------------------------------------------
>
> Key: SPARK-5921
> URL: https://issues.apache.org/jira/browse/SPARK-5921
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, Web UI
> Affects Versions: 1.2.0, 1.2.1
> Environment: OS X, standalone cluster with 1 or more slaves.
> Reporter: Michael Nitschinger
> Attachments: Screen Shot 2015-02-20 at 10.59.26.png, Screen Shot
> 2015-02-20 at 11.00.34.png
>
>
> I've got some very simple code:
> sc
> .parallelize(Seq("foo", "bar), 1)
> .foreachPartition({ iter =>
> println(iter)
> })
> when I run this against a standalone cluster the application itself
> completes, but the job is always active (never completes),because the stage
> is always pending.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
