Michael Nitschinger created SPARK-5921:
------------------------------------------
Summary: Task/Stage always in pending with 1 partition on
foreachPartition
Key: SPARK-5921
URL: https://issues.apache.org/jira/browse/SPARK-5921
Project: Spark
Issue Type: Bug
Components: Spark Core, Web UI
Affects Versions: 1.2.1, 1.2.0
Environment: OS X, standalone cluster with 1 or more slaves.
Reporter: Michael Nitschinger
I've got some very simple code:
sc
.parallelize(Seq("foo", "bar), 1)
.foreachPartition({ iter =>
println(iter)
})
when I run this against a standalone cluster the application itself completes,
but the job is always active (never completes),because the stage is always
pending.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
