[
https://issues.apache.org/jira/browse/SPARK-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063454#comment-14063454
]
Matthew Farrellee commented on SPARK-2313:
------------------------------------------
as this stands, having another communication mechanism for py4j that can be
controlled by the parent is the proper solution. using something like a domain
socket may also assist in the return path from py4j (tmp file).
fyi, a recent change pushed all existing output to stderr in the
spark-class/spark-submit path
i'm not actively working on this
> PySpark should accept port via a command line argument rather than STDIN
> ------------------------------------------------------------------------
>
> Key: SPARK-2313
> URL: https://issues.apache.org/jira/browse/SPARK-2313
> Project: Spark
> Issue Type: Bug
> Components: PySpark
> Reporter: Patrick Wendell
>
> Relying on stdin is a brittle mechanism and has broken several times in the
> past. From what I can tell this is used only to bootstrap worker.py one time.
> It would be strictly simpler to just pass it is a command line.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
