[
https://issues.apache.org/jira/browse/SPARK-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14323487#comment-14323487
]
Davies Liu commented on SPARK-3316:
-----------------------------------
I remembered that this is fixed in SPARK-4415, we could mark this as
duplicated.
> Spark driver will not exit after python program finished
> --------------------------------------------------------
>
> Key: SPARK-3316
> URL: https://issues.apache.org/jira/browse/SPARK-3316
> Project: Spark
> Issue Type: Bug
> Components: PySpark
> Reporter: Davies Liu
>
> conf/spark-defaults.conf
> spark.driver.memory = 2g
> setup SPARK_HOME and PYTHONPATH, then
> $ python pyspark/conf.py
> $ jps
> daviesliu@dm:~/work/spark/python$ jps
> 29659 Jps
> 29658 SparkSubmit
> 29619 SparkSubmitDriverBootstrapper
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
