zhao yufei created SPARK-32993:
----------------------------------
Summary: pyspark on yarn executor hang after some time
Key: SPARK-32993
URL: https://issues.apache.org/jira/browse/SPARK-32993
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 3.0.0
Reporter: zhao yufei
same pyspark program, previously it works ok, but these few days it alwayes
keep hang after running some time. the task is simple, fetch images from url
and use PIL image libary to process images finally write to tensorflow
tfrecords file
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]