Re: Spark Kubernetes 3.0.1 | podcreationTimeout not working

2021-02-12 Thread Attila Zsolt Piros
I believe this problem led to opening SPARK-34389 where the problem is discussed further. [1] https://issues.apache.org/jira/browse/SPARK-34389 -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ - To

Re: Spark Kubernetes 3.0.1 | podcreationTimeout not working

2021-02-10 Thread Jacek Laskowski
Hi Ranju, Can you show the pods and their state? Does the situation happen at the very beginning of spark-submit or some time later (once you've got a couple of executors)? My understanding allows me to think of the driver not starting up due to lack of resources or executors. In either case

Spark Kubernetes 3.0.1 | podcreationTimeout not working

2021-02-10 Thread Ranju Jain
Hi, I submitted the spark job and pods goes in Pending state because of insufficient resources. But they are not getting deleted after this timeout of 60 sec. Please help me in understanding. Regards Ranju