Yikun commented on pull request #35773: URL: https://github.com/apache/spark/pull/35773#issuecomment-1062325739
@dongjoon-hyun Yes, it was also failed in 4U6G. My previous env have 8U16G, so it passed. Cluster have 4U means we can only use about 3U for resources. Also means we can only submitted <= 2 PI jobs (1 driver + 1 executor) in parallel **if no resource control**. Otherwise, all drivers are running to occupy all resource, executors will pending, then stack. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
