httfighter commented on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_… URL: https://github.com/apache/spark/pull/23437#issuecomment-452183521 @srowen Thank you for your review. I am adding new config and state to track if the Worker node failed to assign an executor to the application continuously，the executor number reaches tens of thousands in a short time. This will lead to the Master service and Worker service has been busy with RPC communication, affecting service status.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
