Ngone51 edited a comment on issue #27722: [SPARK-30969][CORE] Remove resource coordination support from Standalone URL: https://github.com/apache/spark/pull/27722#issuecomment-592031322 > Its just running discovery script and assuming this owns all of them, correct? Yea, I think this is the only difference. And it really break local-cluster mode. Though, I haven't made change in `LocalClusterSpark` to handle it and only update one related test to workaround it. And there's no more local-cluster mode tests rely on **coordination**. And, of cause, user should still be aware of resource conflict between multi drivers. So I still keep the warning in the doc. Same node driver and worker mode, actually, is not recommended when driver submitted in client mode. Ideally, it should be an edge node out of cluster for the driver and assumed not to be on the same of host of worker. I think the main concern to remove is this may introduce potential high maintain cost due to its complicate implementation compares to its low benefit we could have.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
