HyukjinKwon commented on pull request #33537: URL: https://github.com/apache/spark/pull/33537#issuecomment-888716059
Yeah, I think we're talking about same thing. So we might better document it in developer tools page which is indented for testing/development only. There's only one reference of `local-cluster` mode in the main Spark documentation so I guess removing it out would be easier then finding the places for each cluster mode and add the documentation. People would find `local-cluster` mode when they read codes in general (as it's barely documented). I think `local` mode is slightly different though that can be used in single machine to leverage multiple cores, here's actual example: https://databricks.com/blog/2018/05/03/benchmarking-apache-spark-on-a-single-node-machine.html. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
