hi,all I am now using spark in production. but I notice spark driver including rdd and dag... and the executors will try to register with the driver.
I think the driver should run on the cluster.and client should run on the gateway. Similar like: <http://apache-spark-user-list.1001560.n3.nabble.com/file/n5575/Spark-interactive_shell.jpg> -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/about-spark-interactive-shell-tp5575.html Sent from the Apache Spark User List mailing list archive at Nabble.com.