Hi, I configured my Spark in Zeppelin to use a remote YARN cluster. I set the "master=yarn" and "deploy-mode=client". Then I started playing some spark command. Everything looks good. I can see the new Spark application in the YARN RM page, and I can see the Spark UI page.
But after some time, when I try to execute any spark statement, I got "java.net.ConnectException: Connection refused". And the spark application logs says (at the end): 16/10/12 07:14:07 ERROR executor.*CoarseGrainedExecutorBackend*: Driver 172.17.0.3:7229 disassociated! Shutting down. 16/10/12 07:14:07 INFO storage.DiskBlockManager: Shutdown hook called 16/10/12 07:14:07 INFO util.ShutdownHookManager: Shutdown hook called 16/10/12 07:14:07 INFO util.ShutdownHookManager: Deleting directory /tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1476089048026_0005/spark-aeaad795-6006-4bf1-b512-08de8bccf1bf End of LogType:stderr Any idea? -- Thanks, David S.
