Maybe this is a known issue with spark streaming and master web ui. Disable event logging, and it should be fine.
https://issues.apache.org/jira/browse/SPARK-6270 On Mon, Jun 22, 2015 at 8:54 AM, scar scar <scar0...@gmail.com> wrote: > Sorry I was on vacation for a few days. Yes, it is on. This is what I have > in the logs: > > 15/06/22 10:44:00 INFO ClientCnxn: Unable to read additional data from > server sessionid 0x14dd82e22f70ef1, likely server has closed socket, > closing socket connection and attempting reconnect > 15/06/22 10:44:00 INFO ClientCnxn: Unable to read additional data from > server sessionid 0x24dc5a319b40090, likely server has closed socket, > closing socket connection and attempting reconnect > 15/06/22 10:44:01 INFO ConnectionStateManager: State change: SUSPENDED > 15/06/22 10:44:01 INFO ConnectionStateManager: State change: SUSPENDED > 15/06/22 10:44:01 WARN ConnectionStateManager: There are no > ConnectionStateListeners registered. > 15/06/22 10:44:01 INFO ZooKeeperLeaderElectionAgent: We have lost > leadership > 15/06/22 10:44:01 ERROR Master: Leadership has been revoked -- master > shutting down. > > > On Thu, Jun 11, 2015 at 8:59 PM, Tathagata Das <t...@databricks.com> > wrote: > >> Do you have the event logging enabled? >> >> TD >> >> On Thu, Jun 11, 2015 at 11:24 AM, scar0909 <scar0...@gmail.com> wrote: >> >>> I have the same problem. i realized that the master spark becomes >>> unresponsive when we kill the leader zookeeper (of course i assigned the >>> leader election task to the zookeeper). please let me know if you have >>> any >>> devlepments. >>> >>> >>> >>> -- >>> View this message in context: >>> http://apache-spark-user-list.1001560.n3.nabble.com/Shutdown-with-streaming-driver-running-in-cluster-broke-master-web-UI-permanently-tp4149p23284.html >>> Sent from the Apache Spark User List mailing list archive at Nabble.com. >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>> For additional commands, e-mail: user-h...@spark.apache.org >>> >>> >> >
