Remove the storm local dir ( if supervisor disappears after some time ) On Tue, Jul 5, 2016 at 3:47 PM, Walid Aljoby <[email protected]> wrote:
> Hi, > > the nodes can ping each other using the name defined inside /etc/hosts. > the cluster consists of two machines: 10.10.10.20 and 10.10.10.15 > > this is my configuration for both machines: > > storm.zookeeper.servers: > - "10.10.10.20" > nimbus.seeds: ["10.10.10.20"] > > > In 10.10.10.20, I run zookeeper, nimbus and UI. In the other one, I run > supervisor only, but it run for a short time then disapper! > > I hope if something is missed, please let me know.. > > Thank you > -- > Regards > > WA > > ------------------------------ > *From:* Jungtaek Lim <[email protected]> > *To:* Walid Aljoby <[email protected]>; Harsha Chintalapani < > [email protected]>; "[email protected]" <[email protected]> > *Sent:* Tuesday, July 5, 2016 5:41 PM > > *Subject:* Re: Topology submision Bugs > > If each node of your cluster doesn't recognize to each other by local > hostname of the node, you need to set storm.local.hostname to IP address > for each node's storm.yaml config file. > > We occasionally add pairs of local hostname / IP to /etc/hosts of all > nodes, or register servers to private DNS when available. > > Jungtaek Lim (HeartSaVioR) > > 2016년 7월 5일 (화) 오후 6:08, Walid Aljoby <[email protected]>님이 작성: > > Thank you.. > > nimbus.seeds: the IP address of machine running nimbus (which is the same > host through which the topology is submitted). > but the bugs still occur! > > -- > Regards > > WA > ------------------------------ > *From:* Harsha Chintalapani <[email protected]> > *To:* [email protected]; Walid Aljoby <[email protected]> > *Sent:* Tuesday, July 5, 2016 6:50 AM > > *Subject:* Re: Topology submision Bugs > > unknownhost generally means your configuration in nimbus.seeds are unable > to resolve to a hostname. Make sure the entries you added in nimbus.seeds > can be pingable from the host you are submitting the topology > > On Mon, Jul 4, 2016 at 2:27 PM Walid Aljoby <[email protected]> > wrote: > > Hi all, > > I am running Apache Storm 1.0.1 over clusters of two nodes (one is called > Master which runs zookeeper and nimbus, the other one runs supervisor). > I just configured the storm.zookeeper.servers: and nimbus.seeds: to be > the IP address of Master node for both two machines. > > However, when I submitted the topology through the Master node like this: > storm jar target/storm-starter-1.0.1.jar > org.apache.storm.starter.WordCountTopology Demo > I came across into the following Exceptions: > > 790 [main] INFO o.a.s.StormSubmitter - Generated ZooKeeper secret > payload for MD5-digest: -6025945650128968937:-8258756050733197469 > 866 [main] INFO o.a.s.s.a.AuthUtils - Got AutoCreds [] > Exception in thread "main" java.lang.RuntimeException: > org.apache.storm.thrift.transport.TTransportException: > java.net.UnknownHostException: wf-ubuntun > at > org.apache.storm.security.auth.TBackoffConnect.retryNext(TBackoffConnect.java:64) > at > org.apache.storm.security.auth.TBackoffConnect.doConnectWithRetry(TBackoffConnect.java:56) > at > org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:99) > at > org.apache.storm.security.auth.ThriftClient.<init>(ThriftClient.java:69) > at org.apache.storm.utils.NimbusClient.<init>(NimbusClient.java:106) > at > org.apache.storm.utils.NimbusClient.getConfiguredClientAs(NimbusClient.java:78) > at > org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:228) > at > org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:288) > at > org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:324) > at > org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:305) > at > org.apache.storm.starter.WordCountTopology.main(WordCountTopology.java:93) > Caused by: org.apache.storm.thrift.transport.TTransportException: > java.net.UnknownHostException: wf-ubuntun > at org.apache.storm.thrift.transport.TSocket.open(TSocket.java:226) > at > org.apache.storm.thrift.transport.TFramedTransport.open(TFramedTransport.java:81) > at > org.apache.storm.security.auth.SimpleTransportPlugin.connect(SimpleTransportPlugin.java:103) > at > org.apache.storm.security.auth.TBackoffConnect.doConnectWithRetry(TBackoffConnect.java:53) > ... 9 more > Caused by: java.net.UnknownHostException: wf-ubuntun > at > java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > at java.net.Socket.connect(Socket.java:579) > at org.apache.storm.thrift.transport.TSocket.open(TSocket.java:221) > ... 12 more > > > > > Please I hope anyone can help, and thank you in advance.. > > > Best Regards > --- > > WA > > > > > > -- Thanks & Regards, Anshu Shukla
