Thank you Jungtaek. I will send you log file of supervisor, but let me first
try to set storm.local.hostname..The question: Do I set storm.local.hostname to
be the IP address of the node that runs the Nimbus? and Where would be these
setting, Is it for both master and slave nodes?
Thank you--RegardsWA
From: Jungtaek Lim <[email protected]>
To: Walid Aljoby <[email protected]>; "[email protected]"
<[email protected]>; Harsha Chintalapani <[email protected]>
Sent: Tuesday, July 5, 2016 6:25 PM
Subject: Re: Topology submision Bugs
If your supervisor has crashed please attach log file of supervisor. It could
be due to connectivity of Nimbus / Zookeeper, and if then you're likely don't
set /etc/hosts properly.
Before resolving you can still set storm.local.hostname to ip address and
restart all storm components.
On 2016년 7월 5일 (화) at 오후 7:17 Walid Aljoby <[email protected]> wrote:
Hi,
the nodes can ping each other using the name defined inside /etc/hosts.the
cluster consists of two machines: 10.10.10.20 and 10.10.10.15
this is my configuration for both machines:
storm.zookeeper.servers: - "10.10.10.20"nimbus.seeds: ["10.10.10.20"]
In 10.10.10.20, I run zookeeper, nimbus and UI. In the other one, I run
supervisor only, but it run for a short time then disapper!
I hope if something is missed, please let me know..
Thank you--Regards
WA
From: Jungtaek Lim <[email protected]>
To: Walid Aljoby <[email protected]>; Harsha Chintalapani
<[email protected]>; "[email protected]" <[email protected]>
Sent: Tuesday, July 5, 2016 5:41 PM
Subject: Re: Topology submision Bugs
If each node of your cluster doesn't recognize to each other by local hostname
of the node, you need to set storm.local.hostname to IP address for each node's
storm.yaml config file.
We occasionally add pairs of local hostname / IP to /etc/hosts of all nodes, or
register servers to private DNS when available.
Jungtaek Lim (HeartSaVioR)
2016년 7월 5일 (화) 오후 6:08, Walid Aljoby <[email protected]>님이 작성:
Thank you..
nimbus.seeds: the IP address of machine running nimbus (which is the same host
through which the topology is submitted).but the bugs still occur!
--Regards
WA From: Harsha Chintalapani <[email protected]>
To: [email protected]; Walid Aljoby <[email protected]>
Sent: Tuesday, July 5, 2016 6:50 AM
Subject: Re: Topology submision Bugs
unknownhost generally means your configuration in nimbus.seeds are unable to
resolve to a hostname. Make sure the entries you added in nimbus.seeds can be
pingable from the host you are submitting the topology
On Mon, Jul 4, 2016 at 2:27 PM Walid Aljoby <[email protected]> wrote:
Hi all,
I am running Apache Storm 1.0.1 over clusters of two nodes (one is called
Master which runs zookeeper and nimbus, the other one runs supervisor).I just
configured the storm.zookeeper.servers: and nimbus.seeds: to be the IP
address of Master node for both two machines.
However, when I submitted the topology through the Master node like this:
storm jar target/storm-starter-1.0.1.jar
org.apache.storm.starter.WordCountTopology DemoI came across into the following
Exceptions:
790 [main] INFO o.a.s.StormSubmitter - Generated ZooKeeper secret payload for
MD5-digest: -6025945650128968937:-8258756050733197469
866 [main] INFO o.a.s.s.a.AuthUtils - Got AutoCreds []
Exception in thread "main" java.lang.RuntimeException:
org.apache.storm.thrift.transport.TTransportException:
java.net.UnknownHostException: wf-ubuntun
at
org.apache.storm.security.auth.TBackoffConnect.retryNext(TBackoffConnect.java:64)
at
org.apache.storm.security.auth.TBackoffConnect.doConnectWithRetry(TBackoffConnect.java:56)
at
org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:99)
at org.apache.storm.security.auth.ThriftClient.<init>(ThriftClient.java:69)
at org.apache.storm.utils.NimbusClient.<init>(NimbusClient.java:106)
at
org.apache.storm.utils.NimbusClient.getConfiguredClientAs(NimbusClient.java:78)
at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:228)
at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:288)
at
org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:324)
at
org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:305)
at
org.apache.storm.starter.WordCountTopology.main(WordCountTopology.java:93)
Caused by: org.apache.storm.thrift.transport.TTransportException:
java.net.UnknownHostException: wf-ubuntun
at org.apache.storm.thrift.transport.TSocket.open(TSocket.java:226)
at
org.apache.storm.thrift.transport.TFramedTransport.open(TFramedTransport.java:81)
at
org.apache.storm.security.auth.SimpleTransportPlugin.connect(SimpleTransportPlugin.java:103)
at
org.apache.storm.security.auth.TBackoffConnect.doConnectWithRetry(TBackoffConnect.java:53)
... 9 more
Caused by: java.net.UnknownHostException: wf-ubuntun
at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at org.apache.storm.thrift.transport.TSocket.open(TSocket.java:221)
... 12 more
Please I hope anyone can help, and thank you in advance..
Best Regards---
WA
