Seems like a name resolution issue. Have you configured the IP addresses for your supervisor machines in /etc/hosts?
On Wed, Feb 11, 2015 at 5:36 AM, Sa Li <[email protected]> wrote: > I did some changes, now, I don't see any errors on Storm UI, but it won't > work as it works in local mode, like writing things in DB, so I tail the > logs again, it is still: > > 2015-02-10T10:34:36.989-0800 b.s.m.n.Client [INFO] Reconnect started for > Netty-Client-pof-kstorm-dev2.pof.local:6702... [300] > 2015-02-10T10:34:36.989-0800 b.s.m.n.StormClientErrorHandler [INFO] > Connection failed Netty-Client-pof-kstorm-dev2.pof.local:6702 > java.nio.channels.UnresolvedAddressException: null > at sun.nio.ch.Net.checkAddress(Net.java:127) ~[na:1.7.0_72] > at > sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:644) > ~[na:1.7.0_72] > at > org.apache.storm.netty.channel.socket.nio.NioClientSocketPipelineSink.connect(NioClientSocketPipelineSink.java:108) > [storm-core-0.9.3.jar:0.9.3] > at > org.apache.storm.netty.channel.socket.nio.NioClientSocketPipelineSink.eventSunk(NioClientSocketPipelineSink.java:70) > [storm-core-0.9.3.jar:0.9.3] > at > org.apache.storm.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendDownstream(DefaultChannelPipeline.java:779) > [storm-core-0.9.3.jar:0.9.3] > at > org.apache.storm.netty.handler.codec.oneone.OneToOneEncoder.handleDownstream(OneToOneEncoder.java:54) > [storm-core-0.9.3.jar:0.9.3] > at > org.apache.storm.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:591) > [storm-core-0.9.3.jar:0.9.3] > at > org.apache.storm.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:582) > [storm-core-0.9.3.jar:0.9.3] > at > org.apache.storm.netty.channel.Channels.connect(Channels.java:634) > [storm-core-0.9.3.jar:0.9.3] > at > org.apache.storm.netty.channel.AbstractChannel.connect(AbstractChannel.java:207) > [storm-core-0.9.3.jar:0.9.3] > at > org.apache.storm.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:229) > [storm-core-0.9.3.jar:0.9.3] > at > org.apache.storm.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:182) > [storm-core-0.9.3.jar:0.9.3] > at backtype.storm.messaging.netty.Client.connect(Client.java:152) > [storm-core-0.9.3.jar:0.9.3] > at > backtype.storm.messaging.netty.Client.access$000(Client.java:43) > [storm-core-0.9.3.jar:0.9.3] > at backtype.storm.messaging.netty.Client$1.run(Client.java:107) > [storm-core-0.9.3.jar:0.9.3] > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > [na:1.7.0_72] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > [na:1.7.0_72] > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) > [na:1.7.0_72] > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) > [na:1.7.0_72] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > [na:1.7.0_72] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > [na:1.7.0_72] > at java.lang.Thread.run(Thread.java:745) [na:1.7.0_72] > 2015-02-10T10:34:37.827-0800 b.s.m.n.Client [INFO] Closing Netty Client > Netty-Client-pof-kstorm-dev2.pof.local:6701 > 2015-02-10T10:34:37.827-0800 b.s.m.n.Client [INFO] Waiting for pending > batchs to be sent with Netty-Client-pof-kstorm-dev2.pof.local:6701..., > timeout: 600000ms, pendings: 0 > 2015-02-10T10:34:37.828-0800 b.s.m.n.Client [INFO] Closing Netty Client > Netty-Client-pof-kstorm-dev2.pof.local:6703 > 2015-02-10T10:34:37.829-0800 b.s.m.n.Client [INFO] Waiting for pending > batchs to be sent with Netty-Client-pof-kstorm-dev2.pof.local:6703..., > timeout: 600000ms, pendings: 0 > 2015-02-10T10:34:37.931-0800 b.s.m.n.Client [INFO] Closing Netty Client > Netty-Client-pof-kstorm-dev2.pof.local:6702 > 2015-02-10T10:34:37.931-0800 b.s.m.n.Client [INFO] Waiting for pending > batchs to be sent with Netty-Client-pof-kstorm-dev2.pof.local:6702..., > timeout: 600000ms, pendings: 0 > > > Any idea how to fix this? seems it has connection issues to workers. > > thanks > > AL > > On Fri, Feb 6, 2015 at 11:09 AM, Sa Li <[email protected]> wrote: > >> Hi, All >> >> I have tested my topologies on local mode, it works fine. Now I like to >> move forward to submit the topologies to storm cluster, here are the >> problems on storm UI >> >> >> $mastercoord-bg0 >> <http://10.100.71.33:8080/component.html?id=%24mastercoord-bg0&topology_id=kstib001-2-1423182631> >> 1 1 0 0 0.000 0 0 pof-kstorm-dev1.pof.local 6702 >> <http://pof-kstorm-dev1.pof.local:8000/log?file=worker-6702.log> >> java.lang.RuntimeException: >> java.lang.NullPointerException at >> storm.trident.topology.state.TransactionalState.<init>(TransactionalState.java:61) >> at storm.trident.topology.state.TransactionalState.ne >> >> >> >> I check the storm logs, I see such errors on workers.log >> >> 2015-02-06T10:36:39.667-0800 b.s.m.n.Client [INFO] Reconnect started for >> Netty-Client-pof-kstorm-dev2.pof.local:6700... [8] >> 2015-02-06T10:36:39.668-0800 b.s.m.n.StormClientErrorHandler [INFO] >> Connection failed Netty-Client-pof-kstorm-dev2.pof.local:6700 >> java.nio.channels.UnresolvedAddressException: null >> at sun.nio.ch.Net.checkAddress(Net.java:127) ~[na:1.7.0_65] >> at >> sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:644) >> ~[na:1.7.0_65] >> at >> org.apache.storm.netty.channel.socket.nio.NioClientSocketPipelineSink.connect(NioClientSocketPipelineSink.java:108) >> [storm-core-0.9.3.jar:0.9.3] >> at >> org.apache.storm.netty.channel.socket.nio.NioClientSocketPipelineSink.eventSunk(NioClientSocketPipelineSink.java:70) >> [storm-core-0.9.3.jar:0.9.3] >> at >> org.apache.storm.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendDownstream(DefaultChannelPipeline.java:779) >> [storm-core-0.9.3.jar:0.9.3] >> at >> org.apache.storm.netty.handler.codec.oneone.OneToOneEncoder.handleDownstream(OneToOneEncoder.java:54) >> [storm-core-0.9.3.jar:0.9.3] >> at >> org.apache.storm.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:591) >> [storm-core-0.9.3.jar:0.9.3] >> at >> org.apache.storm.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:582) >> [storm-core-0.9.3.jar:0.9.3] >> at >> org.apache.storm.netty.channel.Channels.connect(Channels.java:634) >> [storm-core-0.9.3.jar:0.9.3] >> at >> org.apache.storm.netty.channel.AbstractChannel.connect(AbstractChannel.java:207) >> [storm-core-0.9.3.jar:0.9.3] >> at >> org.apache.storm.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:229) >> [storm-core-0.9.3.jar:0.9.3] >> at >> org.apache.storm.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:182) >> [storm-core-0.9.3.jar:0.9.3] >> at backtype.storm.messaging.netty.Client.connect(Client.java:152) >> [storm-core-0.9.3.jar:0.9.3] >> at >> backtype.storm.messaging.netty.Client.access$000(Client.java:43) >> [storm-core-0.9.3.jar:0.9.3] >> at backtype.storm.messaging.netty.Client$1.run(Client.java:107) >> [storm-core-0.9.3.jar:0.9.3] >> at >> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >> [na:1.7.0_65] >> at java.util.concurrent.FutureTask.run(FutureTask.java:262) >> [na:1.7.0_65] >> at >> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) >> [na:1.7.0_65] >> at >> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) >> [na:1.7.0_65] >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >> [na:1.7.0_65] >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >> [na:1.7.0_65] >> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65] >> >> >> Is there something configuration I did wrong, here is my nimbus storm.yaml >> >> storm.zookeeper.servers: >> - "zkserver" >> - "slave1" >> - "slave2" >> >> nimbus.host: "nimbus" >> supervisor.slots.ports: >> - 6700 >> - 6701 >> - 6702 >> - 6703 >> >> nimbus.childopts: "-Xmx1024m -Djava.net.preferIPv4Stack=true" >> ui.childopts: "-Xmx768m -Djava.net.preferIPv4Stack=true" >> supervisor.childopts: "-Djava.net.preferIPv4Stack=true" >> worker.childopts: "-Xmx768m -Djava.net.preferIPv4Stack=true" >> storm.local.dir: "/app/storm" >> >> >> The supervisor storm.yaml >> storm.zookeeper.servers: >> - "zkserver" >> - "slave1" >> - "slave2" >> >> nimbus.host: "nimbus" >> nimbus.childopts: "-Xmx1024m -Djava.net.preferIPv4Stack=true" >> ui.childopts: "-Xmx768m -Djava.net.preferIPv4Stack=true" >> supervisor.childopts: "-Djava.net.preferIPv4Stack=true" >> worker.childopts: "-Xmx768m -Djava.net.preferIPv4Stack=true" >> storm.local.dir: "/app/storm" >> >> >> Thanks >> >> AL >> > >
