I did some changes, now, I don't see any errors on Storm UI, but it won't
work as it works in local mode, like writing things in DB, so I tail the
logs again, it is still:
2015-02-10T10:34:36.989-0800 b.s.m.n.Client [INFO] Reconnect started for
Netty-Client-pof-kstorm-dev2.pof.local:6702... [300]
2015-02-10T10:34:36.989-0800 b.s.m.n.StormClientErrorHandler [INFO]
Connection failed Netty-Client-pof-kstorm-dev2.pof.local:6702
java.nio.channels.UnresolvedAddressException: null
at sun.nio.ch.Net.checkAddress(Net.java:127) ~[na:1.7.0_72]
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:644)
~[na:1.7.0_72]
at
org.apache.storm.netty.channel.socket.nio.NioClientSocketPipelineSink.connect(NioClientSocketPipelineSink.java:108)
[storm-core-0.9.3.jar:0.9.3]
at
org.apache.storm.netty.channel.socket.nio.NioClientSocketPipelineSink.eventSunk(NioClientSocketPipelineSink.java:70)
[storm-core-0.9.3.jar:0.9.3]
at
org.apache.storm.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendDownstream(DefaultChannelPipeline.java:779)
[storm-core-0.9.3.jar:0.9.3]
at
org.apache.storm.netty.handler.codec.oneone.OneToOneEncoder.handleDownstream(OneToOneEncoder.java:54)
[storm-core-0.9.3.jar:0.9.3]
at
org.apache.storm.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:591)
[storm-core-0.9.3.jar:0.9.3]
at
org.apache.storm.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:582)
[storm-core-0.9.3.jar:0.9.3]
at
org.apache.storm.netty.channel.Channels.connect(Channels.java:634)
[storm-core-0.9.3.jar:0.9.3]
at
org.apache.storm.netty.channel.AbstractChannel.connect(AbstractChannel.java:207)
[storm-core-0.9.3.jar:0.9.3]
at
org.apache.storm.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:229)
[storm-core-0.9.3.jar:0.9.3]
at
org.apache.storm.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:182)
[storm-core-0.9.3.jar:0.9.3]
at backtype.storm.messaging.netty.Client.connect(Client.java:152)
[storm-core-0.9.3.jar:0.9.3]
at backtype.storm.messaging.netty.Client.access$000(Client.java:43)
[storm-core-0.9.3.jar:0.9.3]
at backtype.storm.messaging.netty.Client$1.run(Client.java:107)
[storm-core-0.9.3.jar:0.9.3]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[na:1.7.0_72]
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[na:1.7.0_72]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
[na:1.7.0_72]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
[na:1.7.0_72]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_72]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_72]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_72]
2015-02-10T10:34:37.827-0800 b.s.m.n.Client [INFO] Closing Netty Client
Netty-Client-pof-kstorm-dev2.pof.local:6701
2015-02-10T10:34:37.827-0800 b.s.m.n.Client [INFO] Waiting for pending
batchs to be sent with Netty-Client-pof-kstorm-dev2.pof.local:6701...,
timeout: 600000ms, pendings: 0
2015-02-10T10:34:37.828-0800 b.s.m.n.Client [INFO] Closing Netty Client
Netty-Client-pof-kstorm-dev2.pof.local:6703
2015-02-10T10:34:37.829-0800 b.s.m.n.Client [INFO] Waiting for pending
batchs to be sent with Netty-Client-pof-kstorm-dev2.pof.local:6703...,
timeout: 600000ms, pendings: 0
2015-02-10T10:34:37.931-0800 b.s.m.n.Client [INFO] Closing Netty Client
Netty-Client-pof-kstorm-dev2.pof.local:6702
2015-02-10T10:34:37.931-0800 b.s.m.n.Client [INFO] Waiting for pending
batchs to be sent with Netty-Client-pof-kstorm-dev2.pof.local:6702...,
timeout: 600000ms, pendings: 0
Any idea how to fix this? seems it has connection issues to workers.
thanks
AL
On Fri, Feb 6, 2015 at 11:09 AM, Sa Li <[email protected]> wrote:
> Hi, All
>
> I have tested my topologies on local mode, it works fine. Now I like to
> move forward to submit the topologies to storm cluster, here are the
> problems on storm UI
>
>
> $mastercoord-bg0
> <http://10.100.71.33:8080/component.html?id=%24mastercoord-bg0&topology_id=kstib001-2-1423182631>
> 1 1 0 0 0.000 0 0 pof-kstorm-dev1.pof.local 6702
> <http://pof-kstorm-dev1.pof.local:8000/log?file=worker-6702.log>
> java.lang.RuntimeException:
> java.lang.NullPointerException at
> storm.trident.topology.state.TransactionalState.<init>(TransactionalState.java:61)
> at storm.trident.topology.state.TransactionalState.ne
>
>
>
> I check the storm logs, I see such errors on workers.log
>
> 2015-02-06T10:36:39.667-0800 b.s.m.n.Client [INFO] Reconnect started for
> Netty-Client-pof-kstorm-dev2.pof.local:6700... [8]
> 2015-02-06T10:36:39.668-0800 b.s.m.n.StormClientErrorHandler [INFO]
> Connection failed Netty-Client-pof-kstorm-dev2.pof.local:6700
> java.nio.channels.UnresolvedAddressException: null
> at sun.nio.ch.Net.checkAddress(Net.java:127) ~[na:1.7.0_65]
> at
> sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:644)
> ~[na:1.7.0_65]
> at
> org.apache.storm.netty.channel.socket.nio.NioClientSocketPipelineSink.connect(NioClientSocketPipelineSink.java:108)
> [storm-core-0.9.3.jar:0.9.3]
> at
> org.apache.storm.netty.channel.socket.nio.NioClientSocketPipelineSink.eventSunk(NioClientSocketPipelineSink.java:70)
> [storm-core-0.9.3.jar:0.9.3]
> at
> org.apache.storm.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendDownstream(DefaultChannelPipeline.java:779)
> [storm-core-0.9.3.jar:0.9.3]
> at
> org.apache.storm.netty.handler.codec.oneone.OneToOneEncoder.handleDownstream(OneToOneEncoder.java:54)
> [storm-core-0.9.3.jar:0.9.3]
> at
> org.apache.storm.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:591)
> [storm-core-0.9.3.jar:0.9.3]
> at
> org.apache.storm.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:582)
> [storm-core-0.9.3.jar:0.9.3]
> at
> org.apache.storm.netty.channel.Channels.connect(Channels.java:634)
> [storm-core-0.9.3.jar:0.9.3]
> at
> org.apache.storm.netty.channel.AbstractChannel.connect(AbstractChannel.java:207)
> [storm-core-0.9.3.jar:0.9.3]
> at
> org.apache.storm.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:229)
> [storm-core-0.9.3.jar:0.9.3]
> at
> org.apache.storm.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:182)
> [storm-core-0.9.3.jar:0.9.3]
> at backtype.storm.messaging.netty.Client.connect(Client.java:152)
> [storm-core-0.9.3.jar:0.9.3]
> at
> backtype.storm.messaging.netty.Client.access$000(Client.java:43)
> [storm-core-0.9.3.jar:0.9.3]
> at backtype.storm.messaging.netty.Client$1.run(Client.java:107)
> [storm-core-0.9.3.jar:0.9.3]
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> [na:1.7.0_65]
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> [na:1.7.0_65]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
> [na:1.7.0_65]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
> [na:1.7.0_65]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> [na:1.7.0_65]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [na:1.7.0_65]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65]
>
>
> Is there something configuration I did wrong, here is my nimbus storm.yaml
>
> storm.zookeeper.servers:
> - "zkserver"
> - "slave1"
> - "slave2"
>
> nimbus.host: "nimbus"
> supervisor.slots.ports:
> - 6700
> - 6701
> - 6702
> - 6703
>
> nimbus.childopts: "-Xmx1024m -Djava.net.preferIPv4Stack=true"
> ui.childopts: "-Xmx768m -Djava.net.preferIPv4Stack=true"
> supervisor.childopts: "-Djava.net.preferIPv4Stack=true"
> worker.childopts: "-Xmx768m -Djava.net.preferIPv4Stack=true"
> storm.local.dir: "/app/storm"
>
>
> The supervisor storm.yaml
> storm.zookeeper.servers:
> - "zkserver"
> - "slave1"
> - "slave2"
>
> nimbus.host: "nimbus"
> nimbus.childopts: "-Xmx1024m -Djava.net.preferIPv4Stack=true"
> ui.childopts: "-Xmx768m -Djava.net.preferIPv4Stack=true"
> supervisor.childopts: "-Djava.net.preferIPv4Stack=true"
> worker.childopts: "-Xmx768m -Djava.net.preferIPv4Stack=true"
> storm.local.dir: "/app/storm"
>
>
> Thanks
>
> AL
>
