After submitting my topology via the storm jar command:
....
....
....
562 [main] INFO backtype.storm.StormSubmitter - Uploading topology jar
storm-kafka-cassandra-0.1.0-SNAPSHOT-jar-with-dependencies.jar to assigned
location:
storm-local/nimbus/inbox/stormjar-6926fc83-24d1-4b79-81c6-a3dec6dca9d9.jar
2307 [main] INFO backtype.storm.StormSubmitter - Successfully uploaded
topology jar to assigned location:
storm-local/nimbus/inbox/stormjar-6926fc83-24d1-4b79-81c6-a3dec6dca9d9.jar
2307 [main] INFO backtype.storm.StormSubmitter - Submitting topology test
in distributed mode with conf
{"topology.max.task.parallelism":4,"topology.workers":2,"topology.debug":true,"topology.trident.batch.emit.interval.millis":5000,}
Exception in thread "main" java.lang.RuntimeException:
org.apache.thrift7.transport.TTransportException: java.net.SocketException:
Connection reset
at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:95)
at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:41)
at
com.sentaware.sentalytics.storm.trident.TwitterTopology.main(TwitterTopology.java:180)
Caused by: org.apache.thrift7.transport.TTransportException:
java.net.SocketException: Connection reset
at
org.apache.thrift7.transport.TIOStreamTransport.write(TIOStreamTransport.java:147)
at
org.apache.thrift7.transport.TFramedTransport.flush(TFramedTransport.java:157)
at org.apache.thrift7.TServiceClient.sendBase(TServiceClient.java:65)
at
backtype.storm.generated.Nimbus$Client.send_submitTopology(Nimbus.java:139)
at
backtype.storm.generated.Nimbus$Client.submitTopology(Nimbus.java:128)
at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:81)
... 2 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:118)
at java.net.SocketOutputStream.write(SocketOutputStream.java:159)
at
org.apache.thrift7.transport.TIOStreamTransport.write(TIOStreamTransport.java:145)
... 7 more
storm@nimbus:~$ tail /var/log/storm/nimbus.log
2014-03-11 22:38:31 b.s.d.nimbus [INFO] Uploading file from client to
storm-local/nimbus/inbox/stormjar-e7bc17a5-3bf8-4bd1-8860-385ef105f827.jar
2014-03-11 22:38:31 b.s.d.nimbus [INFO] Uploading file from client to
storm-local/nimbus/inbox/stormjar-e7bc17a5-3bf8-4bd1-8860-385ef105f827.jar
2014-03-11 22:38:32 b.s.d.nimbus [INFO] Finished uploading file from
client:
storm-local/nimbus/inbox/stormjar-e7bc17a5-3bf8-4bd1-8860-385ef105f827.jar
2014-03-11 22:38:32 b.s.d.nimbus [INFO] Finished uploading file from
client:
storm-local/nimbus/inbox/stormjar-e7bc17a5-3bf8-4bd1-8860-385ef105f827.jar
2014-03-11 22:38:32 o.a.t.s.TNonblockingServer [ERROR] Read a frame size of
2064605, which is bigger than the maximum allowable buffer size for ALL
connections.
Thoughts on how to proceed? I tried boosting memory from 256mb to 1024mb on
the nimbus and supervisor nodes with no luck. The jar file is roughly 18MB
in size and I can run another topology within the jar fine but the one I
want to run (more complex) fails.
