Hi, I'm trying to work Kafka+Storm in distributed mode. However, it doesn't receive any tuple from Spout when I tried by multiple supervisors though it worked when I tried by single supervisor as same code. In addition, I couldn't find any error logs in Nimbus log, Supervisor logs and Worker logs.
Let me know how I debug and configure Storm configuration. Thanks, -- Hide
Nimbus Configuration Key Value dev.zookeeper.path /tmp/dev-storm-zookeeper drpc.childopts -Xmx768m drpc.invocations.port 3773 drpc.port 3772 drpc.queue.size 128 drpc.request.timeout.secs 600 drpc.worker.threads 64 java.library.path /usr/local/zeromq/lib:/usr/local/jzmq/lib logviewer.appender.name A1 logviewer.childopts -Xmx128m logviewer.port 8000 nimbus.childopts -Xmx1024m nimbus.cleanup.inbox.freq.secs 600 nimbus.file.copy.expiration.secs 600 nimbus.host cluster1 nimbus.inbox.jar.expiration.secs 3600 nimbus.monitor.freq.secs 10 nimbus.reassign true nimbus.supervisor.timeout.secs 60 nimbus.task.launch.secs 120 nimbus.task.timeout.secs 30 nimbus.thrift.port 6627 nimbus.topology.validator backtype.storm.nimbus.DefaultTopologyValidator storm.cluster.mode distributed storm.local.dir /var/lib/storm storm.local.hostname ubuntu-cluster1 storm.local.mode.zmq true storm.messaging.netty.buffer_size 5242880 storm.messaging.netty.client_worker_threads 1 storm.messaging.netty.max_retries 30 storm.messaging.netty.max_wait_ms 1000 storm.messaging.netty.min_wait_ms 100 storm.messaging.netty.server_worker_threads 1 storm.messaging.transport backtype.storm.messaging.zmq storm.thrift.transport backtype.storm.security.auth.SimpleTransportPlugin storm.zookeeper.connection.timeout 15000 storm.zookeeper.port 2181 storm.zookeeper.retry.interval 1000 storm.zookeeper.retry.intervalceiling.millis 30000 storm.zookeeper.retry.times 5 storm.zookeeper.root /storm storm.zookeeper.servers ["cluster1" "cluster2" "cluster3"] storm.zookeeper.session.timeout 20000 supervisor.childopts -Xmx256m supervisor.enable true supervisor.heartbeat.frequency.secs 5 supervisor.monitor.frequency.secs 3 supervisor.slots.ports [6700 6701 6702 6703] supervisor.worker.start.timeout.secs 120 supervisor.worker.timeout.secs 30 task.heartbeat.frequency.secs 3 task.refresh.poll.secs 10 topology.acker.executors topology.builtin.metrics.bucket.size.secs 60 topology.debug true topology.disruptor.wait.strategy com.lmax.disruptor.BlockingWaitStrategy topology.enable.message.timeouts true topology.error.throttle.interval.secs 10 topology.executor.receive.buffer.size 1024 topology.executor.send.buffer.size 1024 topology.fall.back.on.java.serialization true topology.kryo.factory backtype.storm.serialization.DefaultKryoFactory topology.max.error.report.per.interval 5 topology.max.spout.pending topology.max.task.parallelism topology.message.timeout.secs 30 topology.optimize true topology.receiver.buffer.size 8 topology.skip.missing.kryo.registrations false topology.sleep.spout.wait.strategy.time.ms 1 topology.spout.wait.strategy backtype.storm.spout.SleepSpoutWaitStrategy topology.state.synchronization.timeout.secs 60 topology.stats.sample.rate 0.05 topology.tasks topology.tick.tuple.freq.secs topology.transfer.buffer.size 1024 topology.trident.batch.emit.interval.millis 500 topology.tuple.serializer backtype.storm.serialization.types.ListDelegateSerializer topology.worker.childopts topology.worker.shared.thread.pool.size 4 topology.workers 1 transactional.zookeeper.port transactional.zookeeper.root /transactional transactional.zookeeper.servers ui.childopts -Xmx768m ui.port 8080 worker.childopts -Dlog4j.configuration=log4j.properties worker.heartbeat.frequency.secs 1 zmq.hwm 0 zmq.linger.millis 5000 zmq.threads 1
storm.yaml
Description: Binary data
