Turn on debug mode and tail the log From: Sa Li [mailto:[email protected]] Sent: Wednesday, October 29, 2014 8:13 PM To: [email protected] Subject: Re: not writing data into DB in storm cluster, but does in localcluster
I compile the code as mvn clean package -P cluster and run as storm jar target/kafka-storm-ingress-0.0.1-SNAPSHOT-jar-with-dependencies.jar storm.ingress.KafkaIngressTopology it running, but nothing populated into DB, how can debug it in cluster mode? thanks Alec On Wed, Oct 29, 2014 at 2:24 PM, Sa Li <[email protected]<mailto:[email protected]>> wrote: Thanks for reply Bill, here how I submit it : if (args != null && args.length > 0) { System.out.println("local mode...."); cluster.submitTopology("topictest", conf, buildTridentKafkaTopology()); Thread.sleep(1500); //cluster.shutdown(); //drpc.shutdown(); } else { System.out.println("Storm cluster...."); conf.setNumWorkers(10); StormSubmitter.submitTopology("topictest", conf, buildTridentKafkaTopology()); } So I get the number of Workers as 10. Thanks Alec On Wed, Oct 29, 2014 at 2:16 PM, Brunner, Bill <[email protected]<mailto:[email protected]>> wrote: Do you have least 1 Worker defined in your topology? From: Sa Li [mailto:[email protected]<mailto:[email protected]>] Sent: Wednesday, October 29, 2014 5:08 PM To: [email protected]<mailto:[email protected]> Subject: not writing data into DB in storm cluster, but does in localcluster Hi, All I am running a kafkaSpout to consume data from kafka and write data into postgresql DB, it works in localcluster even it is slow (we need to diagnose what the problem is). When I sumbitted it in storm cluster, it doesn't show exceptions, and I see the topology is alive in StormUI, but just no data being written into DB, why that happen? thanks Alec ________________________________ This message, and any attachments, is for the intended recipient(s) only, may contain information that is privileged, confidential and/or proprietary and subject to important terms and conditions available at http://www.bankofamerica.com/emaildisclaimer. If you are not the intended recipient, please delete this message. ---------------------------------------------------------------------- This message, and any attachments, is for the intended recipient(s) only, may contain information that is privileged, confidential and/or proprietary and subject to important terms and conditions available at http://www.bankofamerica.com/emaildisclaimer. If you are not the intended recipient, please delete this message.
