Routing logic possible?

Hi all, I am quite neww to Storm so sorry if my question sounds stupid. I am working with connected devices collecting metrrics through MQTT. So I have got a source of data with my MQTT server I will use a spout to store into db this data I may need depending from the contents of the message to

Re: How to use KafkaSpout to consume kafka cluster secured with kerberos

I'll try to find some time to review it. On Tue, May 15, 2018 at 11:56 PM Aniket Alhat wrote: > Hi Bobby, > > Thanks for your reply, indeed SimpleConsumer.scala doesn't support > extraction of data from Kafka via. Kerberos in which case I'll start > thinking to upgrade

Re: Routing logic possible?

Jerome, In these cases typically what you want to do is that you define all of the options in your topology, but the routing itself can be dynamic. One pattern I often see is a star like pattern. Spout -> router. router -> DBBolt router -> KafkaBolt router -> ESBolt router -> streamingJoin ->

UNSUBSCRIBE

UNSUBSCRIBE

Re: Disable backpressure in Storm 2.0

Yes there are ways to disable backpressure by modifying the code, and if all you want to do is to drop the inserted messages that should be simple enough to do. Take a look at JCQueue https://github.com/apache/storm/blob/master/storm-client/src/jvm/org/apache/storm/utils/JCQueue.java and

Re: Routing logic possible?

Thanks Bobby for this very clear & detailed explanation Kind regards On Thu, May 17, 2018 at 5:52 PM, Bobby Evans wrote: > Jerome, > > In these cases typically what you want to do is that you define all of the > options in your topology, but the routing itself can be

Re: Disable backpressure in Storm 2.0

Thanks Bobby, I will look at the JCQueue as you have advised. Is there any additional considerations I need to be aware of in the netty layer? warm regards, ravi From: Bobby Evans Sent: Thursday, May 17, 2018 9:38 PM To: user@storm.apache.org