yes. My question is about parallelism in a Spout. I see only one spout reading, even when I set the parallelism to more than one.
Regards Anis On Sun, Jun 22, 2014 at 1:54 PM, <[email protected]> wrote: > It's not make sense. I know one SpoutKafka can fetch from one topic > only(due to config). So I use 12 KafkaSpouts to fetch from 12 different > topics, and each for parallelism 1 or 2 only. It works(I can see 12 spouts > in storm UI. Notice that, you have to set different zookeeper paths for > different topics, and they store offset for each topics in different > location of zookeeper. > > SpoutConfig(BrokerHosts hosts, String topic, String zkRoot, String id) > > You should give different *id* for different topics. > > James > > > Anis Nasir <[email protected]> 於 2014/6/22 下午7:43 寫道： > > I have four instances of KafkaSpout in my topology .I can see four > executors running on storm UI, as i have set number of instances to four. > However, only one of the spouts is able to fetch messages from kafka. > > cheers > Anis > > > On Sun, Jun 22, 2014 at 1:40 PM, <[email protected]> wrote: > >> Hi, >> >> How many instances of KafkaSpout in your topology? If you have one only, >> I think you can see one spout in storm UI. However, if you set parallelism >> for 4, you will see "executers" for 4 in storm UI. >> >> James >> >> > Anis Nasir <[email protected]> 於 2014/6/22 下午7:33 寫道： >> > >> > Dear all, >> > >> > I configured my kafka topic to have four partitions and I tried to set >> the spout task parallelism to four as well. However, in storm UI, I can >> only see one spout reading from the kafka topic. Can someone observed the >> same pattern? or am I doing something wrong? >> > >> > Regards >> > Anis >> > >
