Actually I don't really understand your problem yet. You can check:
1. You have settled lots of spout(from different topics) by builder.setSpout(
new kafkaSpout(SpoutConfig))
2. Are the multiple spouts really in your topology? If you need multiple spout
to a bolt, you need add multiple grouping after setBolt.
Ex. builder.setbolt(new
somebolt()).shufflegrouping("spout1id").shufflegrouping("spout2id")......
I successfully subscribe to multiple topics by this.
James
> Anis Nasir <[email protected]> 於 2014/6/22 下午8:51 寫道：
>
> yes. My question is about parallelism in a Spout. I see only one spout
> reading, even when I set the parallelism to more than one.
>
> Regards
> Anis
>
>
>> On Sun, Jun 22, 2014 at 1:54 PM, <[email protected]> wrote:
>> It's not make sense. I know one SpoutKafka can fetch from one topic only(due
>> to config). So I use 12 KafkaSpouts to fetch from 12 different topics, and
>> each for parallelism 1 or 2 only. It works(I can see 12 spouts in storm UI.
>> Notice that, you have to set different zookeeper paths for different topics,
>> and they store offset for each topics in different location of zookeeper.
>>
>> SpoutConfig(BrokerHosts hosts, String topic, String zkRoot, String id)
>>
>> You should give different id for different topics.
>>
>> James
>>
>>
>>> Anis Nasir <[email protected]> 於 2014/6/22 下午7:43 寫道：
>>>
>>
>>> I have four instances of KafkaSpout in my topology .I can see four
>>> executors running on storm UI, as i have set number of instances to four.
>>> However, only one of the spouts is able to fetch messages from kafka.
>>>
>>> cheers
>>> Anis
>>>
>>>
>>>> On Sun, Jun 22, 2014 at 1:40 PM, <[email protected]> wrote:
>>>> Hi,
>>>>
>>>> How many instances of KafkaSpout in your topology? If you have one only, I
>>>> think you can see one spout in storm UI. However, if you set parallelism
>>>> for 4, you will see "executers" for 4 in storm UI.
>>>>
>>>> James
>>>>
>>>> > Anis Nasir <[email protected]> 於 2014/6/22 下午7:33 寫道：
>>>> >
>>>> > Dear all,
>>>> >
>>>> > I configured my kafka topic to have four partitions and I tried to set
>>>> > the spout task parallelism to four as well. However, in storm UI, I can
>>>> > only see one spout reading from the kafka topic. Can someone observed
>>>> > the same pattern? or am I doing something wrong?
>>>> >
>>>> > Regards
>>>> > Anis
>>>
>
