Re: how to make KafkaSource consume the existing messages

2016-10-17 Thread Ping PW Wang
午 06:32:02---Hi, One more thing. If you switch to the new group.id and would like toFrom: Attila Simon To: user@flume.apache.org, d...@flume.apache.orgDate: 2016-10-13 下午 06:32Subject: Re: how to make KafkaSource consume the existing messages Hi,One more thing. If you switch to the new group.id and w

Re: how to make KafkaSource consume the existing messages

2016-10-13 Thread Chris Horrocks
update the parameter "auto.offset.reset = latest" to "earliest", but this does not work. tier2.sources.source1.kafka.consumer.group.id = test-consumer-group-new tier2.sources.source1.kafka.consumer.auto.offset.reset = earliest Anyone knows how to make KafkaSource consume the existing messages? Thanks a lot for any advice!

Re: how to make KafkaSource consume the existing messages

2016-10-13 Thread Attila Simon
10:00 AM, Ping PW Wang wrote: >>> Hi, >>> I used KafkaSource to consume the messages from Kafka. I found only new >>> messages were received while the old existing message not. I tried to use a >>> new consumer group and update the parameter "auto.offset.r

Re: how to make KafkaSource consume the existing messages

2016-10-13 Thread Attila Simon
age not. I tried to use a >> new consumer group and update the parameter "auto.offset.reset = latest" to >> "earliest", but this does not work. >> >> tier2.sources.source1.kafka.consumer.group.id = test-consumer-group-new >> tier2.sources.source1.ka

Re: how to make KafkaSource consume the existing messages

2016-10-13 Thread Attila Simon
-new > tier2.sources.source1.kafka.consumer.auto.offset.reset = earliest > > Anyone knows how to make KafkaSource consume the existing messages? > Thanks a lot for any advice! > > Best Regards, > > Wang Ping (王苹) > InfoSphere BigInsights, CDL > Email: wpw...@cn.ibm.com Pho

how to make KafkaSource consume the existing messages

2016-10-13 Thread Ping PW Wang
ier2.sources.source1.kafka.consumer.group.id = test-consumer-group-newtier2.sources.source1.kafka.consumer.auto.offset.reset = earliestAnyone knows how to make KafkaSource consume the existing messages?Thanks a lot for any advice!   Best Regards,Wang Ping (王苹)InfoSphere BigInsights, CDLEmail: wpw...@cn.ibm.com P

how to make KafkaSource consume the existing messages

2016-10-13 Thread Ping PW Wang
ier2.sources.source1.kafka.consumer.group.id = test-consumer-group-newtier2.sources.source1.kafka.consumer.auto.offset.reset = earliestAnyone knows how to make KafkaSource consume the existing messages?Thanks a lot for any advice!