Hi,I used KafkaSource to consume the messages from Kafka. I found only new messages were received while the old existing message not. I tried to use a new consumer group and update the parameter "auto.offset.reset = latest" to "earliest", but this does not work.tier2.sources.source1.kafka.consumer.
Hi,I used KafkaSource to consume the messages from Kafka. I found only new messages were received while the old existing message not. I tried to use a new consumer group and update the parameter "auto.offset.reset = latest" to "earliest", but this does not work.tier2.sources.source1.kafka.consumer.
Hi,
auto.offset.reset aim to handle failure scenarios when Flume lost the
track of offsets. When Flume is able to successfully consume the
messages it also commits the last processed offset. When failure
happens and was set resetting offset would use the last
committed value.
I don't think that a
for the records cc dev@
On Thu, Oct 13, 2016 at 11:43 AM, Attila Simon wrote:
> Hi,
>
> auto.offset.reset aim to handle failure scenarios when Flume lost the
> track of offsets. When Flume is able to successfully consume the
> messages it also commits the last processed offset. When failure
> hap
Hi,
One more thing. If you switch to the new group.id and would like to
maintain the read from beginning behaviour every time flume restart
then you might try setting enable.auto.commit to false.
Again Kafka normally won't store the events indefinitely.
Cheers,
Attila
On Thu, Oct 13, 2016 at 11
Hi,
Which version of Kafka are you using?
Off the top of my head it should be:
tier2.sources.source1.kafka.auto.offset.reset = earliest
Of course changing the group ID or if it's an older version of Kafka removing
the corresponding offset znode from zookeeper ought to do the trick
-- Chris H
Hi,
We needed a feature in Httpsource wherein when a header in the request does
not match, a notification has to be sent back to the user who initiated
that request. We looked into the Multiplexing concept of Flume but it does
not throw a notification when the criteria fails, it just discards the
Hi, all.
I want to generate flume locally, but when I run `sphinx-build -b html .
../html` in flume/flume-ng-doc/sphinx. I get the document with default
theme.
How can I generate official theme document?
PS: I want improve document theme.
--
Robert Lu
About me: http://about.me/RobberPhex
